parent, teaching

Holyspirit14
PP_Mortality_2.pdf

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

Improving POSTPARTUM EDUCATIOJl

About Warn i ng Signs of

MATERNAL MORBIDITY and MORTALITY

PATRICIA D. SUPLEE LISA KLEPPEL

ANNE SANTA-DoNATO DEBRA BINGHAM

Maternal mortality or pregnancy-related death is the death of a woman from compli-

cations of pregnancy and childbirth occurring up to 1 year postpartum. In a report

using data from 2010, the United States ranked 49th out of 184 countries for mater-

nal mortality (Central Intelligence Agency, 2016); it is one of eight countries where

maternal mortality rates have been on the rise in recent years (Hogan et aI., 2010; Kassebaum et aI., 2014).

Abstract: Maternal morbidity and mortality rates remain high in the United States compared with other developed countries. Of par- ticular concern is the rise in postpartum deaths, because many of the risk factors for complications associated with maternal morbidity and mortality may not be clearly identified before a woman's discharge after birth. Although nurses provide some form of postpartum discharge education to all women who give birth, the information women receive on common potential complications is nat always consistent or evidence based. By improving postpartum education, nurses may be better poised to teach women how to recognize and respond to warning signs. This article describes a project intended to increase women's access to predischarge education about the risks for postbirth complications. http://dx.doi.org/ 10.1016/j.nwh.20 16.10.009

Keywords: maternal morbidity I maternal mortality I postpartum complications I postpartum education I pregnancy-related death

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

Although the most current u.s. pregnancy-related mortal- ity rate shows a slight decrease in maternal deaths, from

17.8 deaths per 100,000 live births in 2011 to 15.9 deaths per

100,000 live births in 2012 (Centers for Disease Control and

Prevention [CDC], 2016), this rate is more than double the

1987 rate of 7.2 deaths per 100,000 births. However, research-

ers working to better understand the measurement limitations

of maternal mortality trends found that the CDC estimates may

underreport maternal mortality rates. Recently, MacDorman,

Declercq, Cabral, and Morton (2016), using adjusted models,

reported an estimated maternal mortality rate for 2014 of 23.8

per 100,000 live births (included 48 states and the District of

Columbia). During this same time period, the rates of mater-

nal mortality in other developed countries decreased (Hogan et

aI., 2010). In addition to maternal mortality, the rates of severe

maternal morbidity in the United States have more than dou-

bled since 1998 (Callaghan, Creanga, & Kuklina, 2012).

The seven leading causes of pregnancy-related deaths for

2011 and 2012 in the United States are noncardiovascular dis-

eases 05.3%; not specifically described by the CDC), cardiovas-

cular diseases 04.7%), infection or sepsis 02.7%), hemorrhage

01.3%), cardiomyopathy (10.8%), thrombotic pulmonary

embolism (9.0%), and hypertensive disorders of pregnancy

(7.6%; CDC, 2016). Although any woman can experience one

of these complications during pregnancy or childbirth, women

with chronic conditions such as cardiac disease, obesity, or high

blood pressure are at higher risk of dying or nearly dying from

these complications.

Health disparities among racial and ethnic groups in the

United States have been well documented in the literature

(Elo & Culhane, 2010), and eliminating these disparities is an

overarching goal of Healthy People 2020 (U.S. Department of

Health and Human Services, 2016). In obstetrics, these dispari-

ties persist and are clearly evident in reported rates of mater-

nal morbidity and mortality. During 2011 and 2012, the CDC

reported the deaths per 100,000 live births as 1l.8 for White

women, 4l.1 for Black women, and 15.7 for women of other

races (CDC, 2016). These data show that maternal mortality

rates are approximately three to four times higher for Black

women compared with White women.

Understanding the timing of maternal deaths and their

possible preventability can help guide the development of

improvement efforts. In 2013, an international review of

Patricia D. Suplee PhD, RNC-OB, is an associate professor in the School of Nursing-Camden at Rutgers University in Camden, NJ. Lisa Kleppel, MPH, PMp, is a project manager at AWHONN in Washington, DC. Anne Santa-Donato, MSN, RNC, is director of obstetric programs at AWHONN in Washington, DC. Debra Bingham, DrPH, RN, FAAN, is a perinatal consultant and founder of the Institute for Perinatal Quality Improvement in Silver Spring, MD. The authors report no conflicts of interest or relevant financial relationships. Address correspondence to: suplee@camden.rutgers.edu.

554 © 2016, AWHONN

maternal mortality found that, on average, nearly 25% of deaths

occurred antepartum, another 25% occurred intrapartum or

immediately postpartum, and almost 50% occurred in the

postpartum period up to 1 year (Kassebaum et aI., 2014). Cre-

anga et ai. (2015), using more recent U.S.-only data, found that

of the maternal deaths reported, 39% of women died before or

on the day of birth and 61% died in the postpartum period.

These data make it clear that postpartum deaths are not just an

international issue but are also a problem in the United States.

Researchers estimate that 40% to 50% of U.S. maternal deaths

are preventable (Bacak, Berg, Desmarais, Hutchins, & Locke,

2006). When focusing on obstetric hemorrhage alone, 54% to

70% of these maternal deaths are estimated to be preventable

(Della Torre et aI., 2011; Main, McCain, Morton, Holtby, &

Lawton, 2015).

POSTPARTUM CARE AND EDUCATION Within hospital systems, establishing guidelines to optimize

and improve postpartum care is important. Recently the Amer-

ican College of Obstetricians and Gynecologists (2016) pub-

lished a Committee Opinion on optimizing postpartum care.

In addition, the Alliance on Innovation in Maternal Care is a

multidisciplinary national program convened to reduce severe

maternal morbidity and maternal mortality and is supported

by the Maternal and Child Health Bureau/Health Resource Ser-

vices Administration. The Alliance on Innovation in Maternal

Care is developing two postpartum safety bundles to be used

by all types of providers (medical, nursing, social service, and

public health) to address the basic elements of postpartum care

(Kleppel, Suplee, Stuebe, & Bingham, 2016). This first bundle

will cover the first 6 weeks postpartum, and the second bun-

dle will focus on interconception care and health up to 1 year

postpartum.

Nurses are the health care providers who perform the most

postpartum education in the United States. Thus, it is critical

that nurses work to improve discharge education so that the

information they provide is efficient, timely, and evidence

based. When women are discharged after birth, nurses playa

vital role in providing them with education on self-care and

infant care and a plethora of information related to transition-

ing home and caring for a newborn. Authors have reported

that the amount of information women receive is overwhelm-

ing (Alden, Lowdermilk, Cashion, & Perry, 2012; Murray &

McKinney, 2014). It is not clear how nurses currently decide

which information is a priority to provide face-to-face educa-

tion on and which information can be given to a woman to read

at home. Many hospitals require the discharging nurse to com-

plete some sort of checklist that includes a list of educational

topics. However, there is wide variation in discharge education

related to information on warning signs of maternal morbidity

nwhjournal.org

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

and mortality (Suplee, Bingham, & Kleppel, 2016). This holds

true for women being discharged from birth centers as well.

For rates of postpartum maternal morbidity and mortality

to be reduced, it is vital for women who have just given birth to

be instructed on specific warning signs so that they know what

to look for, when to call a health care provider, or when to go to

the nearest emergency department. Many of the complications

women experience can be successfully treated if they are identi-

fied quickly and women receive prompt medical attention. To

that end, below we describe the findings from the implemen-

tation phase of a pilot project of the Association of Women's

Health, Obstetric and Neonatal Nurses (AWHONN) entitled

"Empowering Women to Obtain Needed Care" and discuss

implications for clinical practice.

WHY POSTPARTUM DISCHARGE EDUCATION NEEDS IMPROVEMENT The United States Agency for Healthcare Research and Qual-

ity defines quality health care as "doing the right thing, at the

right time, in the right way, for the right person-and having

the best possible results" (2003, p. 1). For

the past few decades, postpartum education

has evolved around maternal self-care and

infant care (Alden et aI., 2012; Murray et aI.,

2014). We conducted a literature review in

CINAHL and found no studies that focused

on educating women about specific potential

complications after birth. One recent study

(Suplee et aI., 2016) found a lack of standard

information and approaches to how nurses

meet the challenge of educating women who

are considered at risk for maternal mortal-

ity, as well as for all women at risk simply on

the basis of their postpregnancy health sta-

tus. National leaders have stated that earlier

recognition of warning signs by postpartum

women and earlier interventions by health

care providers may lead to a decrease in the

current growing maternal morbidity and

mortality rates in the United States (D'Alton,

Main, Menard, & Levy, 2014; The Joint Com-

mission, 2010).

Comprehensive improvement efforts to

advance postpartum education fOCUSing

specifically on potential risks for maternal

morbidity and mortality are needed. Future

education programs should include infor-

mation for both at-risk and healthy women,

because complications may not be clearly

identified or apparent before a woman's dis-

charge after birth.

Dec ember 2016 I January 2017

THE "EMPOWERING WOMEN TO OBTAIN NEEDED CARE" PROJECT With support from the Merck for Mothers program, a 10-year initiative focused on improving the health and well-being of

women during pregnancy and childbirth, AWHONN initiated

the "Empowering Women to Obtain Needed Care" project.

Researchers estimate that 40% to 50% of lJ .S. maternal

deaths are preventable

The goal of this pilot project was to increase women's access

to quality information about risks for postbirth complications,

especially before discharge from the hospital after giving birth.

Accurate and consistent information provided to all women

who give birth can better equip them to recognize health

changes or warning signs of postpartum complications. Early

recognition of postbirth warning signs enables women to seek

Nursing for Women's Health 555

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

and obtain health care for these potentially life-threatening

complications. The project was divided into two phases (see

Figure 1).

PHASE 1: BASELINE ASSESSMENT Baseline assessment included a comprehensive literature

review, a review of postpartum discharge materials currently

used by nurses to educate women about warning signs, and

focus groups with nurses held at selected hospitals to assess

what was currently taught to postpartum women and how the

education was delivered. Findings showed that inconsistent

information was provided to women about postbirth warning

signs and what they should do if they experienced any of these

signs once discharged (Suplee et aI., 2016) .

PHASE 2: IMPLEMENTATION The implementation phase included two components. First,

standardized evidence-based educational materials and dis-

charge teaching talking points were designed for nurses to use

when educating women about maternal morbidity and mor-

tality. Second, these educational materials were pilot tested in

four designated hospitals to identify barriers and facilitators to

FIGURE 1

implementation and to evaluate postpartum nurses' satisfac-

tion using the materials.

The education materials were designed to be easy to use and

to have the ability to be integrated into current teaching tools

used by nurses across the country. The leading causes of mater-

nal morbidity and mortality in the United States formed the

basis of what was included by the Expert Panel on the educa-

tional tools before pilot testing in 2015. What follows is a report

of the results of the implementation phase (Phase 2).

METHODOLOGY Sample Four of the six hospitals from the baseline assessment (Phase

1) agreed to participate in the implem entation portion (Phase

2) . Hospitals chosen for this pilot project reflected diverse

populations of postpartum women in terms of race, ethnicity,

and socioeconomic status. Among the hospitals participating

in this project, African American and Hispanic women were

reported to make up 25% to 65% of the total birth demograph-

ics for 2012. In the same year, Medicaid-reimbursed births in

these hospitals ranged from 25% to 75% of their total births.

Although it was not possible to capture the exact number of

Phases of the Empowering Women to Obtain Needed Care Pilot Project

Phase One: Baseline Assessment

-

IV outcomes

556 Nursing f o r Wom e n 's Hea lt h

Phase Two: Implementation

• Design educational checklist tool for nurses

• Design patient education tool • Design nurses' evaluation tool • Design audit tool • Review all tools with

Expert Panel • Train/orient nurse leaders • Pilot tools in 4 hospitals • Conduct & analyze health

records audit • Analyze nurse evaluations • Redesign tools based

on feedback

-

V o lume 2 0 Issue 6

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

women who received postpartum education using the pilot

project tools, a cumulative estimated calculation of births over

a 3-month period included more than 3,000 women. In addi- tion, approximately 150 nurses were involved in providing the

education to the postpartum women before discharge.

Procedure

After recruiting nurse site leaders from the four hospitals, the

project manager sent copies of all of the tools to them. A con-

ference call was held to introduce the nurse site leaders to the

program tools and to explain how they should be implemented

and how to train staff nurses to use them. The education for

for nurses to use when beginning the conversation with new

mothers: Although the majority of women who give birth do not

have complications once they go home, all women are potentially

at risk. Knowing these postpartum warning signs can save your

life as many signs can indicate a life-threatening condition and

require immediate medical care.

Patient Handout The handout for women to take home, titled "Save Your Life"

(see Figure 3), includes sections on when to call 911, when

to call one's health care provider, and descriptions of warn-

ing signs that could become life-threatening if women do not

Education ~rams should include information for both at-risk and healthy women, because complications may not be clearly

identified or aD-parent before a woman's discharge after birth

nurses included background information on statistics related to

rising rates of maternal mortality to ensure that all of the nurses

participating in the pilot program had accurate and current

information to share with their staff. The pilot implementation

took place from October through December 2015. During this

time, nurse site leaders from all four hospitals reported that the

nurses who provided postpartum education at their hospitals

were using the new forms with all women after birth and before

discharge. Monthly conference calls were held to discuss real

and potential issues encountered with the use of the program

materials and to share feedback among the nurse site leaders.

PROJECT TOOLS Four tools were created by the principal investigators, project

manager, an expert panel of nurses and health professionals on

the basis of information gleaned from the literature review and

focus groups held with nurses from six hospitals in New Jer-

seyand Georgia. Two teaching tools were developed-one for

nurses to use when teaching women about potential warning

signs of maternal morbidity and mortality (see Figure 2) and

another for women to take home (see Figure 3).

Discharge Education Checklist

The Post-Birth Warning Signs: Postpartum Discharge Educa-

tion Checklist (see Figure 2) was deSigned to provide nurses

with a tool they could use when teaching all women to rec-

ognize warning signs of postpartum complications that could

occur after discharge. The hospitals were given permission to

integrate the checklist into their electronic health record. The

checklist defines each potential complication, lists specific signs

and symptoms, and explains where and when a woman should

seek medical attention. It also includes this suggested script

December 20161 January 2017

obtain prompt medical attention. The other important message

included in this handout is a reminder for women to tell pro-

viders caring for them during the first year after giving birth,

I had a baby on [specific date] and I am having the following

specific symptoms . ... This message is intended to alert provid-

ers that a woman's symptoms could be related to a recent preg-

nancy. Nurses instructed each woman to keep the handout in a

place where she could access and review it easily, such as on her

refrigerator. Women were also encouraged to include a partner

or family member in the discharge education sessions before

discharge so that they could also hear the education to support

earlier identification of warning signs and symptoms and help

mobilize timely care.

Education Evaluation Tool

Additional tools were designed by the AWHONN project team

to be used for data collection by the site leader and evaluation

of the teaching tools by the nurses. The Postpartum Education

Evaluation Tool was an online survey distributed to all post-

partum nurses at the participating hospitals. Nurses were asked

to describe the facilitators and barriers to using the discharge

checklist and patient handout by responding to open-ended

questions. They were also asked to rate six statements using

a Likert scale (strongly agree to strongly disagree) focusing on

such elements as satisfaction, ease of use, ease of understand-

ing, assistance with teaching, and their assessment of women's

abilities to understand the warning signs and describe when to

obtain needed care.

Audit Tool A quality improvement health record audit tool was devel-

oped to be used by nurse site leaders when performing 30

Nursing for Women 's Health 557

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

FIGURE 2 Discharge Education Checkl ist (Full-sized PDF version of Figure 2 appears online as Supplemental Figure 51.)

POST-BIRTH WARNING SIGNS: POSTPARTUM DISCHARGE EDUCATION CHECKLIST

This checklist is a teaching guide for nurses to use when educating all women about the essential warning signs that can result in maternal morbidity and/or mortality.

Instructions:

POST- BIRTH

WARNING SIGNS

• Instruct ALL women about all of the following potential complications. All teaching should be documented on this form or in your facility's electronic medical record.

• Focus on risk factors for a specific complication first; then review all warning signs. • Emphasize that women do not have to experience ALL of the signs in each category for them to seek care. • Encourage the woman's significant other or her designated family members to be included in education

whenever possible.

The information included on this checklist is organized according to complications that can result in severe maternal morbidity or maternal mortality. Essential teaching points should be included in all postpartum discharge teaching.

The parent handout, "Save Your Life", is designed to reinforce this teaching. This handout is organized according to AWHONN's acronym, POST-BIRTH, to help everyone remember the key warning signs and when to call 911 or a health provider. A portion of this handout is below for reference.

Call your healthcare provider if you ha ve:

( If you can 't reach your healthcare provider, ca ll 9 11 or go to an emergency room)

o P ain in chest

o O bstructed breathing or shortness of breath

o S eizures

o T houghts of hurting yourself or your baby

o B leeding, soaking through one pad/hour, or blood clots, the size of an egg or bigger

o I ncision that is not healing

o R ed or swollen leg that is painful or warm to touch

o T emperature of 100.4°F or higher

o H eadache that does not get better, even after taking medicine, or bad headache with vision changes

Below is a suggested conversation-starter: "A lthough most women who give birth recover without problems, any woman can have

complications after the birth of a baby. Learning t o recognize these POST- BIRTH warn -

ing signs and knowing what to do can save your life . I would like to go over these POST-

BIRTH warning signs with you now, so you will know what to look for and when to call

9 77 or when to call your healthcare provider.

Please share thiS with family and f riends and post the "Save Your Life" handout in a place where you can get to it easily (like your refngerator). JJ

•• u~o."" Tn ,"".", u' , ;' AWHONN .,,~., ,,,,,n"".,, © AWHONN 2016: All Rights Reserved POST-BIRTH Warning Signs: AWHONN's Postpartum Discharge Education Project

© 2016 , AWHONN . All rights reserved. Requests for permission t o use or reproduce should be directed to permissions@awhonn.org.

(continued)

558 Nursing for Women 's Health Volume 20 Issue 6

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

FIGURE 2 Discharge Education Checklist continued ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• j

POST-BIRTH Warning Signs: Postpartum Discharge

Education Checklist

Pulmonary Embolism Essential Teaching for Women

What is Pulmonary Emboli sm? Pulmonary embolism is a blood clot that has traveled to your lung.

Signs of Pulmonary Embolism • Shortness of breath at rest (e.g., tachypneic shallow, rapid respirations) • Chest pain that worsens when coughing • Change in level of consciousness

Obtaining Immediate Care Ca ll 91 1 or go to nearest emergency room RIGHT AWAY.

RN initials ______________________ Date Family/support person present? YES / NO

Cardiac (Heart) Disease Essential Teaching for Women

What is Cardiac Disease? Card iac disease is when your heart is not working as well as it should and can include a number of disorders that may have different signs and symptoms.

Signs of Potential • Shortness of breath or difficulty breathing Cardiac Emergency • Heart palpitations (feeling that your heart is racing)

• Chest pain or pressure

Obtaining Immediate Care Call 911 or go to nearest emergency room RIGHT AWAY.

RN initials ______________________ Date Family/support person present? YES / NO

Hypertensive Disorders of Pregnancy Essential Teaching for Women

What is Severe Hypertension? Hypertension is when your blood pressure is much higher than it should be.

Signs of Severe Hypertension • Severe constant headache that does not respond to over-the-counter pain medicine, rest, and/or hydration

What is Preeclampsia/Eclampsia? Preeclampsia is a complication of pregnancy that includes high blood pressure and signs of damage to other organ systems. Eclampsia is the convu lsive phase of preeclampsia, characterized by seizures.

Signs of Preeclampsia • Severe constant headache that does not respond to pain medicine, rest, and/or hydration • Changes in vision, seeing spots, or flashing lights • Pa in in the upper right abdominal area • Swellin g of face, hands, and/or legs more than what you wou ld expect • Change in level of consciousness

Signs of Eclampsia • Se izures

Obtaining Immediate Care Ca ll 911 for seizures. Ca ll healthcare provider immed iately for any other signs. If symptoms worsen or no response from provider/clinic, call 911 or go to nearest emergency room.

RN initials ______________________ Date Family/support person present? YES / NO

Obstetric Hemorrhage Essential Teaching for Women

What is Obstetric Hemorrhage? Obstetric hemorrhage is when you have an excess amou nt of bleeding after you have delivered your baby.

Signs of Obstetr ic Hemorrhage • Bleeding through more than 1 sanitary pad/hour • Passing I or more clots the size of an egg or bigger • Character of clots/differentiation of bright red bleed in g from dark with clots

Obtaining Immediate Care Call healthcare provider immediately for signs of hemorrhage. If symptoms worsen or no response from provider/clinic. call 911 or go to nearest emergency room.

RN initials ______________________ Date Family/support person present? YES / NO

Page 1 o f 2 ©AWH ONN 2016: All Rights Reserved POST-BIRTH Warning Signs: AWHONN's Postpartum Discharge Education Proj ect

© 2016, AWHONN . All rights rese rved. Requests for permission to use or reproduce should be directed to permiss ions@awh onn .org.

(con tinued)

December 20161 January 2017 Nursing for Women's Health 559

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

FIGURE 2 Discharge Education Checklist continued

POST- BIRTH Warning Signs: Postpartum Discharge

Education Checklist

Venous Thromboembolism Essential Teaching for Women

What is Venous Thromboembolism? Venous thromboembolism is when you develop a blood clot usua lly in your leg (ca lf area).

Signs of Venous Thromboembolism • Leg pain, tender to touch, burning or redness, particu larly in the ca lf area • Swell ing of one leg more than the other

Obtaining Immediate Care Ca ll healthcare provider immediately for above signs of venous thromboembolism. If symptoms worsen or no response from provider/clinic, call 911 or go to nearest emergency roolTI.

RN initia ls _____________________ _ Date _________ _ Fami ly/support person present? YES / NO

Infect ion Essential Teac hi ng for Women

What is Infection? An infection is an invasion of bacteria or viruses that enter and spread through your body, making you ill.

Signs ofInfection • Temp is 2100.4°F (238°C) • Bad smelling blood or discharge from the vagina • Increase in redness or discharge from episiotomy or C-Section site or open wound not healing

Obtaining Immediate Care Call hea lthcare provider immediately for above signs. If symptoms worsen or no response from provider/clink, ca ll 9 11 or go to nearest emergency room.

RN init ials _____________________ _ Date _________ _ Family/support person present? YES / NO

Postpartum Dep ress ion Essent ial Teach ing for Women

What is Postpartum Depression Postpartum depression is a type of depression that occurs after childbirth. PPD can occur as early as one week (PPD)? up to one year after giving birth.

Signs of Postpartum Depression • Thinking of hurting yourself or your baby • Feeling out of control, unable to care for self or baby • Feel ing depressed or sad most of the day every day • Having trouble sleepi ng or sleeping too much • Having trouble bonding with your baby

Obtaining Immediate Care Call 911 or go to nearest emergency room if you feel you might harm yourself or your baby. Ca ll healthcare provider immediately for other signs of depression (sadness, withdrawn, difficulty coping with parenting).

RN initials _____________________ _ Date _________ _ Family/support person present? YES / NO

Essential Teaching for Women

• Discuss importance of follow-up visit with doctor, nurse practitioner or midwife in 4-6 weeks (or sooner if

Follow- Up health status warrants it) • Provide correct phone number for appointment

AppO intment • Emphasize importance to notifying all healthcare providers of delivery date up to one year after birth of baby

• Confirm date for postpartum appointment prior to discharge

RN initials _____________________ _ Date _________ _ Family/support person present? YES / NO

The patient received the POST-BIRTH Warning Signs education and a copy of the "Save Your Life" handout.

Nurse Initials and Signature: __________________________ Date/Time:

@AW H O N N 2016: A ll Rig ht s Rese rved

16001 Page 2 of 2

POS T- BIRTH Wa rn ing Sig ns: AW H O N N's Pos t pa rtum Di sc harge Ed ucatio n Project

© 2016, AWHONN. All rights reserved. Requests for permission to use or reproduce should be directed to permissions@awhonn.org.

560 Nursing for Women's Health Volume 20 Issue 6

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

FIGURE 3 Patient Handout (Full-sized PDF version of Figure 3 appears online as Supplemental Figure 52.)

SAVE YOUR LIFE:

Call your healthcare provider if you have:

( If you can't reach your healthcare provider, ca ll 911 or go t o an emergency room)

"Trust 'lour instincts. ALWA'IS get ",edical

care if yoU are oot fee\il"g we\\ or

"a"e questtons or concerns .

Get Care for These POST-BIRTH Warning Signs Most women who give birth recover without problems. But any woman can have complications after the birth of a baby. Learning to recog nize these POST-BIRTH warning signs and knowing what to do can save your life.

o P ain in chest

POST- BIRTH

WARNING SIGNS

o O bstructed breathing or shortness of breath

o S eizures

o Th oughts of hurting yourself or your baby

o B leeding, soaking through one pad/hour, or blood clots, the size of an egg or bigger

o I ncision that is not healing

o R ed or swollen leg that is painful or warm to touch

o T emperature of 100.4°F or higher

o H eadache that does not get better, even after taking medicine, or bad headache with vision changes

Tell 911 or your healthcare provider:

"I had a baby on ___ =,,---___ and (Date)

I am having __ ....,.".---.,..,,....--,---,--,-__ ' (Specific warning signs)

These post-birth warning signs can become life- threatening if you don't receive medical care right away because : Pain in chest, obstructed breathing or shortness of breath (trouble catc hin g yo ur breath) may mea n yo u have a blood clot in yo ur lung or a hea rt problem

Seizures may mean yo u have a condition ca lled eclampsia

Thoughts o r feelings of wanting to hurt yourself or your baby may mean yo u have postpartum depression

Bleeding (heavy) , soak ing more t ha n one pad in an hour or pa ssing an egg-sized clot or bigger may mean you have an obstetric hemorrhage

Incision that is not healing, increased redness or any pus from ep isiotomy or C -sect ion si te may mean yo u have an infect io n

Redness, swelling, warmth, or pain in the calf area of yo ur leg may mean you have a blood clot

Temperature of IOO.4°F o r higher, bad smelling vaginal blood or discharge may mean you ha ve a n infection

Headache (ve ry painful), vision changes, or pain in the upper r ight area of your belly may mean you have high blood pressure or post b irth p reeclampsia

GET MyHealthcareProvider/Clinic: ________________ Phone Number: _________ _ HELP Hospital Closest To Me: ______________________________ _

16002 ©20 16 Associat ion of Women's Health, Obstetric, a nd Neonatal Nurses. All rig hts reserved.

Requests for permission to use or reprod uce should be directed to permissions@awhonn.org.

© 2016, AWHONN . All righ t s reserved . Reques t s for permission to use or reproduce should be direc t ed t o permissions@awhonn .org.

December 20161 January 2017 Nurs ing for Women's Health 561

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

When implementing change in any health care setting, it is vital

to incllJde nurse site leaders and champions to facilitate the change

within the setting and to engage them in the review and evaluation process

health record audits per month. Audit topics included type of

birth; family support present during teaching; and education

provided about pulmonary embolism, obstetric hemorrhage,

severe hypertension, venous thromboembolism, infection,

postpartum depression, and follow-up care.

ANALYSIS AND RESULTS The nurse survey and audits were analyzed using descriptive

statistics. Site leaders used different methods to educate the

nurses at their hospitals on the project and on how to use the

project tools. Primarily, education of the staff nurses occurred

during staff meetings; however, the site leaders also met indi-

vidually with small groups and one on one for those who could

not attend. The site leaders were responsible for addressing any

questions nurses had regarding the project. It was beyond the

scope of the project to determine which methods were most

effective for orienting nurses to the program and the tools.

The exact number of nurses who used the tools for educat-

ing women about potential warning signs could not be captured

562 Nursing for Women's Health

during the pilot because of limitations in funding. The hospital-

based nurse site leaders estimated that 150 nurses performed

discharge education at their hospitals during the pilot period.

Of these, 52 nurses responded to the online survey, resulting in

a 33% response rate. This percentage is fairly consistent with that

reported in the literature for survey completion (Watt, Simp-

son, McKillop, & Nunn, 2002). Most nurses who completed the

survey indicated that the discharge education checklist and the

patient handout were easy to use, that the checklist would assist

them with their teaching about postpartum complications, that

they were satisfied with the amount of information on the tools,

and, finally, that women were able to understand what was being

taught to them about warning signs and were able to describe

when they should seek care (see Table 1).

In addition to nurses' comments about the use of the tools,

there were additional questions focusing on the potential bar-

riers and facilitators nurses experienced when they used the

tools. The main barrier reported was that the patient hand-

outs were available only in English, thereby preventing nurses

from distributing handouts to non-English-speaking patients.

Handouts were translated into Spanish to eliminate this barrier.

The main facilitator reported by nurses was the accessibility of

the form on the chart.

DISCUSSION When implementing change in any health care setting, it is vital

to include nurse site leaders and champions to facilitate the

change within the setting and to engage them in the review and

evaluation process. The Post-Birth Warning Signs: Postpartum

Volume 20 Issue 6

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

..................................................................................................................................................................

TABLE 1 Postpartum Education Evaluation Survey Results (n = 52) .................................................................................................................................................................

Statement Strongly Agree, Undecided, Disagree, Strongly Agree, % (n) % (n) % (n) % (n) Disagree, % (n)

I found the Maternal Mortality Checklist easy to use. 25.0 (13) 53.9 (28) 9.6 (5) 3.9 (2) 7.7 (4)

I feel that the Maternal Mortality Checklist will assist me when teaching all women about warning signs of possible postpartum complications. 36.5 (19) 48.1 (25) 5.8 (3) 5.8 (3) 3.9 (2)

I found the Save Your Life handout easy to use when teaching women. 38.5 (20) 40.4 (21) 13.5 (7) 3.9 (2) 3.9 (2)

I was satisfied with the amount of content found on the Save Your Life handout provided to the women. 40.4 (21) 46.2 (24) 3.9 (2) 7.7 (4) 1.9 (1)

I felt that women were able to understand the importance of postpartum warning signs that were discussed with them. 38.5 (20) 48.1 (25) 9.6 (5) 3.9 (2) 0(0)

The women were able to describe to me when to seek and obtain needed care related to all of the warning signs presented on the handout. 28.9 (15) 63.5 (33) 3.9 (2) 1.9 (1) 1.9 (1)

Discharge Education Checklist and the Save Your Life hand-

out were purposely designed in tandem and with consistent

content to enable nurses to teach the content in a standardized

format while women followed along using the handout. Nurses'

perceptions of satisfaction with and ease of use of both of these

tools were overall positive in this pilot project.

The exact teaching method used by the nurses for teaching

about or reinforcing maternal warning signs education was not

measured. However, in the focus groups during Phase 1, many

nurses reported using the teach-back technique, which would

be appropriate to use when teaching about potential complica-

tions of pregnancy and childbirth. The checklist also included

documentation of whether a support person was available dur-

ing the education.

Nurses were asked to discuss the barriers and facilitators of

incorporating these teaching tools into their clinical practice.

December 20161 January 2017

Although not all nurses provided responses to these questions,

many did, and the primary barrier identified was lack of a Span-

ish-language version of the handout; this led the project team

to create a Spanish version for nurses to use as a handout dur-

ing this phase of the project. In the future, it will be important

to validate these Spanish-language teaching tools. These tools

need to be reliable, and the content must be culturally appropri-

ate. The main facilitator of incorporating these tools into clini-

cal practice was reported by the nurses to be the accessibility

of the form on the chart. One aspect of having nurses test new

patient education tools is that a balance of time versus pur-

pose must be reached. As nurses gained additional knowledge

themselves about postpartum maternal mortality, there was an

increased appreciation for the importance of their role in pro-

viding education to all women on recognizing warning signs of

postpartum morbidity and mortality.

Nursing for Women's Health 563

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

The site leaders themselves were also asked about barriers

and facilitators to implementation to assist with future project

design. Their reported barriers and facilitators are listed in Box 1.

PRACTICAL IMPLICATIONS FOR CLINICIANS Indeed, our recommendations are consistent with the findings

that a lack of recognition or understanding of warning signs for

pregnancy complications by health care providers and fami-

lies contribute to preventable maternal mortality (Main et ai.,

2015). Therefore, implementation of standardized education by

nurses who care for women during the postpartum period has

the potential to playa significant role in decreasing maternal

morbidity and mortality. To help achieve this goal, it is essential

to engage all postpartum women (and their support persons

whenever possible) in focused discussions about potentially

life-threatening post-birth complications as a routine compo-

nent of discharge education. One of the challenges for nurses

and other health care professionals is to present this education

in a manner that is informative and that fosters empowerment

without instilling unnecessary fear in women. In fact, this chal-

lenge was reported as a concern by some of the nurse site lead-

ers and resulted in inclusion of additional scripting and talking

points to help nurses engage with women when they were dis-

cussing the components outlined on the Post-Birth Warning

Signs: Postpartum Discharge Education Checklist. Although

it might seem daunting to discuss potentially life-threatening

postbirth complications, especially with women for whom

pregnancy and birth were normal, engaging women and their

families in this critical conversation in an objective and sup-

portive manner may save lives. Because of the alarmingly high

percentage of maternal deaths that occur in the immediate

postpartum period and through the first year after birth (Cre-

anga et ai., 2015; Kassebaum et ai., 2014), the potential benefits

of having the conversation clearly outweigh the potential risks

of not doing so.

Equally critical is the need to help women understand the

importance oflistening to their own bodies and acting on signs

that do not seem normal to them. Women experience a myriad

of signs and symptoms associated with the normal physiologic

and psychosocial changes occurring during the postpartum

period. Therefore, it is important to help them understand nor-

mal signs and symptoms and the ways to differentiate those

that are normal from those that are not. Women also need to

know why it is necessary and appropriate to proactively seek

and obtain care when they are not feeling well and how urgently

they should obtain this care on the basis of the types of symp-

toms they are experiencing. Armed with information about

and understanding of the postbirth warning signs, women can

be empowered to act immediately rather than wait and suffer

potentially devastating consequences.

564 Nursing for Women's Health

BOX 1 Barriers and Facilitators to Postpartum Education Implementation as Reported by Nurse Site Leaders

BARRIERS Duplication of documentation left some nurses frustrated with extra work. Given the short pilot period, most hospitals were unable to integrate all documentation into the electronic health record.

Competing priorities or inadequate staffing did not allow some sites to participate in pilot implementation after participation in Phase 1 of project.

Tight time lines and inadequate lead time from initial orientation to implementation made it difficult for some sites to obtain administra- tive approval and to train nurses .

Inconsistent methods of data collection among sites made it difficult for the project team to compare implementation across sites.

FACILITATORS

Ease of use by nurses with information provided in one tool.

Commitment to the project by hospital leaders and! or administration.

Availability of staff with time to devote to implementation and problem solving.

Authority and decision-making capabil- ity of hospital leaders to respond to issues in a timely way.

Regular support and communication throughout the project via group phone calls to discuss challenges and brainstorm solutions .

Positive working relationships with hospital site leaders contributed to the ease with which this project could gear up for implementation.

Designating specific staff in leadership roles in implementation motivated these nurses to succeed and ultimately contributed to project success.

Volume 20 Issue 6

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

Although the window of opportunity for discharge plan-

ning and teaching postpartum women is small and the volume

of information to be relayed is large, the necessity to provide

this critical information cannot be overstated. Nurses can

EXEMPLAR One of the AWHONN project principal investigators con-

ducted an interview with a woman who received the postbirth

warning signs education before she was discharged from the

One of the challenges for nurses and other health care professionals is to present this education in a manner that is informative

and that fosters empowerment without instilling unnecessary fear in women

work together within their maternity services to strategize and

develop best practices to ensure that essential maternal and

newborn discharge teaching is accomplished in the most effi-

cient and effective manner possible. One strategy may be to plan

discharge teaching over the course of the woman's postpartum

stay rather than waiting for day of discharge. Another strategy

may be to include this education as part of prenatal education.

And finally, incorporating a checklist and patient education tool

(such as the AWHONN tools) into hospital electronic health

record systems and the discharge education process will pro-

vide nurses with a resource handout to use when providing

evidence-based care education.

December 20161 January 2017

hospital and who subsequently experienced a complication.

Her story (see Box 2) aptly illustrates the value in providing

this education to all women and empowering them to obtain

needed care.

LIMITATIONS The AWHONN project team identified limitations to this

project. First, the sample size was small (four hospitals par-

ticipated from two distinct geographic regions), and the data

collected over 3 months were not necessarily reflective of dis-

charge practices across the nation, making the authors cautious

about the results. Second, there was a retention issue: two of

Nursing for Women's Health 565

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

the original six hospitals withdrew from Phase 2. One facility

withdrew related to its lack of resources to execute the project,

and in the other facility, a decision was made that another pro-

ject had priority over this one. This, unfortunately, is the reality

for many health care facilities that are challenged to simul-

taneously orchestrate multiple projects without additional

resources . Lastly, there was a lack of consistency in how hospi-

tal leaders chose to train staff on the implementation and doc-

umentation of the education. Site leaders reported that nurses

received the training during staff meetings, in small groups, or

one on one. An audit tool was designed by the project team to

be used by nurse site leaders for monthly chart reviews; how-

ever, there was inconsistency among the leaders on how data

were obtained and recorded in the audit form . Thus, data from

these audits were determined to not be reliable.

CONCLUSION The overall goal to streamline and improve the education that all

postpartum women receive regarding warning signs of compli-

cations is a lofty but necessary one. The results of this pilot pro-

ject are promising. Future research should include interviewing

women to explore how they perceive the educational tools and

information they received about this content from their nurses,

testing the educational tools and education methods for teach-

ing staff and new mothers in multiple facilities with a larger

sample of nurses and postpartum women, and monitoring

readmission rates resulting from women using and reporting

warning signs after discharge from the hospital and returning

to the hospital to obtain needed care. Further investigation

and evaluation have the potential to demonstrate that hospital

readmission for identified warning signs is the right thing to

do to facilitate early intervention for postpartum complications

and that obtaining needed postpartum care will be the result

of improved education and awareness of the postbirth warning

signs. Thus, providing consistent education to all women in the

postpartum period before discharge has the potential to reduce

severe maternal morbidity and to save lives. NWH

Acknowledgments This project was supported by AWHONN, and the activities

described in this article were supported by funding from Merck,

through its Merck for Mothers program, and are the sole responsi- bility of the authors. Merck for Mothers is known as MSD for Moth- ers outside the United States and Canada. The authors would also like to acknowledge the following members of the Expert Panel

who assisted with the Empowering Women to Obtain Needed

Care Project: Jennifer L. Barkin, PhD, MS, Joan Rosen Bloch,

PhD, CRNp, Helen M. Hurst, DNP, RNC-OB, APRN-CNM, and

Mimi Pomerleau, DNP, WHNP-BC, RNC-OB, CNE.

~ Cross~ark

566 Nursing f o r Wom e n 's Hea lt h

BOX2 Interview With a Woman in the Postpartum Period Who Experienced a Complication

Abigail (not her real name) is a 27-year-old woman who had an uneventful prenatal course without risk factors or complications and had a vaginal birth. Be- fore discharge, the postpartum nurse caring for Abi- gail educated her about the most common postbirth warning signs, gave her the Save Your Life handout, and reviewed the handout with her. During her second postpartum week, Abigail developed and was treated for mastitis. Within a few days of starting antibiotic therapy for the mastitis, she began to feel progressively worse, stating, "I just didn't feel like myself." In the interview, she described symptoms that included a "rapid heart rate, racing, like palpita- tions" and that her breathing was "off," explaining that when she would take a breath "in" she would start coughing. She reported remembering the Save Your Life handout, referring to it, and seeing the words "shortness of breath" and "call 911" on it. She turned to her mother, showed her the handout, and said, "Something isn't right, we're going in [to the emergency departmentl." In the emergency depart- ment of her local hospital, Abigail's heart rate was 163, and she was still short of breath. She recalled being very frightened, stating that her greatest fear then was "not knowing if I'd ever hold my baby again." Abigail was diagnosed with a small pulmo- nary embolus in her right lung, was admitted to the hospital, and was successfully treated on a unit where her baby could stay with her and continue to breastfeed.

As she reflected on this emergency, Abigail was thankful that the physicians and nurses in the emergency department identified her pulmonary embolus, and she shared that, having received the information about postbirth warning signs, she was able to immediately act on what she read on the basis of the symptoms she experienced. Abigail explained that she now knows how important it is to be on the lookout for signs that do not seem nor- mal, even when pregnancy and birth are uneventful. She is grateful to have had the Save Your Life hand- out available. She stated during the interview that she believes the postbirth education and handout she received before discharge saved her life.

V o lume 2 0 Issue 6

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.

Supplementary Material

Note: To access the supplementary material that accompanies this article, visit the online version of Nursing for Women's Health at http://nwhjournal.org and at http://dx.doi.org/10.1016/j.nwh.2016.10.009 .

REFERENCES Agency for Healthcare Research and Quality. (2003). Your guide

to choosing quality health care. Retrieved from www.ahrq.gov/ consumer 1 qntl qntqlook.htm.

Alden, K. R., Lowdermilk, D. L., Cashion, M. c., & Perry, S. E. (2012). Maternity and women's health care (10th ed.). St. Louis, MO: Elsevier.

American College of Obstetricians and Gynecologists (ACOG). (2016). Optimizing postpartum care. Committee Opinion No. 666 . Obstetrics & Gynecology, 127, e187-e192 . doi:l0 .l0971 AOG .0000000000001487

Bacak, S. J., Berg, C. J., Desmarais, J., Hutchins, E., & Locke, E. (Eds.). (2006). State maternal mortality review: Accomplishments of nine states. Atlanta, GA: Centers for Disease Control and Pre- vention. Retrieved from http://www.cdph.ca.gov/data/statistics/ Documents/MO-CDC-ReportAccomplishments9States.pdf

Callaghan, W. M., Creanga, A. A., & Kuklina, E. V. (2012) . Severe maternal morbidity among delivery and postpartum hospitali- zations in the United States. Obstetrics and Gynecology, 120(5), 1029-1036. doi: 10.10971 AOG.ObO 13e31826d60c5

Centers for Disease Control and Prevention. (2016). Pregnancy mortality surveillance system. Retrieved from http://www.cdc .gov/reproductivehealth/maternalinfanthealth/pmss.html

Central Intelligence Agency. (2016). The world factbook. Coun- try comparison: Maternal mortality rate. Retrieved from https :llwww.cia.gov/library/publications/ resources/the- world- factbook/rankorder/2223rank.html

Creanga, A. A., Berg, C. J., Syverson, c., Seed, K, Bruce, E c., & Callaghan, W. M. (2015). Pregnancy-related mortality in the United States, 2006-2010. Obstetrics & Gynecology, 125(1),5-12. doi: 1 0.1 0971 AOG.0000000000000564

D'Alton, M. E., Main, E. K, Menard, M. K, & Levy, B. S. (2014). The National Partnership for Maternal Safety. Obstetrics and Gyne- cology, 123(5),973-977. doi :1O.1097/AOG.0000000000000219

Della Torre, M., Kilpatrick, S. J., Hibbard, J. u., Simonson, L., Scott, S., Koch, A., .. . Geller, S. E. (2011). Assessing preventability for obstetric hemorrhage. American Journal of Perinatology, 28(10), 753-760. doi:1O.1055/s-0031-1280856

December 20161 January 2017

Elo, 1. T., & Culhane, J. E (2010). Variations in health and health behaviors by nativity among pregnant black women in Philadel- phia. American Journal of Public Health, 100(11), 2185-2192 . doi: 10.21051 AJPH.2009.174755

Hogan, M . c., Foreman, K J., Naghavi, M., Ahn, S. Y., Wang, M., Makela, S. M., ... Murray, C. J. (2010) . Maternal mortality for 181 countries, 1980-2008: A systematic analysis of progress towards Millennium Development Goal 5. Lancet, 375(9726), 1609-1623. doi:l0 .10 16/S0140-6736(10)60518-1

Kassebaum, N. J., Bertozzi-Villa, A., Coggeshall, M. S., Shack- elford, K A., Steiner, c., Heuton, K R., ... Lozano, R. (2014). Global, regional, and national levels and causes of maternal mortality during 1990-2013: A systematic analysis for the Global Burden of Disease Study 2013 . Lancet, 384(9947), 980-1004. doi: 10.1 0 16/S0 140-6736( 14)60696-6

Kleppel, L., Suplee, P.D., Stuebe, A.M., & Bingham, D. (2016). National initiatives to improve systems of postpartum care. Maternal and Child Health Journal, 20 (8), 1-5. doi:l0.10071 s10995-016-2171-1

Mac Dorman, M. E, Declercq, E., Cabral, H ., & Morton, C. (2016) . Recent increases in the U.S. maternal mortality rate: Disentan- gling trends from measurement issues. Obstetrics & Gynecology, 128(3),447-455. doi:l0 .1097/AOG.0000000000001556

Main, E. K, McCain, C. L., Morton, C. H ., Holtby, S., & Lawton, E. S. (2015) . Pregnancy-related mortality in California: Causes, char- acteristics, and improvement opportunities. Obstetrics & Gyne- cology. 125(4),938-947. doi: 10.10971 AOG.0000000000000746

Murray, S. S., & McKinney, E. S. (2014) . Foundations of maternal- newborn and women's health nursing (6th ed.). St. Louis, MO: Elsevier.

Suplee, P. D., Bingham, D., & Kleppel, L. (2016). Discharge edu- cation on maternal morbidity and mortality provided by nurses to women in the postpartum period. Journal of Obstetric, Gynecologic, & Neonatal Nursing, 45(6),894-904. doi:10.1016/j. jogn.20 16.07.006

The Joint Commission. (2010, January 26). Preventing mater- nal death. Sentinel Event Alert, 44, 1-3. Retrieved from http:// www.jointcommission.org/sentineLevent_alert_issue_44_ preventin~maternal_deathl

U.S. Department of Health and Human Services. (2016). Healthy People 2020. Retrieved from http://www.healthypeople.gov/2020/ aboutl defauIt.aspx

Watt, S., Simpson, c., McKillop, c., & Nunn, V. (2002). Electronic course surveys: Does automating feedback and reporting give better results? Assessment & Evaluation in Higher Education 27(4),325-337. doi :l0.108010260293022000001346

Nursing for Women 's Health 567

Downloaded for Anonymous User (n/a) at National Certification Corporation from ClinicalKey.com/nursing by Elsevier on October 16, 2017. For personal use only. No other uses without permission. Copyright ©2017. Elsevier Inc. All rights reserved.