Trends in the Prevalence of Developmental Disabilities in US Children, 1997-2008 (Boyle, 2011)

profileJaniseM
Boyle20114.pdf

Trends in the Prevalence of Developmental Disabilities in USChildren, 1997–2008

WHAT’SKNOWNONTHISSUBJECT: USdata on the changes in the prevalence of developmental disabilities are scarce. Although there are a fewstudies on individual disabilities, data examining the impact of the full range of developmental disabilities are unavailable.

WHAT THISSTUDYADDS: Developmental disabilitiesmake a significant contribution to overall childhoodhealth.We show the health disparities that exist for specific populations andhow selected conditions have increasedover the past 10 years.

abstract OBJECTIVE: To fill gaps in crucial data needed for health and educa- tional planning, we determined the prevalence of developmental dis- abilities inUSchildrenand inselectedpopulations forarecent12-year period.

PARTICIPANTSANDMETHODS:Weuseddata onchildrenaged3 to 17 yearsfromthe1997–2008NationalHealth InterviewSurveys,whichare ongoing nationally representative samples of US households. Parent- reported diagnoses of the following were included: attention deficit hyperactivity disorder; intellectual disability; cerebral palsy; autism; seizures; stuttering or stammering; moderate to profound hearing loss; blindness; learning disorders; and/or other developmental delays.

RESULTS: Boys had a higher prevalence overall and for a number of select disabilities comparedwith girls. Hispanic childrenhad the low- est prevalence for a number of disabilities compared with non- Hispanicwhiteandblackchildren.Lowincomeandpublichealth insur- ance were associated with a higher prevalence of many disabilities. Prevalence of any developmental disability increased from 12.84% to 15.04%over 12 years. Autism, attention deficit hyperactivity disorder, and other developmental delays increased, whereas hearing loss showed a significant decline. These trends were found in all of the sociodemographicsubgroups,except forautisminnon-Hispanicblack children.

CONCLUSIONS: Developmental disabilities are common andwere re- ported in �1 in 6 children in the United States in 2006–2008. The number of childrenwith select developmental disabilities (autism, at- tentiondeficithyperactivitydisorder,andotherdevelopmentaldelays) has increased, requiringmore health and education services. Additional study of the influence of risk-factor shifts, changes in acceptance, and benefitsofearlyservices isneeded.Pediatrics2011;127:1034–1042

AUTHORS: ColeenA. Boyle, PhD,a ShereeBoulet, PhD,a

LauraA. Schieve, PhD,a RobinA. Cohen, PhD,b StephenJ. Blumberg, PhD,bMarshalyn Yeargin-Allsopp,MD,a

SusannaVisser,MS,a andMichaelD. Kogan, PhDc

aNational Center onBirthDefects andDevelopmental Disabilities and bNational Center for Health Statistics, Centers for Disease Control andPrevention, Atlanta, Georgia; and cMaternal and Child Health Bureau, Health Resources andServices Administration, Rockville,Maryland

KEYWORDS developmental disabilities, prevalence, autism, attention deficit hyperactivity disorder

ABBREVIATIONS NHIS—National Health InterviewSurvey ADHD—attention deficit hyperactivity disorder

All authorsmadesubstantial intellectual contributions to thestudy, including theconceptionanddesign,acquisitionofdata,analysis, and interpretation.All authorsparticipatedactively in thedrafting andrevisingof themanuscript. Finally, all authorsapproved the final version thatwassubmitted forpublication.DrColeenA.Boyle had full access toall thedataandtakesresponsibility for the integrityof thedataandaccuracyof thedataanalysisand contributed to thestudydesignandconcept, analysisand interpretationof thedata,draftingof themanuscript, critical reviewof themanuscript, andstatisticalanalysis.DrShereeBoulet contributed to thestudydesignandconcept, acquisitionof thedata, analysisand interpretationof thedata,andcritical reviewof the manuscript.DrLauraSchievecontributed to thestudydesignand concept, analysisand interpretationof thedata,draftingof the manuscript, andcritical reviewof themanuscript.DrRobinA. Cohencontributed to theacquisitionof thedataandanalysisand interpretationof thedata.DrStephenJ.Blumbergcontributed to theanalysisand interpretationof thedata,draftingof the manuscript, andcritical reviewof themanuscript.DrMarshalyn Yeargin-Allsoppcontributed to theanalysisand interpretationof thedata,draftingof themanuscript, andcritical reviewof the manuscript.DrSusannaVissercontributed to theanalysisand interpretationof thedata,draftingof themanuscript, andcritical reviewof themanuscript.DrMichaelD.Kogancontributed to the analysisand interpretationof thedata,draftingof themanuscript, andcritical reviewof themanuscript.

The findings and conclusions in this report are those of the authors anddonot necessarily represent the official position of the Centers for DiseaseControl andPrevention or theHealth Resources andServices Administration.

www.pediatrics.org/cgi/doi/10.1542/peds.2010-2989

doi:10.1542/peds.2010-2989

Accepted for publication Feb 25, 2011

Address correspondence to Coleen A. Boyle, PhD, National Center onBirthDefects andDevelopmental Disabilities, Centers for DiseaseControl andPrevention, 1600CliftonRd, Atlanta, GA 30333. E-mail: [email protected]

(Continuedon last page)

1034 BOYLE et al by guest on June 15, 2015pediatrics.aappublications.orgDownloaded from

Dataontheprevalenceofdevelopmen- tal disabilities have been used to de- scribe the importance of these health problems and to assess the educa- tional, medical, and social support needs forchildrenwithdevelopmental disabilities and their families. Esti- mates of the prevalence of develop- mental disabilities in US children on the basis of the 1988 National Health Interview Survey (NHIS) indicated that 16.8% of children younger than 18 years of age had lifelong conditions arising inearlychildhoodasaresultof cognitive or physical impairment or a combination of the 2.1 Findings from morerecent surveys thatusedamore restrictive definition of developmental disabilities suggested that 13.2% of childrenhad1ormoredevelopmental disabilities during 1997–2005 and 1.6% had 3 or more developmental disabili- ties.2Thesestudiesalsodocumentedthe considerable impactof thedisordersas measuredbyhigher ratesof healthand special-education service use for chil- dren with developmental disabilities compared with children without devel- opmentaldisabilities.

Anumberoffactorsmayhaveinfluenced theprevalenceofdevelopmentaldisabil- itiesover thepast10 to15years, includ- ing improved survival of the growing number of children born preterm or with birth defects or genetic disorders, such as spina bifida and Down syn- drome,3 whose improved survival may beoffsetbyadisproportionateburdenof neurologic and other impairments.4,5

Other trends and medical practice changes that might contribute to a re- duction of developmental disabilities in thepopulation include increases inpre- natal diagnosis and therapeutic abor- tion,oldermaternalage,newinfantvac- cines, and the expansion of newborn screening.6,7 Finally, increased aware- nessand improveddiagnosis, particu- larly for conditions with a behavioral phenotype,suchasautismorattention

deficit hyperactivity disorder (ADHD), mayhave contributed to changesover time.

Since 1997, the NHIS has routinely in- cluded questions on a broad array of developmentaldisabilitiesamongchil- drenyoungerthan18yearsofage.This survey, with population-based annual samplesandconsistent verbiage in in- dividual disability conditionquestions, is ideal formonitoring trends in prev- alence over time. We used data for a 12-year timeperiod (1997–2008) toex- amine (1) the national prevalence of developmental disabilities according to major demographic and socioeco- nomiccharacteristicsand(2)changes in the prevalence of developmental disabilities over time.

PARTICIPANTSANDMETHODS

We used the Family Core and Sample Child Components of the NHIS from 1997 to 2008. The NHIS is an ongoing annual survey, conducted by the Cen- ters for Disease Control and Preven- tion, National Center for Health Statis- tics, thatusesamultistageprobability sample toestimate theprevalenceofa number of health conditions in the ci- vilian noninstitutionalized population of the United States.8,9 Demographic and health data on family members

are obtained through an in-person in- terview with a knowledgeable adult family member. For the Sample Child component,moredetaileddataareob- tained for 1 randomly selected child youngerthan18yearsofage.Formore than 90% of the children included in theNHIS Sample Child component, the knowledgeable adult interviewed was aparent or legal guardian.

The current analysis was limited to children aged 3 to 17 years (total 1997–2008 unweighted sample size: 119367). Children younger than 3 years of age were excluded because many developmental disabilities are not recognized or diagnosed before that age. The average household re- sponse rate for the NHIS was 88.3% (range of annual rates: 84.9–91.8%); the average conditional response rate for the sample child component was 91.2% (range: 85.6–93.7%).

The specific conditions assessed were asfollows:ADHD;cerebralpalsy;autism; seizures; stammering or stuttering; mental retardation; moderate to pro- found hearing loss; blindness; learning disorders; and other developmental de- lays (see Table 1 for the survey ques- tions). Thesamesetofquestionswere askedover the11survey years; theex-

TABLE1 TheNHIS Questions onDevelopmental Disabilities, 1997–2008

Condition Survey Question

ADHD/attention deficit disorder (ADD),a

autism, cerebral palsy,mental retardation,b andother developmental delay

“Has adoctor or health professional ever told you that [survey child] hadany of the following conditions?”

Seizures and stuttering or stammering “During the past 12months, has [survey child] had any of the following conditions?”

Moderate to profoundhearing loss “Which statement best describes [survey child’s] hearingwithout a hearing aid: good, a little trouble, a lot of trouble, or deaf?”c

Blindness “Is [survey child] blind or unable to see at all?” Learningdisability “Has a representative from the school of a health

professional ever told you that [survey child] has a learningdisability?”

aNHIS shifted fromasking about ADD in 1997–1999 to asking about ADDandADHD in 2000 and later. bReferred to as intellectual disability in the text and tables. cCategorieswere revised in 2008 to the following: excellent; good; a little trouble;moderate trouble; a lot of trouble; and deaf. Moderate to profound hearing loss included the categories of deaf and a lot of trouble hearing for 1997–2007 and moderate trouble, a lot of trouble, anddeaf for 2008.

ARTICLES

PEDIATRICS Volume127, Number 6, June 2011 1035 by guest on June 15, 2015pediatrics.aappublications.orgDownloaded from

ception was an expansion of the hearing-loss categories in 2008 (see Table 1 for details). Although the NHIS questionnaire used the term “mental retardation,” to be more closely aligned to currently accepted termi- nology, we refer to this condition as “intellectual disability.”10 The time framefor themajorityof thequestions refers towhether the childwas “ever” diagnosed with the condition; for sei- zures and stuttering or stammering the reference periodwas the “past 12 months,” and moderate to profound hearing lossandblindnessreferred to the current status of the child. A child was considered to currently have a condition if there was an affirmative response, regardless of the time frameof thequestions.Therewassub- stantial collinearity between learning disabilities and intellectual disabili- ties, andwe therefore report learning disabilitiesasaconsequenceof the in- tellectual disability rather than a co- occurring condition. That is, children with reported intellectual disabili- ties and learning disabilities were only included in the intellectual dis- ability category.

We examined the prevalence of any parent-reported developmental dis- abilities and of each individual devel- opmental disability for the 12-year pe- riod combined and assessed how the estimatesvariedbyanumberofdemo- graphicandsocioeconomiccharacter- istics, includingthechild’sage;gender and race/ethnicity; mother’s educa- tion; total family income level from all sources, includingsupplemental secu- rity income (with incomedefined rela- tive to the federal poverty level); and health insurance status (any public, private-only, no health insurance re- ported). Children covered by both pri- vate insurance and the state’s Medic- aidprogramsare includedunder “any public.” We also assessed secular trends foreachdisabilityover43-year

time intervals (1997–1999; 2000–2002; 2003–2005; and 2006–2008). For the disabilities with statistically signifi- cant temporal trends, we conducted additional analyses to determine whether trends were uniform within the demographic and socioeconomic subgroups. Income stratification in this report is based on both reported and imputed income.11

Prevalence estimates were weighted usingNHISweightstorepresent theUS noninstitutionalizedpopulationof chil- dren. Variance estimates were pro- duced using Sudaan software to ac- count for the complex NHIS sample design. �2 Tests were used to deter- mine whether the prevalence esti- mates differed among the various groups being compared. Wald-F tests wereusedtoassess lineartrendsover the 4-calendar-year time periods. All associations and differences de- scribed in the text were statistically significant at theP � .05 level. Human subject review was not required for this analysis of publicly availabledata.

RESULTS

Prevalence andDemographic Characteristics

The prevalence of any developmental disability in 1997–2008 was 13.87% and ranged from 0.13% for blindness to6.69%forADHDand7.66%for learn- ing disabilities (Table 2). In general, there was higher prevalence in older childrenforconditions likely tobefirst recognized or confirmed in the school years, including ADHD and learning disabilities. Little change across age groups was noted for cerebral palsy, moderate to profound hearing loss, andotherdevelopmentaldelays.There was a lower prevalence in older chil- dren for stuttering or stammering. Hispanic children had a lower preva- lence of several disorders relative to non-Hispanic white and black chil- dren, including ADHD and learning

disabilities; the prevalence of other developmental delays was higher only in comparison to non-Hispanic whitechildren.Stutteringorstammer- ing was reported more often in non- Hispanic black children than non- Hispanicwhite children. Boys had twice theprevalenceofanydevelopmentaldis- ability and excess prevalence for ADHD, autism, learning disabilities, stuttering or stammering, and other developmen- taldelays, specifically.

There was a nearly twofold higher prevalence of any reported develop- mental disability among children in- suredbyMedicaid relative to those in- sured by private insurance, and this patternwasstatisticallysignificant for ADHD, learning disabilities, intellec- tual disabilities, seizures, stuttering or stammering, and other develop- mental delays. Family incomes below the federal poverty level were associ- ated with a higher prevalence of parent-reported developmental dis- abilities overall and learning disabili- ties, intellectualdisabilities, stuttering or stammering, and other develop- mental delays, specifically. Lowerma- ternal education (ie, any attainment less than a college degree)was associ- atedwithahigherprevalenceofanyde- velopmental disabilities, learning dis- abilities, andstutteringorstammering.

Time Trends

Forall developmentaldisabilitiescom- bined, there was a small, but statisti- cally significant, linear increase in the prevalence over the 4 time periods, from12.84%in1997–1999 to15.04%in 2006–2008 (Table 3). Of the individual disorders, ADHD and autism showed significant and successive increases overtime.Otherdevelopmentaldelays, a catch-all category, also showed sig- nificant increases over the time pe- riod, but the increase was observed only between themost recent 2 inter- vals (from 2003–2005 to 2006–2008).

1036 BOYLE et al by guest on June 15, 2015pediatrics.aappublications.orgDownloaded from

ADHD, because of its considerably higherprevalence,waschieflyrespon- sible for theupward trend in theover- all prevalence of developmental dis- abilities, with a 33% increase in prevalence from 1997–1999 to 2006– 2008. Autism, however, showed, by far, the largestrelative increase,withnearly a fourfold change froma prevalence of 0.19% in 1997–1999 to 0.74% in 2006– 2008.Moderatetoprofoundhearingloss was theonlydisorder todecline inprev- alence, showing a 31% decrease from 1997–1999 to2006–2008.

Although themagnitude of the change varied somewhat among the various descriptive factors (Table 4), in gen- eral, we observed upward trends in the parent-reported prevalence of ADHD and autism and a decrease for moderate to profound hearing loss. One exception was race/ethnicity and autism, with a lack of a significant in- crease in non-Hispanic black children.

DISCUSSION

Developmentaldisabilitiesaffectasig- nificant proportion of children in the United States. We found that 15% of children aged 3 to 17 years, or nearly 10millionchildrenin2006–2008,hada developmental disability on the basis of parent report. The 17% increase in prevalence over the 12-year period represents�1.8millionmorechildren with developmental disabilities in 2006–2008 thanadecade earlier.

It is difficult to corroborate theoverall prevalence reported in this study be- cause of the lack of comparable stud- ies using a similar grouping of condi- tions. In comparing theprevalence for individual disorders, however, we find good agreement for someof the prev- alence estimates. A comparable high prevalence of ADHD recently was re- ported from the 2003–2007 National Survey of Children’s Health, using a similar set of parent-reported survey questions.12 Prevalence rates for au- TA B LE 2 Pr ev al en ce of D ev el op m en ta lD is ab ili ti es in Ch ild re n Ag ed 3 to 17 Ye ar s, by Se le ct ed D em og ra ph ic an d So ci oe co no m ic Fa ct or s, N H IS ,1 99 7– 20 08

Co nd it io n

To ta l, %

Ag e, % ,y

R ac e an d Et hn ic it y, %

G en de r, %

M at er na lE du ca ti on ,%

Po ve rt y Le ve l,%

H ea lt h In su ra nc e Co ve ra ge ,%

3– 10

11 – 17

N on -H is pa ni c

W hi te

N on -H is pa ni c

B la ck

H is pa ni c B oy s G ir ls

Le ss Th an

H ig h Sc ho ol H ig h Sc ho ol /

So m e

Co lle ge

Co lle ge

G ra du at e

or H ig he r

� 20 0%

� 20 0%

Pr iv at e M ed ic ai d

or CH IP

U ni ns ur ed

An y de ve lo pm en ta ld is ab ili ty 13 .8 7 11 .7 8 16 .2 4c

14 .9 9

14 .7 7

10 .6 5d ,e 18 .0 4c

9. 50

13 .8 9

14 .7 8

10 .8 8g ,h

16 .0 8

12 .4 2j

12 .1 0

20 .2 8k

11 .6 1

AD H D

6. 69

4. 72

8. 93 c

7. 82

6. 30

3. 87 d ,e

9. 51 c 3. 73

5. 46

7. 26 i

5. 35

7. 20

6. 36

6. 01

9. 55 k

4. 97 l

Au ti sm

0. 47

0. 56

0. 37

0. 52

0. 41

0. 32

0. 74 c 0. 19

0. 25

0. 50

0. 61

0. 44

0. 49

0. 45

0. 67

0. 19

B lin d/ un ab le to se e at al l

0. 13

0. 10

0. 16

0. 12

0. 13

0. 15

0. 16

0. 10

0. 16

0. 13

0. 07

0. 16

0. 11

0. 10

0. 17

0. 17

Ce re br al pa ls ya

0. 39

0. 36

0. 37

0. 39

0. 36

0. 33

0. 36

0. 37

0. 33

0. 35

0. 42

0. 41

0. 34

0. 61

0. 60

0. 33

M od er at e to pr of ou nd

he ar in g lo ss

0. 45

0. 44

0. 46

0. 51

0. 41

0. 32

0. 54

0. 35

0. 56

0. 50

0. 28

0. 64

0. 32

0. 34

0. 77

0. 44

Le ar ni ng di sa bi lit ie s

7. 66

5. 07

9. 27 c

7. 58

7. 62

5. 50 d ,e

8. 97 c 5. 01

8. 06

7. 50

4. 85 g ,h

8. 57

6. 03 j

5. 94

10 .8 7k

6. 16 l

In te lle ct ua ld is ab ili ti es b

0. 71

0. 59

0. 84

0. 62

1. 06

0. 70

0. 78

0. 63

0. 93

0. 70

0. 48

1. 03

0. 50 j

0. 44

1. 68 k

0. 38 l

Se iz ur es in th e pa st 12

m on th s

0. 67

0. 72

0. 61

0. 66

0. 91

0. 61

0. 73

0. 62

0. 73

0. 75

0. 45

0. 91

0. 52

0. 49

1. 31 k

0. 46 l

St ut te re d or st am m er ed in

th e pa st 12 m on th s

1. 60

1. 99

1. 15 c

1. 27

2. 63 f

1. 96

2. 25 a 0. 91

2. 57

1. 59

0. 96 g ,h

2. 40

1. 07 j

1. 08

3. 09 k

1. 64 l

O th er de ve lo pm en ta ld el ay

3. 65

3. 86

3. 41

3. 97

3. 62

2. 64 d

4. 64 c 2. 61

3. 19

3. 91

3. 32

4. 39

3. 16 j

3. 03

6. 06 k

2. 42 l

a W e ex cl ud ed ce re br al pa ls y fr om th e an al ys is fo r 20 04 – 20 07 be ca us e of th e hi gh lik el ih oo d of in te rv ie w er er ro r ar is in g fr om a qu es ti on na ir e ch an ge in 20 04 .

b Th e su rv ey qu es ti on as ke d ab ou t m en ta lr et ar da ti on ,b ut w e re fe r to th e co nd it io n as in te lle ct ua ld is ab ili ty .

c P

� .0 5, ag es 3– 10 vs 11 – 17 ye ar s.

d P

� .0 5, no n- H is pa ni c w hi te ve rs us H is pa ni c.

e P

� .0 5, no n- H is pa ni c bl ac k ve rs us H is pa ni c.

f P

� .0 5, no n- H is pa ni c w hi te ve rs us no n- H is pa ni c bl ac k.

g P

� .0 5, le ss th an hi gh sc ho ol ve rs us co lle ge gr ad ua te .

h P

� .0 5, hi gh sc ho ol ve rs us co lle ge gr ad ua te .

i P

� .0 5, le ss th an hi gh sc ho ol ve rs us hi gh sc ho ol gr ad ua te .

j P

� .0 5,

� 20 0% ve rs us

� 20 0% po ve rt y le ve l.

k P

� .0 5, pr iv at e in su ra nc e ve rs us M ed ic ai d.

l P

� .0 5, M ed ic ai d ve rs us un in su re d.

ARTICLES

PEDIATRICS Volume127, Number 6, June 2011 1037 by guest on June 15, 2015pediatrics.aappublications.orgDownloaded from

tism,cerebralpalsy,seizures,blindness, and stuttering or stammering are com- parable with those from several population-basedprevalencestudiesus- ing varied study methods.13–18 This is particularly relevant for seizures, where the nomenclature, as en- dorsed by the International League Against Epilepsy, for recurrent sei- zures is epilepsy and not seizures or seizure disorder.18 The prevalence of moderate to profound hearing loss was considerably higher, whereas theprevalenceof intellectualdisabil- ities was �50% lower than findings from a population-based surveil- lance program that requires audi- tory test results formoderate topro- foundhearing lossandcognitive test results for intellectual disabilities.17

A number of factors may have influ- enced these discordant findings, in- cluding amore restrictive case defi- nition in the records-based surveillance program for moderate to profound hearing loss (ie, bilat- eral measured loss of 40 dB or greater) than that used in the NHIS analysis. In the case of intellectual disabilities, and particularly mild in- tellectual disabilities, because test- ing often is done in the context of educationalplacement, theparentor

guardian may never have been told that their child’s test results sug- gested functioning in the intellectual disabilitiesrange.Also,since1997, fed- eral lawhasallowedforstateandlocal education agencies to extend the use of the less-specific “developmental de- lay” category up to 9 years of age, en- abling many children to not require a more specific education classifica- tion, such as intellectual disability.19

Someof thesechildrenmayhavebeen identified in the NHIS by the question “other developmental delay,” as sug- gested by the high and increasing prevalence for this category.20 Al- though it is not clear what specific functional problems children with otherdevelopmental delayshave, Bou- let et al2 showed that 76% have a co- occurring developmental disability andthat learningdisabilitiesandADHD were the most frequent co-occurring conditions.

The 17% increase in all developmental disabilities over the 12 years was caused in large part by shifts in the prevalence of ADHD and autism. In- creases in autism during the mid- 1990s to late 1990s and continuing through the late 2000s have been noted in a number of studies14,19,21–23

usingvaryingdefinitionsofautismand study designs, ranging from adminis- trativeeducationalandservicesystem data to retrospective studies of suc- cessive birth cohorts of children. Al- thoughdataontrendsinADHDareless available, they support a similar in- crease.23,24 A Danish study23 reported that trends in the birth cohort prev- alence of several neuropsychiatric disorders, including autism and hy- perkinetic disorder (International Classification of Diseases 10 Revi- sion classification that is closely aligned with the hyperactivity com- ponent of ADHD) increased signifi- cantly for children born in 1990 through 1999. A US-based study24 re- ported significant increases in the prevalence of office-based visits for ADHD during 1991–1998. Finally, an upward trend in prevalence, using US education data, was found for the “otherhealth impaired”educationcat- egory,which, since 1991, is the educa- tion category used for children with ADHD.19,25 Decreases in the prevalence ofmoderate to profound hearing loss over the 12-year period have not been reported previously. Trend data from service records over a shorter time frameshowed little tonochange.17Na- tionally, the number of infants identi-

TABLE3 Trends in Prevalence of SpecificDevelopmental Disabilities in Children Aged 3 to 17 Years, NHIS, 1997–2008

Disability n (Unweighted)

All Years,% 1997–1999,% 2000–2002,% 2003–2005,% 2006–2008,% Percent Change 1997–1999 versus 2006–2008c

Any developmental disability 15956 13.87 12.84 13.70 13.88 15.04 17.1d

ADHD 7652 6.69 5.69 6.71 6.77 7.57 33.0d

Autism 537 0.47 0.19 0.35 0.59 0.74 289.5d

Blind/unable to see at all 160 0.13 0.11 0.15 0.12 0.13 18.2 Cerebral palsy 305 0.39 0.39 0.43 b b b

Moderate to profoundhearing loss 533 0.45 0.55 0.44 0.42 0.38 30.9 Learningdisability 8154 7.04 6.86 7.24 6.82 7.24 5.5 Intellectual disabilitya 868 0.71 0.68 0.73 0.75 0.67 �1.5 Seizures, past 12months 792 0.67 0.66 0.65 0.66 0.72 9.1 Stuttered or stammered, past 12months 1924 1.60 1.63 1.40 1.69 1.68 3.1 Other developmental delay 3978 3.65 3.40 3.28 3.67 4.24 24.7d

Source: Centers for DiseaseControl andPrevention, National Center for Health Statistics, NHIS. aSurvey question askedaboutmental retardation, butwe refer to the condition as intellectual disability. bWe excluded cerebral palsy from the analysis for 2004–2007because of the high likelihoodof interviewer error arising fromaquestionnaire change in 2004. cPercent changebetween 1997–1999 and2006–2008. d Test of linear trendover 4 timeperiods,P � .05.

1038 BOYLE et al by guest on June 15, 2015pediatrics.aappublications.orgDownloaded from

fied with congenital moderate to pro- found hearing loss from state newborn-screening programs has in- creased dramatically with the expan- sionofuniversalscreening26;however, it is unlikely that this program would have impacted the prevalence for this survey. The lower prevalence of mod- erate to profound hearing loss from the NHIS was limited to 2006–2008; in 2008, therewas amodification in the moderate to profound hearing loss categories, which makes it difficult to determine whether this lower trend continues. More data are needed to better understand this finding.

Factors responsible for increases in autismandADHDarenumerous. Avail- ability of services and in how the ser- vicesystemclassifieschildrenwithbe- havioral disorders has progressed as welearnmoreabouttheadvantagesof earlier interventions. Improvements in clinical,parental,andsocietalrecogni- tion of and screening for these disor- ders have occurred. For example, we have national campaigns to increase awareness of autism,27 and the American Academy of Pediatrics has incorporated ongoing monitoring of a child’s development as a practice recommendation forpediatricians in 2007.28 Another contributing factor maybetheefficacyofmedicationsand behavioral treatments for ADHD.29

Therealsohasbeenan increase in the prevalenceofknownprenatal risk fac- tors for these conditions. Examples in- clude increases in the prevalence of preterm birth and the recognition of the full range of potential adverse developmental consequences of late preterm birth,4,5 shifts toward older parental age, and increases in the prevalence of assisted reproductive technologies and possibly other hor- monal infertility treatments and the consequent increase in multiple births, each of which is associated TA B LE 4 Pr ev al en ce of AD H D ,A ut is m ,a nd M od er at e to Pr of ou nd H ea ri ng Lo ss in Ch ild re n Ag es 3 to 17 ye ar s, by Se le ct Ch ar ac te ri st ic s an d Ti m e Pe ri od ,N H IS ,1 99 7– 20 08

Ch ar ac te ri st ic s

AD H D ,%

Pe rc en ta ge

Ch an ge

19 97 – 19 99

ve rs us

20 06 – 20 08

Au ti sm ,%

Pe rc en ta ge

ch an ge

19 97 – 19 99

ve rs us

20 06 – 20 08

M od er at e to Pr of ou nd H ea ri ng Lo ss ,%

Pe rc en ta ge

Ch an ge

19 97 – 19 99

ve rs us

20 06 – 20 08

19 97 – 19 99 20 00 – 20 02 20 03 – 20 05 20 06 – 20 08

19 97 – 19 99 20 00 – 20 02 20 03 – 20 05 20 06 – 20 08

19 97 – 19 99 20 00 – 20 02 20 03 – 20 05 20 06 – 20 08

Ag e, y 3– 10

4. 16

4. 80

4. 74

5. 19

24 .8

0. 27

0. 40

0. 72

0. 87

22 2. 2

0. 54

0. 43

0. 45

0. 34

� 37 .0 4

11 – 17

7. 51

8. 90

8. 98

10 .2 4

36 .4

0. 11

0. 31

0. 45

0. 59

43 6. 4

0. 57

0. 46

0. 37

0. 43

� 24 .5 6

G en de r

M al e

8. 43

9. 55

9. 44

10 .5 9

25 .6

0. 31

0. 58

0. 94

1. 12

26 1. 3

0. 65

0. 57

0. 52

0. 42

� 35 .3 8

Fe m al e

2. 83

3. 73

3. 96

4. 39

55 .1

0. 07

0. 11

0. 22

0. 34

38 5. 7

0. 45

0. 31

0. 30

0. 35

� 22 .2 2

R ac e/ et hn ic it y

N on H is pa ni c w hi te

6. 74

7. 95

7. 80

8. 89

31 .9

0. 16

0. 36

0. 74

0. 88

45 0. 0a

0. 64

0. 45

0. 50

0. 44

� 31 .2 5

N on H is pa ni c bl ac k

4. 40

6. 08

6. 86

7. 81

77 .5

0. 33

0. 36

0. 51

0. 44

33 .3

0. 39

0. 49

0. 40

0. 35 c

� 10 .2 6

H is pa ni c

3. 13

3. 65

4. 10

4. 39

40 .3

0. 17

0. 25

0. 32

0. 47

17 6. 5a

0. 37

0. 40

0. 20

0. 32

� 13 .5 1

M ot he r’ s ed uc at io n:

Le ss th an hi gh sc ho ol

5. 08

5. 42

5. 89

5. 44

7. 1

0. 19

0. 16

0. 33

0. 33

73 .7

0. 68

0. 57

0. 47

0. 51

� 25 .0 0

H ig h sc ho ol /s om e

co lle ge

6. 07

7. 27

7. 33

8. 43

38 .9

0. 16

0. 37

0. 62

0. 85

43 1. 3

0. 62

0. 50

0. 49

0. 37

� 40 .3 2

Co lle ge or gr ea te r

4. 51

5. 47

5. 15

6. 09

35 .0

0. 27

0. 49

0. 73

0. 88

22 5. 9

0. 31

0. 24

0. 24 c

0. 32

3. 23

% of po ve rt y le ve l

� 20 0

6. 05

6. 98

7. 13

8. 54

41 .2

0. 22

0. 35

0. 48

0. 69

21 3. 6

0. 84

0. 71

0. 55

0. 47

� 44 .0 5

� 20 0%

5. 45

6. 55

6. 53

6. 89

26 .4

0. 17

0. 35

0. 65

0. 78

35 8. 8

0. 36

0. 28

0. 32

0. 32

� 11 .1 1

H ea lt h in su ra nc e

Pr iv at e

5. 23

6. 18

6. 25

6. 46

23 .5

0. 16

0. 31

0. 63

0. 73

35 6. 3

0. 41

0. 34

0. 31

0. 31

� 24 .3 9

M ed ic ai d or CH IP

8. 81

9. 40

8. 88

10 .6 4

20 .8

0. 36

0. 59

0. 59

0. 94

16 1. 1

1. 29

0. 86

0. 62

0. 55

� 57 .3 6

U ni ns ur ed

4. 33

5. 03

5. 50

5. 17

19 .4

b 0. 22 c

0. 26 c

0. 20 c

d 0. 44

0. 32 c

0. 61 c

0. 41 c

� 7. 3

a Te st of lin ea r tr en d ov er 4 ti m e pe ri od s, P

� .0 5.

b Es ti m at es w it h an SE of hi gh er th an 50 % ar e no t sh ow n.

c Es ti m at es ha ve a re la ti ve SE of m or e th an 30 % an d le ss th an or eq ua lt o 50 % an d sh ou ld be us ed w it h ca ut io n be ca us e th ey do no t m ee t th e st an da rd s of re lia bi lit y or pr ec is io n.

d N ot ca lc ul at ed be ca us e of im pr ec is e es ti m at es .

ARTICLES

PEDIATRICS Volume127, Number 6, June 2011 1039 by guest on June 15, 2015pediatrics.aappublications.orgDownloaded from

with adverse developmental out- comes.30 Finally, given that the shift in developmental disability prevalence over timeseems tobe focusedoncon- ditions thatarebasedonanemotional or behavioral phenotype, a societal shift in the acceptance and destigma- tization of such conditions in young children alsomayplay a role.31

Several of our findings regarding the descriptive characteristicsof children with developmental disabilities were noteworthy. Others studies have re- ported lowerprevalenceestimates for autism and ADHD in Hispanics,12,14,32,33

although findings from more recent studies suggest that the gapsmay be closing.13 Rather than these patterns reflecting true differences, they are more likely the result of languagebar- riers, lack of access to services, and health insurance coverage. The pre- dominanceofboyswithdevelopmental disabilities also was remarkable. Al- though the increased gender ratio for selected developmental disabilities is well described, this study showed the pattern present for nearly all develop- mental disabilities. Some of this is cer- tainlybiological,suchasX-linkedgenetic disorders that result in intellectual dis- abilitiesandotherfunctional limitations. Others have described a cultural fac- tor related to greater incentive for case finding in boys compared with girls.34 Alternatively, there may be gender-specific presentations of some of the disorders, particularly for condi- tionswithanexclusivelybehaviorpheno- type (ADHD and autism) that favor the identificationofboysovergirls.ADHDisa goodexample,inthatgirlstendtoexhibit less of the impulsivity associated with the disorder and therefore maybe be less likely tocometoclinicalattention.35

Regarding socioeconomic inequities, public health insurance coverage

seemed tobeassociatedwithahigher prevalence of developmental disabili- ties; lowfamilyincomeandlowmaternal education had similar but less signifi- cant impacts. Larson and Halfon36

showedasimilarinversesocioeconomic gradient with family income and the prevalenceofADHD,learningdisabilities, and speech problems but not autism. Some of the impact with public insur- ance is likely reflecting eligibility for Medicaid forchildrenwithdisabilities.

The strengths of the NHIS are impor- tant to highlight. The survey has a na- tionally representative sample that al- lows for generalizability to the US population of 3- to 17-year-old chil- dren. The same set of questions was asked of parents in each survey year. Asaconsequence, this istheonlystudy able to examine, in detail, trends in these disorders. The response rate for the NHIS remained at exemplary high levels over the 11 years, despite the challenges of door-to-door sur- veys, limitingourconcernsabout the bias resulting from selectivity and nonresponse.

Limitations also are important to con- sider. Parent report ofmedical condi- tions is not without error. Inaccurate reportingcanresult fromparentaldis- tress and the stigma associated with some of the conditions; the questions may be misunderstood or there may bevariations inprofessional terminol- ogy used for developmental disabili- ties; for example, autism can be re- ferred to by more broad or umbrella terms,suchasautismspectrumdisor- ders. Also, specific terms fall outofac- cepteduse(mental retardationversus intellectual disability and seizure dis- order versus epilepsy). A few stud- ies33,37,38 have examined the validity of parent report for selected develop- mental disabilities. Some, but not all,

of theconditionsseemtohavehighva- lidity(seeBouletetal2 formoredetail.) Ongoing survey research is needed to maintain the validity of the survey questions,whilebalancingthebenefits of historical information to compare overtime. Finally, although we as- sumed that many of these conditions are chronic, in fact, a condition may resolve to the point where parents or health care providers may no longer consider the child ashaving thedisor- der. Recent evidence13,39 of this was found for autism, and a longitudinal studyshowedconsiderablechanges in diagnoses over time for children with physical andemotional orbehaviordi- agnoses. Finally, some children in- cludedinthestutteringorstammering or seizures categories may have had transient conditions, resulting in an overestimation of the prevalence of these conditions.

CONCLUSIONS

We found that the number of children withdevelopmental disabilitieshas in- creased over the decade. These find- ingshaveadirect bearingon theneed for health, education, and social ser- vices, including theneed formorespe- cializedhealthservices (mentalhealth services, medical specialists, thera- pists, andalliedhealth professionals). Also, the consequent burden on fami- liesandcaregiverswillneedtobecon- sidered. Finally,moredetailedstudyof the influence of risk factor shifts, changes inacceptance,andbenefitsof early services isneeded tobetterun- derstand why these shifts have occurred.

ACKNOWLEDGMENTS The National Health Interview Study is supported by the Centers for Disease ControlandPrevention,Atlanta,Georgia.

1040 BOYLE et al by guest on June 15, 2015pediatrics.aappublications.orgDownloaded from

REFERENCES

1. Boyle CA, Decoufle P, Yeargin-Allsopp M. Prevalence and health impact of develop- mental disabilities in US children. Pediat- rics. 1994;93(3):399–403

2. Boulet SL, Boyle CA, Schieve LA. Health care useandhealthand functional impactofde- velopmental disabilities among US chil- dren,1997–2005.ArchPediatrAdolescMed. 2009;163(1):19–26

3. ShinM,BesserLM,KucikJE,LuC,SiffelC,Cor- rea A. Prevalence of Down syndrome among childrenandadultsin10regionsintheUnited States.Pediatrics. 2009;124(6):1565–1571

4. BouletSL,SchieveLA,BoyleCA.Birthweight andhealthanddevelopmental outcomes in US children, 1997–2005. Matern Child Health J. 2009[Epubaheadof print]

5. PetriniJR,DiasT,McCormickMC,MassoloML, Green NS, Escobar GJ. Increased risk of ad- verse neurological development for late pre- terminfants.JPediatr. 2009;154(2):169–176

6. BroscoJP,MattinglyM,SandersLM. Impact of specificmedical interventions on reduc- ing the prevalence of mental retardation. Arch Pediatr Adolesc Med. 2006;160(3): 302–309

7. WilckenB,HaasM,JoyP,etal.Expandednew- bornscreening:outcomeinscreenedandun- screenedpatients at age 6 years.Pediatrics. 2009;124(2).Availableat:www.pediatrics.org/ cgi/content/full/124/2/e241

8. National Center for Health Statistics, National Health Interview Survey. About the National Health Interview Survey [ar- ticle online], 2009. Available at: www.cdc. gov/nchs/nhis/about_nhis.htm#sample_ design Accessed April 22, 2011

9. National Center for Health Statistics. Na- tionalHealth InterviewSurvey: researchfor the 1995–2004 redesign. Vital Health Stat. 1999;(126):1–119

10. Schalock RL, Luckasson RA, Shogren KA. Perspectives: the renaming of mental retardation: understanding the change to the term intellectual disability. Intellectual DevDisabilities. 2007;45(2):116–124

11. Schenker N, Raghunathan TE, Chiu PL, MakucD, ZhangG, CohenAJ.Multiple impu- tation of family income and personal earn- ings intheNationalHealth InterviewSurvey: methods and examples [article online], 2009. National Center for Health Statistics, Atlanta, GA. Available at: www.cdc.gov/ nchs/data/nhis/tecdoc3.pdf Accessed April 22, 2011

12. Centers forDiseaseControlandPrevention. Increasing prevalence of parent-reported attention-deficit/hyperactivity disorder

among children: United States, 2003–2007. MMWR 2010;59(44):1439–1443

13. Kogan MD, Blumberg SJ, Schieve LA, et al. The prevalence of parent-reported diagno- sis of autism spectrum disorder among children in the United States, 2007. Pediat- rics. 2009;124(5):1395–1403

14. Autism and Other Developmental Disabili- tiesMonitoring Network. Prevalence of au- tismspectrumdisorders:AutismandDevel- opmental Disabilities Monitoring Network, UnitedStates, 2006.MMWR. 2009;58(SS-10): 2–21

15. Yeargin-Allsopp M, Van Naarden-Braun K, DoernbergN, Benedict R, KirbyR, DurkinM. Prevalence of cerebral palsy in 8-year-old children in threeareasof theUnitedStates in 2002: a multisite collaboration. Pediat- rics. 2008;121(3):547–554

16. MurphyCC, TrevathanE, Yeargin-AllsoppM. Prevalence of epilepsy and epileptic sei- zures in 10-year-old children: results from the Metropolitan Atlanta Developmental Disabilities Study. Epilepsia. 1995;36(9): 866–872

17. Karapurkar-Bhasin, T, Brocksen S, Avchen RN, Van Naarden-Braun K. Prevalence of fourdevelopmental disabilitiesamongchil- dren age 8 years: Metropolitan Atlanta De- velopmental Disabilities Surveillance Pro- gram, 1996 and 2000. MMWR. 2006; 55(SS01):1–9

18. International League Against Epilepsy. Re- vised terminology and concepts for organi- zation of the epilepsies: report of the Com- mission on Classification and Terminology [article online], 2009. Available at: www.ilae-epilepsy.org/visitors/centre/ctf/ ctfoverview.cfmAccessedApril 22, 2011

19. Newschaffer CJ, Falb, MD, Gurney JG. Na- tional autism prevalence trends from United States special education data. Pedi- atrics. 115(3). www.pediatrics.org/cgi/ content/full/115/3/e277

20. Larson SA, Lakin KC, Doljanac D. (2005). Problems indefiningmental retardation and developmental disability: using the National Health InterviewSurvey [articleonline], 2005. Vol 7, No 1. DD Data Brief, University of Minnesota-Minneapolis, Institute on Commu- nity Integration. Available at: http://rtc.umn. edu/docs/dddb7-1.pdf. Accessed April 22, 2011

21. Gurney JG, Fritz MS, Ness KK, Sievers P, Newschaffer CJ, Shapiro EG. Analysis of prevalence trends of autism spectrumdis- order in Minnesota. Arch Pediatr Adolesc Med. 2003;157(7):622–627

22. Schechter R, Grether JK. Continuing in-

creases in autism reported to California’s developmental servicessystem:Mercury in retrograde. Arch Gen Psychiatry. 2008; 65(1):15–16

23. Atladóttir HO, Parner ET, Schendel D, Dals- gaardS,ThomsenPH,ThorsenP.Timetrends in reported diagnoses of childhood neu- ropsychiatric disorders. Arch Pediatr AdolescMed. 2007;161(2):193–198

24. RobinsonLM,SkaerTL,SclarDA,GalinRS. Is attention deficit hyperactivity disorder in- creasingamonggirls in theUS?CNSDrugs. 2002;16(2):129–137

25. US Department of Education, Office of Spe- cial Education Programs. Clarification of policy toaddress theneedsofchildrenwith ADD within general and/or special educa- tion [article online], 1999. Available at: www.ed.gov/policy/speced/leg/idea/brief6. html?esp�0. AccessedApril 22, 2011

26. GaffneyM,EichwaldJ,GrosseSD,MasonCA. Identifying infantswithhearing loss:United States, 1999–2007. MMWR. 2010;59(8): 220–223

27. Daniel KL, Prue C, Taylor MK, Thomas J, ScalesM. ‘LearntheSigns.ActEarly: ’acam- paign to help every child reach his or her full potential. Public Health Reports. 2009; 123 (Suppl 1):e11–e16

28. American Academy of Pediatrics Council on Children with Disabilities. Identifying infants and young children with develop- mental disorders in themedical home: an algorithm fordevelopmental surveillance and screening. Pediatrics. 2006;118(1): 405–420

29. MTACooperativeGroup.National Institute of Mental Health multimodal treatment study of ADHD: 24-month outcomes of treatment strategies for attention- deficit/hyperactivity disorder. Pediatrics. 2004;113(4):754–761

30. SchieveLA,DevineO,BoyleCA,PetriniJR,War- ner L. Estimation of the contribution of non- assisted reproductive technology ovulation stimulation fertility treatments in US single- tonandmultiplebirths.AmJEpidemiol. 2009; 170(11):1396–1407Dec1

31. Grinker RR, Yeargin-Allsopp M, Boyle C. Culture and autism spectrum disorders: the impact on prevalence and recogni- tion. In: Amaral D, Geschwin D, Dawson G, Eds. Autism Spectrum Disorders. New York,NY:OxfordUniversityPress, Inpress

32. FroehlichTE, LanphearBP, EpsteinJN,Barba- resiWJ, KatusicSK, KahnRS.Prevalence, rec- ognition, and treatment of attention-deficit/ hyperactivity disorder. Arch Pediatr Adolesc Med. 2007;161(9):857–864

ARTICLES

PEDIATRICS Volume127, Number 6, June 2011 1041 by guest on June 15, 2015pediatrics.aappublications.orgDownloaded from

33. SchieveLA,RiceC,BoyleC,VisserSN.Mental health in theUnitedStates: parental report of diagnosed autism in children aged 4–17 years: United States, 2003–2004. MMWR. 2006;55(17):481–486

34. Rowland AS, Lesesne CA, Abramowitz AJ. The epidemiology of attention-deficity/ hyperactivity disorder (ADHD): a public health view. Ment Retard Dev Disabil Res Rev. 2002;8(3):162–70

35. deHaas PA. Attention styles and peer rela- tionships of hyperactive and normal boys and girls. J Abnorm Child Psychol. 1986; 14(3):457–467

36. LarsonK,HalfonN.Family incomegradients in the health and health care access of US children.MaternChildHealthJ. 2010;14(3): 332–342

37. Ackland MJ, Wade RQ. Health status of Victorian special school children.

J Paediatr Child Health. 1995;31(5): 423–427

38. MillerJE,GabodaD,DavisD.Earlychildhood illness: comparability of maternal reports and medical records. Vital Health Stat 2. 2001;(131):1–10

39. Van Cleave J, Gortmaker SL, Perrin JM. Dy- namic of obesity and chronic health condi- tions among children and youth. JAMA. 2010;303(7):623–630

(Continued fromfirst page)

PEDIATRICS (ISSNNumbers: Print, 0031-4005; Online, 1098-4275).

Copyright©2011by the American Academyof Pediatrics

FINANCIALDISCLOSURE: Theauthors have indicated that they have nopersonal financial relationships relevant to this article to disclose.

1042 BOYLE et al by guest on June 15, 2015pediatrics.aappublications.orgDownloaded from

DOI: 10.1542/peds.2010-2989 ; originally published online May 23, 2011; 2011;127;1034Pediatrics

Blumberg, Marshalyn Yeargin-Allsopp, Susanna Visser and Michael D. Kogan Coleen A. Boyle, Sheree Boulet, Laura A. Schieve, Robin A. Cohen, Stephen J.

2008 −Trends in the Prevalence of Developmental Disabilities in US Children, 1997

Services Updated Information &

tml http://pediatrics.aappublications.org/content/127/6/1034.full.h including high resolution figures, can be found at:

References

tml#ref-list-1 http://pediatrics.aappublications.org/content/127/6/1034.full.h at: This article cites 28 articles, 7 of which can be accessed free

Citations

tml#related-urls http://pediatrics.aappublications.org/content/127/6/1034.full.h This article has been cited by 53 HighWire-hosted articles:

Subspecialty Collections

nt:behavioral_issues_sub http://pediatrics.aappublications.org/cgi/collection/developme Developmental/Behavioral Issues the following collection(s): This article, along with others on similar topics, appears in

Permissions & Licensing

ml http://pediatrics.aappublications.org/site/misc/Permissions.xht tables) or in its entirety can be found online at: Information about reproducing this article in parts (figures,

Reprints http://pediatrics.aappublications.org/site/misc/reprints.xhtml

Information about ordering reprints can be found online:

rights reserved. Print ISSN: 0031-4005. Online ISSN: 1098-4275. Grove Village, Illinois, 60007. Copyright © 2011 by the American Academy of Pediatrics. All and trademarked by the American Academy of Pediatrics, 141 Northwest Point Boulevard, Elk publication, it has been published continuously since 1948. PEDIATRICS is owned, published, PEDIATRICS is the official journal of the American Academy of Pediatrics. A monthly

by guest on June 15, 2015pediatrics.aappublications.orgDownloaded from

DOI: 10.1542/peds.2010-2989 ; originally published online May 23, 2011; 2011;127;1034Pediatrics

Blumberg, Marshalyn Yeargin-Allsopp, Susanna Visser and Michael D. Kogan Coleen A. Boyle, Sheree Boulet, Laura A. Schieve, Robin A. Cohen, Stephen J.

2008 −Trends in the Prevalence of Developmental Disabilities in US Children, 1997

http://pediatrics.aappublications.org/content/127/6/1034.full.html

located on the World Wide Web at: The online version of this article, along with updated information and services, is

of Pediatrics. All rights reserved. Print ISSN: 0031-4005. Online ISSN: 1098-4275. Boulevard, Elk Grove Village, Illinois, 60007. Copyright © 2011 by the American Academy published, and trademarked by the American Academy of Pediatrics, 141 Northwest Point publication, it has been published continuously since 1948. PEDIATRICS is owned, PEDIATRICS is the official journal of the American Academy of Pediatrics. A monthly

by guest on June 15, 2015pediatrics.aappublications.orgDownloaded from

  • Trends in the Prevalence of Developmental Disabilities in US Children, 1997–2008
    • PARTICIPANTS AND METHODS
    • RESULTS
      • Prevalence and Demographic Characteristics
      • Time Trends
    • DISCUSSION
    • CONCLUSIONS
    • ACKNOWLEDGMENTS
    • REFERENCES