PPLR
Copyright © The British Psychological Society Reproduction in any form (including the internet) is prohibited without prior permission from the Society
Low specificity of symptoms on the post-traumatic stress disorder (PTSD) symptom scale: A comparison of individuals with PTSD, individuals with other anxiety disorders and individuals without psychopathology
Iris M. Engelhard1*, Arnoud Arntz2 and Marcel A. van den Hout1 1Clinical and Health Psychology, Utrecht University, Utrecht, The Netherlands 2Department of Medical, Clinical and Experimental Psychology, Maastricht University, Maastricht, The Netherlands
Objectives. Screening for post-traumatic stress disorder (PTSD) takes place in clinical and research settings where diagnostic interviews are not feasible, and typically relies on self-report instruments like the PTSD symptom scale (PSS). Concerns have been raised about the specificity of PTSD symptoms assessed by questionnaires. This study examined whether the PSS distinguishes between patients with PTSD and those with other anxiety disorders or healthy controls.
Design. A between-participants design was employed.
Methods. The participants were 65 individuals with PTSD, 40 individuals with other anxiety disorders and 40 healthy controls. They completed the PSS with respect to a range of stressful life-events.
Results. Using this instrument, 86% of individuals with PTSD and 5% of healthy controls endorsed sufficient symptoms to meet the PTSD diagnosis. This was also the case for 43% of individuals with other anxiety disorders, and self-reported symptoms related to traumatic events and aversive events that are generally not considered traumatic.
Conclusions. The findings suggest that many people screened positive for PTSD may actually be suffering from another anxiety disorder.
Post-traumatic stress disorder (PTSD) was established as a psychiatric diagnosis in the
DSM-III (American Psychiatric Association, 1980) and defined as a characteristic
symptom pattern following exposure to a traumatic event. This includes persistently
* Correspondence should be addressed to Iris M. Engelhard, Clinical and Health Psychology, Utrecht University, PO Box 80140, 3508 TC Utrecht, The Netherlands (e-mail: [email protected]).
The British Psychological Society
449
British Journal of Clinical Psychology (2007), 46, 449–456
q 2007 The British Psychological Society
www.bpsjournals.co.uk
DOI:10.1348/014466507X206883
Copyright © The British Psychological Society Reproduction in any form (including the internet) is prohibited without prior permission from the Society
re-experiencing the event, avoidance of its reminders and numbing, and hyperarousal
(American Psychiatric Association, 1994). The establishment of PTSD has brought about
an outburst of research and clinical work, but there has been much debate about the
validity of the diagnosis. There are at least two main concerns: that traumatic stressors
do not form a unique class with their own distinctive effects (e.g. Bowman, 1999;
McNally, 2003; Scott & Stradling, 1994; Yehuda & McFarlane, 1995) and that PTSD is not clearly distinct from existing disorders (e.g. Brewin, 2003) or normal trauma-related
reactions (Summerfield, 2001).
PTSD as a condition or psychiatric syndrome is unique in that it is thought to result
from a particular kind of event, which is defined in the DSM-IV as ‘actual or threatened
death or serious injury, or a threat to the physical integrity of self and others’, which
evokes ‘intense fear, horror, or helplessness’ (p. 429). However, the risk of depression
and other anxiety disorders is also increased after such events (e.g. Breslau, 1998; Shalev
et al., 1998), and several studies have reported that substantial PTSD symptoms can also arise from relatively minor (ordinary) stressors, such as problems with work, finances
and relationships (e.g. Mol et al., 2005; Scott & Stradling, 1994; Solomon & Canino,
1990). Furthermore, several PTSD symptoms overlap with other anxiety disorders and
depression (McNally, 1992). Involuntary intrusive memories are often considered its
hallmark symptoms (e.g. Jones & Barlow, 1990), but these also occur in panic disorder
(Rainey, Aleem, Ortiz et al., 1987), social phobia (Hackmann, Clark, & McManus, 2000)
and depression (Reynolds & Brewin, 1999).
In clinical or research settings, self-report PTSD instruments, like the PTSD symptom scale (PSS; Foa, Riggs, Dancu, & Rothbaum, 1993), may be used for rapid screening by
deciding whether or not participants meet symptom criteria for PTSD (see e.g. Brewin,
Andrews, & Rose, 2000; Ehlers, Mayou, & Bryant, 1998; Engelhard, van den Hout,
Arntz, & McNally, 2002; Hoge, Castro, Messer et al., 2004; Schlenger, Caddell, Ebert
et al., 2002). It is relevant to know whether a self-report measure of PTSD symptoms,
like the PSS, distinguishes between patients with PTSD and those with other anxiety
disorders. The prevalence of all other anxiety disorders is more than twice that of PTSD.
If other anxiety patients also commonly report symptoms on PTSD instruments, this could imply that many individuals screened positive for PTSD in population research are
actually suffering from another anxiety disorder.
The aim of this study was to assess the specificity of self-rated PTSD symptoms on the
PSS in a sample of PTSD patients, other anxiety disorder patients and individuals without
psychopathology. The groups were matched on background factors that are related to
the presence of anxiety disorders (i.e. age, sex and socio-economic factors; see Kessler
et al., 1994). We tested whether self-rated PTSD symptoms were common among
patients with PTSD and equally uncommon among patients with other anxiety disorders and healthy controls.
Method
Participants The participants were 65 individuals with PTSD (40 women; 63%), 40 had other anxiety
disorders (24 women; 60%) and 40 were healthy controls (24 women; 60%). Current
comorbid axis I diagnoses, diagnosed by means of the structured clinical interview for
axis I DSM-IV disorders (SCID-I; First, Spitzer, & Williams, 1997), in the PTSD group
included 9 major depression, 3 dysthymia, 10 panic disorder, 5 social phobia, 3
450 Iris M. Engelhard et al.
Copyright © The British Psychological Society Reproduction in any form (including the internet) is prohibited without prior permission from the Society
obsessive–compulsive disorder, 1 generalized anxiety disorder, 9 specific phobia and 2
hypochondriasis (some PTSD participants had more than one comorbid disorder). The
primary diagnoses of patients with other anxiety disorders were 21 panic disorder, 10
social phobia, 6 obsessive–compulsive disorder, 2 generalized anxiety disorder and 1
specific phobia. None of them had comorbid PTSD, and none of the healthy controls
exhibited a SCID-I diagnosis. The mean age was 34 (SD ¼ 11). Most participants were married or cohabiting, 19% were single and 10% were divorced. Almost half was college
educated. About one-third was employed, one-third was unemployed and the others
were student or homemaker. These factors were not significantly different between the
groups (smallest p ¼ :07, for education). The mean period of pre-treatment complaints was 4 years (SD ¼ 8) for PTSD patients and 7.1 years (SD ¼ 8:7) for patients with other anxiety disorders.
Procedure and measures Patients admitted for treatment to the Anxiety Disorders Program of the Community
Mental Health Centre of Maastricht, which is affiliated with Maastricht University, were
administered the SCID-I by a licensed psychologist with extensive diagnostic
experience. They received verbal and written information about the study and were
invited to participate. After giving written informed consent, they completed the PSS-
self-report version (Foa et al., 1993), State-Trait Anxiety Inventory (STAI; Spielberger, 1983), Symptom Checklist-90 (SCL-90; Derogatis, 1977) and Fear Questionnaire
(FQ; Marks & Mathews, 1979). The healthy controls were recruited from the community
with advertisements seeking healthy persons for a study of questionnaires. They
received verbal and written information about the study. After giving written informed
consent, they were administered the SCID-I by a licensed psychologist and the
questionnaires, except the SCL-90. An Institutional Review Panel approved this study.
The PTSD group rated the PSS with respect to their most traumatic event, which was
consistent with the SCID-I-PTSD module. Participants without PTSD were asked to identify their most bothersome, aversive life-event, and to rate the PSS with respect to
this event. Respondents rated how much each symptom had bothered them in the past
month, using a four-point scale (0, not at all; 3, almost always). Self-rated symptoms
based on the PSS agreed with the PTSD module of the SCID-I (First et al., 1997) for
62–90% of victims with PTSD and 84–100% of victims without PTSD (Foa et al., 1993;
Wohlfarth, van den Brink, Winkel, & ter Smitten, 2003). The PTSD diagnosis was
calculated according to the DSM-IV symptom criteria. Foa et al. (1993, 1997) scored a
symptom as present if it was rated at least 1 (‘once in a while’), but some researchers (e.g. Brewin et al., 2000; Engelhard et al., 2002) used a more conservative scoring rule of
at least 2 (‘half the time’). In this study, both scoring rules were used. Cronbach’s alpha
was 0.85 for the PTSD group and 0.95 for all groups. Subscale coefficients for re-
experiencing, avoidance and hyperarousal were 0.85, 0.73 and 0.76, respectively, for
the PTSD group, and 0.92, 0.88 and 0.86, respectively, for all groups.
Results
Traumatic events reported by the PTSD group were physical (N ¼ 22) or sexual assault (N ¼ 18), accident (N ¼ 14), witnessing violence or death (N ¼ 4), war (N ¼ 2) and other (N ¼ 5; i.e. almost choking on food, catching fire from fondue, being briefly jailed
Specificity of symptoms on the PSS 451
Copyright © The British Psychological Society Reproduction in any form (including the internet) is prohibited without prior permission from the Society
on an alleged child sexual abuse charge, death of a child and neonatal death). The most
aversive events reported by other anxiety patients were death of loved one (N ¼ 8), witnessing or experiencing violence (N ¼ 5), somatic illness of self or loved one (N ¼ 5), car crash (N ¼ 2), ‘hyperventilation’, panic attack and change in medication (N ¼ 6), aversive social event (N ¼ 3) and other (N ¼ 11; i.e. rape, parents arguing, maggots being thrown at as child by other child, partner’s infidelity, own infidelity, being
bullied, being fired, being overworked, doubts about sexual orientation due to same-sex
childhood sexual experience, being told by relative to be a bad mother and witnessing a
child almost getting hurt on a conveyer belt). The most aversive events reported by
healthy controls were death of loved one (N ¼ 15), accident of self or loved one (N ¼ 8), breakup or divorce (N ¼ 5), somatic illness of loved one (N ¼ 4), undisclosed (N ¼ 1) and other (N ¼ 7; i.e. being at pool during thunderstorm as child, being caught lying as child, briefly losing sight of daughter during family trip, financial problems of
mother, being suspended from High School, being sent to boarding school as teenager
and not becoming a professional soccer player).
Table 1 shows the means (SD) of the psychometric measures. As expected, the groups
with PTSD or other anxiety disorders scored significantly higher on the STAI and FQ than
the healthy controls. For the latter group, the STAI and FQ scores fell in the normal range (Spielberger, 1983; Gillis, Haaga, & Ford, 1995). Compared with the patients with other
anxiety disorders, the PTSD group scored significantly higher on the PSS (subscales).
Contrary to what was hypothesized, the group with other anxiety disorders scored higher
on the PSS (subscales) compared with the healthy controls.
Next, we tested whether the high PSS scores in the group with other anxiety
disorders could be attributed to Criterion A traumatic events (including death of loved
one and panic attack). However, there were no significant differences on the PSS scores
between 20 patients who met Criterion A events [M ¼ 11:9, SD ¼ 9:9] and 20 who did not [M ¼ 17:2, SD ¼ 10:6; Fð1; 38Þ ¼ 2:6, ns]. The difference was in the opposite direction to what would be expected if Criterion A events were related to PTSD
symptoms.
Table 1. Means (standard deviations in parentheses)
Group
Measures PTSD Other anxiety disorders Healthy F
PSS 27.0 (10.8)a 14.1 (10.4)b 2.5 (3.7)c 89.0* Re-experiencing 8.0 (3.9)a 3.5 (3.6)b 0.6 (1.5)c 66.4* Avoidance 10.6 (4.9)a 5.4 (5.0)b 0.6 (1.6)c 68.2* Arousal 8.4 (3.7)a 5.1 (3.1)b 1.4 (1.4)c 68.0* STAI-trait scale 54.3 (12.6)a 52.6 (10.2)a 31.7 (9.3)b 56.6* STAI-state scale 53.6 (13.9)a 47.6 (12.9)a 29.4 (8.4)b 48.5* SCL-90 1.5 (0.8)a 1.2 (0.6)a 1.5 FQ fear 38.2 (21.2)a 44.6 (20.6)a 17.1 (7.1)b 25.6* FQ avoidance 41.5 (24.1)a 42.4 (22.7)a 14.5 (10.3)b 25.1*
Note. Possible ranges of scores were PSS, 0–51; STAI-state/trait, 20–80; SCL-90 global severity index, 0–4; FQ fear/avoidance, 0–120. Means with different subscripts differ significantly at p , :05 in the multiple comparison.
*p , :05.
452 Iris M. Engelhard et al.
Copyright © The British Psychological Society Reproduction in any form (including the internet) is prohibited without prior permission from the Society
Table 2 shows a comparison of DSM-IV PTSD-diagnoses made using the PSS with the
SCID-I. Using the conservative scoring rule and comparing the individuals with PTSD
with individuals with other anxiety disorders, the sensitivity was 0.48 (proportion of
true positives), specificity was 0.8 (proportion of true negatives), positive predictive
value was 0.79 (proportion of people who score positive on the PSS who actually have
PTSD on the SCID-I), negative predictive value was 0.48 (proportion of people who score negative on the PSS who actually do not have PTSD on the SCID-I) and the overall
‘hit rate’ was 0.6. Individuals with other anxiety disorders met the PTSD symptom
criteria on the PSS in relation to ‘hyperventilation’, panic attack, being bullied, heart
attack of father, witnessing brother being hurt in a fight, parents arguing, partner’s
infidelity and being fired. The specificity was 1 for the healthy control group.
Using the liberal scoring rule and comparing the individuals with PTSD with the
individuals with other anxiety disorders, the sensitivity was 0.86, specificity was 0.58, positive predictive value was 0.77, negative predictive power was 0.72 and the overall
hit rate was 0.75. 1 For the further nine patients with other anxiety disorders, PTSD
symptom criteria were met in relation to panic attack (N ¼ 2), change in medication, maggots being thrown at as a child, rape, death of a relative after illness (N ¼ 2), own infidelity and being overworked. Most of them had a primary diagnosis of panic disorder (N ¼ 10) or social phobia (N ¼ 4). The specificity was 0.95 for the healthy controls (two met the PTSD symptom criteria due to death of loved one after illness).
Discussion
PTSD symptoms on the PSS showed good sensitivity and specificity distinguishing PTSD
patients from healthy controls when using the liberal scoring rule, which nicely
replicates earlier findings (Foa et al., 1993, 1997; Wohlfarth et al., 2003). However, with
the same scale and criteria, nearly half of the patients with other anxiety disorders
reported sufficient symptoms to meet the PTSD diagnosis. The conservative scoring
rules out a number of false positives, but the gains in specificity go hand in hand with a
loss of sensitivity. There are several explanations for the high rate of false positives among anxiety
patients without PTSD. First, the aversive events mentioned by many patients without
Table 2. Comparison of diagnoses made using the PTSD symptom scale (PSS) with the structured
clinical interview for axis I DSM-IV disorders (SCID-I)
SCID-I
PSS PTSD Other anxiety disorders Healthy controls
Conservative scoring Positives 31 8 0 Negatives 34 32 40
Liberal scoring Positives 56 17 2 Negatives 9 23 38
1 Recent studies (e.g. Coffey et al., 2006) have suggested a severity cut-off. The findings are similar when using 15 as scoring
rule.
Specificity of symptoms on the PSS 453
Copyright © The British Psychological Society Reproduction in any form (including the internet) is prohibited without prior permission from the Society
PTSD are not typically regarded as traumatic, at least not by the DSM-IV (partner’s
infidelity, being overworked, etc.), but may breed symptoms that characterize PTSD. As
mentioned, earlier studies have documented PTSD symptoms after problems with work,
finances and relationships (e.g. Mol et al., 2005). Second, there is considerable overlap
between symptoms of PTSD and other anxiety disorders. Four of the five PTSD
hyperarousal symptoms are also defining features of generalized anxiety disorder, and the PTSD numbing symptoms (e.g. ‘feeling detachment or estrangement from others’)
are similar to derealization and depersonalization in panic disorder. Some of the DSM-IV
PTSD symptoms refer to the traumatic event (e.g. intrusions about the trauma), but
many others do not (i.e. ‘diminished interest or participation in significant activities’,
‘feeling detachment or estrangement from others’, ‘restricted range of affect’, ‘sense of a
foreshortened future’, ‘difficulty falling or staying asleep’, ‘irritability or outbursts of
anger’, ‘difficulty concentrating’, ‘hypervigilance’ and ‘exaggerated startle responses’;
American Psychiatric Association, 1994, pp. 424–429). Research among traumatized individuals has shown that the most sensitive (PSS) symptoms are those of the
hyperarousal cluster, intrusive recollections, distress when confronted with reminders
and cognitive avoidance. However, these show low to moderate specificity (Ehlers et al.,
1998). Anxious patients without DSM-IV-defined trauma might endorse many of those
items. An example could be an OCD patient with harming obsessions affirming that
(s)he has intrusions about a traumatic event. The high rate of false positives may be due
to symptom overlap or symptoms being so similar that anxiety patients without PTSD
overlook subtle differences and affirm their presence. Third, several symptoms of avoidance/numbing and hyperarousal are prominent in depression (McNally, 1992).
Clinical or subclinical depression often co-occurs with anxiety disorders, including
PTSD (Brown, Campbell, Lehman, Grisham, & Mancill, 2001). The high rate of false
positives among other anxiety patients could result from symptom overlap with
(subclinical) depression. Finally, neuroticism is a fundamental personality trait that
increases risk of anxiety disorders and/or depression (Clark, Watson, & Mineka, 1994).
In fact, neuroticism scores of clinical patients are about two standard deviations above
the population mean (Van den Hout, 2004). Interestingly, the symptom overlap between neuroticism and the PTSD hyperarousal symptoms is considerable (Engelhard, van den
Hout, & Kindt, 2003). Thus, shared variance between anxiety disorders and neuroticism
might be responsible for the high rate of false positives.
Whatever the reason for the high rate of false positives, its existence is troublesome.
The PTSD diagnostic criteria are unusual by including an etiological factor (a particular
traumatic event). The validity of the diagnosis does not seem to benefit from this: most
individuals exposed to a DSM-IV-defined traumatic event will not develop PTSD (see
Breslau, 1998), and many individuals displaying the PTSD symptom pattern may not have experienced a related traumatic event.
Limitations of this study include the small sample sizes and use of mainly self-reports,
which might have influenced the results if people misunderstand certain items. Future
research could take several directions. First, the data raise doubts about the assessment
of PTSD by self-report measures: these may identify many PTSD patients as well as
anxiety patients without PTSD. However, some self-report instruments might work
better than others, such as inventories that measure many different conditions together
(i.e. multiscale tests), which is an empirical issue that awaits future research. Second, knowledge is scant with respect to the qualitative nature of reactions to traumatic and
common stressors. The nature of the stressor might determine different subtypes of
PTSD (e.g. depressive or physiologically responsive subtypes). Third, it might be
454 Iris M. Engelhard et al.
Copyright © The British Psychological Society Reproduction in any form (including the internet) is prohibited without prior permission from the Society
interesting to test whether treatment proven useful to PTSD is also effective for
individuals suffering from similar symptoms after stressors not defined as traumatic by
the DSM-IV. In sum then, the impact of traumatic events on mental health is often
determined by merely examining whether or not participants meet symptom criteria for
PTSD on a questionnaire. Our findings suggest that many people screened positive for
PTSD this way may not be actually suffering from the disorder.
Acknowledgements
This study was supported by an Innovational Research Incentive VENI Scheme (016.045.106) by
The Netherlands Organization for Scientific Research (NWO) awarded to Iris M. Engelhard. We
thank two anonymous reviewers for their helpful comments.
References
American Psychiatric Association (1980/1994). Diagnostic and statistical manual of the mental
disorders. Washington, DC: APA.
Bowman, M. L. (1999). Individual differences in posttraumatic stress: Problems with the DSM-IV
model. Canadian Journal of Psychiatry, 44, 21–33.
Breslau, N. (1998). Epidemiology of trauma and posttraumatic stress disorder. In R. Yehuda (Ed.),
Psychological trauma (pp. 1–29). Washington, DC: APA.
Brewin, C. R. (2003). Posttraumatic stress disorder: Malady or myth? New Haven, CT: Yale
University Press.
Brewin, C. R., Andrews, B., & Rose, S. (2000). Fear, helplessness, and horror in posttraumatic
stress disorder: Investigating DSM-IV criterion A2 in victims of violent crime. Journal of
Traumatic Stress, 13, 499–509.
Brown, T. A., Campbell, L. A., Lehman, C. L., Grisham, J. R., & Mancill, R. B. (2001). Current and
lifetime comorbidity of the DSM-IV anxiety and mood disorders in a large clinical sample.
Journal of Abnormal Psychology, 110, 585–599.
Clark, L. A., Watson, D., & Mineka, S. (1994). Temperament, personality, and the mood and anxiety
disorders. Journal of Abnormal Psychology, 103, 103–116.
Coffey, S. F., Gudmundsdottir, B., Beck, J. G., Palyo, S. A., & Miller, L. (2006). Screening for PTSD in
motor vehicle accident survivors using the PSS-SR and IES. Journal of Traumatic Stress, 19,
119–128.
Derogatis, L. R. (1977). SCL-90: administration, scoring and procedures manual-I for the
R(evised) version. Baltimore: John Hopkins University School of Medicine, Clinical
Psychometrics Research Unit.
Ehlers, A., Mayou, R. A., & Bryant, B. (1998). Psychological predictors of chronic posttraumatic
stress disorder after motor vehicle accidents. Journal of Abnormal Psychology, 107, 508–519.
Engelhard, I. M., van den Hout, M. A., Arntz, A., & McNally, R. J. (2002). A longitudinal study of
“Intrusion-based reasoning” and PTSD after a train disaster. Behaviour Research and Therapy,
40, 49–58.
Engelhard, I. M., van den Hout, M. A., & Kindt, M. (2003). The relationship between neuroticism,
pre-traumatic stress, and post-traumatic stress: A prospective study. Personality and
Individual Differences, 35, 381–388.
First, M. B., Spitzer, R. L., & Williams, J. B. W. (1997). Structured clinical interview for DSM-IVaxis
I disorders: SCID-I: Clinician version. New York: Columbia University/APA.
Foa, E. B., Cashman, L., Jaycox, L., & Perry, K. (1997). The validation of a self-report measure of
posttraumatic stress disorder: The posttraumatic diagnostic scale. Psychological Assessment,
9, 445–451.
Foa, E. B., Riggs, D. S., Dancu, C. V., & Rothbaum, B. O. (1993). Reliability and validity of a brief
instrument for assessing post-traumatic stress disorder. Journal of Traumatic Stress, 6, 459–473.
Specificity of symptoms on the PSS 455
Copyright © The British Psychological Society Reproduction in any form (including the internet) is prohibited without prior permission from the Society
Gillis, M. M., Haaga, D. A. F., & Ford, G. T. (1995). Normative values for the Beck anxiety inventory,
fear questionnaire, Penn worry questionnaire, and social phobia and anxiety inventory.
Psychological Assessment, 7, 450–455.
Hackmann, A., Clark, D. M., & McManus, F. (2000). Recurrent images and early memories in social
phobia. Behaviour Research and Therapy, 38, 601–610.
Hoge, C. W., Castro, C. A., Messer, S. C., McGurk, D., Cotting, D. I., & Koffman, R. L. (2004).
Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care. New
England Journal of Medicine, 351, 13–22.
Jones, J. C., & Barlow, D. H. (1990). The etiology of posttraumatic stress disorder. Clinical
Psychology Review, 10, 299–328.
Kessler, R. C., McGonagle, K. A., Zhao, S., Nelson, C. B., Hughes, M., Eshleman, S., et al. (1994).
Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the United States:
Results from the national comorbidity survey. Archives of General Psychiatry, 51, 8–19.
Marks, I. M., & Mathews, A. M. (1979). Brief standard self-rating for phobic patients. Behaviour
Research and Therapy, 17, 263–267.
McNally, R. J. (1992). Psychopathology of posttraumatic stress disorder (PTSD): Boundaries of the
syndrome. In M. Başoğlu (Ed.), Torture and its consequences: Current treatment approaches
(pp. 229–252). Cambridge: Cambridge University Press.
McNally, R. J. (2003). Remembering trauma. Cambridge, MA: Harvard University Press.
Mol, S. S. L., Arntz, A., Metsemakers, J. F. M., Dinant, G.-J., Vilters-van Monfort, P. A. P., &
Knottnerus, J. A. (2005). Symptoms of post-traumatic stress disorder: Evidence from an open
population study. British Journal of Psychiatry, 186, 494–499.
Rainey, J. M., Aleem, A., Ortiz, A. M., Yeragani, V. K., Pohl, R., & Berchou, R. (1987). A laboratory
procedure for the induction of flashbacks. American Journal of Psychiatry, 144, 1317–1319.
Reynolds, M., & Brewin, C. R. (1999). Intrusive memories in depression and posttraumatic stress
disorder. Behaviour Research and Therapy, 36, 135–146.
Schlenger, W. E., Caddell, J. M., Ebert, L., Jordan, B. K., Rourke, K. M., Wilson, D., et al. (2002).
Psychological reactions to terrorist attacks. Findings from the national study of Americans’
reactions to September 11. Journal of American Medical Association, 288, 581–588.
Scott, M. J., & Stradling, S. G. (1994). Post-traumatic stress disorder without the trauma. British
Journal of Clinical Psychology, 33, 71–74.
Shalev, A. Y., Freedman, S., Peri, T., Brandes, D., Sahar, T., Orr, S. P., et al. (1998). Prospective study
of posttraumatic stress disorder and depression following trauma. American Journal of
Psychiatry, 155, 630–637.
Solomon, S. D., & Canino, G. J. (1990). Appropriateness of DSM-III-R criteria for posttraumatic
stress disorder. Comprehensive Psychiatry, 31, 227–237.
Spielberger, C. D. (1983). State-Trait Anxiety Inventory (Form Y) manual. Redwood City, CA:
Mind Garden.
Summerfield, D. (2001). The invention of post-traumatic stress disorder and the social usefulness
of a psychiatric category. British Medical Journal, 322, 95–98.
Van den Hout, M. A. (2004). Personality, safety behaviours, and anxiety disorders. Paper
presented at the annual meeting of the European Association for Behavioural and Cognitive
Therapies (EABCT), Manchester, UK.
Wohlfarth, T. D., van den Brink, W., Winkel, F. W., & ter Smitten, M. (2003). Screening for
posttraumatic stress disorder: An evaluation of two self-report scales among crime victims.
Psychological Assessment, 15, 101–119.
Yehuda, R., & McFarlane, A. C. (1995). Conflict between current knowledge about posttraumatic
stress disorder and its original conceptual basis. American Journal of Psychiatry, 152,
1705–1713.
Received 19 September 2006; revised version received 1 March 2007
456 Iris M. Engelhard et al.