2 Assignments due on separate days

., r := ~ i ~.J:.

~] ~.§ ~ ~ "'=s :!'. f ":: ~ .£

- ,

Psychotherapy Volume 38/Spring 2001/Number I

REVIVING FREUD'S VISION OF A PSYCHOANALYTIC SCIENCE: IMPLICATIONS FOR CLINICAL

TRAINING AND EDUCATION

ALEXANDERJ. SCHUT LOUIS G. CASTONGUAY Pennsylvania State University

Traditional assumptions about the analytic encounter have contributed to the detachment of psychoanalytic psychotherapy from the empirical movement that has dominated mainstream academic clinical psychology. However, recent research findings on the process and mechanisms of change within psychoanalytic forms of treatment now provide much needed empirical support for some of the basic tenets of psychoanalytic theory and practice, challenge long-standing notions regarding the link between therapeutic technique and clinical improvement, and suggel·t that factors once believed to be unique to psychoanalytic psychotherapy might be playing a crucial role in the promotion of change in other therapeutic modalities. The implications of these process research findings for the present state and future of clinical training and education are provided.

Preparation of lhis manuscripl was supported in pan by Nalional lns1i1u1e of Menial Heallh Research Granc MH· SR593.

An earlier version of chis article was submined by lhc first au1hor and awarded lirsl prize in 1999 for the American Psy- chological Association's Division 29 S1uden1 Paper Campell· lion on Education and Training.

Correspondence regarding this article should be addressed to Aleunder J. Schue , Department of Psychology. Pcnnsylva. nia S1a1e University, 429 Moore Building, Universicy Park. PA 16802. E-mail: [email protected]

40

Although Freud expressed his wish for a scien- tifically informed psychoanalytic psychotherapy over 100 years ago (see Westen, 1998), a survey of modem-day practitioners indicates that the bevy of empirical findings generated from aca- demic psychology (e.g . , psychotherapy research) has little, if any, impact on actual, day-to-day clinical practice (Beutler, Williams, Wakefield, & Entwistle, 1995). Indeed, many analytically oriented psychologists would probably agree that the research activities expected of them during their graduate training are either irrelevant to or far removed from the conduct of analytic work . Although this state of affairs is probably multiply determined , we believe that the schism analysts face between the "ivory tower" of academic psy- chology and the "real world" of psychoanalytic practice is a product of at least two tacit assump- tions about the analytic encounter that have been perpetuated within the scientific and practicing communities. First, there has been a long- standing belief that the analytic process is, and should remain, exempt from the scientific endeav- ors of academic psychology because of its inher- ent complexity and/or because it involves the as- sessment and treatment of private, hard-to- operationalize structures, processes, and contents of the mind . Second is the assumption that re- searching the analytic encounter in some way con- taminates or disrupts the treatment process, thereby invalidating the very phenomenon to be studied.

These two assumptions have contributed to the virtual detachment of psychoanalytic psy- chotherapy from the empirical movement that has dominated the rest of academic clinical psy- chology (Strupp, 1976) . In our view, this dis- connection of analytic practice from scientific inquiry is problematic for at least two reasons . First, with the infiltration of managed-care or- ganizations in psychotherapy practice and the

- !.

Psychoanalytic Research, Education, & Training

press for implementing empirically supported treatments (usually brief, symptom-oriented treatment methods) (e .g., Chambless & Hollon, 1998), the failure of the analytic community to provide scientific support for its concepts or treatment methods threatens to render psycho- analytic psychotherapy a nonreimbursable form of therapy and push it toward the realm of an outdated pseudoclinical science. Second, the weak impact of scientific findings on the appli- cation of psychoanalytic psychotherapy is anti· thctical to the mission of clinical training and education set forth by the American Psychologi- cal Association (APA) after it adopted the Boul- der Model in 1949 (APA, 1950). Trainees arc, at the least, expected to read relevant scientific literature and utilize research methodology to bolster the efficacy of their analytic treatment or to provide empirical support for their theoretical conceptualizations regarding psychopathology or psychotherapy.

Fortunately, however, over the last two-and- s -half decades, a contingent of psychoanalytic psychotherapy researchers has begun to gener- ate a substantial body of empirical research on the analytic encounter, breathing new life into the psychoanalytic approach and reaffirming its position as a worthy clinical and scientific enter- prise. Recent publications have already pre- sented clear evidence for the beneficial impact of psychodynamically oriented therapy (Ander- son & Lambert, 1995 ; Crits-Christoph, 1992; Luborsky et al., 1993). ln this article, we first specifically highlight empirical studies that ex- plicate the process and mechanisms of change in psychoanalytic psychotherapy and show bow such programmatic research demonstrates em- pirical support for some of the basic tenets of psychoanalytic theory and practice. Next, we summarize recent process research findings on analytic treatment that present a challenge to traditionally held theoretical notions or assump- tions regarding therapeutic technique and clini- cal improvement, which, in turn, may suggest the need for conceptual and/or clinical refine- ments. Finally, we show how the study of pro- cess in psychoanalytic and nonanalytic psycho- therapies has generated strong evidence to suggest that analytic researchers can inform the- oreticians and researchers of other orientations about the basic mechanisms of change operating in their approaches. The implications of these reviewed empirical findings in terms of the pres-

ent state and future of clinical training and edu- cation are offered in the closing section.'

A Sample of Research Findings on Some Buie Tenets of Psychoanalytic Theory and Practice

Within the last 25 years, several groups initi- ated sophisticated programs of research investi- gating the fundamental assumptions about the psychoanalytic process as originally posited by Freud or other important authors of this tradition (e.g., Sullivan) . Perhaps one of the more prolific groups associated with this line of clinical re- search was started by Lester Luborsky at the Uni- versity of Pennsylvania. Luborsky and his col- leagues ( 1985) have committed to a series of investigations of what they aptly called "Freud's grandest clinical hypothesis": the phenomenon of transference . Using clients' narratives of their interpersonal relationships or "relationship epi- sodes" as the source of data, Luborsky and col- leagues developed a system to objectively de- scribe clients' central relationship patterns. Their method, entitled the "core conflictual relationship theme" (CCRT), was intended to operationalize and extract the template or general relationship pattern that Freud ( 1912/ 1958) suggested clients brought to session. These templates or relation- ship patterns, Freud argued, arc eventually expe- rienced in the moment with the therapist and are expressed by the client via the transference.

As described by Luborsky and Crits-Christoph (1990), the CCRT has three components: the cli- ents' wishes, intentions, or needs; the (expected) responses of others, and the responses of self. Research shows that each of the CCRT compo- nents-the presumed elements of Freud's hy- pothesized transference template-as well as the relationship episodes themselves can be reliably identified in psychotherapy transcripts (Crits- Christoph, Luborsky, Popp, Mellon, & Mark , 1990). This line of research also generated empir- ical evidence corresponding with many of Freud's basic assumptions about transf ere nee phenomena as outlined in his clinical "technique'' papers

1 Although we: focus attention in this article on empirically derived psychoanalytic: psychotherapy process findings and their implications for clinical training and education, it is important 10 nore that the researc:h programs from which these findings arc based are indebted to the groundbrcalcing efforu of many psychoanalytic: r:linir:al inveslieations that have taken plac:e over the last c,:ntury.

41

A . J. Schut & l. G. Castonguay

(e .g., Freud, 1912/1958; 1914/1958). Using the CCRT method, Luborsky (1990) and his col- leagues showed that (a) clients' main relational patterns are found within relationship episodes about the therapist, that is, their pattern comes to "involve" the therapist; (b) the relational pattern originates in early parental relationships and ex- hibits consistency over time; (c) clients' wishes conflict with responses of self and others; and (d) the use of interpretations, particularly those that focus on the client's pattern as reflected in the CCRT, change the expression of the pattern and are associated with client improvement.

The CCRT method is just one of the many systems currently used to assess transference phe- nomena. More generally, such systems are used to develop psychodynamic case fonnulations that later serve to guide actual therapeutic interven- tions. Although describing each system is beyond the scope of this article, the reader is directed to recent volumes and journal articles devoted to comparing the psychometric properties and clini- cal usage of some of the more popular systems (e.g., Horowitz, 1991 ; Luborsky, Popp, & Bar- ber, 1994).

Alongside these developments in transference/ case-fonnulation measures arc equally exciting innovations in other domains of analytic theory and practice. They include the movement toward operationalizing and empirically demonstrating (a) the clinical ramifications of the quality and depth of patients' object representations (e.g., Blatt, Stayner, Auerbach, & Behrends, 1996), (b) the patient's representation and internalization of the therapist (e.g., Harrist, Quintana, Strupp, & Henry, 1994; Orlinsky & Geller, 1993), (c) the relationship between perceived childhood experiences with primary caregivers and actions directed towards the self in adulthood (e.g., Ben- jamin, 1996), (d) the development of the thera- peutic alliance and its link with treatment outcome (e.g . • Gaston . 1990; Horvath & Symonds , 1991; Westennan , 1998) , (e) mechanisms of defense (e.g. , Perry , 1993), (f) countcrtransfcrence phe- nomena (e.g .• Hayes, Riker, & Ingram, 1997; Nonnandin & Bouchard, 1993), (g) primary and secondary process mcntation (e.g . , Bucci & Miller, 1993), (h) the structure and functions of emotions (e.g., Dahl, 1991), and (i) the system- atic codification of psychoanalytic technique (e.g., Barber & Crits-Christoph, 1996; Jones & Pulos, 1993; Piper, Oebbanc, de Carufel, & Bien- venu, 1987) .

42

While many more lines of research on psycho- analytic theory and practice continue to emerge (see reviews by Beutler & Crago, I 99 I: Bornstein & Masling, 1998; Fisher & Greenberg, 1996; Henry, Strupp, Schacht, & Gaston, 1994; Lubor- sky, Barber, & Beutler, 1993; Luborsky, Barber, & Crits-Christoph, 1990; Miller, Luborsky, Bar- ber, & Docherty, 1993; Wallerstein & DeWitt, 1997; Weiss & Sampson, 1986; Westen, 1998), the take-home message for the reader is that the psychoanalytic encounter can, indeed, be subjected to rigorous scientific methods and survive! Strong evidence now suggests that once-considered vague analytic constructs and techniques can be operation- alized, reliably and validly assessed, and meaning- fully linked with client improvement.

Recent Challenges to Old Assumptions About the Link Between Technique and the Process or Change

Alongside these advancements within the psy- choanalytic psychotherapy research field arc intri- guing data that raise serious questions about traditional views of the relationship between psy- choanalytic technique and the process of change. For example, Strachey ( 1934) and others have argued extensively in the clinical literature that the "mutative" factor or the vehicle of cure in psychoanalytic psychotherapy is the interpreta- tion or the transference . Until recently, this clini- cal hypothesis went unchallenged by convincing empirical evidence and perhaps inadvertently led some analysts to take this clinical postulate to an extreme position, for example, the idea that frequent use or transference interpretations intrin- sically leads to greater client improvement than moderate or infrequent use of such interventions (sec Piper, Azim, Joyce, & McCallum, 1991).

However, several recent, well-controlled em- pirical studies conducted at independent sites in- dicate that such an extreme position is far from accurate (see Henry ct al., 1994; Piper, Joyce, McCallum, & Azim, 1993, for reviews). In gen- eral, excessive use of transference interpretations has been found to be either ineffective or actually detrimental to the therapeutic alliance and to out- come {e.g., Hflglend , 1993; Piper ct al., 1991; Piper, Debbane, Bienvenu, de Carufcl, & Garant, 1986). This docs not mean, however, that trans- ference interpretations arc not helpful or that they should not be used in treatment. For example, research shows that the accuracy or suitability of the therapist' s interpretations, including transfer-

Psychoanalytic Research, Education, & Training

cnce interpretations, is predictive of clients' in- session progress or productivity (e.g., Silb- crschatz, Fretter, & Curtis, 1986), the develop- ment of the therapeutic alliance (Crits-Christoph, Barber, & Kurcias, 1993), and outcome (Crits- Christoph, Cooper, & Luborsky, 1988). More finer-grained analyses indicate that the clients' quality of object relations (i.e., primitive vs . ma- ture) may also moderate the relationships among transference interpretations, alliance, and treat- ment outcome. For example, research by Piper ct al. ( 1993) has showed that a low frequency of highly accurate transference interpretations ap- pears to facilitate J10Sitive outcomes in individuals with mature object relations. For those with less mature object relations, Piper ct al. (1993) found that highly accurate transference interpretations were associated with poorer therapeutic alliance and outcome. More recently, Connolly ct al. (l 999) and Ogrodniczuk, Piper, Joyce, and McCallum (1999) found that higher levels of transf crcnce interpretations were associated with poorer outcomes for those clients described as having low quality of object relations. Conse- quently, Connolly ct al. ( 1999) and Piper, Joyce, McCallum, and Azim (1998) suggested that more supportive, as opposed to interpretive, therapeu- tic work might be beneficial for individuals pre- senting with primitive modes of relating. This is in line with other investigations demonstrating that less disturbed patients benefited more from expressive (or interpretive) interventions, whereas more disturbed patients improved with supportive types of therapeutic techniques (Horo- witz, Marmar, Weiss, DeWitt, & Rosenbaum, 1984; Jones, Cumming, & Horowitz, 1988).

As cogently argued by Binder and Strupp ( 1997), however, the majority of research investi- gating proposed links between therapeutic tech- niques and outcome have typically failed to con- sider the interpersonal tone and context from within which such interventions arc provided. Thus, the frequent failure to find strong positive links between technique and outcome (Lambert, 1992) may be more a function of how and under what interpersonal context the therapist provides his or her interventions (i.e., an issue of process) rather than a function of the actual type of inter- ventions he or she uses (i.e., an issue of content).

The distinction between process and content is not necessarily new to analysts regarding their clinical work, but it does potentially shed addi- tional light on older notions from classical theory

that suggest simply providing particular types of interventions (e.g. , confrontations, interpreta- tions) be related to client improvement. TilC im- portance of the process/content distinction is highlighted from the Vanderbilt I and II Psycho- therapy Research Projects. In these studies, it was revealed that therapists, while using similar tech- niques with similar patients, exhibited markedly different interpersonal behaviors in their "poor" outcome cases as compared to their "good" out- come cases (Henry, Schacht, & Strupp, 1986, 1990). Specifically, therapists' "good" outcome cases involved significantly more affiliative modes of therapist communication (e.g., they were more affirming and understanding, more helping and protecting, and Jess belittling and blaming), whereas therapists' "poor" outcome cases involved significantly more negative (i.e., hostile and controlling) types of interpersonal ex- changes. For example, there was a greater fre- quency in the poor outcome cases of negative interpersonal complementarity,. where hostility from one member of the therapeutic dyad "pulled for" hostility from the other participant.

Although Henry ct al. (1986, 1990) did not investigate the relationship between specific types of interventions and interpersonal process within the client-therapist dyad, their results suggest that while the content of interventions may not vary across clients, the process by which the therapist provides his or her interventions may yield radi- cally different therapeutic outcomes. Interest- ingly, even specific training designed to help ther- apists detect and manage negative process within the therapeutic relationship did not guarantee im- proved outcome, as many therapists showed more frequent hostile or complex communication (e.g., communication that simultaneously supports and blames) while increasing their adherence to tech- niques (e.g., transference interpretations) follow- ing such training (Henry, Strupp, Butler, Schacht, & Binder, 1993).

Clearly, these data cast doubt on old notions that simply implementing techniques undoubtedly leads to client improvement. The negative transfercnce-countertransfercnce matrix created by particular client-therapist interactions may only add "fuel to the fire" unless careful consider- ation is given to the ways in which one offers his or her interventions. Binder and Strupp (1997), along with many other analysts (e.g. , Aron, 1996; Kohut, 1984; Schwaber, 1983), argued that great care must also be made with respect to the thcoret-

43

A. J. Schut & L. G. Castonguay

icaJ and philosophical propositions from which one works. More specifically. it has been argued that individuals working from che clal>\ical psy. choanalytic perspec1ive often use methods that are "experience-discant," 1hat implicitly blame the client for his or her troubles. and/or that promote the view thac the client is distoning reality and thal the therapisc is the arbiter of truth . Such mod- els may serve to only disengage the client and therapist from one ano1her and promote negative process (Binder & S1rupp. 1997). 1

An alternative, relational view of 1he analytic process (e.g .• Aron. 1996; Mitchell, 1988: Safran & Muran. 2000) strives for a more ··experience- near" perspective in which the therapist and client both examine their contributions 10 the unfolding of 1he therapeutic relationship. Through "meta- communicative feedback," whereby the therapist aims to process his or her observations aboul the here-and-now interaction with the client. it is ar· gued that negative process can be more easily detected and effectively managed (Binder & Strupp, 1997. p. 133).

Building Bridges: Identification of the Basic Mechanisms of Change and the Movement Toward Psychotherapy Integration

Recent studies devoted lo comparing the pro- cess of change in psychoanalytic and other forms of psychotherapy have also yielded surprising evi- dence suggesting 1ha1 factors once believed to be unique 10 psychoanalytic psychotherapy may actu- ally play a crucial role in the promotion of change in other therapeutic modalities. For example, in a study comparing lhe process of change in cognitive- behavioral and brief psychodynamic psychotherapy for depression, Jones and Pulos ( 1993) found 1ha1

! These: chntcal msigh1s hnvc: n:ccivc:d prelimin~ry c:mpin· cal support from an c:"'plor.tlory s1udy conduc1ed by Cas1on- J,!U.t)'· Goldfried. Hayes, Raue, Wis.:r, and Shapiro ( 1990). These: au1hors found tha1 p~ychodynamic 1hc:r11p1s1 intcrven• 1ions aimed a1 ch11n11ing clienls • views of sc:lf were nc:g:111vcly rc:la1ed to improvement. Contcn1 analyses conduc1ed to clarify 1his find ing n:vcaled 1ha11hc: 1herapiMs frequently n:auributcd 1he rc:~pons1h ilil y 10 c lients (or hlamcd them) for thc:1r prob- lems (e.g. , ··1s ii possible 1hat !he w:iy your wife: behaves is. 1n part . 11 react ion to your own bchav,or?"). These results. however. should be considered wi1h caution until rcplic.uc:d. Allhnugh the: size of 1hc ncga11vc: com:lation bc:twc:.=n the: thcrapisl intcrvcn1lons and client improvement was subs1anti11l (i e ,. - 0 SI ). thiscorrcla1 ion was only marginally s1gnilican1 < p < . 11 due: to the small s.imple .

44

actions and techniques typically associated with psychodynamic approaches (e.g .. therapists' em- phasis on deepening clients' feelings; interpreta- tion of clients' warded-off wishes , feelings. or ideas: linking of clients' feelings or perceptions to sicuations of 1he pa!>t) were associated with client improvement in both cognitive-behavioral and psychodynamic treatments . However. none of 1he techniques and activities typically associ- ated with cognittve-behavioral therapy (e.g., theraplstl>' didactic-Ilk~ behavior: emphasis of specific activities clients should eng<1ge in outside of treatment; discu!l!lion of clients' ideas or belief system!>) were found 10 relate to positive change in either treatml!nt. In a similar vein, Hayes. Cas- tonguay and Goldfried (1996), using a theory- neutral coding system 10 study the process of change in cognitive therapy for depression, dis- covered 1hat interventions addressing interper- sonal and developmental aspects of clients ' func- tioning (e .g. . attachment experiences with parents) were found 10 be positively associated with client improvement. whereas intervencions addressing intrapersonal aspects of cognicion were not . Finally. studies of the psychodynamic construct of the working or therapeutic alliance (e.g .. Zetzel, 1956) have shown chat the alli- ance is strongly predictive of outcome in psy- chodynamic therapy and also 1n' cognitive, cognitive-behavioral. interpersonal, and phar- macological therapies (e .g. , Castonguay. Gold· fried. Wiser. Raue, & Hayes. 1996; Krupnick et al. . 1996).

The results of these process studies provide much needed empirical suppon for psychoana- lytic models of change. However, these data also point to che identification of basic mechanisms of change that may cul across other theoretical orientations. This latter observation is panicularly notewonhy given the recent trend in psychother- apy research for identifying "common factors" of treatment (e .g . . Arkowicz. 1992) and given the increasingly popular movement toward the prac· tice of eclectic or integrative psychotherapy (Cas- tonguay & Goldfried. 1994; Jensen. Bergin, & Greaves. 1990). In fact. several theorists from nonanalycic orientations have already begun the process of integrating psychoanalytic clinical wis- dom into their practice. Perhaps one of the more well-known integrative models comes from Jer- emy Safran, who has developed a fruitful line of clinical~research integrating psychodynamic- interpersonal, experiential. and cognicive tradi-

Psychoanalytic Research, Education, & Training

tions. His integrative approach has stemmed a vast number of studies devoted to helping clini- cians negotiate and repair ruptures to the thera- peutic alliance (e.g., Safran & Muran, 1996).

Largely influenced by the work of Safran and substantially based on the process findings de- scribed above, a group of researchers has devel- oped " fonn of therapy that integrates psychody- namic and interpersonal techniques within a cognitive-behavioral treatment (CBT) for gen- eralized anxiety disorder (GAD) (Newman, Cas- tonguay, & Borkovcc, 1999). Specifically, the protocol adds to the coping and skill-training techniques of CBT a number of procedures to (a) increase emotional deepening, (b) explore and resolve conflicts between needs and fears, (c) ex- plore past relationships with early caregivers, (d) address current maladaptive interpersonal pat- terns, and (c) explore and repair alliance ruptures that emerge in therapy. The rationale underlying the addition of these techniques is based on the fact that although CBT therapists tend not to focus substantially on emotional, conflictual, develop- mental, and interpersonal issues, process findings suggest that when they do so in ways that arc reminiscent of psychodynamic and interpersonal practices their patients show greater improvement (sec Castonguay, 2000). Results from a prelimi- nary investigation of this new treatment indicate that CBT and psychodynamic~lly oriented tech- niques can indeed be integrated , that is , that thera- pists can adhere to the treatment protocol and implement it with minimal competence (New- man, Castonguay, Borkovec, & Schut, 1999), and that the therapist and client experience (e.g., feelings, thoughts, actions) in therapy is consist- ent with the model of change underlying the pro- tocol (Castonguay, Schut, Newman, & Borko- vec, 1999). Based on preliminary, but promising, outcome results (Borkovcc, Newman, & Caston- guay, 1998; Newman, Castonguay, Borkovec, & Molnar, in press), a large clinical trial is currently being conducted comparing the integnuive fonn of therapy with CBT -which currently stands as the gold-standard treatment for GAD.

Despite these recent trends and preliminary re- sults from comparative process studies, however, much more research on the psychoanalytic pro- cess (and on the identification of the specific ac- tive ingredients in psychoanalytic psychotherapy) needs to be conducted before more precise con- clusions can be made. This observation coalesces with the recommendations made by members of

the National Institute of Mental Health (NIMH) workshop on psychotherapy integration, who in- dicated that researchers must continue to elucidate the "crucial components of treatment" before more fruitful integration is to occur (Wolfe & Goldfried, 1988, p. 449) . This being said, future researchers may wish to investigate the role of other factors that have rich clinical and theoretical roots within psychoanalytic fonns of treatment (e.g., holding and containing functions on the pan of the analyst, the use of support), as well as factors that have traditionally gone under- investigated (e.g. , clients' and therapists' race, ethnicity, sexual orientation) as they may relate to the process of change.

Implications or the Reviewed Psychoanalytic Process Research Findings for Clinical Training and Education

We began this article by describing how psy- choanalytic clinicians have historically either failed to sec the relevance of their graduate re- search training on the practice of psychoanalytic psychotherapy or refused to integrate clinical re- search methods or empirical findings from aca- demic psychology into their current-day analytic work. We ·then noted how these realities, stem- ming from traditionally held assumptions about the analytic process, have contributed to the de- tachment of psychoanalytic psychotherapy from the empirical approach that has dominated main- stream academic clinical psychology throughout this century. ln our opinion, this disregard for the scientific tradition by individuals within the analytic community reflects a breakdown in the graduate clinical training and education process. Specifically, we strongly believe that there needs to be greater effort made by the training faculty in clinical programs to expose students to the type of process research findings and methodologies we reviewed in this article. Programs that fail to introduce such clinically relevant data and meth- odology in their graduate seminars on research methods, advanced psychotherapy, or clinical practica perform a great disservice to the prof cs- sional development of their trainees and perpetu- ate the already-existing schism between the scien- tific and practicing communities. In our view, process research findings such as those described above speak directly to the conduct of psychother- apy, which, in tum, lead to better theoretical and clinical developments regarding the nature and task of therapeutic change. For analytic prac-

45

A. J. Schut & L. G. Castonguay

titioners in particular, process research findings that lend support to some of the long-held theoret- ical constructs or techniques developed from clin- ical wisdom may be (within the current social and political climate) required if psychoanalytic psychotherapy plans to remain a viable clinical science .

It is thus no longer appropriate or valid for the psychodynamically oriented therapist who also serves as a faculty member, mentor, or clinical supervisor to students to believe that research on the moment-to-moment processes between thera- pist and patient fails to capture the complexity and vicissitudes of the therapeutic interaction, is unreliable, or is unable to measure such private internal or interpersonal states . As we have shown, programmatic research shows that some of the most fundamental aspects and core tenets of psychoanalytic theory and practice (e.g .. trans- ference) can indeed be operationalized, reliably and validly assessed, and meaningfully linked with client improvement. Studies such as these need to continue, but the onus now lies with the educators in tenns of integrating these process research methods into their graduate-training cur- ricula. Clearly, advisors could encourage trainees to conduct psychoanalytic process research stud- ies as pan of their master's or disscnation projects or enlist their skills for their own ongoing process research . Client and therapist self-reports of the therapeutic encounter (e.g., Orlinsky & Howard, 1966) or observer-based coding of the intra- psychic and interpersonal aspects of the analyst- patient dyad (e.g ., Benjamin, J 974) can be imple- mented into any research paradigm. Trainees may also wish to study the process and mechanisms of change using archival data sets or organize data collection for research on more naturalistic settings, for example, some state psychological associations have begun to implement practice- research networks (cf. Borkovcc & Castonguay. 1998) .

Our review of some of the more recent psycho- analytic process research findings on transference interpretation challenges assumptions carried over from classical analytic theory regarding the link between technique and client improvement. We believe that this line of research clearly high- lights how scientific exploration of the conditions under which therapists use such techniques can infonn clinical practice as well as the training of future therapists . As discussed by Henry ct al. ( 1993) and Binder and Strupp ( 1997), the prepon-

46

derance of negative process in psychotherapy is commonly a function of the use of therapeutic techniques under poor interpersonal contexts. The literature we have summarized by Henry ct al . (1986. 1990) thus suggests that clinical training and supervision may need to expand its focus from simply training students in the use of particu- lar therapeutic techniques to include the training of how to detect and manage negative interper- sonal cycles . According to Binder and Strupp (1997), metacommunication may be a highly therapeutic tool when working with negative in- terpersonal complementarity between members of the analytic dyad . From this perspective of clini- cal training, students could feasibly empirically observe the effects of various interpersonal trans- actions within their own caseload. Such intensive, single-case process research designs have been encouraged by Moras, Telfer, and Barlow (1993) and by Rice and Greenberg ( 1984) .

Finally , our brief review of studies examining the process of change in psychoanalytic and non- analytic forms of treatment appear to infonn the practice and training of not only dynamic thera- pists but also those of other orientations. For ex- ample, it was revealed that mechanisms once con· sidcred unique to psychoanalytic psychotherapy (e.g. , the link between present-day functioning and early experience with primary caregivers) may, surprisingly, serve as a vehicle of change in these other treatment modalities . These ~ndings clearly provide needed empirical support for psy- choanalytic theories of change . However, as we have shown with a new treatment for GAD, re- searchers and clinicians from other theoretical/ clinical orientations (e.g .. cognitive-behavioral, humanistic) may also find that integrating the above findings into their clinical research pro- grams or private practices will assist them in the construction and development of more effective treannents (Grcncavage & Norcross, 1990). In ad- dition, nonpsychodynamically oriented graduate programs could integrate these findings in such a way as to improve the clinical training and educa- tion of their students . Students in valved in cogni- tive-behavioral programs, for example, should be exposed to the empirical findings that demonstrate that not only do psychodynamic processes (e .g . , emotional deepening, exploration of attachment issues) take place in cognitive-behavioral therapy but that they arc also related to client improve- ment. Because research evidence indicates that such processes arc active ingredients of change,

Psychoanalytic Research, Education, & Training

they deserve to become integral parts of any grad- uate training anchored in the Boulder Model.

Referenca

American P5ychological Association. (19SO). Training in clinlt:al psychology: Conftrtnu on 1raduatt tdllcation In clinical p,ychology. New York: Prentice Hall.

AANDERSON, E. M .• & LAMBERT, M. J. (199S). Short-tenn dynamically oriented psychotherapy: A review md mela· analysis. Clinical Psychology Rtvitw, 15, S03-Sl4.

Aa1towrrz, H. ( 1992). Integrative theories of lhcrapy. In D. K. Frccdhcim (Ed.), History of psycholhtrapy: A ctn· tury of chongt (pp. 261-303). Washington, DC: American Psychological Association.

AaoN, L. (1996). A mttting of minds: Mutuality in psycho- 1J111Jlysis. Hillsdale, NJ: Analytic Press.

BARBER, J.P., & Curs-CHRISTOPH, P. (1996). Development of a therapist 1dhcrcnce/competcncc rating scale for supportive-expressive dynamic psychotherapy: A prelimi· nary report. Psycholhtrapy Rtstarch, 6,' 81-94.

BENIAMIN, L. S. ( 1974 ). Suuctural analysis of social behavior. Psychological Rtvitw, 81, 392-425.

BENL\MJN, L. S. ( 1996). lnttrptrso1111I dlasnosis Olld trtat- mtnt of ptrso11111iry disordtrs (2nd ed.). New York: Guilford.

BeVTLER, L. E. , & OlAoo, M. (Eds. ). (1991 ). Psychothtrapy rtstarch: An inttr1111tio1111I rtvitw of progra11t111Dtic studits. W115hington, DC: APA.

BEIJ'Tl.EII, L. E .• Wn.UAMS, R. E., WAXEflEI.D, P. J., & Emw1STLE, S. R. (199S). Bridging scicnlist and prac- titioner pcnpcclives in clinical psychology. Amtrican P,y- cholo1ist , 50, 984-994.

BINDER, J. L. , & ST1lVl'I', H. H. (1997). "Negative process": A recurrently discovered and underestimated facet of thera- peutic process and outcome in lhe individual psychotherapy of adults. Cli,iical Psychology: Scitnct and Praruct, ~. 121-139.

BLATT, s. J. , STAYNElt, D. A .• AVEJIIIACH, J. s .. & BEH- RENDS, R. S. (1996). Change in object and sclf- rq,~ntations in long-term, intensive, inpatient b'cltment of seriously disnubc:d adolescents and young adults.Psychi• atry, 59, 82-107.

Boaxovec. T. D., &. CAsTONOUAY, L. G. (1998). What is the scientific meaning of empirically suppotted therapy? Jour,ia/ of Consulti,ig Olld Clinical Psychology, 66, 136- 142.

BoRxovEC, T. D., NEWMAN, M. G .• & CASTONGUAY, L. G. (1998, November). The pottntial rolt of inttrptr· sonal tmotioNJI proctssing in the trtatmtnl of 1tntraliztd OIIZitty disonur. Paper presented at the annual meeting of the Association for the Advancement or Behavior Therapy, Washington, DC.

BORNSTEIN, R. F., & MASUNG, J . M. (Eds.). (1998). E,n- piriral studits of tht thtraptutlc hour. Washington, DC: APA.

Duca, W., &. MILLER, N. E. (1993). Primary process ana- logue: The referential activity (RA) mcasute. In N. E. Miller, L. Lubonlr.y, J.P. Barber, &J . P. Docherty (Eds .), Psychody1111tnic treOJment rtstarch: A hOlldbook for clini- cal practict (pp. 387-406). New York: Basic Books .

CASTONOUAY, L. G. (2000). A common factors approach to psychotherapy training. Jourrial of Psycholherapy lnitgra· tion , JO, 263-282.

C...sroNOUAY, L. G., & Got.DFRIED, M. R. (1994). P5ycho- lherapy integration: An idea whose time has come. Applitd and Preventativt Psycholo1y, J, IS9-172.

CASTONOUAY, L. G .• Gol.l>F1UED, M. R .• HAYES, A. H .• RAvE, P. J ., W1sER, S. W., & SHAPIRO, D. (1990. June). Quantitat/'l't! Olld qualitativt 1J111Jlysts of proctss-outcomt data/or dilftrtnt approaclrts. Paper given 11 the 21st An· nual Meeting of the Society for Psychotherapy Research, Wintergrcc:n, VA .

CASTONGUAY, L. G .• GoLDFRIED, M. R. , WISER, s. L., RAVE, P. J .• & HAYES, A. M. (1996). Predicting the effect o( cognitive therapy for depression: A study of unique and common facton . Journal of Consultin1 Olld Clinical Psy- chology, 64, 497-S04.

CASTONGUAY, L. o .. SCHur, A. J . • NEWMAN, M. a .. & BoRXOVEc:, T. D. (1999, April). Tht therapist Olld clitnt tJCptritnct in inttgrativt trtalnltnl for gtntraliztd anzltty disorder. Papcr~scntcd at the 1Sth annual meeting oflhe Society for the Exploration of Psychotherapy Integration, Miami, FL.

CHAMBLESS, D. L., & HOLI.OH, S. D. (1998). Deliningempir· ically suppottcd therapies. Jourr11JI of Consul1in1 and Clifli- ca/ Psychology, 66, 7-18.

CoNNOU.Y, M. e .. CRm-CHRJSTO('H, P .• SHAPPEU.., s .. B.u. BER, J. P., Lvaoasxv, L. , & SHAFFEA, C. (1999). Rcl11ion of iransference intcrpretatioos to outcome in the early SCS· siais of brief supportive-expressive psychotherapy. P,y- c/sotherapy Rtstarch, 9, 48S-49S.

CR1Ts-CHR1STOPH, P. (1992). The e(ficacy of brief dynamic psychotherapy: A meta-analysis. American Journal of P sy- chiatry, /49, ISi- lS8.

CRm-CHR1sroPH, P. , BARBER, J. P. , & Kuac1As, J. S. (1993). The accuracy of therapists' interpretations and the development of the therapeutic alliance. P.syc/rothtrapy Rt· search , J, lS-3.5.

CRm-CHRISTOPH, P., CooPER, A., & LvaoRSKY , L. (1988). The accuracy of therapists' interpretations and the outcome of dynamic psychotherapy. Journal of Consulting ruid Clin· ical Psychology, 56, 490-49S.

CRITS-CHRIS'IOPH, P . • LVBORSXY, L .• Pol'P, c .. Ma.t.oN, J ., & MAR1t, D. ( 1990). The reliability of choice of namtivcs and of the CCRT measure. In L . Luborsky & P. Crits• Christoph (Eds. ), Understandin1 trOIISftrtru:e: Tire cart conflictual rtlationship thtmt mtthod (pp. 93-101). New York: Basic Books.

DAHL, H. (1991 ). The key to undcntanding chan1e: Emotions 115 appetitive wishes and beliefs about their fulfillment. Ill J. D. Safran & L. S. Orccnbcrg (Eds.), Emotion, psycho- thtrapy. Olld chongt (pp. 130-16S). New Yortc: Guilford.

F1sHEA, S. , & GREENBERO, R. P. ( 1996). Freud scientifically rtappraistd: Ttsling the thtories Olld tlrLrapy. New York: John Wiley.

FUtJD, S. (19S8). The dynamics of tnnsfcrence. In J. Strachey (Ed. andTrans.), Tht .suuidard tdilion rf tlrt COlffJlett psycho- logical worb of Sigmund Frtud (Vol. 12, pp. 99-108). London: Hogarth Press. (Original work published 1912)

Fuuo, S. (19S8). Remembering, repealing, and working through: Further recommendations on the technique of psy- choanalysis. In J. Strac:hey (Ed. md Trans.), Tht standard tditlon of the COfffJlttt psyc/rolo1tca/ worb of Slgnuutd Freud (Vol. 12, pp. 147-IS6). London: Hogarth Press. (Original work published 1914)

G...s10N, L. (1990). The concept of the alliance and its role in psychotherapy: Theoretical and empirical considerations. Psyc/rothtrapy, 27, 143- IS3.

41

;

, .:: ~ -· ~ ..:. "7 . .::. ..:: ""::: ~ ~ ~..:: ~;: .=: ;:; ~4 - "" E J;. = - ~ ~

= ; ~~ ~ ~

~ ~ ~- ::: .-- - ~~

!'l :... -e;-

= 1 i. = - -= 2 .: - ,

A. J. Schut & L. G. Castonguay

GRENCAVAGE, L. M. , & NoRcRo.U, J. C . (1990) . Where an: the commonalities among the therapeutic common factors? ProftJSlonal PsJcho/ogy- Rts~arch of Practict, 21, 372 - 378.

HARRIST, R. s .. QUINTANA, s. M .• STRUPP, H. H . • & HENRY, W. P. (l 994 ). Internalization of interpersonal process in time-limited dynamic psychotherapy Psychothuapy, JI , 49-57 .

HAYES, A. M., CASlONGUAY, L. G .. & GoLO~R1Eo, M. R ( 1996). Effectiveness of targeting the vulnerability factors of depression in cognitive lhcrapy. Journal of Consulting and Clinical Psychology, 64, 623 - 627.

HAYES, J. A .• R1KER, J. R . . &. INGRAM, K, M (1997). Coun- tertransference behavior and management in bncf counsel- ing . A field scudy. Psychothtrapy Rtstarch, 7, 14S- I SJ .

HENRY, W P . . SCHACHT. T. E .• &. STRUPP, H. H. (1986), Structural analysis of social behavior: Application lo a study of mterpcrsonal process in differential therapeutic outcome. Journal of Consulting and Clinical Psychology , 54, 27- 31.

HENRY, W. P, SCHACHT, T E .. & STRUPP, H. H. (1990). Patient and therapist introject, interpersonal process, and differential psychotherapy outcome. Journal of Consulting and Clinical Psychology. 58, 768 - 774 .

HF.NIIY, W. P . • STRUPP, H. H .• BUT1.E11, s. F . • SCHACHT, T. E. , & BINDER , J. L. (1993). Effects ofcraining in 1imc- hmi1ed dynamic psychotherapy: Changes in therapist be· havior. Journal of Consulting and Clinical Psychology. 6/, 434- 440.

HENRY, w. P . • STRIJPP, H. H .. ScHACHT, T. E ' & GAS'ION, L ( 1994). Psychodynamic approaches . In A. E. Bergin & S. L Garfield (Eds.), Handbook of psychothtrapy and bthavior changt (41h ed, pp. 467- 508). New York Jahn Wiley.

HooL£No, P. ( 1993) Transference in1erpre1a1ions and long- lerm change arm dynamic psychotherapy of brief to moder- arc length . Amtrican Journal of Psychothtrapy, 47, 494- S07.

HOROWITZ, M. J. (Ed.). (1991). Ptrson schtmas and ma/• adaptivt inrtrp~rsonal patttrns. Chicago· University of Chicago Press.

Ho11owrrz, M J ., MARMAR, C .. WE1Ss, D S. , DEWm, K. N .. & RosENBAUM, R. (1984). Brief psychotherapy of bereavement reactions: The relationship of process lo outcome Archivts of a~ntral Psychia1ry. 4/, 438-448 .

HORVATH, A. 0 . , & SYMONDS, D. B. (1991). Relatiomhip between working alliance and outcome in psychotherapy· A melB·analysis. Journal of Counstling Psychology, J8, 139-149.

JENSEN, J. P . . BERGIN, A. E .• & GREAVES, D. w. (1990). The meaning of eclecticism: New survey and analysis or components. Proftssional Psychology-Rtstarch and Practict, 21. 124 - 1.30.

JONES, E. E .• CUMMING, J. D .. & Ho11owin, M. J. (1988). Anather look at the nonspecific hypothesis of therapeutic effectiveness. Journal ofConswlting and Clinical Psycho/· ogy. 56, 48 - SS .

JoNEs, E. E .• & PuLOs, S. M. ( 1993). Comparing the process of psychodynamic and cognitive-behavioral therapies. Journal of Consulting and Clinical Psychology, 6/, 306- 316 .

KoHUT, H (1984) . Howdotsarialysiscurt? Chicago: Univer- sity of Chicago Press.

KRUPNICK, J. L .• S10TSKY, s. M .. SIMMENS. s .. MOYER, J .. ELK1111, I .. WAnt1Ns, J., & P1LK0N1S, P. A. (1996). The role of the therapeutic alliance in psychotherapy and phar-

48

macolherapy outcome · Findings in the Notional Institute of Menial Health Trcatmenc or Depression Collabonicive Research Program . Journal of Consulting and Clinical Psv . chology, 64, S32 - S39 .

LAMBERT, M. ( 1992) . Psychotherapy outcome research. Im- plications for integrative and eclectic therapists, In J. C Norcross & M, R. Goldfried (Eds.), Handbook of psycho• thtrap_v inttgration (pp. 94-129). New York: Basic Books.

LVAORSKY, L . ( 198S) A verification of Freud's grandest clini- cal hypothesis; The transference. Clinical Psychology Rt- vitw, 5 , 231 - 246

LuaoRsKY, L. (1990). The convergence of Freud's observa• lions about transference and the CCRT evidence. In L Luborsky & P. Crits-Christoph (Eds. ), Undm1anding transftrtnct: Tht cart conjlictwal rt/ationship thtmt mtthod {pp. 251 - 267) . New York: Basic Books ,

LueoRSKY, L, BARBER, J.P .• & BEUTLER, L. (1993). Intro- duction 10 special section: A briefing on curative factors in dynamic psychotherapy. Jowrnal of Consulting and Clinical Psychology. 61, 539- 541.

LVBORSKY, L .. BARBER , J. P., & CRITS•CHRJS'IOPH, P. (1990). Theory,based research for understanding the process of dy• namic psychotherapy. Jowrnal of Co11su/1ing and Clinical Psychology, 58, 281 - 287 .

LUIIORSKY. L., & CRITS-CHRISlOPH, P. (1990). Undtrs,and, ing transftrtnct: Tht cart conflictual r~lationship thtmt mtthod. New York: Basic Books.

LU80RSKY, L., D10LIER, L., LUIIORSKY, E , SINGER, B . • DICK- TER, D., & SCHMIOT, K . A. (1993). The efficacy or dy• namic psychotherapies; Is it true that 'everyone has won and all mU51 hove prizes'? In N. E. Miller, L. Luborslcy. J. P. Barber, & J . P. Docherty (Eds. ), Psychodynamic trtatmtnt rtstarch · A handbook for clinical pracllct (pp. 497-S16), New York: Basic Books

LuBoRSKY , L.. PoPP, C. , & BARBER, J P. ( 1994). Common and special factors in different transference-related mea, surcs. Psychotherapy Rts~arch, 4, 277 - 286 .

MIU.ER, N. E .• LURORSKY, L .• BARBER,,. P •• & DocllERTY, J. P. (Eds.). (1993). Psychodynamic trtatm~n, rtstarch· A handbook/or clinical practict. New York: Basic Books.

MITCHELi., S. A. ( 1988). Rtlational conupu in psychoana/y· sis An inttgration. Cambridge, MA . Harvard University Press.

MORAS, K., TELFER, L. A.&. BARLOW, D. H. (1993) . Effi. cacy and specific effects data on new 1rea1mcn1s: A case study strategy with mixed anxiety-depression . Journal of Conswlting and Clinical Psychology, 61, 412- 420.

NEWMAN, M. G .• CAS'l01'1GUAY, L. G . & BDRKOVEC, T. D. ( I 999, April). Ntw dimtnsions In tht trtatmtnt of gtn~ral- i:td a~i~ty disordtr: lnttrptrsonal focus and miotional duptning . Paper presented al the I 5th annual meeting of lhe Society for the Exploration of Psychotherapy ln1egra• cion. Miami. FL.

NEWMAN, M. G., CAS'IONOUAV, L. G •• BOIIKOYEC, T. o .. & MOLNAR, C. (in press). lntcgr.nive therapy for generalized anxiety disorder To be published in R. G. Heimberg, C. L. Turk,&. D. S. Mennin (Eds.), G~ntraliitd a~itty dlsordtr: Adi•ancts in rtstarch and practict. New York: Guilford.

NEWMAN, M. G .. CASTONGUAY, L. G., BoRKOVEC, T. D. , & SCHUT, A. J. (1999, November). lnttgrating c:ognitiVt• bthovloral, inttrptrsona/, and humanislic inltrv~ntions. Why should wt and how can wt? Poper presented at the First Mid,Adantic Chapter meeting of the Society for Psy- chotherapy Research. College Park, MD.

,,. _ 1 ""2 :;, ::: ·1

Psychoanalytic Research, Education, & Training

NORMANDIN, L. , & BOUCHARD, M.-A. (1993). The effects of theoretical orientation and experience on ntional, reactive, and reflective countcnransrerence. Psychothtrapy Rt· starch, 1 ; 77 • 94.

OoRODNICZUK, J. s .. PIPER, W. E., JOYCE, A. s .. & McCAL• LUM, M. ( 1999). Transference interpretations in short-tcnn dynamic psychotherapy. Journal of Ntrvous and Mtntal Distast, /87, 571 - 578.

ORLINSKY, D. E. , & GEu.u, J. D. (1993). Patients' represen· talions of their thenpists and therapy: New measures. In N. E . Miller, L . Lubonky, J. P. Barber, & J.P. Docherty (Eds.), hychodyNJmic tuaJmtnt rtstarch: A. handbook/or clinical pracrict (pp. 423 - 466), New York: Basic Books.

ORLINSKY , D. E ., & HowARD, K. I. (1966). Thtrapy stssion rtpon. Forms P & T . Chicago: Institute for Juvenile Research.

PERitv. J. C. (1993). Defenses and their effects. In N. E. Miller, L. Lubo~ky, J. P. Buber, &J.P. Docherty (Eds.), P:ychodyanmic trtatmtnl rtstarch: A. handbook for clini· cal practlct (pp. 274- 306). New York: Basic Books.

PIPER, W. E. , AzlM, H.F. A. , JoycE, A . S., & McCAU.UM, ,M. (1991). Tnnsference interpretations, therapeutic alli, ancc, and outcome in short-tenn individual psychotherapy. A.rchivts of Gtntral Psychiatry, 48, 946-953.

PIPEII, W. E .. DEIBANE, E.G., B1£NVENU, J. P. , DE CARUFEI.., F. L. , & GARANT, J. (1986). Relationships between the object focus of therapist intcq,retations and outcome in short-term individual psychotherapy. British Journal of Mtdfr:al Psychology, 59, 1- 11.

PIPER, w. E., DEIBANE, E. G . • DE CARUFEI.., F. L., & BIEN- VENU, J. P. (1987) . A system for differentiating lhenpist interpretations from other interventions. Bullttin of tht Mtnningtr Clinic, 5 I, 532- 550.

PIPEII, W. E .• JOYCE, A. s .. McCALLUM, M., & AziM. H. F. A. (1993). Concenuation and correspondence of transference interpretations in short·tcnn psychotherapy. Journal of Consulting and Clinical Psychology, 61, 586- 59S .

PlPllR, W. E .• JOYCE, A. s .. McCAU.UM, M .• & AzlM, H. F. A. (1998). Interpretive and supportive fonns of psy- chothenpy and patient personality variables. Journal of Consulting and Clinical Psychology, 66, 558-567.

R1CE, L. N., & GREENBEIIG, L. S. (1984 ). Patttrns of changt: lnttnsivt analysis of psychothtrap_v proetss. New York: Guilford,

SAFllAN, J. D •• & MURAN, J. C. (1996). The rcsohltKJ11 of ruptures in the thenpeutic alliance. Journal of ConsultinR and Clinical Psychology, 64, 447-458.

SAFRAN, J., & MURAN, J. C. (2000). Ntgoriating tht thtra· ptutic allianct: A rtlational trtatmtnt guidt. New York: Guilford.

SCHwABER, E. (1983). Psychoanalytic listening and psychic reality. lnttrnationa/ Rtvitw of P5Ychoana/ysis, /0, 379- 392.

S1LBER5CHATZ, G., FRETTER, P. B .. & CURTIS, J. T. (1986). How do interpretations influence the process of psychother- apy? Journal of Consulting and Clinical Psychology, 54, 646- 652.

STIV.CHEY, l . (1934). The nature of lhe 1herapeutic action of psychoanalysis. /nttrnatioNJI Journal of Psychoanalysis, 15, 127- 159.

SnuPP, H. H. (1976). Some critical comments on lhc future of psychoanalylic psychothcnpy. Bulltt/n of tht Mtnningtr Clinic, 40, 238 - 254.

WAt.t.£XSTEIN, R. S. , & DEWm, K. N. (1997). Intervention modes in psychoanalysis and in psychoanalytic psychother- apies: A revised classification . JourMI of Psychothtrap_v lnttgrarion, 7, 129- 150.

WEISS, J., & SAMPSON, H. (1986). Tht psychoanalytic pro• ctSJ: Thtory. clinical obstntation, and m,pirical rt1tarch . New York: Guilford.

WE.STEN, D. (1998) . The scientific legacy of Sigmund Freud: Toward a psychodynamically informed psychological sci- ence. Psychological Bullttin, 124, 333-371.

WESTUMAN, M. A. (1998). Curvilinear tnjcctory in patient coordination over the course of shon-tcnn psychotherapy. Psychothtrapy, 15, 206-219.

Wcx.FE, B. E., & GoLDf'RtED, M. R. (1988). Research on psychotherapy integration: Recommendations and conclu- sions from an NIMH workshop. Journal of Consulting and Clinical PsycholoRY, 56, 448-451.

Zaza, E. R. ( 1956). Cum:nt concepts of tnnsfcrencc. /nttr· natioNJI Journal of Psychoanalysis, J7, 367-376.

49