Resource Readings

Psychology 645.4: Psychotherapy Outcome Research
William B. Stiles, Instructor
Fall Semester, 2005

 

Reviews of Outcome Research

Elliott, R., Greenberg, L. S., & Lietaer, G. (2004). Research on experiential psychotherapies. In M. J. Lambert, (Ed), Bergin and Garfield's handbook of psychotherapy and behavior change (5th ed.), New York: Wiley.

Dobson K. (1989). A meta-analysis of the efficacy of cognitive therapy for depression. Journal of Consulting and Clinical Psychology, 57, 414-420.

Gloaguen, V., Cottraux, J., Cucherat, M., & Blackburn, I-M. (1998). A meta-analysis of the effects of cognitive therapy in depressed patients. Journal of Affective Disorders, 49, 59-72.

Hollon, S. D., Thase, M. E., & Markowitz, J. C. (2002). Treatment and prevention of depression. Psychological Science in the Public Interest, 3, 39-77

Hollon, S. D., & Beck, A. T. (2004). Cognitive and cognitive behavioral therapies. In M. J. Lambert (Ed.), Garfield and Bergin's Handbook of psychotherapy and behavior change (5th ed., pp 447-492). New York: Wiley.

Lambert, M. J., & Ogles, B. M. (2004). The efficacy and effectiveness of psychotherapy. In M. J. Lambert (Ed.) Bergin and Garfield's handbook of psychotherapy and behavior change (5th ed.). New York: Wiley.

Lambert, M. J., & Bergin, A. E. (1994). The effectiveness of psychotherapy. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (4th ed., pp. 143-189). New York: Wiley.

Leichsenring, F. (2001). Comparative effects of short-term psychodynamic psychotherapy and cognitive-behavioral therapy in depression: a meta-analytic approach. Clinical Psychology Review, 21, 401-419.

Leichsenring, F., & Leibing, E. (2003). The effectiveness of psychodynamic therapy and cognitive behavior therapy in the treatment of personality disorders: a meta-analysis. American Journal of Psychiatry, 160, 1223-1232.

Leichsenring F., Rabung, S., & Leibing E. (2004). The efficacy of short-term psychodynamic psychotherapy in specific psychiatric disorders: a meta-analysis. Archives of General Psychiatry, 6, 1208-16.

Lipsey, M. W., & Wilson, D. B. (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48, 1181-1209.

Roth, A., & Fonagy, P. (2004). What works for whom? A critical review of psychotherapy research (second edition). New York: Guilford Publications, 2004.

Shadish, W. R., Matt, G. E., Navarro, A. N., & Phillips, G. (2000). The effects of psychological therapies under clinically representative conditions.  Psychological Bulletin, 126, 512-529.

Shapiro, D. A., & Shapiro, D. (1982). Meta-analysis of comparative therapy outcome studies: A replication and refinement. Psychological Bulletin, 92, 581-604.

Smith, M. L., & Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32, 752-760.

Smith, M. L., Glass, G. V., & Miller, T. I. (1980). The benefits of psychotherapy. Baltimore: The Johns Hopkins University Press.

Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. N. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, ''all must have prizes." Psychological Bulletin, 122, 203-215.

Wampold, B. E. (2001). The great psychotherapy debate: Models, methods, and findings. Mahwah, NJ: Lawrence Erlbaum Associates.

Westen, D., & Morrison, K. (2001). A multidimensional meta-analysis of treatments for depression, panic, and generalized anxiety disorder: An empirical examination of the status of empirically supported therapies.  Journal of Consulting and Clinical Psychology, 69, 875-899.

Dodo Verdict

Beutler, L. E. (1991). Have all won and must all have prizes? Revisiting Luborsky et al.'s verdict. Journal of Consulting and Clinical Psychology, 59, 226-232.

Elliott, R., Stiles, W. B., & Shapiro, D. A. (1993). "Are some psychotherapies more equivalent than others?" In T. R. Giles (Ed.), Handbook of effective psychotherapy (pp. 455-479). New York: Plenum Press.

Luborsky, L., Singer, B., & Luborsky, L. (1975). Comparative studies of psychotherapies: Is it true that "Everyone has won and all must have prizes"? Archives of General Psychiatry, 32, 995-1008.

Norcross, J. C. (1995). Dispelling the dodo bird verdict and the exclusivity myth in psychotherapy. Psychotherapy, 32, 500-504.

Rosenzweig, S. (1936). Some implicit common factors in diverse methods of psychotherapy. American Journal of Orthopsychiatry, 6, 412-415.

Stiles, W. B., Shapiro, D. A., & Elliott, R. (1986). "Are all psychotherapies equivalent?" American Psychologist, 41, 165 180.

Some Major Studies of Outcome

Barlow, D., Gorman, J., Shear, M.K., & Woods, S.W. (2000).  Cognitive-behavioral therapy, imipramine, or their combination for panic disorder:  A randomized controlled trial.  Journal of the American Medical Association, 283, 2529-2536.

Clark, D., Salkovskis, P., Hackman, A., Middleton, H., Anastasiades, P. & Gelder M. (1994). A comparison of cognitive therapy, applied relaxation and imipramine in the treatment of panic disorder. British Journal of Psychiatry, 164, 759-769.

Crits-Christoph, P. (1999). Psychosocial treatments for cocaine dependence: National Institute on Drug Abuse Collaborative Cocaine Treatment Study. Archives of General Psychiatry, 56, 493-502.

Elkin, I. (1994). The NIMH Treatment of Depression Collaborative Research Program: Where we began and where we are. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change, 4th ed. (pp. 114-139). New York: Wiley.

Elkin, I., Shea, M. T., Watkins, J. T., Imber, S. D, Sotsky, S. M., Collins, J. F., Glass, D. R, Pilkonis, P. A., Leber, W. R., Docherty, J. P., Fiester, S. J., & Parloff, M. B. (1989). National Institute of Mental Health Treatment of Depression Collaborative Research Program: General effectiveness of treatments. Archives of General Psychiatry, 46, 971-982.

Goldman, R. N., Greenberg, L. S., & Angus, L. (in press). The effects of adding emotion-focused interventions to the therapeutic relationship in the treatment of depression. Psychotherapy Research.

Greenberg, L. S., & Watson, J. (1998). Experiential therapy of depression: Differential effects of client centered relationship conditions and active experiential interventions. Psychotherapy Research, 8, 210-224.

Hollon, S., DeRubeis, R., Evans, M., Weimer, M., Garvey, M., Grove, W. & Tuason, V. (1992). Cognitive therapy and pharmacotherapy for depression. Archives of General Psychitry, 49, 774-781.

Seligman, M. (1995). The effectiveness of psychotherapy: The Consumer Reports study. American Psychologist, 50, 965-974.

Shapiro, D. A., & Firth, J. A. (1987) Prescriptive vs. Exploratory Psychotherapy: Outcomes of the Sheffield Psychotherapy Project. British Journal of Psychiatry, 151, 790-799.

Shapiro, D. A., Barkham, M., Rees, A. Hardy, G. E., Reynolds, S., & Startup, M. (1994). Effects of treatment duration and severity of depression on the effectiveness of cognitive/behavioral and psychodynamic/interpersonal psychotherapy. Journal of Consulting and Clinical Psychology, 62, 522-534.

Sloane, R. B., Staples, F. R., Cristol, A. H., Yorkston, N. J., & Whipple, K. (1975). Psychotherapy versus behavior therapy. Cambridge, MA: Harvard University Press.

Strupp, H. H., & Hadley, S. W. (1979). Specific versus nonspecific factors in psychotherapy: A controlled study of outcome. Archives of General Psychiatry, 36, 1125-1136.

Ward, E., King, M., Lloyd, M., Bower, P., Sibbald, B., Farrelly, S., Gabbay, M., Tarrier, N., & Addington-Hall, J. (2000). Randomised controlled trial of non-directive counselling, cognitive-behaviour therapy, and usual general practitioner care for patients with depression. I: Clinical effectiveness. BMJ, 321, 1383 - 1388.

Watson, J.C., Gordon, L.B. Stermac, L., Steckley, P., & Kalogerakos, A.  (2003). Comparing the effectiveness of process-experiential with cognitive-behavioral psychotherapy in the treatment of depression. Journal of Consulting and Clinical Psychology.

Follow-up Studies

Shapiro, D., & Firth-Cozens, J. (1990). Two-year follow-up of the Sheffield psychotherapy project. British Journal of Psychiatry, 157, 389-391.

Shapiro, D. A., Rees, A., Barkham, M., Hardy, G. E., Reynolds, S., & Startup, M. J. (1995). Effects of treatment duration and severity of depression on the maintenance of gains following cognitive/behavioral and psychodynamic/interpersonal psychotherapy. Journal of Consulting and Clinical Psychology, 63, 378-387.

Shea, M., Elkin, I., Imber, S., Sotsky, S., Watkins, J., Collins, J., Pilkonis, P., Beckham, E., Glass, D., Dolan, R. & Parloff, M. (1992). Course of depressive symptoms over follow-up: findings from the National Institue of Mental Health treatment of depression collaborative research program. Archives of General Psychiatry, 49, 782-787.

Assessment of Outcome: Methods

Haaga, D. A. F., & Stiles, W. B. (2000). Randomized clinical trials in psychotherapy research: Methodology, design, and evaluation. In C. R. Snyder & R. E. Ingram (Eds.), Handbook of psychological change: Psychotherapy processes and practices for the 21st century (pp. 14-39). New York: Wiley.

Kazdin, A. E. (1986). Comparative outcome studies of psychotherapy: Methodological issues and strategies. Journal of Consulting and Clinical Psychology, 54, 95-105.

Kazdin, A. E. (1994). Methodology, design, and evaluation in psychotherapy research. In A. E. Bergin & S. L. Garfield (eds.), Handbook of psychotherapy and behavior change (pp. 19-71), 4th edition, Chichester: John Wiley & Sons,

Assessment of Outcome: Measures

Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C., Benson, L., Connell, J., Audin, K. & McGrath, G. (2001). Service profiling and outcomes benchmarking using the CORE-OM: Towards practice-based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69, 184-196.

Barkham M, Gilbert, N., Connell, J., Marshall, C. & Twigg, E. (2005). Suitability and utility of the CORE-OM and CORE-A for assessing severity of presenting problems in psychological therapy services based in primary and secondary care settings. British Journal of Psychiatry, 186, 239-246.

Beck, A.T., Epstein, N., Brown, G. & Steer, R.A. (1988). An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology, 56, 893-897.

Beck, A.T., Steer, R.A. & Garbin, M.G. (1988). Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clinical Psychology Review, 8, 77-100.

Beck, A. T., Ward, C. H., Mendelson, M., Mock, J., & Erbaugh, J. (1961). An inventory for measuring depression. Archives of General Psychiatry, 4, 561-571.

Endicott, J., Spitzer, R.L., Fleiss, J.L., Cohen, J. (1976). The Global Assessment Scale: Procedure for measuring overall severity of psychiatric disturbance. Archives of General Psychiatry, 33, 766-771.

Evans, C., Connell, J., Barkham, M., Margison, F., Mellor-Clark, J., McGrath, G. & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE-OM. British Journal of Psychiatry, 180, 51-60.

Horowitz, L.M., Rosenberg, S.E., Baer, B.A., Ureno, G. & Villasenor, V.S. (1988). Inventory of Interpersonal Problems: Psychometric properties and clinical applications. Journal of Consulting and Clinical Psychology, 56, 885-892.

Rosenberg, M. (1965). Society and the adolescent self image. Princeton, NJ: Princeton University Press.

Spitzer, R., Williams, J., Gibbon, M., & First, M. (1995). Structured Clinical Interview for DSM-IV. New York, NY: American Psychiatric Press Inc.

Clinical Significance

Jacobson, N.S. & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.

Jacobson, N.S., Roberts, L.J., Berns, S.B. & McGlinchey, J.B. (1999). Methods for defining and determining the clinical significance of treatment effects: Description, application, and alternatives. Journal of Consulting and Clinical Psychology, 67, 300-307.

Nietzel, M. T., Russell, R. L., Hemmings, K. A., & Gretter, M. L. (1987). Clinical significance of psychotherapy for unipolar depression: A meta-analytic approach to social comparison. Journal of Consulting and Clinical Psychology, 55, 156-161.

Ogles, B.M., Lambert, M.J., & Sawyer, J.D. (1995).  Clinical significance of the National Institute of Mental Health Treatment of Depression Collaborative Research Program Data.  Journal of Consulting and Clinical Psychology, 63, 321-326.

Alternative Explanations: Allegiance, Responsiveness

Gaffan, E. A., Tsaousis, I., & Kemp-Wheeler, S. M. (1995). Researcher allegiance and meta-analysis: The case of cognitive therapy for depression. Journal of Consulting and Clinical Psychology, 63, 966-980.

Hardy, G. E., Stiles, W. B., Barkham, M., & Startup, M. (1998). Therapist responsiveness to client interpersonal styles during time-limited treatments for depression. Journal of Consulting and Clinical Psychology, 66, 304-312.

Luborsky, L., Diguer, L., Seligman, D. A., Rosenthal, R., Krause, E. D., Johnson, S., Halperin, G., Bishop, M., Berman, J. S., & Schweizer, E. (1999). The researcher's own therapy allegiances: A ''wild card'' in comparisons of treatment efficacy. Clinical Psychology: Science and Practice, 6, 95-106.

Robinson, L. A., Berman, J. S., & Neimeyer, R. A. (1990). Psychotherapy for the treatment of depression: A comprehensive review of controlled outcome research. Psychological Bulletin, 108, 30-49.

Stiles, W. B., Honos-Webb, L., & Surko, M. (1998). Responsiveness in psychotherapy. Clinical Psychology: Science and Practice, 5, 439-458.