We examine project drop-out in 39 sessions of psychodynamic group therapy. A total of 327 patients were included in the project, but 25.4% (83) did not evaluate outcome. According to therapists’ evaluation only 25.3% of the project drop-outs “improved” in “symptoms and problems” as compared with 79.1% of the project responders. According to Jacobson & Truax’s classification of Reliable Change, 52.9% of the project responders had a reliable improvement in the SCL-90 R Global Severity Index (GSI). Based on the relationship between therapist evaluations and GSI we estimated that only 43.7% of the whole samples might have had a reliable improvement in GSI. The SPSS standard statistical imputations procedure estimated that 48.6% of the patients reliably improved in GSI, and 50.2% when therapist evaluations were not included. It is concluded that therapist evaluations are essential in order to avoid bias in reported outcome solely based on project responders in the present naturalistic study, where outcome data probably are missing not at random.
KeywordsPsychodynamic Group TherapyProject Drop-OutMissing Outcome DataTherapist Evaluations
Bell, M. L., Kenward, M. G., Fairclough, D. L., & Horton, N. J. (2013). Differential Dropout and Bias in Randomised Controlled Trials: When It Matters and When It May Not. British Medical Journal, 346, e8668. https://doi.org/10.1136/bmj.e8668
Bohart. A. C., & Wade, A. G. (2013). The Client in Psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield’s Handbook of Psychotherapy and Behavior Change (6th ed., pp. 219-257). Hoboken, New Jersey: John Wiley & Sons, Inc.
Brueton, V. C., Tierney, J., Stenning, S., Harding, S., Meredith, S., Nazareth, I., & Rait, G. (2014). Methods That Might Help to Keep People in Randomised Trials. A Cochrane Systematic Review and Meta-Analysis. British Medical Journal Open, 4, e003821. https://doi.org/10.1136/bmjopen-2013-003821
Chapman, C. L., Burlingame, G. M., Gleave, R., Rees, F., Beecher, M., & Porter, G. S. (2012). Clinical Prediction in Group Psychotherapy. Psychotherapy Research, 22, 673-681. https://doi.org/10.1080/10503307.2012.702512
Chiesa, M., Fonagy, P., Bateman, A. W., & Mace, C. (2009). Psychiatric Morbidity and Treatment Pathway Outcomes of Patients Presenting to Specialist NHS Psychodynamic Psychotherapy Services: Results from a Multi-Centre Study. Psychology and Psychotherapy: Theory, Research and Practice, 82, 83-98. https://doi.org/10.1348/147608308X339512
Clark, D. M., Layard, R., Smithies, R., Richards, D. A., Suckling, R., & Wright, B. (2009). Improving Access to Psychological Therapy: Initial Evaluations of Two UK Demonstration Sites. Behaviour Research and Therapy, 47, 910-920. https://doi.org/10.1016/j.brat.2009.07.010
Crameri, A., von Wyl, A., Koemeda, M., Schulthess, P., & Tschuschke, V. (2015). Sensitivity Analysis in Multiple Imputation in Effectiveness Studies of Psychotherapy. Frontiers in Psychology, 16, 1-11.
Danske Regioner (2012). Pakkeforløb i psykiatrien. http://www.regioner.dk/Aktuelt/Nyheder/2012/Juni/Pakkeforl%C3%B 8b+vil+l%C3%B8fte+kvalitet+og+middellevetid+for+psykisk+syge.aspx
Dong, Y., & Peng, C.-Y. J. (2013). Principled Missing Data Methods for Researchers. Springer Plus, 2, 222. https://doi.org/10.1186/2193-1801-2-222
Elkjær, H., Mortensen, E. L., Poulsen, S., Kristensen, E., & Lau, M. (2012). (U)overensstemmelse mellem behandlerog patientvurdering af effekt af gruppeterapi. Matrix, 1, 23-38.
Eskildsen, A., Hougaard, E., & Rosenberg, N. (2010). Pre-Treatment Patient Variables as Predictirs of Drop-Out and Treatment Outcome in Cognitive Behavioural Therapy for Social Phobia: A Systematic Review. Nordic Journal of Psychiatry, 64, 94-105. https://doi.org/10.3109/08039480903426929
Fewtress, M. S., Kennedy, K., Singhal, A., Martin, R. M., Ness, A., Hadders-Algra, M., Koletzko, B., & Lucas, A. (2008). How Much Loss to Follow-Up Is Acceptable in Long-Term Randomized Trials and Prospective Studies? Archives of Disease in Childhood, 93, 458-461. https://doi.org/10.1136/adc.2007.127316
Graham, J. W. (2009). Missing Data Analysis: Making It Work in the Real World. Annual Review of Psychology, 60, 549-576. https://doi.org/10.1146/annurev.psych.58.110405.085530
Green, B. L., Gleser, G. C., Stone, W. N., & Seifert, R. F. (1975). Relationships among Diverse Measures of Psychotherapy Outcome. Journal of Consulting and Clinical Psychology, 43, 689-699. https://doi.org/10.1037/0022-006X.43.5.689
Groenwold, R. H., Donders, R. T., Roes, K. C, Harrell, F. E., & Moons, K. G. (2012). Dealing with Missing Outcome Data in Randomized Trials and Observational Studies. American Journal of Epidemiology, 175, 210-217. https://doi.org/10.1093/aje/kwr302
Hill, C. E., & Lambert, M. J. (2004). Methodological Issues in Studying Psychotherapy Processes and Outcomes. In M. J. Lambert (Ed.), Bergin and Garfield’s Handbook of Psychotherapy and Behavior Change (pp. 87-135). New York: John Wiley & Sons.
Jacobson, N. S., & Truax, P. (1991). Clinical Significance. A Statistical Approach to Defining Meaningful Change in Psychotherapy Research. Journal of Consulting and Clinical Psycholology, 59, 12-19. https://doi.org/10.1037/0022-006X.59.1.12
Jensen, H. H., Mortensen, E. L., & Lotz, M. (2014). Drop-Out from a Psychodynamic Group Psychotherapy Outpatient Unit. Nordic Journal of Psychiatry, 68, 594-604. https://doi.org/10.3109/08039488.2014.902499
Jensen, H. H., Mortensen, E. L., & Lotz, M. (2013). SCL-90-R Symptom Profiles and Outcome of Short-Term Psychodynamic Group Therapy. ISRN Psychiatry, 2013, Article ID: 450137.
Jensen, H. H., Mortensen, E. L., & Lotz, M. (2010). Effectiveness of Short-Term Psychodynamic Group Therapy in a Public Outpatient Psychotherapy Unit. Nordic Journal of Psychiatry, 64, 106-114. https://doi.org/10.3109/08039480903443874
Jensen, H. H., Mortensen, E. L., & Lotz, M. (2008). The Association between Retrospective Outcome Evaluations and Pre-Post-Treatment Changes in Psychodynamic Group-Psychotherapy. Scandinavian Journal of Psychology, 49, 339-343. https://doi.org/10.1111/j.1467-9450.2008.00656.x
Jung, S. I., Serralta, F. B., Nunes, M. C. T., & Eizirik, C. L. (2013). Beginning and End of Treatment of Patients Who Dropped out of Psychoanalytic Psychotherapy. Trends in Psychiatry and Psychotherapy, 35, 181-190. https://doi.org/10.1590/S2237-60892013000300005
Kristman, V., Manno, M., & Cote, P. (2004). Loss to Follow-Up in Cohort Studies: How Much Is too Much? European Journal of Epidemiology, 19, 751-760. https://doi.org/10.1023/B:EJEP.0000036568.02655.f8
Lambert, M. J. (2013). Outcome in Psychotherapy: The Past and Important Advances. Psychotherapy, 50, 42-51. https://doi.org/10.1037/a0030682
Leichsenring, F., & Rabung, S. (2007). The Role of Efficacy vs. Effectiveness Research in Evaluating Psychotherapy. Mental Health and Learning Disabilities Research and Practice, 4, 125-143. https://doi.org/10.5920/mhldrp.2007.42125
Little, R. J., D’Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., Frangakis, C., Hogan, J. W., Molenberghs, G., Murphy, S. A., Neaton, J. D., Rotnitzky, A., Scharfstein, D., Shih,, W. J., Siegel, J. P., & Stern, H. (2012). The Prevention and Treatment of Missing Data in Clinical Trials. The New England Journal of Medicine, 367, 1355-1360. https://doi.org/10.1056/NEJMsr1203730
Lotz, M., & Jensen, H. H. (2006). Focus in Psychodynamic Group Therapy. Nordic Psychology, 58, 248-261. https://doi.org/10.1027/1901-2276.58.3.248
Nathan, P. E, Stuart, S. P., & Dolen, S. L. (2000). Research on Psychotherapy Efficacy and Effectiveness: Between Scylla and Charybdis. Psychological Bulletin, 120, 954-981. https://doi.org/10.1037/0033-2909.126.6.964
Newman, D. A. (2014). Missing Data: Five Practical Guidelines. Organizational Research Methods, 17, 372-411. https://doi.org/10.1177/1094428114548590
Olsen, L. R., Mortensen, E. L., & Bech, P. (2006) Mental Distress in the Danish General Population. Acta Psychiatrica Scandinavica, 113, 477-484. https://doi.org/10.1111/j.1600-0447.2005.00743.x
Samstag, L. W., Batchelder, S. T., Muran, J. C., Safran, J. D. et al. (1994). In-Session Interpersonal Predictors of Treatment Outcome. York: Society for Psychotherapy Research.
Samstag, L. W., Batchelder, S. T., Muran, J. C., Safran, J. D., & Winston, A. (1998). Early Identification of Treatment Failures in Short-Term Psychotherapy. Journal of Psychotherapy Practice and Research, 7, 126-143.
Schlomer, G. L., Bauman, S., & Card, N. O. (2010). Best Practices for Missing Data Management in Counseling Psychiatry. Journal of Counseling Psychology, 57, 1-10. https://doi.org/10.1037/a0018082
Spineli, L. M., Pandis, N., & Salanti, G. (2015). Reporting and Handling Missing Outcome Data in Mental Health: A Systematic Review of Cochrane Systematic Reviews and Meta-Analysis. Research Synthesis Methods, 6, 175-187. https://doi.org/10.1002/jrsm.1131
SPSS for Windows Inc. Version 22. Chicago, Illinois.
Strauss, B. M., Lutz, W., Steffanowski, A., Wittmann, W. W., Boehnke, J. R., Rubel, J., Scheidt, C. E., Caspar, F., Vogel, H., Altmann, U., Steyer, R., Zimmermann, A., Bruckmayer, E., von Heimann, F., Kramer, D., & Kirchmann, H. (2015). Benefits and Challenges in Practice-Oriented Psychotherapy Research in Germany: The TK and the QS-PSY-BAY Projects of Quality Assurance in Outpatient Psychotherapy. Psychotherapy Research, 25, 32-51. https://doi.org/10.1080/10503307.2013.856046
Streiner, D. L. (2008). Missing Data and the Trouble with LOCF. Evidence Based Mental Health, 11, 3-5. https://doi.org/10.1136/ebmh.11.1.3-a
Streiner, D., & Geddes, J. (2001). Intention to Treat Analysis in Clinical Trials Where There are Missing Data. Evidence Based Mental Health, 4, 70-71. https://doi.org/10.1136/ebmh.4.3.70
Swift, J. K., & Greenberg, R. P. (2015). Premature Termination in Psychotherapy. Washington DC: American Psychological Association.