Predictors of nonresponse and drop-out among children and adolescents receiving TF-CBT: investigation of client-, therapist-, and implementation factors
Ane-Marthe Solheim Skar, Nora Braathu, Tine K Jensen, Silje Mørup Ormhaug, Ane-Marthe Solheim Skar, Nora Braathu, Tine K Jensen, Silje Mørup Ormhaug
Abstract
Background: There is a paucity of evidence about effective implementation strategies to increase treatment response and prevent drop-out among children receiving evidence-based treatment. This study examines patient, therapist, and implementation factors and their association to nonresponse and drop-out among youth receiving Trauma-Focused Cognitive Behavioral Therapy (TF-CBT).
Methods: Youth (n = 1240) aged 6-18 (M = 14.6) received TF-CBT delivered by 382 TF-CBT therapists at 66 clinics. Odds ratio analyses were used to investigate whether pretreatment child (age, gender, number of trauma experiences, post-traumatic stress symptoms (PTSS), therapist (education), and implementation strategy factors (high-low, low-low, low-high intensity therapist and leadership training respectively) or tele-mental health training during the Covid-19 pandemic are associated with nonresponse (above clinical PTSS level post-treatment) and drop-out (therapist-defined early termination). Fidelity checks were conducted to ensure that TF-CBT was used consistently.
Results: One fourth of the children (24.4%) were nonresponders and 13.3 percent dropped out. Exposure to three or more traumatic experiences were related to nonresponse and drop-out. Higher baseline PTSS was related to a higher probability of nonresponse. There was no effect of therapist education or child gender on nonresponse and drop-out, whereas children over 15 years had a higher likelihood of both. After controlling for baseline PTSS, the effect of age on nonresponse was no longer significant. Drop-out was related to fewer sessions, and most dropped out during the first two phases of TF-CBT. Fidelity was high throughout the different implementation phases. High-intensity therapist training was related to a lower probability of both nonresponse and drop-out, whereas low therapist and leadership training were related to a higher likelihood of both. Multivariate analysis revealed higher child age and higher PTSS baseline scores as significant predictors of nonresponse, and number of trauma experiences (> = 3) at baseline as the only predictor of drop-out.
Conclusions: High-intensity therapist training seem key to prevent patient nonresponse and drop-out. Leadership training might positively affect both, although not enough to compensate for less intensive therapist training. More complex cases (higher PTSS and exposure to more traumas) predict nonresponse and drop-out respectively, which underscores the importance of symptom assessment to tailor the treatment. The lack of predictive effect of therapist education increases the utilization of TF-CBT.
Trial registration: Retrospectively registered in ClinicalTrials, ref. nr. NCT05248971.
Keywords: Attrition; Evidence-based practice; Treatment interruption.
Conflict of interest statement
The authors declare that they have no competing interests.
© 2022. The Author(s).
Figures
References
- Aarons GA, Ehrhart MG, Farahnak LR, Hurlburt MS. Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implement Sci. 2015;10:11. doi: 10.1186/s13012-014-0192-y.
- Aarons GA, Ehrhart MG. (2022). Leading implementation by focusing on strategic implementation leadership. Implementation Science, 1st Edition, Routledge.
- Akoglu H. User's guide to correlation coefficients. Turk J Emerg Med. 2018;18(3):91–93. doi: 10.1016/j.tjem.2018.08.001.
- Alisic E, Zalta AK, Wesel F, Larsen SE, Smid GE. Rates of posttraumatic stress disorder in trauma-exposed children and adolescents: meta-analysis. Br J Psychiatry. 2014;204:335–340. doi: 10.1192/bjp.bp.113.131227.
- Amaya-Jackson L, Hagele D, Sideris J, Potter D, Briggs EC, Keen L, Murphy RA, Dorsey S, Parchett V, Ake GS, Socolar R. Pilot to policy: Statewide dissemination and implementation of evidence-based treatment for traumatized youth. BMC Health Serv Res. 2018;18(1):589. doi: 10.1186/s12913-018-3395-0.
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fifth edition. (DSM-5). 2013.
- Bates, D., Maechler, M., Bolker, B., Walker, S., Christensen, R. H., Singmann, H., Krivitsky, P. N. (2021). LME4: Linear mixed-effects models using 'Eigen' and S4. Retrieved November 6, 2021, from
- Bear HA, Edbrooke-Childs J, Norton S, Krause KR, Wolpert M. Systematic review and meta-analysis: outcomes of routine specialist mental health care for young people with depression and/or anxiety. Child AdolescPsychiatr. 2020;59(7):810–841.
- Borge RH, Egeland KM, Aarons GA, Ehrharat MG, Sklar M, Skar A-MS. “Change Doesn’t Happen by Itself”: A Thematic Analysis of First-Level Leaders’ Experiences Participating in the Leadership and Organizational Change for Implementation (LOCI) Strategy. Adm Policy Ment Health. 2022;542:5.
- Borrelli B, Sepinwall D, Ernst D, Orwig D. A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. J Consult Clin Psychol. 2005;73(5):852–860. doi: 10.1037/0022-006X.73.5.852.
- Cohen JA, Deblinger E, Mannarino AP, Steer R. A Multi-site, randomized controlled trial for children with abuse-related PTSD symptoms. J Am Acad Child Adolesc Psychiatry. 2004;43(4):393–402. doi: 10.1097/00004583-200404000-00005.
- Cohen JA, Mannarino AP, Iyengar S. Community treatment of posttraumatic stress disorder for children exposed to intimate partner violence: a randomized controlled trial. Arch Pediatr Adolesc Med. 2011;165:16–21. doi: 10.1001/archpediatrics.2010.247.
- Cohen JA, Mannarino AP, Deblinger E. (2006). Treating trauma and traumatic grief in children and adolescents. Guilford Press.
- Cohen JA, Mannarino AP, Deblinger E. (2016). Treating trauma and traumatic grief in children and adolescents. Guilford Publications.
- Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50:217–226. doi: 10.1097/MLR.0b013e3182408812.
- Deblinger E, Cohen J, Mannarino A, Runyon M, Hanson R. TF-CBT PRACTICE fidelity Checklist. Unpublished instrument. Stratford: CARES Institute, RowanSOM; 2014.
- Deblinger E, Mannarino AP, Cohen JA, Runyon MK, Steer RA. Trauma-focused cognitive behavioral therapy for children: impact of the trauma narrative and treatment length. Depress Anxiety. 2011;28(1):67–75. doi: 10.1002/da.20744.
- de Haan AM, Boon AE, de Jong JTVM, Vermeiren RRJM. A meta-analytic review on treatment dropout in child and adolescent outpatient mental health care. Clin Psychol Rev. 2013;33(5):698–711. doi: 10.1016/j.cpr.2013.04.005.
- Diehle J, Opmeer B, Broer F, Mannarino AP, Lindauer RJL. Trauma-focused cognitive behavioral therapy or eye movement desensitization and reprocessing: what works in children with posttraumatic stress symptoms? A randomized controlled trial. Eur Child Adolesc Psychiatry. 2015;24(2):227–236. doi: 10.1007/s00787-014-0572-5.
- Dossett KW, Reid GJ. Defining dropout from children's mental health services: a novel need-based definition. J Child Fam Stud. 2020;29:2028–2038. doi: 10.1007/s10826-019-01631-1.
- Egeland KM, Skar A-MS, Endsjø M ... Aarons GA. Testing the leadership and organizational change for implementation (LOCI) intervention in Norwegian mental health clinics: a stepped-wedge cluster randomized design study protocol. Implement Sci. 2019;14(1). 10.1186/s13012-019-0873-7.
- Espeleta HC, Peer SO, Are F, Hanson R. (2021). Therapists' Perceived Competence in Trauma-Focused Cognitive Behavioral Therapy and Client Outcomes: Findings From a Community-Based Learning Collaborative. Child Maltreatment. 10.1177/10775595211003673
- Finkelhor D, Ormrod RK, Turner HA, Holt MA. Pathways to poly-victimization. Child Maltreat. 2009;14(4):316–329. doi: 10.1177/1077559509347012.
- Fritz CO, Morris PE, Richler JJ. Effect size estimates: current use, calculations, and interpretation. J Exp Psychol Gen. 2012;141(1):2. doi: 10.1037/a0024338.
- Green JG, McLaughlin KA, Berglund P, Gruber MJ, Sampson NA, Zaslavsky AM, Kessler RC. Childhood adversities and adult psychopathology in the National Comorbidity Survey Replication (NCS-R) I: Associations with first onset of DSM-IV disorders. Arch Gen Psychiatry. 2010;62:113–123. doi: 10.1001/archgenpsychiatry.2009.186.
- Grol R, Wensing M. (2013). Effective implementation of change in healthcare: a systematic approach. Wiley online Library. In Grol R, Wensing M, Eccles M, Davis D. Improving Patient Care, 2nd Edition. The Implementation of Change in Health Care. Wiley Blackwell, BMJ Books.
- Hauber K, Boon A, Vermeiren R. Therapeutic Relationship and Dropout in High-Risk Adolescents' Intensive Group Psychotherapeutic Programme. Front Prychol. 2020. 10.3389/fpsyg.2020.533903
- Hunsley J, Aubry TD, Verstervelt CM, Vito D. Comparing therapist and client perspectives on reasons for psychotherapy termination. Psychother Theory Res Pract Train. 1999;36(4):380. doi: 10.1037/h0087802.
- International Society for Traumatic Stress Studies, ISTSS (2021). From
- Jaberghaderi N, Rezaei M, Kolivand M, Shokoohi A. Effectiveness of cognitive behavioral therapy and eye movement desensitization and reprocessing in child victims of domestic violence. Iran J Psychiatry. 2019;14(1):67–75.
- Jensen TK, Holt T, Ormhaug SM, Egeland K, Granly L, Hoaas LC, Wentzel-Larsen T. A randomized effectiveness study comparing trauma-focused cognitive behavioral therapy with therapy as usual for youth. J Clin Child Adolesc Psychol. 2014;43(3):356–369. doi: 10.1080/15374416.2013.822307.
- Kazdin AE, Mazurick JL, Siegel TC. Treatment outcome among children with externalizing disorder who terminate prematurely versus those who complete psychotherapy. J Am Acad Child Adolesc Psychiatry. 1994;33:549–557. doi: 10.1097/00004583-199405000-00013.
- Kar N. Cognitive behavioral therapy for the treatment of posttraumatic stress disorder: a review. Neuropsychiatr Dis Treat. 2011;7:167–181. doi: 10.2147/NDT.S10389.
- Kessler RC, McLaughlin KA, Green JG, Gruber MJ, Sampson NA, Zaslavsky AM, Williams DR. Childhood adversities and adult psychopathology in the WHO World Mental Health Surveys. Br J Psychiatry. 2010;197:378–385. doi: 10.1192/bjp.bp.110.080499.
- Knutsen ML, Sachser C, Holt T, Goldbeck L, Jensen TK. Trajectories and possible predictors of treatment outcome for youth receiving trauma-focused cognitive behavioral therapy. Psychol Trauma. 2020;12(4):336–346. doi: 10.1037/tra0000482.
- Lee E, Bowles K. (2020). Navigating treatment recommendation for PTSD: A rapid review. Int J Ment Health, 10.1080/00207411.2020.1781407
- Lee E, Faber J, Bowles K. A Review of Trauma Specific Treatments (TSTs) for Post-Traumatic Stress Disorder (PTSD) Clin Soc Work J. 2022;50:147–159. doi: 10.1007/s10615-021-00816-w.
- Lenz SA, Hollenbaugh MK. Meta-analysis of trauma-focused cognitive behavioral threapy for treating PTSD and Co-occurring depression among children and adolescents. Counseling Outcome Research and Evaluation. 2015;6(1):18–32. doi: 10.1177/2150137815573790.
- McLaughlin KA, Green JG, Gruber MJ, Sampson NA, Zaslavsky A, Kessler RC. Childhood adversities and first onset of psychiatric disorders in a national sample of adolescents. Arch Gen Psychiatry. 2012;69:1151–1160. doi: 10.1001/archgenpsychiatry.2011.2277.
- Mendez JL, Carpenter JL, LaForett DR, et al. Parental engagement and barriers to participation in a community-based preventive intervention. Am J Community Psychol. 2009;44:1–14. doi: 10.1007/s10464-009-9252-x.
- Murray LK, Skavenski S, Kane JC, Bolton PA. Effectiveness of trauma-focused cognitive behavioral therapy among trauma-affected children in Lusaka, Zambia: a randomized clinical trial. JAM Pedriatr. 2015;169(8):761–769. doi: 10.1001/jamapediatrics.2015.0580.
- National Institute for Health and Care Excellence, NICE (2018). From
- Keeffe SO, Martin P, Goodyer IM, Kelvin R, Dubicka B. IMPACT Consortium, Midgley, N. Prognostic Implications for Adolescents With Depression Who Drop Out of Psychological Treatment During a Randomized Controlled Trial. J Am Acad Child Adolesc Psychiatry. 2019;58(10):983–92.
- Ormhaug SM, Jensen TK. Investigating treatment characteristics and first-session relationship variables as predictors of dropout in the treatment of traumatized youth. Psychother Res. 2018;28(2):235–249. doi: 10.1080/10503307.2016.1189617.
- Pfeiffer E, Ormhaug SM, Tutus D, Holt T, Rosner R, Wentzel Larsen T, Jensen TK. Does the therapist matter? Therapist characteristics and their relation to outcome in trauma-focused cognitive behavioral therapy for children and adolescents. Eur J Psychotraumatol. 2020;11(1):1776048. doi: 10.1080/20008198.2020.1776048.
- Powell BJ, Waltz TJ, Chinman MJ, Kirchner J. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2014;10(21). 10.1186/s13012-015-0209-1.
- Powell BJ, Fernandez ME, Williams NJ, Weiner BJ. (2019). Enhancing the Impact of Implementaiton Strategies in Helathcare: A Research Agenda. Fron. Public Health. 10.3389/fpubh.2019.00003
- R Core Team (2020). R: A language and environment for statistical computing. Vienna, Austria.
- Racine N, Hartwick C, Collin-Vèzina D, Madigan S. Telemental health for child trauma treatment during and post-COVID-19: Limitations and considerations. Child Abuse Negl. 2020;101. 10.1016/j.chiabu.2020.104698.
- Sachser C, Berliner L, Holt T, et al. International development and psychometric properties of the Child and Adolescent Trauma Screen (CATS). J Affect Disord. 2017;210:189–95. 10.1016/j.jad.2016.12.040-DOI-PubMed.
- Sachser C, Berliner L, Risch E, et al. The child and Adolescent Trauma Screen 2 (CATS-2) – validation of an instrument to measure DSM-5 and ICD-11 PTSD and complex PTSD in children and Adolescents. Eur J Psychotraumatol. 2022;13(2):2105580. doi: 10.1080/20008066.2022.2105580.
- Simmons C, Meiser-Stedman R, Baily H, Beazley P. A meta-analysis of dropout from evidence-based psychological treatment for posttraumatic stress disorder (PTSD) in children and young people. Eur J Psychotraumatol. 2021;12(1):1947570. doi: 10.1080/20008198.2021.1947570.
- Skar A-MS, Braathu N, Peters N ... Egeland KM. A stepped-wedge randomized trial investigating the effect of the Leadership and Organizational Change for Implementation (LOCI) intervention on implementation and transformational leadership, and implementation climate. BMC Health Serv Res. 2022;22(298).
- Szumilas M. Explaining odds rations. J Can Acad Child Adolesc Psychiatry. 2010;19(3):227–229.
- Teicher MH, Samson JA. Annual research review: enduring neurobiological effects of childhood abuse and neglect. J Child Psychol Psychiatry. 2016;57(3):241–266. doi: 10.1111/jcpp.12507.
- Trickey D, Siddaway AP, Meiser-Stedman R, Serpell L, Field AP. A meta-analysis of risk factors for posttraumatic stress disorder in children and adolescents. Clin Psychol Rev. 2012;32(2):122–138. doi: 10.1016/j.cpr.2011.12.001.
- Varker T, Kartal D, Watson L, Hinton M. Defining response and non-response to post-traumatic stress disorder treatments: A systematic review. Clin Psychol Sci Pract. 2020;27(4).
- Wachen JS, Dondanville KA, Evans WR, Morris K, Cole A. Adjusting the Timeframe of Evidence-Based Therapies for PTSD-Massed Treatments. Curr Treat Options Psychiatry. 2019;6:107–118. doi: 10.1007/s40501-019-00169-9.
- Wamser-Nanney R, Steinzor CE. Factors related to attrition from trauma-focused cognitive behavioral therapy. Child Abuse Negl. 2017;66:73–83. doi: 10.1016/j.chiabu.2016.11.031.
- Wamser-Nanney R, Scheeringa M, Weems CF. Early treatment response in children and adolescents receiving CBT for trauma. J Pediatr Psychol. 2016;41(1):128–137. doi: 10.1093/jpepsy/jsu096.
- Weisz JR, Kuppens S, Eckshtain D, Ugueto AM, Hawley KM, Jensen- Doss A. Do Evidence-Based Youth Psychotherapies Outperform Usual Clinical Care? A Multilevel Meta-Analysis. JAMA Psychiatry. 2013;70(7).
- Wells JE, Browne MO, Aguilar-Gaxiola S, Kesller RC. Drop out from out-patient mental healthcare in the World Health Organization's World Mental Health Survey initiative. Br J Psychiatry. 2013;2020:42–49. doi: 10.1192/bjp.bp.112.113134.
- Wasserstein RL, Schirm AL, Lazar NA. Moving to a world beyond “p< 0.05”. Am Stat. 2019;73(S1):1–19. doi: 10.1080/00031305.2019.1583913.
- Wong CA, Cummings GG, Ducharme L. The relationship between nursing leadership and patient outcomes: a systematic review update. J Nurs Manag. 2013;5:709–724. doi: 10.1111/jonm.12116.
- Wright I, Mughal F, Bowers G, Meiser-Stedman R. Dropout from randomised controlled trials of psychological treatments for depression in children and youth: a systematic review and meta-analyses. J Affect Disord. 2021;281:880–890. doi: 10.1016/j.jad.2020.11.039.
- Yasinski C, Hayes AM, Alpert E, McCauley T, Ready CB, Webb C, Deblinger E. Treatment processes and demographic variables as predictors of dropout from trauma-focused cognitive behavioral therapy (TF-CBT) for youth. Behav Res Ther. 2018;107:10–18. doi: 10.1016/j.brat.2018.05.008.
- Ziliak S, McCloskey D. (2008). The cult of statistical significance: How the standard error costs us jobs, justice, and lives. University of Michigan Press.
Source: PubMed