A hybrid effectiveness-implementation cluster randomized trial of group CBT for anxiety in urban schools: rationale, design, and methods

Ricardo Eiraldi, Muniya S Khanna, Abbas F Jawad, Jessica Fishman, Henry A Glick, Billie S Schwartz, Jaclyn Cacia, Abraham Wandersman, Rinad Beidas, Ricardo Eiraldi, Muniya S Khanna, Abbas F Jawad, Jessica Fishman, Henry A Glick, Billie S Schwartz, Jaclyn Cacia, Abraham Wandersman, Rinad Beidas

Abstract

Background: Schools present a context with great potential for the implementation of psychosocial evidence-based practices. Cognitive behavioral therapy (CBT) is an evidence-based practice that has been found to be very effective in treating anxiety in various community settings, including schools. Friends for Life (FRIENDS) is an efficacious group CBT protocol for anxiety. Unfortunately, evidence-based practices for anxiety are seldom employed in under-resourced urban schools, because many treatment protocols are not a good fit for the urban school context or the population, existing behavioral health staff do not receive adequate training or support to allow them to implement the treatment with fidelity, or school districts do not have the resources to contract with external consultants. In our prior work, we adapted FRIENDS to create a more culturally sensitive, focused, and feasible CBT protocol for anxiety disorders (CBT for Anxiety Treatment in Schools (CATS)).

Methods/design: The aim of this 5-year study is to evaluate both the effectiveness of CATS for urban public schools compared to the original FRIENDS as well as compare the implementation strategies (train-the-trainer vs. train-the-trainer + ongoing consultation) by conducting a three-arm, parallel group, type 2 hybrid effectiveness-implementation trial in 18 K-8 urban public schools. We will also assess the cost-effectiveness and the mediators and moderators of fidelity. Ninety therapists, 18 agency supervisors, and 360 children will participate. The interactive systems framework for dissemination and implementation guides the training and support procedures for therapists and supervisors.

Discussion: This study has the potential to demonstrate that agency therapists and supervisors who have had little to no prior exposure to evidence-based practices (EBPs) can implement an anxiety disorder EBP with fidelity. Comparisons of the implementation strategies would provide large urban mental health systems with data to make decisions about the adoption of EBPs.

Trial registration: ClinicalTrials.gov, NCT02651402.

Keywords: Anxiety disorders; Capacity building; Co-location model; Effectiveness; Group cognitive behavioral therapy; Hybrid trial; Implementation; Urban schools.

Figures

Fig. 1
Fig. 1
Interactive systems framework for dissemination and implementation
Fig. 2
Fig. 2
Moderators and mediators of intervention effects on implementation fidelity

References

    1. Costello EJ, et al. Prevalence and development of psychiatric disorders in childhood and adolescence. Arch Gen Psychiatry. 2003;60(8):837–44. doi: 10.1001/archpsyc.60.8.837.
    1. Pina AA, Silverman WK. Clinical phenomenology, somatic symptoms, and distress in Hispanic/Latino and European American youths with anxiety disorders. J Clin Child Adolesc Psychol. 2004;33(2):227–36. doi: 10.1207/s15374424jccp3302_3.
    1. Greco L, Morris T. Factors influencing the link between social anxiety and peer acceptance: Contributions of social skills and close friendships during middle childhood. Behav Ther. 2005;36(2):197–205. doi: 10.1016/S0005-7894(05)80068-1.
    1. Van Amerigen M, Manicini C, Farvolden P. The impact of anxiety disorders on educational achievement. J Anxiety Disord. 2003;17(5):561–71. doi: 10.1016/S0887-6185(02)00228-1.
    1. Kearney CA, Albano AM. The functional profiles of school refusal behavior. Diagnostic aspects. Behav Modif. 2004;28(1):147–61. doi: 10.1177/0145445503259263.
    1. Beidel DC. Social phobia and overanxious disorder in school-age children. J Am Acad Child Adolesc Psychiatry. 1991;30(4):545–52. doi: 10.1097/00004583-199107000-00003.
    1. Ialongo N, et al. The significance of self-reported anxious symptoms in first grade children: prediction to anxious symptoms and adaptive functioning in fifth grade. J Child Psychol Psychiatry. 1995;36(3):427–37. doi: 10.1111/j.1469-7610.1995.tb01300.x.
    1. Taras HL. School-based mental health services. Pediatrics. 2004;113(6):1839–45. doi: 10.1542/peds.113.6.1839.
    1. Masia-Warner C, et al. School-based intervention for adolescents with social anxiety disorder: results of a controlled study. J Abnorm Child Psychol. 2005;33(6):707–22. doi: 10.1007/s10802-005-7649-z.
    1. Evans SW. Mental health services in schools: utilization, effectiveness, and consent. Clin Psychol Rev. 1999;19(2):165–78. doi: 10.1016/S0272-7358(98)00069-5.
    1. Silverman WK, et al. Treating anxiety disorders in children with group cognitive-behaviorial therapy: a randomized clinical trial. J Consult Clin Psychol. 1999;67(6):995–1003. doi: 10.1037/0022-006X.67.6.995.
    1. Ollendick TH, King NJ. Empirically supported treatments for children with phobic and anxiety disorders: Current status. J Clin Child Psychol. 1998;27:156–67. doi: 10.1207/s15374424jccp2702_3.
    1. Briesch AM, Sanetti LMH, Briesch JM. Reducing the prevalence of anxiety in children and adolescents: an evaluation of the evidence base for the FRIENDS for Life program. Sch Ment Health. 2010;2(4):155–65. doi: 10.1007/s12310-010-9042-5.
    1. Barrett P, Turner C. Prevention of anxiety symptoms in primary school children: preliminary results from a universal school-based trial. Br J Clin Psychol. 2001;40(Pt 4):399–410. doi: 10.1348/014466501163887.
    1. Bernstein A, et al. Fit of evidence-based treatment components to youths served by wraparound process: a relevance mapping analysis. J Clin Child Adolesc Psychol. 2015;44(1):44-57.
    1. Cooley-Quille M, Boyd RC, Grados JJ. Feasibility of an anxiety prevention intervention for community violence exposed children. J Prim Prev. 2004;25(1):105–23. doi: 10.1023/B:JOPP.0000039941.85452.ea.
    1. Eiraldi R et al. Examining effectiveness of group cognitive-behavioral therapy for externalizing and internalizing disorders in urban schools. Behav Modif. 2016;40:611-39.
    1. Aarons GA, et al. Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implement Sci. 2012;7:32. doi: 10.1186/1748-5908-7-32.
    1. Carvalho ML, et al. Balancing fidelity and adaptation: implementing evidence-based chronic disease prevention programs. J Public Health Manag Pract. 2013;19(4):348–56. doi: 10.1097/PHH.0b013e31826d80eb.
    1. Stirman SW, et al. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:17. doi: 10.1186/1748-5908-7-17.
    1. Lee SJ, Altschul I, Mowbray CT. Using planned adaptation to implement evidence-based programs with new populations. Am J Community Psychol. 2008;41(3-4):290–303. doi: 10.1007/s10464-008-9160-5.
    1. Kendall PC. Child and adolescent therapy: cognitive-behavioral procedures. 2. New York: the Guilford Press; 2000.
    1. McHugh RK, Barlow DH. Dissemination and implementation of evidence-based psychological interventions. New York: Oxford University Press; 2012.
    1. Dorsey S, et al. Improving practice in community-based settings: a randomized trial of supervision - study protocol. Implement Sci. 2013;8:89. doi: 10.1186/1748-5908-8-89.
    1. Southam-Gerow MA, et al. MAPping Los Angeles county: taking an evidence-informed model of mental health care to scale. J Clin Child Adolesc Psychol. 2014;43(2):190–200. doi: 10.1080/15374416.2013.833098.
    1. Sholomskas DE, et al. We don’t train in vain: a dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. J Consult Clin Psychol. 2005;73(1):106–15. doi: 10.1037/0022-006X.73.1.106.
    1. Herschell AD, et al. The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations. Clin Psychol Rev. 2010;30(4):448–66. doi: 10.1016/j.cpr.2010.02.005.
    1. Shore BA, et al. Pyramidal staff training in the extension of treatment for severe behavior disorders. J Appl Behav Anal. 1995;28(3):323–32. doi: 10.1901/jaba.1995.28-323.
    1. Demchak M, Browder DM. An evaluation of the pyramid model of staff training in group homes for adults with severe handicaps. Educ Train Ment Retard. 1990;25(2):150–63.
    1. Wandersman A, et al. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41(3-4):171–81. doi: 10.1007/s10464-008-9174-z.
    1. Wandersman A, Chien VH, Katz J. Toward an evidence-based system for innovation support for implementing innovations with quality: tools, training, technical assistance, and quality assurance/quality improvement. Am J Community Psychol. 2012;50:3-4.
    1. Proctor E, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76. doi: 10.1007/s10488-010-0319-7.
    1. Grol R, Wensing M. What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004;180(6 Suppl):S57–60.
    1. Armitage CJ, Conner M. Efficacy of the theory of planned behaviour: a meta-analytic review. Br J Soc Psychol. 2001;40(Pt 4):471–99. doi: 10.1348/014466601164939.
    1. Sheeran P. Intention—behavior relations: a conceptual and empirical review. In: Stroebe W, Hewstone M, editors. European Review of Social Psychology. Chichester: Wiley; 2002.
    1. Fishbein M, Ajzen I. Predicting and changing behavior: the reasoned action approach. New York: Psychology Press; 2010.
    1. Public Citizens for Children and Youth . Behavioral health goes to school: an analysis of school-based behavioral health services in Philadelphia. Philadelphia: Public Citizens for Children and Youth (PCCY); 2011.
    1. Stirman SW, et al. Clinicians’ perspectives on cognitive therapy in community mental health settings: implications for training and implementation. Adm Policy Ment Health. 2013;40(4):274–85. doi: 10.1007/s10488-012-0418-8.
    1. Foster S, et al. School mental health services in the United States, 2002-2003. Rockville: Center for Mental Health Services, Substance Abuse and Mental Health Administration; 2005.
    1. Cammack NL. et al. Funding expanded school mental health programs, in Handbook of school mental health: research, training, practice, and policy, M.D. Weist, et al., Editors. 2014, Springer: New York. p. 17–30.
    1. Curran GM, et al. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26. doi: 10.1097/MLR.0b013e3182408812.
    1. Cully JA, et al. Brief cognitive behavioral therapy in primary care: a hybrid type 2 patient-randomized effectiveness-implementation design. Implement Sci. 2012;7:64. doi: 10.1186/1748-5908-7-64.
    1. Birmaher B, et al. Psychometric properties of the Screen for Child Anxiety Related Emotional Disorders (SCARED): a replication study. J Am Acad Child Adolesc Psychiatry. 1999;38(10):1230–6. doi: 10.1097/00004583-199910000-00011.
    1. Albano AM, Silverman WK. The Anxiety Disorders Interview Schedule for Children for DSM-5 (parent version) New York: Oxford University Press; 2015.
    1. Albano AM, Silverman WK. In: The Anxiety Disorders Interview Schedule for Children for DSM-5 (unpublished parent Spanish version) Ehrenreich-May J, Jensen-Doss A, editors. Miami: University of Miami; 2015.
    1. Compton SN, et al. Child/Adolescent Anxiety Multimodal Study (CAMS): rationale, design, and methods. Child Adolesc Psychiatry Ment Health. 2010;4:1. doi: 10.1186/1753-2000-4-1.
    1. Lochman JE, et al. Dissemination of the Coping Power program: importance of intensity of counselor training. J Consult Clin Psychol. 2009;77(3):397–409. doi: 10.1037/a0014514.
    1. Bickman L, et al. Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. Psychiatr Serv. 2011;62(12):1423–9. doi: 10.1176/appi.ps.002052011.
    1. Schoenwald SK, et al. Clinical supervision in effectiveness and implementation research. Clinical Psychology: Science and Practice. 2013;20:44–59.
    1. Beidas RS, Kendall PC. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol Sci Pract. 2010;17(1):1–30. doi: 10.1111/j.1468-2850.2009.01187.x.
    1. American Psychological Association (APA) Guidelines for clinical supervision in health service psychology. Am Psychol. 2015;70(1):33–46. doi: 10.1037/a0038112.
    1. Sburlati ES, et al. A model of therapist competencies for the empirically supported cognitive behavioral treatment of child and adolescent anxiety and depressive disorders. Clin Child Fam Psychol Rev. 2011;14:1. doi: 10.1007/s10567-011-0083-6.
    1. Beidas RS, et al. Training school mental health providers to deliver cognitive-behavioral therapy. Sch Ment Health. 2012;4:197–206. doi: 10.1007/s12310-012-9074-0.
    1. Martin JL, et al. Moving evidence-based practices into everyday clinical care settings: addressing challenges associated with pathways to treatment, child characteristics, and structure of treatment. Emotional & Behavioral Disorders in Youth. 2007;7:5–21.
    1. Beidas RS, Barmish AJ, Kendall PC. Training as usual: can therapist behavior change after reading a manual and attending a brief workshop on cognitive behavioral therapy for youth anxiety? Behav Therapist. 2009;32:97–101.
    1. Barrett P. Friends for Life: group leaders’ manual for children. Sydney: Pathways Health and Research Centre, Australia; 2008.
    1. Shortt AL, Barrett PM, Fox TL. Evaluating the FRIENDS program: a cognitive-behavioral group treatment for anxious children and their parents. J Clin Child Psychol. 2001;30(4):525–35. doi: 10.1207/S15374424JCCP3004_09.
    1. Barrett P, Donderegger R, Xenos S. Using FRIENDS to combat anxiety and adjustment problems among young migrants to Australia: a national trial. Clin Child Psychol Psychiatry. 2003;8:241–60. doi: 10.1177/1359104503008002008.
    1. Barlow DH. Anxiety and its disorders. New York: The Guilford Press; 1988.
    1. Eiraldi R, et al. A cluster randomized trial to evaluate external support for the implementation of positive behavioral interventions and supports by school personnel. Implement Sci. 2014;9:12. doi: 10.1186/1748-5908-9-12.
    1. Bernal G, Bonilla J, Bellido C. Ecological validity and cultural sensitivity for outcome research: issues for the cultural adaptation and development of psychosocial treatments with Hispanics. J Abnorm Child Psychol. 1995;23(1):67–82. doi: 10.1007/BF01447045.
    1. Glick HA, et al. Economic evaluation in clinical trials. 2. Oxford: Oxford University Press; 2015.
    1. Bernard HR, Ryan GW. Analyzing qualitative data: systematic approaches. Thousand Oaks: Sage Publications; 2010.
    1. Preacher KJ, Rucker DD, Hayes AF. Addressing moderated mediation hypotheses: theory, methods, and prescriptions. Multivar Behav Res. 2007;42(1):185–227. doi: 10.1080/00273170701341316.
    1. Ajzen I, Fishbein M. Understanding attitudes and predicting social behavior. Englewood Cliffs: Prentice Hall; 1980.
    1. Hayes AF. PROCESS: A versatile computational tool for observed variable mediation, moderation, and conditional process modeling, W. paper], Editor 2012: Retrieved from .
    1. SAS. SAS Institute Inc. User’s Guide. Cary, NC, USA: SAS Institute Inc; 2002–2012. SAS/STAT®.
    1. IBM Corp. IBM SPSS statistics for Windows, version 21.0, IBM Corp: Armonk, NY; 2012.
    1. Chambers D. The interactive systems framework for dissemination and implementation: enhancing the opportunity for implementation science. Am J Community Psychol. 2012;50:282–4. doi: 10.1007/s10464-012-9528-4.
    1. Martinez RG, Lewis CC, Weiner BJ. Instrumentation issues in implementation science. Implement Sci. 2014;9:118. doi: 10.1186/s13012-014-0118-8.
    1. Guy W. Clinical Global Impression (CGI), in ECDEU Assessment Manual for Psychopharmacology Revised, 1976, U.S. Department of Health, Education, and Welfare: Rockville, MD. p. 217–222.
    1. Shaffer D et al. A children's global assessment scale (CGAS). Arch Gen Psychiatry. 1983;40(11):1228–31.
    1. March JS. Manual for the Multidimensional Anxiety Scale for Children-2nd Edition (MASC 2). 2012, North Tonawanda, NY: MHS.
    1. DiPerna J, Elliott S. Academic Competence Evaluation Scales. 2000, San Antonio, TX: The Psychological Corporation.
    1. DiPerna JC, Volpe RJ, Elliott SN. A model of academic enablers and academic achievement. School Psychology Review. 2002;31:298–312.
    1. Demaray MK, LN Jenkins. Relations among academic enablers and academic achievement in children with and without high levels of parent-rated symptoms of inattention, impulsivity, and hyperactivity Psychology in the Schools. 2011;48:6.
    1. Rutherford LE, DuPaul GJ, Jitendra AK. Examining the relationship between treatment outcomes for academic achievement and social skills in school-age children with attention-deficit hyperactivity disorder. Psychology in the Schools. 2008;45(2):145–157.
    1. QSR International Pty Ltd, NVivo qualitative data analysis software, 2012: QSR International Pty Ltd.
    1. French MT et al. A structured instrument for estimating the economic cost of drug abuse treatment. The Drug Abuse Treatment Cost Analysis Program (DATCAP). J Subst Abuse Treat. 1997;14(5):445–55.
    1. French MT, Roebuck MC, McLellan AT. Cost estimation when time and resources are limited: the Brief DATCAP. J Subst Abuse Treat. 2004;27(3):187–93.
    1. Mellin EA, et al. Measuring interprofessional team collaboration in expanded school mental health: Model refinement and scale development. J Interprof Care. 2010;24(5):514–23.

Source: PubMed

Sponsorer og samarbeidspartnere

Medisinsk tilstand

Legemiddelintervensjoner

3
Abonnere