Adaptive School-based Implementation of CBT (ASIC): clustered-SMART for building an optimized adaptive implementation intervention to improve uptake of mental health interventions in schools

Amy M Kilbourne, Shawna N Smith, Seo Youn Choi, Elizabeth Koschmann, Celeste Liebrecht, Amy Rusch, James L Abelson, Daniel Eisenberg, Joseph A Himle, Kate Fitzgerald, Daniel Almirall, Amy M Kilbourne, Shawna N Smith, Seo Youn Choi, Elizabeth Koschmann, Celeste Liebrecht, Amy Rusch, James L Abelson, Daniel Eisenberg, Joseph A Himle, Kate Fitzgerald, Daniel Almirall

Abstract

Background: Depressive and anxiety disorders affect 20-30% of school-age youth, most of whom do not receive adequate services, contributing to poor developmental and academic outcomes. Evidence-based practices (EBPs) such as cognitive behavioral therapy (CBT) can improve outcomes, but numerous barriers limit access among affected youth. Many youth try to access mental health services in schools, but school professionals (SPs: counselors, psychologists, social workers) are rarely trained adequately in CBT methods. Further, SPs face organizational barriers to providing CBT, such as lack of administrative support. Three promising implementation strategies to address barriers to school-based CBT delivery include (1) Replicating Effective Programs (REP), which deploys customized CBT packaging, didactic training in CBT, and technical assistance; (2) coaching, which extends training via live supervision to improve SP competence in CBT delivery; and (3) facilitation, which employs an organizational expert who mentors SPs in strategic thinking to promote self-efficacy in garnering administrative support. REP is a relatively low-intensity/low-cost strategy, whereas coaching and facilitation require additional resources. However, not all schools will require all three strategies. The primary aim of this study is to compare the effectiveness of a school-level adaptive implementation intervention involving REP, coaching, and facilitation versus REP alone on the frequency of CBT delivered to students by SPs and student mental health outcomes. Secondary and exploratory aims examine cost-effectiveness, moderators, and mechanisms of implementation strategies.

Methods: Using a clustered, sequential multiple-assignment, randomized trial (SMART) design, ≥ 200 SPs from 100 schools across Michigan will be randomized initially to receive REP vs. REP+coaching. After 8 weeks, schools that do not meet a pre-specified implementation benchmark are re-randomized to continue with the initial strategy or to augment with facilitation.

Discussion: EBPs need to be implemented successfully and efficiently in settings where individuals are most likely to seek care in order to gain large-scale impact on public health. Adaptive implementation interventions hold the promise of providing cost-effective implementation support. This is the first study to test an adaptive implementation of CBT for school-age youth, at a statewide level, delivered by school staff, taking an EBP to large populations with limited mental health care access.

Trial registration: NCT03541317 -Registered on 29 May 2018 on ClinicalTrials.gov PRS.

Keywords: Adaptive intervention; Cognitive-behavioral therapy; Health behavior change; Schools.

Conflict of interest statement

Ethics approval and consent to participate

This study was approved by the Institutional Review Board of the University of Michigan on 14 May 2018.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Figures

Fig. 1
Fig. 1
Adaptive implementation of school-based CBT study flow and timeline. Potential to benefit from facilitation is defined as ≥ 1 participating SPs delivering  2 barriers to CBT uptake

References

    1. Merikangas KR, He JP, Burstein M, Swanson SA, Avenevoli S, Cui LH, Benjet C, Georgiades K, Swendsen J. Lifetime prevalence of mental disorders in U.S. adolescents: results from the National Comorbidity Survey Replication-Adolescent Supplement (NCS-A) J Am Acad Child Psy. 2010;49(10):980–989. doi: 10.1016/j.jaac.2010.05.017.
    1. Charvat JL. National Association of School Pscyhologists. 2012. Research on the relationship between mental health and academic achievement.
    1. Greenberg PE, Kessler RC, Birnbaum HG, Leong SA, Lowe SW, Berglund PA, Corely-Lisle PL. The economic burden of depression in the United States: how did it change between 1990 and 2000? J Clin Psychiatry. 2003;64(12):1465. doi: 10.4088/JCP.v64n1211.
    1. Smyth JM, Arigo D. Recent evidence supports emotion-regulation interventions for improving health in at-risk and clinical populations. Current opinion in psychiatry. 2009;22(2):205–210. doi: 10.1097/YCO.0b013e3283252d6d.
    1. Weisz JR, Southam-Gerow MA, Gordis EB, Connor-Smith JK, Chu BC, Langer DA, McLeod BD, Jensen-Doss A, Updegraff A, Weiss B. Cognitive-behavioral therapy versus usual clinical care for youth depression: an initial test of transportability to community clinics and clinicians. J Consult Clin Psychol. 2009;77(3):383–396. doi: 10.1037/a0013877.
    1. Zins JE, Bloodworth MR, Weissberg RP, Walberg HJ. The scientific base linking emotional learning to student success and academic outcomes. In: Zins JE, Weissberg RP, Wang MC, Walberg HJ, editors. Building academic success on social and emotional learning: What does the research say? New York: Teachers College Press; 2004.
    1. Ginsburg GS, Becker KD, Drazdowski TK, Tein JY. Treating anxiety disorders in inner city schools: results from a pilot randomized controlled trial comparing CBT and usual care. Child Youth Care Forum. 2012;41(1):1–19. doi: 10.1007/s10566-011-9156-4.
    1. Huey SJ, Jr, Polo AJ. Evidence-based psychosocial treatments for ethnic minority youth. J Clin Child Adolesc Psychol. 2008;37(1):262–301. doi: 10.1080/15374410701820174.
    1. Kataoka SH, Zhang L, Wells KB. Unmet need for mental health care among U.S. children: variation by ethnicity and insurance status. Am J Psychiatry. 2002;159(9):1548–1555. doi: 10.1176/appi.ajp.159.9.1548.
    1. Farmer EM, Burns BJ, Phillips SD, Angold A, Costello EJ. Pathways into and through mental health services for children and adolescents. Psychiatr Serv. 2003;54(1):60–66. doi: 10.1176/appi.ps.54.1.60.
    1. Burns BJ, Costello EJ, Angold A, Tweed D, Stangl D, Farmer E, Erkanli A. Children's mental health service use across service sectors. Health Aff. 1995;14(3):147–159. doi: 10.1377/hlthaff.14.3.147.
    1. Weist MD, Rubin M, Moore E, Adelsheim S, Wrobel G. Mental health screening in schools. J Sch Health. 2007;77(2):53–58. doi: 10.1111/j.1746-1561.2007.00167.x.
    1. Hallfors D, Godette D. Will the ‘principles of effectiveness’ improve prevention practice? Early findings from a diffusion study. Health Educ Res. 2002;17(4):461–470. doi: 10.1093/her/17.4.461.
    1. Forman SG, Olin SS, Hoagwood KE, Crowe M, Saka N. Evidence-based interventions in schools: developers’ views of implementation barriers and facilitators. Sch Ment Heal. 2008;1(1):26–36. doi: 10.1007/s12310-008-9002-5.
    1. Rones M, Hoagwood K. School-based mental health services: a research review. Clin Child Fam Psychol Rev. 2000;3(4):223–241. doi: 10.1023/A:1026425104386.
    1. Atkins MS, Frazier SL, Abdul-Adil J, Talbott E. School-based mental health services in urban communities. In: Weist MD, Evans SW, Lever NA, editors. Handbook of school mental health, advancing practice and research. New York: Kluwer Academic/Plenum; 2003. pp. 165–178.
    1. Garland AF, Brookman-Frazee L, Hurlburt MS, Accurso EC, Zoffness RJ, Haine-Schlagel R, Ganger W. Mental health care for children with disruptive behavior problems: a view inside therapists’ offices. Psychiatr Serv. 2010;61(8):788–795. doi: 10.1176/ps.2010.61.8.788.
    1. Asarnow JR, Jaycox LH, Duan N, LaBorde AP, Rea MM, Tang L, Anderson M, Murray P, Landon C, Tang B, et al. Depression and role impairment among adolescents in primary care clinics. J Adolesc Health. 2005;37(6):477–483. doi: 10.1016/j.jadohealth.2004.11.123.
    1. Jaycox LH, Langley AK, Stein BD, Wong M, Sharma P, Scott M, Schonlau M. Support for students exposed to trauma: a pilot study. Sch Ment Heal. 2009;1(2):49–60. doi: 10.1007/s12310-009-9007-8.
    1. Edmunds JM, Beidas RS, Kendall PC. Dissemination and implementation of evidence-based practices: training and consultation as implementation strategies. Clin Psychol. 2013;20(2):152–65.
    1. Mychailyszyn MP, Bedas RS, Benjamin CL, Edmunds JM, Podell JL, Cohen JS, Kendall PC. Assessing and treating child anxiety in schools. Psychol Sch. 2011;48(3):223–232. doi: 10.1002/pits.20548.
    1. Bruns EJ, Duong MT, Lyon AR, Pullmann MD, Cook CR, Cheney D, McCauley E. Fostering SMART partnerships to develop an effective continuum of behavioral health services and supports in schools. Am J Orthopsychiatry. 2016;86(2):156. doi: 10.1037/ort0000083.
    1. Garrison EG, Roy IS, Azar V. Responding to the mental health needs of Latino children and families through school-based services. Clin Psychol Rev. 1999;19(2):199–219. doi: 10.1016/S0272-7358(98)00070-1.
    1. Langley AK, Nadeem E, Kataoka SH, Stein BD, Jaycox LH. Evidence-based mental health programs in schools: barriers and facilitators of successful implementation. Sch Ment Heal. 2010;2(3):105–113. doi: 10.1007/s12310-010-9038-1.
    1. Merry S, McDowell H, Wild CJ, Bir J, Cunliffe R. A randomized placebo-controlled trial of a school-based depression prevention program. J Am Acad Child Adolesc Psychiatry. 2004;43(5):538–547. doi: 10.1097/00004583-200405000-00007.
    1. Stephan SH, Weist M, Kataoka S, Adelsheim S, Mills C. Transformation of children’s mental health services: the role of school mental health. Psychiatr Serv. 2007;58(10):1330–1338. doi: 10.1176/ps.2007.58.10.1330.
    1. Schwebel DC, Plumert JM, Pick HL. Integrating basic and applied developmental research: a new model for the twenty-first century. Child Dev. 2000;71(1):222–230. doi: 10.1111/1467-8624.00137.
    1. Green JG, McLaughlin KA, Alegria M, Costello EJ, Gruber MJ, Hoagwood K, Leaf PJ, Olin S, Sampson NA, Kessler RC. School mental health resources and adolescent mental health service use. J Am Acad Child Adolesc Psychiatry. 2013;52(5):501–510. doi: 10.1016/j.jaac.2013.03.002.
    1. Beidas RS, Barmish AJ, Kendall PC. Training as usual: can therapist behavior change after reading a manual and attending a brief workshop on cognitive behavioral therapy for youth anxiety? Behav Ther. 2009;32:97–101.
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, Proctor EK, Kirchner JE. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):1. doi: 10.1186/s13012-015-0209-1.
    1. Koschmann EA,J, Fitzgerald K, Kilbourne AM. Transforming research into action to improve the lives of students (TRAILS) 2017.
    1. Nadeem E, Gleacher A, Beidas RS. Consultation as an implementation strategy for evidence-based practices across multiple contexts: unpacking the black box. Adm Policy Ment Hlth. 2013;40(6):439–450. doi: 10.1007/s10488-013-0502-8.
    1. Beidas RS, Mychailyszyn MP, Edmunds JM, Khanna MS, Downey MM, Kendall PC. Training school mental health providers to deliver cognitive-behavioral therapy. Sch Ment Heal. 2012;4(4):197–206. doi: 10.1007/s12310-012-9074-0.
    1. Kilbourne AM, Goodrich DE, Lai Z, Almirall D, Nord KM, Bowersox NW, Abraham KM. Reengaging veterans with serious mental illness into care: preliminary results from a national randomized trial. Psychiatr Serv. 2015;66(1):90–93. doi: 10.1176/appi.ps.201300497.
    1. Kelly JA, Heckman TG, Stevenson LY, Williams PN, Ertl T, Hays RB, Leonard NR, O'Donnell L, Terry MA, Sogolow ED, et al. Transfer of research-based HIV prevention interventions to community service providers: fidelity and adaptation. AIDS Educ Prev. 2000;12(5 Suppl):87–98.
    1. Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci. 2007;2:42. doi: 10.1186/1748-5908-2-42.
    1. Kilbourne AM, Neumann MS, Waxmonsky J, Bauer MS, Kim HM, Pincus HA, Thomas M. Public-academic partnerships: evidence-based implementation: the role of sustained community-based practice and research partnerships. Psychiatr Serv. 2012;63(3):205–207. doi: 10.1176/appi.ps.201200032.
    1. Waxmonsky J, Kilbourne AM, Goodrich DE, Nord KM, Lai Z, Laird C, Clogston J, Kim HM, Miller C, Bauer MS. Enhanced fidelity to treatment for bipolar disorder: results from a randomized controlled implementation trial. Psychiatr Serv. 2014;65(1):81–90. doi: 10.1176/appi.ps.201300039.
    1. Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE, Fortney JC, Kirchner JE, Solberg LI, Main D, Bauer MS. Protocol: adaptive implementation of effective programs trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implement Sci. 2014;9(1):1. doi: 10.1186/1748-5908-9-1.
    1. Kilbourne AM, Almirall D, Goodrich DE, Lai Z, Abraham KM, Nord KM, Bowersox NW. Enhancing outreach for persons with serious mental illness: 12-month results from a cluster randomized trial of an adaptive implementation strategy. Implement Sci. 2014;9(1):1. doi: 10.1186/1748-5908-9-1.
    1. Owens JS, Lyon AR, Brandt NE, Warner CM, Nadeem E, Spiel C, Wagner M. Implementation science in school mental health: key constructs in a developing research agenda. Sch Ment Heal. 2014;6(2):99–111. doi: 10.1007/s12310-013-9115-3.
    1. Eiraldi R, Wolk CB, Locke J, Beidas R. Clearing hurdles: the challenges of implementation of mental health evidence-based practices in under-resourced schools. Adv School Ment Health Promot. 2015;8(3):124–140. doi: 10.1080/1754730X.2015.1037848.
    1. Beidas RS, Kendall PC. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol-Sci Pr. 2010;17(1):1–30. doi: 10.1111/j.1468-2850.2009.01187.x.
    1. Lyon AR, Charlesworth-Attie S, Vander Stoep A, McCauley E. Modular psychotherapy for youth with internalizing problems: implementation with therapists in school-based health centers. Sch Psychol Rev. 2011;40(4):569.
    1. Becker EM, Becker KD, Ginsburg GS. Modular cognitive behavioral therapy for youth with anxiety disorders: a closer look at the use of specific modules and their relation to treatment process and response. Sch Ment Heal. 2012;4(4):243–253. doi: 10.1007/s12310-012-9080-2.
    1. Chiu AW, Langer DA, McLeod BD, Har K, Drahota A, Galla BM, Jacobs J, Ifekwunigwe M, Wood JJ. Effectiveness of modular CBT for child anxiety in elementary schools. Sch Psychol Q. 2013;28(2):141. doi: 10.1037/spq0000017.
    1. Chorpita BF, Weisz JR, Daleiden EL, Schoenwald SK, Palinkas LA, Miranda J, Higa-McMillan CK, Nakamura BJ, Austin AA, Borntrager CF. Long-term outcomes for the child STEPs randomized effectiveness trial: a comparison of modular and standard treatment designs with usual care. J Consult Clin Psychol. 2013;81(6):999. doi: 10.1037/a0034200.
    1. Chorpita BF, Daleiden EL, Park AL, Ward AM, Levy MC, Cromley T, Chiu AW, Letamendi AM, Tsai KH, Krull JL: Child STEPs in California: a cluster randomized effectiveness trial comparing modular treatment with community implemented treatment for youth with anxiety, depression, conduct problems, or traumatic stress. 2016.
    1. Chiu AW, Langer DA, McLeod BD, Har K, Drahota A, Galla BM, Jacobs J, Ifekwunigwe M, Wood JJ. Effectiveness of modular CBT for child anxiety in elementary schools. Sch Psychol. 2013;28(2):141–153. doi: 10.1037/spq0000017.
    1. Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE, Fortney JC, Kirchner JE, Solberg LI, Main D, Bauer MS, et al. Protocol: adaptive implementation of effective programs trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implement Sci. 2014;9:132. doi: 10.1186/s13012-014-0132-x.
    1. Richardson LP, McCauley E, Grossman DC, McCarty CA, Richards J, Russo JE, Rockhill C, Katon W. Evaluation of the Patient Health Questionnaire-9 item for detecting major depression among adolescents. Pediatrics. 2010;126(6):1117–1123. doi: 10.1542/peds.2010-0852.
    1. March J, Silva S, Petrycki S, Curry J, Wells K, Fairbank J, Burns B, Domino M, McNulty S, Vitiello B, et al. Fluoxetine, cognitive-behavioral therapy, and their combination for adolescents with depression: Treatment for Adolescents with Depression Study (TADS) randomized controlled trial. JAMA. 2004;292:807–820. doi: 10.1001/jama.292.7.807.
    1. Walkup JT, Albano AM, Piacentini J, Birmaher B, Compton SN, Sherrill JT, Ginsburg GS, Rynn MA, McCracken J, Waslick B, et al. Cognitive behavioral therapy, sertraline, or a combination in childhood anxiety. N Engl J Med. 2008;359(26):2753–2766. doi: 10.1056/NEJMoa0804633.
    1. Hofmann SG, Asnaani A, Vonk IJ, Sawyer AT, Fang A. The efficacy of cognitive behavioral therapy: a review of meta-analyses. Cogn Ther Res. 2012;36(5):427–440. doi: 10.1007/s10608-012-9476-1.
    1. Chorpita BF, Daleiden EL, Weisz JR. Modularity in the design and application of therapeutic interventions. Appl Prev Psychol. 2005;11(3):141–156. doi: 10.1016/j.appsy.2005.05.002.
    1. Chorpita BF WJ. Modular approach to therapy for children with anxiety, depression, or conduct problems. Cambridge: University of Hawaii at Manoa and Judge Baker Children's Center, Harvard medical school; 2005.
    1. Ginsburg GS, Becker KD, Kingery JN, Nichols T. Transporting CBT for childhood anxiety disorders into inner-city school-based mental health clinics. Cogn Behav Pract. 2008;15(2):148–158. doi: 10.1016/j.cbpra.2007.07.001.
    1. Weisz JR, Chorpita BF, Palinkas LA, Schoenwald SK, Miranda J, Bearman SK, Daleiden EL, Ugueto AM, Ho A, Martin J. Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: a randomized effectiveness trial. Arch Gen Psychiatry. 2012;69(3):274–282. doi: 10.1001/archgenpsychiatry.2011.147.
    1. Masia-Warner C, Klein RG, Dent HC, Fisher PH, Alvir J, Albano AM, Guardino M. School-based intervention for adolescents with social anxiety disorder: results of a controlled study. J Abnorm Child Psychol. 2005;33(6):707–722. doi: 10.1007/s10802-005-7649-z.
    1. Herzig-Anderson K, Colognori D, Fox JK, Stewart CE, Masia Warner C. School-based anxiety treatments for children and adolescents. Child Adolesc Psychiatr Clin N Am. 2012;21(3):655–668. doi: 10.1016/j.chc.2012.05.006.
    1. Chorpita BF, Daleiden EL. Mapping evidence-based treatments for children and adolescents: application of the distillation and matching model to 615 treatments from 322 randomized trials. J Consult Clin Psychol. 2009;77(3):566–579. doi: 10.1037/a0014565.
    1. Garland AF, Hawley KM, Brookman-Frazee L, Hurlburt MS. Identifying common elements of evidence-based psychosocial treatments for children's disruptive behavior problems. J Am Acad Child Adolesc Psychiatry. 2008;47(5):505–514. doi: 10.1097/CHI.0b013e31816765c2.
    1. Rogers EM. Diffusion of innovations, 5th edn. New York: The Free Press; 2003.
    1. Green LW, Kreuter MW. Health promotion planning: an educational and environmental approach. In: Health promotion planning: an educational and environmental approach. Edn. California City: Mayfield Publishing Company; 1991.
    1. Hershfeldt PA, Pell K, Sechrest R, Pas ET, Bradshaw CP. Lessons learned coaching teachers in behavior management: the PBISplus coaching model. J Educ Psychol Consult. 2012;22(4):280–299. doi: 10.1080/10474412.2012.731293.
    1. Fixsen DL, Blase KA, Duda MA, Naoom SF, Van Dyke M. Implementation of evidence-based treatments for children and adolescents: research findings and their implications for the future. 2010.
    1. Herschell AD, Kolko DJ, Baumann BL, Davis AC. The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations. Clin Psychol Rev. 2010;30(4):448–466. doi: 10.1016/j.cpr.2010.02.005.
    1. McHugh RK, Barlow DH. The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. Am Psychol. 2010;65(2):73–84. doi: 10.1037/a0018121.
    1. Lochman JE, Boxmeyer C, Powell N, Qu L, Wells K, Windle M. Dissemination of the coping power program: importance of intensity of counselor training. J Consult Clin Psychol. 2009;77(3):397–409. doi: 10.1037/a0014514.
    1. Miller WR, Yahne CE, Moyers TB, Martinez J, Pirritano M. A randomized trial of methods to help clinicians learn motivational interviewing. J Consult Clin Psychol. 2004;72(6):1050–1062. doi: 10.1037/0022-006X.72.6.1050.
    1. Joyce BR, Showers B: Student achievement through staff development, 3rd edn. Alexandria, VA: Association for Supervision and Curriculum Development; 2002.
    1. Funderburk B, Chaffin M, Bard E, Shanley J, Bard D, Berliner L. Comparing client outcomes for two evidence-based treatment consultation strategies. J Clin Child Adolesc Psychol. 2015;44(5):730–741. doi: 10.1080/15374416.2014.910790.
    1. Kilbourne AM, Abraham KM, Goodrich DE, Bowersox NW, Almirall D, Lai Z, Nord KM. Cluster randomized adaptive implementation trial comparing a standard versus enhanced implementation intervention to improve uptake of an effective re-engagement program for patients with serious mental illness. Implement Sci. 2013;8:136. doi: 10.1186/1748-5908-8-136.
    1. Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev. 1977;84(2):191–215. doi: 10.1037/0033-295X.84.2.191.
    1. Marchese DD, Becker KD, Keperling JP, Domitrovich CE, Reinke WM, Embry DD, Ialongo NS: A Step-by-step guide for coaching classroom teachers in evidence-based interventions: Oxford University Press; 2017.
    1. Kilbourne AM, Abraham KM, Goodrich DE, Bowersox NW, Almirall D, Lai Z, Nord KM. Cluster randomized adaptive implementation trial comparing a standard versus enhanced implementation intervention to improve uptake of an effective re-engagement program for patients with serious mental illness. Implement Sci. 2013;8(1):1. doi: 10.1186/1748-5908-8-136.
    1. Kirchner JE, Ritchie MJ, Pitcock JA, Parker LE, Curran GM, Fortney JC. Outcomes of a partnered facilitation strategy to implement primary care–mental health. J Gen Intern Med. 2014;29(4):904–912. doi: 10.1007/s11606-014-3027-2.
    1. Aarons GA, Ehrhart MG, Farahnak LR. The Implementation Leadership Scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9(1):45. doi: 10.1186/1748-5908-9-45.
    1. Kolko DJ, Baumann BL, Herschell AD, Hart JA, Holden EA, Wisniewski SR. Implementation of AF-CBT by community practitioners serving child welfare and mental health: a randomized trial. Child Maltreat. 2012;17(1):32–46. doi: 10.1177/1077559511427346.
    1. Kramer TL, Burns BJ. Implementing cognitive behavioral therapy in the real world: a case study of two mental health centers. Implement Sci. 2008;3:14. doi: 10.1186/1748-5908-3-14.
    1. Addis ME, Krasnow AD. A national survey of practicing psychologists’ attitudes toward psychotherapy treatment manuals. J Consult Clin Psychol. 2000;68(2):331–339. doi: 10.1037/0022-006X.68.2.331.
    1. Hepner KA, Azocar F, Greenwood GL, Miranda J, Burnam MA. Development of a clinician report measure to assess psychotherapy for depression in usual care settings. Admin Pol Ment Health. 2010;37(3):221–229. doi: 10.1007/s10488-009-0249-4.
    1. Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS) Implement Sci. 2014;9:157. doi: 10.1186/s13012-014-0157-1.
    1. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS) Ment Health Serv Res. 2004;6(2):61–74. doi: 10.1023/B:MHSR.0000024351.12294.65.
    1. Bauer MS, McBride L, Williford WO, Glick H, Kinosian B, Altshuler L, Beresford T, Kilbourne AM, Sajatovic M, Cooperative Studies Program 430 Study T Collaborative care for bipolar disorder: part II. Impact on clinical outcome, function, and costs. Psychiatr Serv. 2006;57(7):937–945. doi: 10.1176/ps.2006.57.7.937.
    1. Shortreed SM, Laber E, Scott Stroup T, Pineau J, Murphy SA. A multiple imputation strategy for sequential multiple assignment randomized trials. Stat Med. 2014;33(24):4202–4214. doi: 10.1002/sim.6223.
    1. Schafer JL: Imputation of missing covariates under a multivariate linear mixed model. In: Tech; 1997.
    1. NeCamp T, Kilbourne A, Almirall D: Comparing cluster-level dynamic treatment regimens using sequential, multiple assignment, randomized trials: regression estimation and sample size considerations. arXiv preprint arXiv:160704039 2016.

Source: PubMed

3
订阅