Protocol for a hybrid type 2 cluster randomized trial of trauma-focused cognitive behavioral therapy and a pragmatic individual-level implementation strategy

Aaron R Lyon, Michael D Pullmann, Shannon Dorsey, Carol Levin, Larissa M Gaias, Stephanie K Brewer, Madeline Larson, Catherine M Corbin, Chayna Davis, Ian Muse, Mahima Joshi, Rosemary Reyes, Nathaniel J Jungbluth, Rachel Barrett, David Hong, Michael D Gomez, Clayton R Cook, Aaron R Lyon, Michael D Pullmann, Shannon Dorsey, Carol Levin, Larissa M Gaias, Stephanie K Brewer, Madeline Larson, Catherine M Corbin, Chayna Davis, Ian Muse, Mahima Joshi, Rosemary Reyes, Nathaniel J Jungbluth, Rachel Barrett, David Hong, Michael D Gomez, Clayton R Cook

Abstract

Background: More than two-thirds of youth experience trauma during childhood, and up to 1 in 5 of these youth develops posttraumatic stress symptoms that significantly impair their functioning. Although trauma-focused cognitive behavior therapy (TF-CBT) has a strong evidence base, it is rarely adopted, delivered with adequate fidelity, or evaluated in the most common setting where youth access mental health services-schools. Given that individual behavior change is ultimately required for successful implementation, even when organizational factors are firmly in place, focusing on individual-level processes represents a potentially parsimonious approach. Beliefs and Attitudes for Successful Implementation in Schools (BASIS) is a pragmatic, motivationally focused multifaceted strategy that augments training and consultation and is designed to target precise mechanisms of behavior change to produce enhanced implementation and youth clinical outcomes. This study protocol describes a hybrid type 2 effectiveness-implementation trial designed to concurrently evaluate the main effects, mediators, and moderators of both the BASIS implementation strategy on implementation outcomes and TF-CBT on youth mental health outcomes.

Methods: Using a cluster randomized controlled design, this trial will assign school-based mental health (SMH) clinicians and schools to one of three study arms: (a) enhanced treatment-as-usual (TAU), (b) attention control plus TF-CBT, or (c) BASIS+TF-CBT. With a proposed sample of 120 SMH clinicians who will each recruit 4-6 youth with a history of trauma (480 children), this project will gather data across 12 different time points to address two project aims. Aim 1 will evaluate, relative to an enhanced TAU condition, the effects of TF-CBT on identified mechanisms of change, youth mental health outcomes, and intervention costs and cost-effectiveness. Aim 2 will compare the effects of BASIS against an attention control plus TF-CBT condition on theoretical mechanisms of clinician behavior change and implementation outcomes, as well as examine costs and cost-effectiveness.

Discussion: This study will generate critical knowledge about the effectiveness and cost-effectiveness of BASIS-a pragmatic, theory-driven, and generalizable implementation strategy designed to enhance motivation-to increase the yield of evidence-based practice training and consultation, as well as the effectiveness of TF-CBT in a novel service setting.

Trial registration: ClinicalTrials.gov registration number NCT04451161 . Registered on June 30, 2020.

Keywords: Education sector; Health action process approach; Implementation strategy; Individual determinants; Mental health; Theory of planned behavior.

Conflict of interest statement

All authors declare that they have no completing interests.

Figures

Fig. 1
Fig. 1
BASIS and TF-CBT intervention components, hypothesized mechanisms of change, and target outcomes. Mechanisms appear in boxes with rounded corners. Blue = BASIS. Green = TF-CBT. Gray = outcomes
Fig. 2
Fig. 2
CONSORT diagram

References

    1. Copeland WE, Keeler G, Angold A, Costello J. Traumatic events and posttraumatic stress in childhood. Arch Gen Psychiatry. 2007;64:577–584. doi: 10.1001/archpsyc.64.5.577.
    1. Bridges AJ, de Arellano MA, Rheingold AA, Danielson CK, Silcott L. Trauma exposure, mental health, and service utilization rates among immigrant and United States-born Hispanic youth: results from the Hispanic family study. Psychol Trauma Theory Res Pract Policy. 2010;2(1):40–48. doi: 10.1037/a0019021.
    1. Overstreet S, Chafouleas SM. Trauma-informed schools: introduction to the special issue. Sch Ment Heal. 2016;8(1):1–6. doi: 10.1007/s12310-016-9184-1.
    1. Dorsey S, McLaughlin KA, Kerns SEU, et al. Evidence base update for psychosocial treatments for children and adolescents exposed to traumatic events. J Clin Child Adolesc Psychol. 2017;46(3):303–330. doi: 10.1080/15374416.2016.1220309.
    1. de Arellano MAR, Lyman DR, Jobe-Shields L, et al. Trauma-focused cognitive-behavioral therapy for children and adolescents: assessing the evidence. Psychiatr Serv. 2014;65(5):591–602. doi: 10.1176/appi.ps.201300255.
    1. Mannarino AP, Cohen JA, Deblinger E, Runyon MK, Steer RA. Trauma-focused cognitive-behavioral therapy for children: sustained impact of treatment 6 and 12 months later. Child Maltreat. 2012;17(3):231–241. doi: 10.1177/1077559512451787.
    1. Sigel BA, Benton AH, Lynch CE, Kramer TL. Characteristics of 17 statewide initiatives to disseminate trauma-focused cognitive-behavioral therapy (TF-CBT) Psychol Trauma Theory Res Pract Policy. 2013;5(4):323–333. doi: 10.1037/a0029095.
    1. Hanson RF, Gros KS, Davidson TM, et al. National trainers’ perspectives on challenges to implementation of an empirically-supported mental health treatment. Admin Pol Ment Health. 2014;41(4):522–534. doi: 10.1007/s10488-013-0492-6.
    1. Farmer TW, Estell DB, Bishop JL, O’Neal KK, Cairns BD. Rejected bullies or popular leaders? The social relations of aggressive subtypes of rural African American early adolescents. Dev Psychol. 2003;39:992–1004. doi: 10.1037/0012-1649.39.6.992.
    1. Merikangas KR, He J, Burstein M, et al. Service utilization for lifetime mental disorders in U.S. adolescents: results of the National Comorbidity Survey-Adolescent Supplement (NCS-A) J Am Acad Child Adolesc Psychiatry. 2011;50(1):32–45. doi: 10.1016/j.jaac.2010.10.006.
    1. Duong M, Bruns E, Lee K, et al. Rates of mental health service utilization by children and adolescents in schools and other common service settings: a systematic review and meta-analysis. Admin Pol Ment Health. 2020. 10.1007/s10488-020-01080-9.
    1. Aarons GA, Sklar M, Mustanski B, Benbow N, Brown CH. “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implement Sci. 2017;12:111. doi: 10.1186/s13012-017-0640-6.
    1. Owens JS, Lyon AR, Brandt NE, et al. Implementation science in school mental health: key constructs in a developing research agenda. Sch Ment Heal. 2014;6(2):99–111. doi: 10.1007/s12310-013-9115-3.
    1. Ennett ST, Ringwalt CL, Thorne J, et al. A comparison of current practice in school-based substance use prevention programs with meta-analysis findings. Prev Sci. 2003;4(1):1–14. doi: 10.1023/A:1021777109369.
    1. Evans SW, Weist MD. Implementing empirically supported treatments in the schools: what are we asking? Clin Child Fam Psychol Rev. 2004;7(4):263–267. doi: 10.1007/s10567-004-6090-0.
    1. Odom SL, McLean ME, Johnson LJ, LaMontagne MJ. Recommended practices in early childhood special education: validation and current use. J Early Interv. 1995;19(1):1–17. doi: 10.1177/105381519501900101.
    1. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Admin Pol Ment Health. 2011;38(1):4–23. doi: 10.1007/s10488-010-0327-7.
    1. Beidas RS, Kendall PC. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol Sci Pract. 2010;17(1):1–30. doi: 10.1111/j.1468-2850.2009.01187.x.
    1. Glisson C. The organizational context of children’s mental health services. Clin Child Fam Psychol Rev. 2002;5(4):233–253. doi: 10.1023/A:1020972906177.
    1. Michie S, Van Stralen M, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6(1):1. doi: 10.1186/1748-5908-6-1.
    1. Kincaid D, Childs K, Blase KA, Wallace F. Identifying barriers and facilitators in implementing schoolwide positive behavior support. J Posit Behav Interv. 2007;9(3):174–184. doi: 10.1177/10983007070090030501.
    1. Sanford DeRousie RM, Bierman KL. Examining the sustainability of an evidence-based preschool curriculum: the REDI program. Early Child Res Q. 2012;27:55–65. doi: 10.1016/j.ecresq.2011.07.003.
    1. Locke J, Lawson GM, Beidas RS, et al. Individual and organizational factors that affect implementation of evidence-based practices for children with autism in public schools: a cross-sectional observational study. Implement Sci. 2019;14(1):29. doi: 10.1186/s13012-019-0877-3.
    1. Locke J, Kang-Yi C, Frederick L, Mandell DS. Individual and organizational characteristics predicting intervention use for children with autism in schools. Autism. 2020;24(5):1152–1163. doi: 10.1177/1362361319895923.
    1. Lyon AR, Whitaker K, Locke J, et al. The impact of inter-organizational alignment (IOA) on implementation outcomes: evaluating unique and shared organizational influences in education sector mental health. Implement Sci. 2018;13(1):24. doi: 10.1186/s13012-018-0721-1.
    1. McHugh RK, Barlow DH. The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. Am Psychol. 2010;65(2):73–84. doi: 10.1037/a0018121.
    1. Nadeem E, Saldana L, Chapman J, Schaper H. A mixed methods study of the stages of implementation for an evidence-based trauma intervention in schools. Behav Ther. 2018;49(4):509–524. doi: 10.1016/j.beth.2017.12.004.
    1. Dart EH, Cook CR, Collins TA, Gresham FM, Chenier JS. Test driving interventions to increase treatment integrity and student outcomes. Sch Psychol Rev. 2012;41(4):467–481. doi: 10.1080/02796015.2012.12087500.
    1. Gonzalez JE, Nelson JR, Gutkin TB, Shwery CS. Teacher resistance to school-based consultation with school psychologists: a survey of teacher perceptions. J Emot Behav Disord. 2004;12(1):30–37. doi: 10.1177/10634266040120010401.
    1. Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50(2):179–211. doi: 10.1016/0749-5978(91)90020-t.
    1. Ajzen I. From intentions to actions: a theory of planned behavior. In: Action control: from cognition to behavior: Springer Berlin Heidelberg; 1985. p. 11–39.
    1. Hill RJ, Fishbein M, Ajzen I. Belief, attitude, intention and behavior: an introduction to theory and research. Contemporary Sociology. 1977;6:244. 10.2307/2065853.
    1. Eccles MP, Grimshaw JM, Johnston M, et al. Applying psychological theories to evidence-based clinical practice: identifying factors predictive of managing upper respiratory tract infections without antibiotics. Implement Sci. 2007;2:26. doi: 10.1186/1748-5908-2-26.
    1. Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals’ intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008;3:36. doi: 10.1186/1748-5908-3-36.
    1. Ajzen I, Manstead A. Changing health-related behaviours: an approach based on the theory of planned behaviour the scope of social psychology: theory and applications. In: The scope of social psychology: theory and applications. New York: Psychology Press; 2007. p. 43–63.
    1. Steinmetz H, Knappstein M, Ajzen I, Schmidt P, Kabst R. How effective are behavior change interventions based on the theory of planned behavior? Z Psychol. 2016;224(3):216–233. doi: 10.1027/2151-2604/a000255.
    1. Potthoff S, Presseau J, Sniehotta FF, Johnston M, Elovainio M, Avery L. Planning to be routine: habit as a mediator of the planning-behaviour relationship in healthcare professionals. Implement Sci. 2017;12(1):24. doi: 10.1186/s13012-017-0551-6.
    1. Hagermoser Sanetti LM, Collier-Meek MA, Long ACJ, Byron J, Kratochwill TR. Increasing teacher treatment integrity of behavior support plans through consultation and implementation planning. J Sch Psychol. 2015;53(3):209–229. doi: 10.1016/j.jsp.2015.03.002.
    1. Hagger MS, Luszczynska A. Implementation intention and action planning interventions in health contexts: state of the research and proposals for the way forward. Appl Psychol Health Well-Being. 2014;6(1):1–47. doi: 10.1111/aphw.12017.
    1. Schwarzer R, Lippke S, Luszczynska A. Mechanisms of health behavior change in persons with chronic illness or disability: the Health Action Process Approach (HAPA) Rehabil Psychol. 2011;56(3):161–170. doi: 10.1037/a0024509.
    1. Sanetti LMH, Collier-Meek MA, Long ACJ, Kim J, Kratochwill TR. Using implementation planning to increase teachers’ adherence and quality to behavior support plans. Psychol Sch. 2014;51(8):879–895. doi: 10.1002/pits.21787.
    1. Ramsay CR, Thomas RE, Croal BL, Grimshaw JM, Eccles MP. Using the theory of planned behaviour as a process evaluation tool in randomised trials of knowledge translation strategies: a case study from UK primary care. Implement Sci. 2010;5(1):71. doi: 10.1186/1748-5908-5-71.
    1. Presseau J, Grimshaw JM, Tetroe JM, et al. A theory-based process evaluation alongside a randomised controlled trial of printed educational messages to increase primary care physicians’ prescription of thiazide diuretics for hypertension [ISRCTN72772651] Implement Sci. 2016;11(1):121. doi: 10.1186/s13012-016-0485-4.
    1. Desroches S, Gagnon M-P, Tapp S, Légaré F. Implementing shared decision-making in nutrition clinical practice: a theory-based approach and feasibility study. Implement Sci. 2008;3(1):48. doi: 10.1186/1748-5908-3-48.
    1. Lavis JN, Wilson MG, Grimshaw JM, et al. Effects of an evidence service on health-system policy makers’ use of research evidence: a protocol for a randomised controlled trial. Implement Sci. 2011;6(1):51. doi: 10.1186/1748-5908-6-51.
    1. Fraser KD, Sales AE, Baylon MAB, Schalm C, Miklavcic JJ. Data for improvement and clinical excellence: a report of an interrupted time series trial of feedback in home care. Implement Sci. 2017;12(1):66. doi: 10.1186/s13012-017-0600-1.
    1. Zwarenstein M, Grimshaw JM, Presseau J, et al. Printed educational messages fail to increase use of thiazides as first-line medication for hypertension in primary care: a cluster randomized controlled trial [ISRCTN72772651] Implement Sci. 2016;11(1):124. doi: 10.1186/s13012-016-0486-3.
    1. Lewis CC, Klasnja P, Powell BJ, et al. From classification to causality: advancing understanding of mechanisms of change in implementation science. Front Public Health. 2018;6. 10.3389/fpubh.2018.00136.
    1. Williams NJ. Multilevel mechanisms of implementation strategies in mental health: integrating theory, research, and practice. Admin Pol Ment Health. 2016;43(5):783–798. doi: 10.1007/s10488-015-0693-2.
    1. Schwarzer R. Health action process approach (HAPA) as a theoretical framework to understand behavior change. Actual En Psicol. 2016;30(121):119–130. doi: 10.15517/ap.v30i121.23458.
    1. Cook CR, Lyon AR, Kubergovic D, Browning Wright D, Zhang Y. A supportive beliefs intervention to facilitate the implementation of evidence-based practices within a multi-tiered system of supports. Sch Ment Heal. 2015;7(1):49–60. doi: 10.1007/s12310-014-9139-3.
    1. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–226. doi: 10.1097/MLR.0b013e3182408812.
    1. Palinkas LA, Horwitz SM, Chamberlain P, Hurlburt MS, Landsverk J. Mixed-methods designs in mental health services research: a review. Psychiatr Serv. 2011;62(3):255–263. doi: 10.1176/ps.62.3.pss6203_0255.
    1. Stein BD, Jaycox LH, Kataoka SH, et al. A mental health intervention for schoolchildren exposed to violence: a randomized controlled trial. JAMA. 2003;290(5):603–611. doi: 10.1001/jama.290.5.603.
    1. Kataoka S, Jaycox LH, Wong M, et al. Effects on school outcomes in low-income minority youth: preliminary findings from a community-partnered study of a school trauma intervention. Ethn Dis. 2011;21(3 0 1):S1-71-77.
    1. Vona P, Wilmoth P, Jaycox LH, et al. A web-based platform to support an evidence-based mental health intervention: lessons from the CBITS web site. Psychiatr Serv. 2014;65(11):1381–1384. doi: 10.1176/appi.ps.201300512.
    1. Cialdini RB, Reno RR, Kallgren CA. A focus theory of normative conduct: recycling the concept of norms to reduce littering in public places. J Pers Soc Psychol. 1990;58(6):1015–1026. doi: 10.1037/0022-3514.58.6.1015.
    1. Abrams D, Wetherell M, Cochrane S, Hogg MA, Turner JC. Knowing what to think by knowing who you are: self-categorization and the nature of norm formation, conformity and group polarization*. Br J Soc Psychol. 1990;29(2):97–119. doi: 10.1111/j.2044-8309.1990.tb00892.x.
    1. Berkowitz AD. Applications of social norms theory to other health and social justice issues. In: The social norms approach to preventing school and college age substance abuse: a handbook for educators, counselors, clinicians. San Francisco: Jossey-Bass; 2002.
    1. Petrova PK, Cialdini RB, Sills SJ. Consistency-based compliance across cultures. J Exp Soc Psychol. 2007;43(1):104–111. doi: 10.1016/j.jesp.2005.04.002.
    1. Cioffi D, Garner R. On doing the decision: effects of active versus passive choice on commitment and self-perception. Personal Soc Psychol Bull. 1996;22(2):133–147. doi: 10.1177/0146167296222003.
    1. Pratkanis AR. An invitation to social influence research. In: The science of social influence: advances and future progress. New York: Psychology Press; 2007. p. 1–16.
    1. Lundahl BW, Kunz C, Brownell C, Tollefson D, Burke BL. A meta-analysis of motivational interviewing: twenty-five years of empirical studies. Res Soc Work Pract. 2010;20(2):137–160. doi: 10.1177/1049731509347850.
    1. Boyd-Ball AJ, Dishion TJ. Family-centered treatment for American Indian adolescent substance abuse: toward a culturally and historically informed strategy. In: Treating adolescent substance abuse: state of the science. New York: Cambridge University Press; 2006. p. 423–48.
    1. Connell AM, Dishion TJ, Yasui M, Kavanagh K. An adaptive approach to family intervention: linking engagement in family-centered intervention to reductions in adolescent problem behavior. Consult Clin Psychol. 2007;75(4):568–579. doi: 10.1037/0022-006X.75.4.568.
    1. Dishion TJ, Kavanagh K. Intervening in adolescent problem behavior: a family-centered approach. New York: Guilford Press; 2003.
    1. Mouzakitis A, Codding RS, Tryon G. The effects of self-monitoring and performance feedback on the treatment integrity of behavior intervention plan implementation and generalization. J Posit Behav Interv. 2015;17(4):223–234. doi: 10.1177/1098300715573629.
    1. Frey AJ, Lee J, Small JW, Seeley JR, Walker HM, Feil EG. The motivational interviewing navigation guide: a process for enhancing teachers’ motivation to adopt and implement school-based interventions. Adv School Ment Health Promot. 2013;6(3):158–173. doi: 10.1080/1754730X.2013.804334.
    1. Cohen GL, Sherman DK. The psychology of change: self-affirmation and social psychological intervention. Annu Rev Psychol. 2014;65(1):333–371. doi: 10.1146/annurev-psych-010213-115137.
    1. MCQueen A, Klein WMP. Experimental manipulations of self-affirmation: a systematic review. Self Identity. 2006;5(4):289–354. doi: 10.1080/15298860600805325.
    1. Walton GM, Cohen GL. A brief social-belonging intervention improves academic and health outcomes of minority students. Science. 2011;331(6023):1447–1451. doi: 10.1126/science.1198364.
    1. Sanetti LMH, Kratochwill TR, Long ACJ. Applying adult behavior change theory to support mediator-based intervention implementation. Sch Psychol Q. 2013;28(1):47–62. doi: 10.1037/spq0000007.
    1. Adriaanse MA, Vinkers CDW, De Ridder DTD, Hox JJ, De Wit JBF. Do implementation intentions help to eat a healthy diet? A systematic review and meta-analysis of the empirical evidence. Appetite. 2011;56(1):183–193. doi: 10.1016/j.appet.2010.10.012.
    1. Bélanger-Gravel A, Godin G, Amireault S. A meta-analytic review of the effect of implementation intentions on physical activity. Health Psychol Rev. 2013;7(1):23–54. doi: 10.1080/17437199.2011.560095.
    1. Orbell S, Sheeran P. Motivational and volitional processes in action initiation: a field study of the role of implementation intentions1. J Appl Soc Psychol. 2000;30(4):780–797. doi: 10.1111/j.1559-1816.2000.tb02823.x.
    1. Sheeran P, Orbell S. Implementation intentions and repeated behaviour: augmenting the predictive validity of the theory of planned behaviour. Eur J Soc Psychol. 1999;29(2-3):349–369. doi: 10.1002/(SICI)1099-0992(199903/05)29:2/3<349::AID-EJSP931>;2-Y.
    1. Orbell S, Hodgkins S, Sheeran P. Implementation intentions and the theory of planned behavior. Personal Soc Psychol Bull. 1997;23(9):945–954. doi: 10.1177/0146167297239004.
    1. Lyon AR, Cook CR, Duong MT, et al. The influence of a blended, theoretically-informed pre-implementation strategy on school-based clinician implementation of an evidence-based trauma intervention. Implement Sci. 2019;14(1):54. doi: 10.1186/s13012-019-0905-3.
    1. DeSantis L, Ugarriza DN. The concept of theme as used in qualitative nursing research. West J Nurs Res. 2000;22(3):351–372. doi: 10.1177/019394590002200308.
    1. Hill CE, Knox S, Thompson BJ, Williams EN, Hess SA, Ladany N. Consensual qualitative research: an update. J Couns Psychol. 2005;52(2):196–205. doi: 10.1037/0022-0167.52.2.196.
    1. Oxman AD, Thomson MA, Davis DA, Haynes RB. No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. CMAJ. 1995;153(10):1423–1431.
    1. Tashakkori A, Teddlie C. Handbook of mixed methods in social & behavioral research. Thousand Oaks: SAGE Publications; 2010.
    1. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS) Ment Health Serv Res. 2004;6(2):61–74. doi: 10.1023/B:MHSR.0000024351.12294.65.
    1. Francis J, Eccles MP, Johnston M, et al. Constructing questionnaires based on the theory of planned behaviour: a manual for health services researchers. Published online 2004. .
    1. Schwarzer R, Hallum S. Perceived teacher self-efficacy as a predictor of job stress and burnout: mediation analyses. Appl Psychol. 2008;57(s1):152–171. doi: 10.1111/j.1464-0597.2008.00359.x.
    1. Kortteisto T, Kaila M, Komulainen J, Mäntyranta T, Rissanen P. Healthcare professionals’ intentions to use clinical guidelines: a survey using the theory of planned behaviour. Implement Sci. 2010;5(1):51. doi: 10.1186/1748-5908-5-51.
    1. Meiser-Stedman R, Smith P, Bryant R, et al. Development and validation of the Child Post-Traumatic Cognitions Inventory (CPTCI) J Child Psychol Psychiatry. 2009;50(4):432–440. doi: 10.1111/j.1469-7610.2008.01995.x.
    1. Vrolijk-Bosschaart TF, Verlinden E, Langendam MW, et al. The diagnostic utility of the child sexual behavior inventory for sexual abuse: a systematic review. J Child Sex Abuse. 2018;27(7):729–751. doi: 10.1080/10538712.2018.1477215.
    1. van Minnen A, Hagenaars MA. Avoidance behaviour of patients with posttraumatic stress disorder. Initial development of a questionnaire, psychometric properties and treatment sensitivity. J Behav Ther Exper Pschiatr. 2010;41(3):191–198. doi: 10.1016/j.jbtep.2010.01.002.
    1. Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS) Implement Sci. 2014;9(1):157. doi: 10.1186/s13012-014-0157-1.
    1. Lyon AR, Cook CR, Brown EC, et al. Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implement Sci. 2018;13(1):5. doi: 10.1186/s13012-017-0705-6.
    1. Aarons GA, Ehrhart MG, Farahnak LR. The Implementation Leadership Scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9(1):45. doi: 10.1186/1748-5908-9-45.
    1. Dorsey S, Pullmann MD, Deblinger E, et al. Improving practice in community-based settings: a randomized trial of supervision – study protocol. Implement Sci. 2013;8(1):89. doi: 10.1186/1748-5908-8-89.
    1. Foa EB, Asnaani A, Zang Y, Capaldi S, Yeh R. Psychometrics of the child PTSD symptom scale for DSM-5 for trauma-exposed children and adolescents. J Clin Child Adolesc Psychol. 2018;47(1):38–46. doi: 10.1080/15374416.2017.1350962.
    1. Holt T, Cohen JA, Mannarino A. Factor structure of the parent emotional reaction questionnaire: analysis and validation. Eur J Psychotraumatol. 2015;6(1):28733. doi: 10.3402/ejpt.v6.28733.
    1. Angold A, Costello EJ, Messer SC, Pickles A, Winder F, Silver D. The development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. Int J Methods Psychiatr Res. 1995;5:237–249.
    1. Goodman R. Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2001;40(11):1337–1345. doi: 10.1097/00004583-200111000-00015.
    1. Creswell JW, Clark VLP. Designing and conducting mixed methods research. Los Angeles: SAGE Publications; 2017.
    1. Creswell JW, Klassen AC, Plano Clark VL, Smith KC. Best practices for mixed methods research in the health sciences. Bethesda (Maryland): National Institutes of Health. 2011;2013:541–5.
    1. Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Admin Pol Ment Health. 2011;38(1):44–53. 10.1007/s10488-010-0314-z.
    1. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. doi: 10.1186/1748-5908-4-50.
    1. Rogers E. Diffusion of innovations. New York: Free Press; 2003.
    1. MacKinnon DP, Fairchild AJ, Fritz MS. Mediation analysis. Annu Rev Psychol. 2007;58(1):593–614. doi: 10.1146/annurev.psych.58.110405.085542.
    1. Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–1288. doi: 10.1177/1049732305276687.
    1. Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42(4):1758–1772. doi: 10.1111/j.1475-6773.2006.00684.x.
    1. Glaser B, Strauss A. The discovery of grounded theory: strategies for qualitative research. 1967.
    1. Strauss A, Corbin J. Basics of qualitative research: grounded theory procedures and techniques. Thousand Oaks: Sage Publications; 1990.
    1. Hill CE, Thompson BJ, Williams EN. A guide to conducting consensual qualitative research. Couns Psychol. 1997;25(4):517–572. doi: 10.1177/0011000097254001.
    1. National Therapist Certification Program. Randomized clinical trials. Trauma-Focused Cognitive Behavioral Therapy. Published September 13, 2016. Accessed February 25, 2019. .
    1. Baldwin SA, Murray DM, Shadish WR, et al. Intraclass correlation associated with therapists: estimates and applications in planning psychotherapy research. Cogn Behav Ther. 2011;40(1):15–33. doi: 10.1080/16506073.2010.520731.
    1. Fritz MS, MacKinnon DP. Required sample size to detect the mediated effect. Psychol Sci. 2007;18(3):233–239. doi: 10.1111/j.1467-9280.2007.01882.x.
    1. Powell BJ, McMillen JC, Proctor EK, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–157. doi: 10.1177/1077558711430690.
    1. Powell BJ, Waltz TJ, Chinman MJ, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):21. doi: 10.1186/s13012-015-0209-1.
    1. Dopp AR, Parisi KE, Munson SA, Lyon AR. Integrating implementation and user-centred design strategies to enhance the impact of health services: protocol from a concept mapping study. Health Res Policy Sys. 2019;17(1):1. doi: 10.1186/s12961-018-0403-0.
    1. Lewis CC, Boyd MR, Walsh-Bailey C, et al. A systematic review of empirical studies examining mechanisms of implementation in health. Implement Sci. 2020;15(1):1–25. doi: 10.1186/s13012-020-00983-3.
    1. Aarons GA, Ehrhart MG, Farahnak LR, Hurlburt MS. Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implement Sci. 2015;10(1):11. doi: 10.1186/s13012-014-0192-y.
    1. Glisson C, Schoenwald SK. The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Ment Health Serv Res. 2005;7(4):243–259. doi: 10.1007/s11020-005-7456-1.
    1. Kirchner JE, Ritchie MJ, Pitcock JA, Parker LE, Curran GM, Fortney JC. Outcomes of a partnered facilitation strategy to implement primary care–mental health. J Gen Intern Med. 2014;29(4):904–912. doi: 10.1007/s11606-014-3027-2.
    1. Olmstead T, Carroll KM, Canning-Ball M, Martino S. Cost and cost-effectiveness of three strategies for training clinicians in motivational interviewing. Drug Alcohol Depend. 2011;116(1):195–202. doi: 10.1016/j.drugalcdep.2010.12.015.
    1. Aas E, Iversen T, Holt T, Ormhaug SM, Jensen TK. Cost-effectiveness analysis of trauma-focused cognitive behavioral therapy: a randomized control trial among Norwegian youth. J Clin Child Adolesc Psychol. 2018:1–14. 10.1080/15374416.2018.1463535.
    1. Dopp AR, Hanson RF, Saunders BE, Dismuke CE, Moreland AD. Community-based implementation of trauma-focused interventions for youth: economic impact of the learning collaborative model. Psychol Serv. 2017;14(1):57–65. doi: 10.1037/ser0000131.
    1. Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76. doi: 10.1007/s10488-010-0319-7.
    1. Raghavan R. The role of economic evaluation in dissemination and implementation research. In: Dissemination and implementation research in health. New York: Oxford University Press; 2017.
    1. Walker SC, Lyon AR, Aos S, Trupin EW. The consistencies and vagaries of the Washington state inventory of evidence-based practice: the definition of “evidence-based” in a policy context. Admin Pol Ment Health. 2017;44(1):42–54. doi: 10.1007/s10488-015-0652-y.
    1. Han SS, Weiss B. Sustainability of teacher implementation of school-based mental health programs. J Abnorm Child Psychol. 2005;33(6):665–679. doi: 10.1007/s10802-005-7646-2.
    1. Scheirer MA, Dearing JW. An agenda for research on the sustainability of public health programs. Am J Public Health. 2011;101(11):2059–2067. doi: 10.2105/AJPH.2011.300193.
    1. Stirman SW. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:1–19. doi: 10.1186/1748-5908-7-1.
    1. Aarons GA, Green AE, Willging CE, et al. Mixed-method study of a conceptual model of evidence-based intervention sustainment across multiple public-sector service settings. Implement Sci. 2014;9(1):183. doi: 10.1186/s13012-014-0183-z.
    1. Aarons GA, Green AE, Trott E, et al. The roles of system and organizational leadership in system-wide evidence-based intervention sustainment: a mixed-method study. Admin Pol Ment Health. 2016;43(6):991–1008. doi: 10.1007/s10488-016-0751-4.
    1. Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. doi: 10.1111/j.0887-378X.2004.00325.x.
    1. McIntosh K, Horner RH, Sugai G. Sustainability of systems-level evidence-based practices in schools: Current knowledge and future directions. In: Handbook of Positive Behavior Support. Boston: Springer; 2009. pp. 327–52.
    1. Moore JE, Mascarenhas A, Bain J, Straus SE. Developing a comprehensive definition of sustainability. Implement Sci. 2017;12(1):110. doi: 10.1186/s13012-017-0637-1.

Source: PubMed

3
Subskrybuj