Care team and practice-level implementation strategies to optimize pediatric collaborative care: study protocol for a cluster-randomized hybrid type III trial

David J Kolko, Elizabeth A McGuier, Renee Turchi, Eileen Thompson, Satish Iyengar, Shawna N Smith, Kimberly Hoagwood, Celeste Liebrecht, Ian M Bennett, Byron J Powell, Kelly Kelleher, Maria Silva, Amy M Kilbourne, David J Kolko, Elizabeth A McGuier, Renee Turchi, Eileen Thompson, Satish Iyengar, Shawna N Smith, Kimberly Hoagwood, Celeste Liebrecht, Ian M Bennett, Byron J Powell, Kelly Kelleher, Maria Silva, Amy M Kilbourne

Abstract

Background: Implementation facilitation is an effective strategy to support the implementation of evidence-based practices (EBPs), but our understanding of multilevel strategies and the mechanisms of change within the "black box" of implementation facilitation is limited. This implementation trial seeks to disentangle and evaluate the effects of facilitation strategies that separately target the care team and leadership levels on implementation of a collaborative care model in pediatric primary care. Strategies targeting the provider care team (TEAM) should engage team-level mechanisms, and strategies targeting leaders (LEAD) should engage organizational mechanisms.

Methods: We will conduct a hybrid type 3 effectiveness-implementation trial in a 2 × 2 factorial design to evaluate the main and interactive effects of TEAM and LEAD and test for mediation and moderation of effects. Twenty-four pediatric primary care practices will receive standard REP training to implement Doctor-Office Collaborative Care (DOCC) and then be randomized to (1) Standard REP only, (2) TEAM, (3) LEAD, or (4) TEAM + LEAD. Implementation outcomes are DOCC service delivery and change in practice-level care management competencies. Clinical outcomes are child symptom severity and quality of life.

Discussion: This statewide trial is one of the first to test the unique and synergistic effects of implementation strategies targeting care teams and practice leadership. It will advance our knowledge of effective care team and practice-level implementation strategies and mechanisms of change. Findings will support efforts to improve common child behavioral health conditions by optimizing scale-up and sustainment of CCMs in a pediatric patient-centered medical home.

Trial registration: ClinicalTrials.gov, NCT04946253 . Registered June 30, 2021.

Keywords: Collaborative care model; Facilitation; Implementation strategies; Leadership; Mechanisms; Team.

Conflict of interest statement

The authors declare no competing interests.

© 2022. The Author(s).

Figures

Fig. 1
Fig. 1
Implementation trial design

References

    1. Merikangas KR, He J-P, Brody D, Fisher PW, Bourdon K, Koretz DS. Prevalence and treatment of mental disorders among US children in the 2001–2004 NHANES. Pediatrics. 2010;125(1):75–81.
    1. Tempel AB, Herschell AD, Kolko D. The encyclopedia of clinical psychology. American Cancer Society; 2015. Conduct disorder; pp. 1–6.
    1. Asarnow JR, Rozenman M, Wiblin J, Zeltzer L. Integrated medical-behavioral care compared with usual primary care for child and adolescent behavioral health: a meta-analysis. JAMA Pediatr. 2015;169(10):929–937.
    1. Elango S, Whitmire R, Kim J, Berhane Z, Davis R, Turchi RM. Family experience of caregiver burden and health care usage in a statewide medical home program. Acad Pediatr. 2021; Available from: . Cited 2021 Nov 8.
    1. McAllister JW, Cooley WC, Cleave JV, Boudreau AA, Kuhlthau K. Medical home transformation in pediatric primary care—what drives change? Ann Fam Med. 2013;11(Suppl 1):S90–S98.
    1. Lichstein JC, Ghandour RM, Mann MY. Access to the medical home among children with and without special health care needs. Pediatrics. 2018;142(6):e20181795.
    1. Mohanty S, Wells N, Antonelli R, Turchi RM. Incorporating patient- and family-centered care into practice: the PA medical home initiative. Pediatrics. 2018;142(3). 10.1542/peds.2017-2453 Cited 2021 Nov 8.
    1. Richardson LP, McCarty CA, Radovic A, Suleiman AB. Research in the integration of behavioral health for adolescents and young adults in primary care settings: a systematic review. J Adolesc Health. 2017;60(3):261–269.
    1. Campo JV, Geist R, Kolko DJ. Integration of pediatric behavioral health services in primary care: improving access and outcomes with collaborative care. Can J Psychiatry. 2018;63(7):432–438.
    1. Council on Children with Disabilities and Medical Home Implementation Project Advisory Committee. Turchi RM, Antonelli RC, Norwood KW, Jr, Adams RC, Brei TJ, et al. Patient- and family-centered care coordination: a framework for integrating care for children and youth across multiple systems. Pediatrics. 2014;133(5):e1451–e1460.
    1. Goodrich DE, Kilbourne AM, Nord KM, Bauer MS. Mental health collaborative care and its role in primary care settings. Curr Psychiatry Rep. 2013;15(8):383.
    1. Woltmann E, Grogan-Kaylor A, Perron B, Georges H, Kilbourne AM, Bauer MS. Comparative effectiveness of collaborative chronic care models for mental health conditions across primary, specialty, and behavioral health care settings: systematic review and meta-analysis. Am J Psychiatry. 2012;169(8):790–804.
    1. Katon W, Unützer J, Wells K, Jones L. Collaborative depression care: history, evolution and ways to enhance dissemination and sustainability. Gen Hosp Psychiatry. 2010;32(5):456–464.
    1. Huffman JC, Mastromauro CA, Beach SR, Celano CM, DuBois CM, Healy BC, et al. Collaborative care for depression and anxiety disorders in patients with recent cardiac events: the management of sadness and anxiety in cardiology (MOSAIC) Randomized Clinical Trial. JAMA Intern Med. 2014;174(6):927–935.
    1. Unützer J, Chan Y-F, Hafer E, Knaster J, Shields A, Powers D, et al. Quality improvement with pay-for-performance incentives in integrated behavioral health care. Am J Public Health. 2012;102(6):e41–e45.
    1. Miller CJ, Grogan-Kaylor A, Perron BE, Kilbourne AM, Woltmann E, Bauer MS. Collaborative chronic care models for mental health conditions: cumulative meta-analysis and metaregression to guide future research and implementation. Med Care. 2013;51(10):922–930.
    1. Davis TD, Deen T, Bryant-Bedell K, Tate V, Fortney J. Does minority racial-ethnic status moderate outcomes of collaborative care for depression? Psychiatr Serv. 2011;62(11):1282–1288.
    1. Grubbs KM, Cheney AM, Fortney JC, Edlund C, Han X, Dubbert P, et al. The role of gender in moderating treatment outcome in collaborative care for anxiety. Psychiatr Serv. 2015;66(3):265–271.
    1. Wagner EH, Austin BT, Korff MV. Organizing care for patients with chronic illness. Milbank Q. 1996;74(4):511.
    1. Davy C, Bleasel J, Liu H, Tchan M, Ponniah S, Brown A. Effectiveness of chronic care models: opportunities for improving healthcare practice and health outcomes: a systematic review. BMC Health Serv Res. 2015;15(1):194.
    1. Lyon AR, Whitaker K, Richardson LP, French WP, McCauley E. Collaborative care to improve access and quality in school-based behavioral health. J Sch Health. 2019;89(12):1013–1023.
    1. Asarnow JR, Hoagwood KE, Stancin T, Lochman JE, Hughes JL, Miranda JM, et al. Psychological science and innovative strategies for informing health care redesign: a policy brief. J Clin Child Adolesc Psychol Off J Soc Clin Child Adolesc Psychol Am Psychol Assoc Div 53. 2015;44(6):923–932.
    1. Cohen DJ, Balasubramanian BA, Isaacson NF, Clark EC, Etz RS, Crabtree BF. Coordination of health behavior counseling in primary care. Ann Fam Med. 2011;9(5):406–415.
    1. Crabtree BF, Nutting PA, Miller WL, McDaniel RR, Stange KC, Jaen CR, et al. Primary care practice transformation is hard work: insights from a 15-year developmental program of research. Med Care. 2011;49:S28.
    1. Cromp D, Hsu C, Coleman K, Fishman PA, Liss DT, Ehrlich K, et al. Barriers and facilitators to team-based care in the context of primary care transformation. J Ambul Care Manage. 2015;38(2):125–133.
    1. Kadu MK, Stolee P. Facilitators and barriers of implementing the chronic care model in primary care: a systematic review. BMC Fam Pract. 2015;16(1):12.
    1. Lipschitz JM, Benzer JK, Miller C, Easley SR, Leyson J, Post EP, et al. Understanding collaborative care implementation in the Department of Veterans Affairs: core functions and implementation challenges. BMC Health Serv Res. 2017;17(1):691.
    1. Nutting PA, Crabtree BF, Miller WL, Stange KC, Stewart E, Jaén C. Transforming physician practices to patient-centered medical homes: lessons from the National Demonstration Project. Health Aff (Millwood) 2011;30(3):439–445.
    1. Overbeck G, Davidsen AS, Kousgaard MB. Enablers and barriers to implementing collaborative care for anxiety and depression: a systematic qualitative review. Implement Sci. 2016;11(1):165.
    1. Wood E, Ohlsen S, Ricketts T. What are the barriers and facilitators to implementing collaborative care for depression? A systematic review. J Affect Disord. 2017;214:26–43.
    1. Kolko DJ, Perrin EC. The integration of behavioral health interventions in children’s health care: services, science, and suggestions. J Clin Child Adolesc Psychol. 2014;43(2):216–228.
    1. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4–23.
    1. Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci. 2019;14(1):1.
    1. Kolko DJ, Torres E, Rumbarger K, James E, Turchi R, Bumgardner C, et al. Integrated pediatric health care in Pennsylvania: a survey of primary care and behavioral health providers. Clin Pediatr (Phila). 2019;58(2):213–225.
    1. Dinh JV, Traylor AM, Kilcullen MP, Perez JA, Schweissing EJ, Venkatesh A, et al. Cross-disciplinary care: a systematic review on teamwork processes in health care. Small Group Res. 2020;51(1):125–166.
    1. Schmutz J, Manser T. Do team processes really have an effect on clinical performance? A systematic literature review. BJA Br J Anaesth. 2013;110(4):529–544.
    1. Cramm JM, Strating MMH, Nieboer AP. The role of team climate in improving the quality of chronic care delivery: a longitudinal study among professionals working with chronically ill adolescents in transitional care programmes. BMJ Open. 2014;4(5):e005369.
    1. Stout S, Zallman L, Arsenault L, Sayah A, Hacker K. Developing high-functioning teams: factors associated with operating as a “real team” and implications for patient-centered medical home development. Inq J Med Care Organ Provis Financ. 2017;54:0046958017707296.
    1. Lukas C, Mohr D, Meterko M. Team effectiveness and organizational context in the implementation of a clinical innovation. Qual Manag Health Care. 2009;18(1):25–39.
    1. Denti L, Hemlin S. Leadership and innovation in organizations: a systematic review of factors that mediate or moderate the relationship. Int J Innov Manag. 2012;16(03):1240007.
    1. Aarons GA, Sommerfeld DH. Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. J Am Acad Child Adolesc Psychiatry. 2012;51(4):423–431.
    1. Aarons GA, Fettes DL, Hurlburt MS, Palinkas LA, Gunderson L, Willging CE, et al. Collaboration, negotiation, and coalescence for interagency-collaborative teams to scale-up evidence-based practice. J Clin Child Adolesc Psychol. 2014;0(0):1–14.
    1. Aarons GA, Fettes DL, Sommerfeld DH, Palinkas LA. Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat. 2012;17(1):67–79.
    1. Aarons GA, Sklar M, Mustanski B, Benbow N, Brown CH. “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implement Sci. 2017;12:111.
    1. Egeland KM, Skar A-MS, Endsjø M, Laukvik EH, Bækkelund H, Babaii A, et al. Testing the leadership and organizational change for implementation (LOCI) intervention in Norwegian mental health clinics: a stepped-wedge cluster randomized design study protocol. Implement Sci. 2019;14(1):28.
    1. Michaelis B, Stegmaier R, Sonntag K. Shedding light on followers’ innovation implementation behavior: the role of transformational leadership, commitment to change, and climate for initiative. J Manag Psychol. 2010;25(4):408–429.
    1. Proctor E, Ramsey AT, Brown MT, Malone S, Hooley C, McKay V. Training in Implementation Practice Leadership (TRIPLE): evaluation of a novel practice change strategy in behavioral health organizations. Implement Sci. 2019;14(1):66.
    1. Miech EJ, Rattray NA, Flanagan ME, Damschroder L, Schmid AA, Damush TM. Inside help: an integrative review of champions in healthcare-related implementation. SAGE Open Med. 2018;6 Available from: . Cited 2019 Jan 25.
    1. Kelleher KJ, Stevens J. Evolution of child mental health services in primary care. Acad Pediatr. 2009;9(1):7–14.
    1. Asarnow JR, Kolko DJ, Miranda J, Kazak AE. The pediatric patient-centered medical home: innovative models for improving behavioral health. Am Psychol. 2017;72(1):13–27.
    1. Smith SN, Liebrecht CM, Bauer MS, Kilbourne AM. Comparative effectiveness of external vs blended facilitation on collaborative care model implementation in slow-implementer community practices. Health Serv Res. 2020;55(6):954–965.
    1. Kilbourne AM, Abraham KM, Goodrich DE, Bowersox NW, Almirall D, Lai Z, et al. Cluster randomized adaptive implementation trial comparing a standard versus enhanced implementation intervention to improve uptake of an effective re-engagement program for patients with serious mental illness. Implement Sci. 2013;8(1):136.
    1. Kilbourne AM, Goodrich DE, Nord KM, Van Poppelen C, Kyle J, Bauer MS, et al. Long-term clinical outcomes from a randomized controlled trial of two implementation strategies to promote collaborative care attendance in community practices. Adm Policy Ment Health Ment Health Serv Res. 2015;42(5):642–653.
    1. Rycroft-Malone J. The PARIHS Framework—a framework for guiding the implementation of evidence-based practice. J Nurs Care Qual. 2004;19(4):297–304.
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):21.
    1. Berta W, Cranley L, Dearing JW, Dogherty EJ, Squires JE, Estabrooks CA. Why (we think) facilitation works: insights from organizational learning theory. Implement Sci. 2015;10(1):1–13.
    1. Hoagwood KE, Atkins M, Ialongo N. Unpacking the black box of implementation: the next generation for policy, research and practice. Adm Policy Ment Health Ment Health Serv Res. 2013;40(6):451–455.
    1. Nadeem E, Gleacher A, Beidas RS. Consultation as an implementation strategy for evidence-based practices across multiple contexts: unpacking the black box. Adm Policy Ment Health Ment Health Serv Res. 2013;40(6):439–450.
    1. Parker L, Ritchie M, Bonner L, Kirchner J. Examining inside the black box of implementation facilitation: process and effects on program quality. Bethesda; Presented at the National Institutes of Health/AcademyHealth 7th Annual Conference on the Science of Dissemination and Implementation, Bethesda, MD, December 9, 2014. Abstracts for all talks within the panel - .
    1. Ritchie MJ, Dollar KM, Miller CJ, Smith JL, Oliver KA, Kim B, Connolly, SL, Woodward E, Ochoa-Olmos T, Day S, Lindsay JA, Kirchner JE. Using Implementation Facilitation to Improve Healthcare (Version 3). Veterans Health Administration, Behavioral Health Quality Enhancement Research Initiative (QUERI). 2020. Available at: .
    1. Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, et al. Role of “external facilitation” in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implement Sci. 2006;1(1):1–15.
    1. Parchman ML, Noel PH, Culler SD, Lanham HJ, Leykum LK, Romero RL, et al. A randomized trial of practice facilitation to improve the delivery of chronic illness care in primary care: initial and sustained effects. Implement Sci. 2013;8(1):93.
    1. Bhat A, Bennett IM, Bauer AM, Beidas RS, Eriksen W, Barg FK, et al. Longitudinal remote coaching for implementation of perinatal collaborative care: a mixed-methods analysis. Psychiatr Serv. 2020;71(5):518–521.
    1. Walunas TL, Ye J, Bannon J, Wang A, Kho AN, Smith JD, et al. Does coaching matter? Examining the impact of specific practice facilitation strategies on implementation of quality improvement interventions in the Healthy Hearts in the Heartland study. Implement Sci. 2021;16(1):33.
    1. Smith SN, Almirall D, Prenovost K, Liebrecht C, Kyle J, Eisenberg D, et al. Change in patient outcomes after augmenting a low-level implementation strategy in community practices that are slow to adopt a collaborative chronic care model: a cluster randomized implementation trial. Med Care. 2019;57(7):503–511.
    1. Fortney JC, Pyne JM, Ward-Jones S, Bennett IM, Diehl J, Farris K, et al. Implementation of evidence-based practices for complex mood disorders in primary care safety net clinics. Fam Syst Health. 2018;36(3):267–280.
    1. Kirchner JE, Ritchie MJ, Pitcock JA, Parker LE, Curran GM, Fortney JC. Outcomes of a partnered facilitation strategy to implement primary care–mental health. J Gen Intern Med. 2014;29(S4):904–912.
    1. Baloh J, Zhu X, Ward MM. Types of internal facilitation activities in hospitals implementing evidence-based interventions. Health Care Manage Rev. 2018;43(3):229–237.
    1. Smith S, Almirall D, Bauer M, Liebrecht C, Kilbourne A. (When) is more better? Comparative effectiveness of external vs external+internal facilitation on site-level uptake of a collaborative care model in community-based practices that are slow to adopt. Health Serv Res. 2020;55(S1):61–62.
    1. Saldana L, Bennett I, Powers D, Vredevoogd M, Grover T, Schaper H, et al. Scaling implementation of collaborative care for depression: adaptation of the Stages of Implementation Completion (SIC) Adm Policy Ment Health. 2020;47(2):188–196.
    1. Nadeem E, Olin SS, Hill LC, Hoagwood KE, Horwitz SM. Understanding the components of quality improvement collaboratives: a systematic literature review. Milbank Q. 2013;91(2):354–394.
    1. Nadeem E, Gleacher A, Pimentel S, Hill LC, McHugh M, Hoagwood KE. The role of consultation calls for clinic supervisors in supporting large-scale dissemination of evidence based treatments for children. Adm Policy Ment Health Ment Health Serv Res. 2013;40(6):530–540.
    1. Bauer MS, Miller C, Kim B, Lew R, Weaver K, Coldwell C, et al. Partnering with health system operations leadership to develop a controlled implementation trial. Implement Sci. 2016;11:22.
    1. Rattray NA, Khaw A, McGrath M, Damush TM, Miech EJ, Lenet A, et al. Evaluating the feasibility of implementing a Telesleep pilot program using two-tiered external facilitation. BMC Health Serv Res. 2020;20(1):357.
    1. Weiner BJ, Lewis MA, Clauser SB, Stitzenberg KB. In search of synergy: strategies for combining interventions at multiple levels. J Natl Cancer Inst Monogr. 2012;2012(44):34–41.
    1. Schilling S, Bigal L, Powell BJ. Developing and Applying Synergistic Multilevel Implementation Strategies to Increase Adoption of Screening and Referral to an Evidence-Based Parenting Intervention in Primary Care. Manuscript submitted for publication. Implementation Research and Practice. 2022.
    1. Williams NJ, Ehrhart MG, Aarons GA, Marcus SC, Beidas RS. Linking molar organizational climate and strategic implementation climate to clinicians’ use of evidence-based psychotherapy techniques: cross-sectional and lagged analyses from a 2-year observational study. Implement Sci. 2018;13(1):85.
    1. Williams NJ, Glisson C, Hemmelgarn A, Green P. Mechanisms of change in the ARC organizational strategy: increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Adm Policy Ment Health. 2017;44(2):269–283.
    1. Lewis CC, Klasnja P, Powell BJ, Lyon AR, Tuzzio L, Jones S, et al. From classification to causality: advancing understanding of mechanisms of change in implementation science. Front Public Health. 2018;6 Available from: . Cited 2018 Oct 12.
    1. Lewis CC, Boyd MR, Walsh-Bailey C, Lyon AR, Beidas R, Mittman B, et al. A systematic review of empirical studies examining mechanisms of implementation in health. Implement Sci. 2020;15(1):1–25.
    1. Lewis CC, Powell BJ, Brewer SK, Nguyen AM, Schriger SH, Vejnoska SF, et al. Advancing mechanisms of implementation to accelerate sustainable evidence-based practice integration: protocol for generating a research agenda. BMJ Open. 2021;11(10):e053474.
    1. Powell BJ, Fernandez ME, Williams NJ, Aarons GA, Beidas RS, Lewis CC, et al. Enhancing the impact of implementation strategies in healthcare: a research agenda. Front Public Health. 2019;7 Available from: . Cited 2019 Jan 29.
    1. Williams NJ. Multilevel mechanisms of implementation strategies in mental health: integrating theory, research, and practice. Adm Policy Ment Health Ment Health Serv Res. 2016;43(5):783–798.
    1. Williams NJ, Beidas RS. Annual research review: the state of implementation science in child psychology and psychiatry: a review and suggestions to advance the field. J Child Psychol Psychiatry. 2019;60:430–450.
    1. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs. Med Care. 2012;50(3):217–226.
    1. Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci. 2007;2(1):42.
    1. Green LW, Kreuter MW. Health promotion planning: an educational and environmental approach. 2. Mountain View: Mayfield Publishing Company; 1991. p. 506.
    1. Kirchner JE, Kearney LK, Ritchie MJ, Dollar KM, Swensen AB, Schohn M. Research and services partnerships: lessons learned through a national partnership between clinical leaders and researchers. Psychiatr Serv. 2014;65(5):577–579.
    1. Kilbourne AM, Goodrich DE, Lai Z, Almirall D, Nord KM, Bowersox NW, et al. Reengaging veterans with serious mental illness into care: preliminary results from a national randomized trial. Psychiatr Serv. 2015;66(1):90–93.
    1. Kilbourne AM, Neumann MS, Waxmonsky J, Bauer MS, Kim HM, Pincus HA, et al. Public-academic partnerships: evidence-based implementation: the role of sustained community-based practice and research partnerships. Psychiatr Serv. 2012;63(3):205–207.
    1. Neumann MS, Sogolow ED. Replicating effective programs: HIV/AIDS prevention technology transfer. AIDS Educ Prev Off Publ Int Soc AIDS Educ. 2000;12(5 Suppl):35–48.
    1. Bandura A. Social learning theory: Englewood Cliffs. NJ: Prentice-Hall; 1977.
    1. Rogers EM. Diffusion of innovations. 4th ed. New York, NY. Simon and Schuster; 2010. p. 550.
    1. Knox L, Taylor EF, Geonnotti K, Machta R, Kim J, Nysenbaum J, et al. Developing and running a primary care practice facilitation program: a how-to guide. Mathematica Policy Research Reports. Mathematica Policy Research; 2011. (Mathematica Policy Research Reports). Report No.: cf15b9115d714275b538a9c835145652. Available from: . Cited 2021 Oct 29.
    1. Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10(1):63–74.
    1. Klein C, DiazGranados D, Salas E, Le H, Burke CS, Lyons R, et al. Does team building work? Small Group Res. 2009;40(2):181–222.
    1. Miller CJ, Kim B, Silverman A, Bauer MS. A systematic review of team-building interventions in non-acute healthcare settings. BMC Health Serv Res. 2018;18(1):146.
    1. McEwan D, Ruissen GR, Eys MA, Zumbo BD, Beauchamp MR. The effectiveness of teamwork training on teamwork behaviors and team performance: a systematic review and meta-analysis of controlled interventions. PLoS One. 2017;12(1):e0169604.
    1. Salas E, DiazGranados D, Klein C, Burke CS, Stagl KC, Goodwin GF, et al. Does team training improve team performance? A meta-analysis. Hum Factors. 2008;50(6):903–933.
    1. Reyes DL, Tannenbaum SI, Salas E. Team development: the power of debriefing. People Strategy. 2018;41(2):46.
    1. Tannenbaum SI, Cerasoli CP. Do team and individual debriefs enhance performance? A meta-analysis. Hum Factors. 2013;55(1):231–245.
    1. Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE, Fortney JC, et al. Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implement Sci. 2014;9(1):132.
    1. Aarons GA, Ehrhart MG, Farahnak LR, Sklar M. The role of leadership in creating a strategic climate for evidence-based practice implementation and sustainment in systems and organizations. Front Public Health Serv Syst Res. 2014;3(4):3.
    1. Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS) Implement Sci. 2014;9:157.
    1. Aarons GA, Farahnak LR, Ehrhart MG, Sklar M. Aligning leadership across systems and organizations to develop strategic climate to for evidence-based practice implementation. Annu Rev Public Health. 2014;35:255–274.
    1. Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9(1):45.
    1. Kolko DJ, Campo J, Kilbourne AM, Hart J, Sakolsky D, Wisniewski S. Collaborative care outcomes for pediatric behavioral health problems: a cluster randomized trial. Pediatrics. 2014;133(4):e981–e992.
    1. Kolko DJ, Campo JV, Kilbourne AM, Kelleher K. Doctor-Office Collaborative Care for pediatric behavioral problems: a preliminary clinical trial. Arch Pediatr Adolesc Med. 2012;166(3):224–231.
    1. Kolko DJ, Campo JV, Kelleher K, Cheng Y. Improving access to care and clinical outcome for pediatric behavioral problems: a randomized trial of a nurse-administered intervention in primary care. J Dev Behav Pediatr. 2010;31(5):393–404.
    1. Stange KC, Nutting PA, Miller WL, Jaén CR, Crabtree BF, Flocke SA, et al. Defining and measuring the patient-centered medical home. J Gen Intern Med. 2010;25(6):601–612.
    1. Lindhiem O, Kolko DJ. Trajectories of symptom reduction during treatment for behavior problems in pediatric primary-care settings. Adm Policy Ment Health Ment Health Serv Res. 2011;38(6):486–494.
    1. Yu H, Kolko DJ, Torres E. Collaborative mental health care for pediatric behavior disorders in primary care: does it reduce mental health care costs? Fam Syst Health J Collab Fam Healthc. 2017;35(1):46–57.
    1. Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586.
    1. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.
    1. Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340(mar23 1):c869.
    1. Hamburger R, Berhane Z, Gatto M, Yunghans S, Davis RK, Turchi RM. Evaluation of a statewide medical home program on children and young adults with asthma. J Asthma. 2015;52(9):940–948.
    1. Jellinek MS, Murphy JM, Robinson J, Feins A, Lamb S, Fenton T. Pediatric symptom checklist: screening school-age children for psychosocial dysfunction. J Pediatr. 1988;112(2):201–209.
    1. Stiffman AR, Horwitz SM, Hoagwood K, Compton W, Cottler L, Bean DL, et al. The Service Assessment for Children and Adolescents (SACA): adult and child reports. J Am Acad Child Adolesc Psychiatry. 2000;39(8):1032–1039.
    1. Pediatrics AA of Appendix S3: mental health practice readiness inventory. Pediatrics. 2010;125(Supplement 3):S129–S132.
    1. King MA, Wissow LS, Baum RA. The role of organizational context in the implementation of a statewide initiative to integrate mental health services into pediatric primary care. Health Care Manage Rev. 2018;43(3):206–217.
    1. Baum RA, King MA, Wissow LS. Outcomes of a statewide learning collaborative to implement mental health services in pediatric primary care. Psychiatr Serv. 2019;70(2):123–129.
    1. Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108.
    1. Wolraich ML, Lambert W, Doffing MA, Bickman L, Simmons T, Worley K. Psychometric properties of the Vanderbilt ADHD Diagnostic Parent Rating Scale in a referred population. J Pediatr Psychol. 2003;28(8):559–568.
    1. Wolraich ML, Bard DE, Neas B, Doffing M, Beck L. The psychometric properties of the Vanderbilt Attention-Deficit Hyperactivity Disorder Diagnostic Teacher Rating Scale in a community population. J Dev Behav Pediatr. 2013;34(2):83–93.
    1. Varni JW, Seid M, Kurtin PS. PedsQLTM 4.0: reliability and validity of the Pediatric Quality of Life InventoryTM Version 4.0 Generic Core Scales in healthy and patient populations. Med Care. 2001;39(8):800–812.
    1. Varni JW, Katz ER, Seid M, Quiggins DJL, Friedman-Bender A, Castro CM. The Pediatric Cancer Quality of Life Inventory (PCQL). I. Instrument development, descriptive statistics, and cross-informant variance. J Behav Med. 1998;21(2):179–204.
    1. Song H, Chien AT, Fisher J, Martin J, Peters AS, Hacker K, et al. Development and validation of the Primary Care Team Dynamics Survey. Health Serv Res. 2015;50(3):897–921.
    1. Ziniel SI, Rosenberg HN, Bach AM, Singer SJ, Antonelli RC. Validation of a parent-reported experience measure of integrated care. Pediatrics. 2016;138(6) Available from: . Cited 2021 Nov 3.
    1. Stock R, Mahoney E, Carney PA. Measuring team development in clinical care settings. Fam Med. 2013;10:691–700.
    1. Finn NK, Torres EM, Ehrhart MG, Roesch SC, Aarons GA. Cross-validation of the Implementation Leadership Scale (ILS) in child welfare service organizations. Child Maltreat. 2016;21(3):250–255.
    1. Torres EM, Ehrhart MG, Beidas RS, Farahnak LR, Finn NK, Aarons GA. Validation of the Implementation Leadership Scale (ILS) with supervisors’ self-ratings. Community Ment Health J. 2018;54(1):49–53.
    1. Aarons GA, Ehrhart MG, Torres EM, Finn NK, Beidas RS. The humble leader: association of discrepancies in leader and follower ratings of implementation leadership with organizational climate in mental health. Psychiatr Serv. 2016;68(2):115–122.
    1. Aarons GA, Green AE, Trott E, Willging CE, Torres EM, Ehrhart MG, et al. The roles of system and organizational leadership in system-wide evidence-based intervention sustainment: a mixed-method study. Adm Policy Ment Health Ment Health Serv Res. 2016;43(6):991–1008.
    1. Fernandez ME, Walker TJ, Weiner BJ, Calo WA, Liang S, Risendal B, et al. Developing measures to assess constructs from the Inner Setting domain of the Consolidated Framework for Implementation Research. Implement Sci. 2018;13(1):52.
    1. McLennan JD, Jansen-McWilliams L, Comer DMA, Gardner WP, Kelleher KJ. The Physician Belief Scale and psychosocial problems in children: a report from the pediatric research in office settings and the Ambulatory Sentinel Practice Network. J Dev. 1999;20(1):24–30.
    1. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8(1):139.
    1. Waxmonsky J, Kilbourne AM, Goodrich DE, Nord KM, Lai Z, Laird C, et al. Enhanced fidelity to treatment for bipolar disorder: results from a randomized controlled implementation trial. Psychiatr Serv. 2014;65(1):81–90.
    1. Kolko DJ, McGuier EA, Campo JV, Kilbourne AM, Kelleher KJ. The role of treatment team collaboration in a clinical trial for behavior problems and ADHD in pediatric primary care. Poster presentation at the 14th Annual Conference on the Science of Dissemination and Implementation in Health, Virtual. 2021.
    1. Kolko DJ. Individual cognitive behavioral treatment and family therapy for physically abused children and their offending parents: a comparison of clinical outcomes. Child Maltreat. 1996;1(4):322–342.
    1. MacKinnon DP, Lockwood CM, Hoffman JM, West SG, Sheets V. A comparison of methods to test mediation and other intervening variable effects. Psychol Methods. 2002;7(1):83.
    1. Mazumdar S, Tang G, Houck PR, Dew MA, Begley AE, Scott J, et al. Statistical analysis of longitudinal psychiatric data with dropouts. J Psychiatr Res. 2007;41(12):1032–1041.
    1. Schafer JL, Graham JW. Missing data: our view of the state of the art. Psychol Methods. 2002;7(2):147–177.
    1. Wallace ML, Frank E, Kraemer HC. A novel approach for developing and interpreting treatment moderator profiles in randomized clinical trials. JAMA Psychiatry. 2013;70(11):1241–1247.
    1. International Committee of Medical Journal Editors . Recommendations for the conduct, reporting, editing, and publication of scholarly work in medical journals. 2021.
    1. Waltz TJ, Powell BJ, Fernández ME, Abadie B, Damschroder LJ. Choosing implementation strategies to address contextual barriers: diversity in recommendations and future directions. Implement Sci. 2019;14(1):42.
    1. Shelton RC, Cooper BR, Stirman SW. The sustainability of evidence-based interventions and practices in public health and health care. Annu Rev Public Health. 2018;39:55–76.

Source: PubMed

Patrocinadores e Colaboradores

Condições médicas

Intervenções de drogas

3
Se inscrever