The influence of a blended, theoretically-informed pre-implementation strategy on school-based clinician implementation of an evidence-based trauma intervention

Aaron R Lyon, Clayton R Cook, Mylien T Duong, Semret Nicodimos, Michael D Pullmann, Stephanie K Brewer, Larissa M Gaias, Shanon Cox, Aaron R Lyon, Clayton R Cook, Mylien T Duong, Semret Nicodimos, Michael D Pullmann, Stephanie K Brewer, Larissa M Gaias, Shanon Cox

Abstract

Background: Individual-level implementation determinants, such as clinician attitudes, commonly influence the successful adoption of evidence-based practices, but few explicit strategies have been tested with regard to their ability to impact these key mechanisms of change. This paper reports on an initial test of a blended, theoretically informed pre-implementation strategy designed to target malleable individual-level determinants of behavior change. Beliefs and Attitudes for Successful Implementation in Schools (BASIS) is a brief and pragmatic pre-implementation strategy that uses strategic education, social influence techniques, and group-based motivational interviewing to target implementation attitudes, perceived social norms, perceived behavioral control, and behavioral intentions to implement among mental health clinicians working in the education sector.

Methods: As part of a pilot trial, 25 school mental health clinicians were randomized to BASIS (n = 12) or an attention control placebo (n = 13), with both conditions receiving training and consultation in an evidence-based intervention for youth experiencing trauma (the Cognitive Behavioral Intervention for Trauma in Schools). Theorized mechanisms of change (attitudes, perceived social norms, perceived behavioral control, and behavioral intentions) were assessed at baseline, post-training, and 4-month follow-up. Clinician participation in post-training consultation and intervention adoption were also tracked.

Results: A series of regression models and independent sample t tests indicated that BASIS had significant, medium to large effects on the majority of its proximal mechanisms from baseline to post-training. BASIS was also associated with a greater latency between initial training in the intervention and discontinuation of participation in post-training consultation, with clinicians in the BASIS condition persisting in consultation for an average of 134 days versus 32 days for controls, but this difference was not statistically significant. At 4-month follow-up, most differences in the theorized mechanisms had attenuated, and approximately the same small number of BASIS clinicians adopted the trauma intervention as controls.

Conclusion: Findings suggest that the brief BASIS pre-implementation strategy had a significant influence on its proximal mechanisms of change, but that these changes did not persist over time or translate into adoption of the trauma intervention. Implications for theory refinement, revisions to the BASIS protocol, and next steps for research surrounding individual-level implementation strategies are discussed.

Trial registration: ClinicalTrials.gov Identifier: NCT03791281 . Registered 31 December 2018-Retrospectively registered.

Keywords: Adoption; Behavioral intentions; Implementation strategy; Individual determinants; Theory of planned behavior; Trauma intervention.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
BASIS components aligned with TPB hypothesized mechanisms of change and implementation outcomes. Colored boxes reflect the theory of planned behavior components
Fig. 2
Fig. 2
CONSORT diagram for study participation
Fig. 3
Fig. 3
Time-to-event analysis: days until providers dropped out of CBITS implementation
Fig. 4
Fig. 4
Time-to-event analysis: days until providers initiated a CBITS group

References

    1. Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2017;44:177–194. doi: 10.1007/s11414-015-9475-6.
    1. Proctor E, Powell B, Mcmillen J. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:139. doi: 10.1186/1748-5908-8-139.
    1. Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69:123–157. doi: 10.1177/1077558711430690.
    1. Krause J, Van Lieshout J, Klomp R, Huntink E, Aakhus E, Flottorp S, et al. Identifying determinants of care for tailoring implementation in chronic diseases: an evaluation of different methods. Implement Sci. 2014;9:102. doi: 10.1186/s13012-014-0102-3.
    1. Lewis CC, Puspitasari A, Boyd MR, Scott K, Marriott BR, Hoffman M, et al. Implementing measurement based care in community mental health: a description of tailored and standardized methods. BMC Res Notes. 2018;11:76. doi: 10.1186/s13104-018-3193-0.
    1. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Admin Pol Ment Health. 2011;38:4–23. doi: 10.1007/s10488-010-0327-7.
    1. Beidas RS, Kendall PC. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol Sci Pract. 2010;17:1–30. doi: 10.1111/j.1468-2850.2009.01187.x.
    1. Brackett MA, Reyes MR, Rivers SE, Elbertson NA, Salovey P. Assessing teachers’ beliefs about social and emotional learning. J Psychoeduc Assess. 2012;30:219–236. doi: 10.1177/0734282911424879.
    1. Dart EH, Cook CR, Collins TA, Gresham FM, Chenier JS. Test driving interventions to increase treatment integrity and student outcomes. Sch Psychol Rev. 2012;41:467–481.
    1. Kincaid D, Childs K, Blase KA, Wallace F. Identifying barriers and facilitators in implementing schoolwide positive behavior support. J Posit Behav Interv. 2007;9:174–184. doi: 10.1177/10983007070090030501.
    1. Locke J, Lawson GM, Beidas RS, Aarons GA, Xie M, Lyon AR, Stahmer A, Seidman M, Frederick L, Oh C, Spaulding C. Individual and organizational factors that affect implementation of evidence-based practices for children with autism in public schools: a cross-sectional observational study. Implementation Science. 2019;14(1):29.
    1. Aarons GA, Ehrhart MG, Farahnak LR, Hurlburt MS. Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implement Sci. 2015;10:11. doi: 10.1186/s13012-014-0192-y.
    1. Glisson C, Schoenwald SK. The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Ment Health Serv Res. 2005;7:243–259. doi: 10.1007/s11020-005-7456-1.
    1. Glisson C. The organizational context of children’s mental health services. Clin Child Fam Psychol Rev. 2002;5:233–253. doi: 10.1023/A:1020972906177.
    1. Michie S, Van Stralen M, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:1. doi: 10.1186/1748-5908-6-1.
    1. Lewis CC, Boyd MR, Walsh-Bailey C, Lyon AR, Beidas R, Mittman B, et al. A systematic review of empirical studies examining mechanisms of dissemination and implementation in health. under review
    1. Williams NJ. Multilevel mechanisms of implementation strategies in mental health: integrating theory, research, and practice. Adm Policy Ment Health. 2016;43:783–798. doi: 10.1007/s10488-015-0693-2.
    1. Ajzen I. The theory of planned behaviour. Organ Behav Hum Decis Process. 1991;50:179–211. doi: 10.1016/0749-5978(91)90020-T.
    1. Ajzen I. From intentions to actions: a theory of planned behavior. In: Kuhl J, Beckmann J, editors. Action control: from cognition to behavior. Berlin: Springer Berlin Heidelberg; 1985. pp. 11–39.
    1. Fishbein M, Ajzen I. Belief, attitude, intention, and behavior: an introduction to theory and research. New York: Addison-Wesley Pub. Co; 1975.
    1. Eccles MP, Grimshaw JM, Johnston M, Steen N, Pitts NB, Thomas R, et al. Applying psychological theories to evidence-based clinical practice: identifying factors predictive of managing upper respiratory tract infections without antibiotics. Implement Sci. 2007;2:26. doi: 10.1186/1748-5908-2-26.
    1. Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals’ intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008;3:36. doi: 10.1186/1748-5908-3-36.
    1. Ajzen I, Manstead A. Changing health-related behaviours: an approach based on the theory of planned behaviour. In: Hewstone M, Schut H, de Wit J, Van Den Bos K, Stroebe M, editors. The scope of social psychology: theory and applications. New York City: Psychology Press; 2007. pp. 43–63.
    1. Steinmetz H, Knappstein M, Ajzen I, Schmidt P, Kabst R. How effective are behavior change interventions based on the theory of planned behavior? Z Psychol. 2016;224:216–233.
    1. Eccles MP, Hrisos S, Francis J, Kaner EF, Dickinson HO, Beyer F, et al. Do self- reported intentions predict clinicians’ behaviour: a systematic review. Implement Sci. 2006;1:28. doi: 10.1186/1748-5908-1-28.
    1. Perou R, Bitsko RH, Blumberg SJ, Pastor P, Ghandour RM, Gfroerer JC, et al. Mental health surveillance among children—United States, 2005-2011. MMWR Suppl. 2013;62:1–35.
    1. Farmer EMZ, Burns BJ, Phillips SD, Angold A, Costello EJ. Pathways into and through mental health services for children and adolescents. Psychiatr Serv. 2003;54:60–66. doi: 10.1176/appi.ps.54.1.60.
    1. Flaherty LT, Osher D. History of school-based mental health services in the United States. In: Weist MD, Evans S, Lever NA, editors. Handbook of School Mental Health Advancing Practice and Research. Boston: Springer; 2003. p. 11–22.
    1. Rones M, Hoagwood K. School-based mental health services: a research review. Clin Child Fam Psychol Rev. 2000;3:223–241. doi: 10.1023/A:1026425104386.
    1. Teich JL, Robinson G, Weist MD. What kinds of mental health services do public schools in the United States provide? Adv School Ment Health Promot. 2008;1:13–22. doi: 10.1080/1754730X.2008.9715741.
    1. Ennett ST, Ringwalt CL, Thorne J, Rohrbach LA, Vincus A, Simons-Rudolph A, et al. A comparison of current practice in school-based substance use prevention programs with meta-analysis findings. Prev Sci. 2003;4:1–14. doi: 10.1023/A:1021777109369.
    1. Evans SW, Weist MD. Commentary: implementing empirically supported treatments in the schools: what are we asking? Clin Child Fam Psychol Rev. 2004;7:263–267. doi: 10.1007/s10567-004-6090-0.
    1. Odom SL, McLean ME, Johnson LJ, LaMontagne MJ. Recommended practices in early childhood special education: validation and current use. J Early Interv. 1995;19:1–17. doi: 10.1177/105381519501900101.
    1. Owens JS, Lyon AR, Brandt NE, Warner CM, Nadeem E, Spiel C, et al. Implementation science in school mental health: key constructs in a developing research agenda. Sch Ment Heal. 2014;6:99–111. doi: 10.1007/s12310-013-9115-3.
    1. Fishman J, Beidas R, Reisinger E, Mandell DS. The utility of measuring intentions to use best practices: a longitudinal study among teachers supporting students with autism. J Sch Health. 2018;88:388–395. doi: 10.1111/josh.12618.
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci. 2015;10:21. doi: 10.1186/s13012-015-0209-1.
    1. Cook CR, Lyon AR, Kubergovic D, Wright DB, Zhang Y. A supportive beliefs intervention to facilitate the implementation of evidence-based practices within a multi-tiered system of supports. Sch Ment Heal. 2015;7:49–60. doi: 10.1007/s12310-014-9139-3.
    1. Duong MT, Cook CR, Lee K, Davis C, Vazquez-Colon C, Lyon AR. Stakeholder perspectives on the development of a blended pre-implementation strategy for school-based behavioral health providers. under review;
    1. Jaycox LH, Kataoka SH, Stein BD, Langley AK, Wong M. Cognitive behavioral intervention for trauma in schools. J Appl Sch Psychol. 2012;28:239–255. doi: 10.1080/15377903.2012.695766.
    1. Chafouleas SM, Johnson AH, Overstreet S, Santos NM. Toward a blueprint for trauma-informed service delivery in schools. Sch Ment Heal. 2016;8:144–162. doi: 10.1007/s12310-015-9166-8.
    1. Overstreet S, Chafouleas SM. Trauma-informed schools: introduction to the special issue. Sch Ment Heal. 2016;8:1–6. doi: 10.1007/s12310-016-9184-1.
    1. Nadeem Erum, Saldana Lisa, Chapman Jason, Schaper Holle. A Mixed Methods Study of the Stages of Implementation for an Evidence-Based Trauma Intervention in Schools. Behavior Therapy. 2018;49(4):509–524. doi: 10.1016/j.beth.2017.12.004.
    1. Aarons GA. Measuring provider attitudes toward evidence-based practice: consideration of organizational context and individual differences. Child Adolesc Psychiatr Clin N Am. 2005;14:255–viii. doi: 10.1016/j.chc.2004.04.008.
    1. Perkins HW, Meilman PW, Leichliter JS, Cashin MA, Presley CA. Misperceptions of the norms for the frequency of alcohol and other drug use on college campuses. J Am Coll Heal. 1999;47:253–258. doi: 10.1080/07448489909595656.
    1. Perkins HW. The contextual effect of secular norms on religiosity as moderator of student alcohol and other drug use. Research in the social scientific study of religion. 1994;6:187-208.
    1. Chassin L, Presson CC, Sherman SJ, C E, Olshavsky RW. Predicting the onset of cigarette smoking in adolescents: a longitudinal study. J Appl Soc Psychol. 1984;14:224–243. doi: 10.1111/j.1559-1816.1984.tb02233.x.
    1. Berkowitz AD. Applications of social norms theory to other health and social justice issues. In: Perkins HW, editor. The social norms approach to preventing school and college age substance abuse: a handbook for educators, counselors, clinicians. San Francisco: Jossey-Bass; 2002.
    1. Cioffi D, Garner R. On doing the decision: effects of active versus passive choice on commitment and self-perception. Personal Soc Psychol Bull. 1996;22:133–147. doi: 10.1177/0146167296222003.
    1. Petrova PK, Cialdini RB, Sills SJ. Consistency-based compliance across cultures. J Exp Soc Psychol. 2007;43:104–111. doi: 10.1016/j.jesp.2005.04.002.
    1. Miller WR, Rollnick S. Motivational interviewing: preparing people for change. 2nd ed. New York: Guilford Publications, Inc; 2002.
    1. Boyd-Ball AJ, Dishion TJ. Family-centered treatment for American Indian adolescent substance abuse: toward a culturally and historically informed strategy. In: Liddle H, Rowe C, editors. Treating adolescent substance abuse: state of the science. New York: Cambridge; 2006. pp. 423–448.
    1. Connell AM, Dishion TJ, Yasui M, Kavanagh K. An adaptive approach to family intervention: linking engagement in family-centered intervention to reductions in adolescent problem behavior. J Consult Clin Psychol. 2007;75:568–579. doi: 10.1037/0022-006X.75.4.568.
    1. Dishion TJ, Kavanagh K. Intervening in adolescent problem behavior: a family-centered approach. New York: Guilford Press; 2003.
    1. Lundahl BW, Kunz C, Brownell C, Tollefson D, Burke BL. A meta-analysis of motivational interviewing: twenty-five years of empirical studies. Res Soc Work Pract. 2010;20:137–160. doi: 10.1177/1049731509347850.
    1. Frey AJ, Lee J, Small JW, Seeley JR, Walker HM, Feil EG. The motivational interviewing navigation guide: a process for enhancing teachers’ motivation to adopt and implement school-based interventions. Adv School Ment Health Promot. 2013;6:158–173. doi: 10.1080/1754730X.2013.804334.
    1. Reinke WM, Herman KC, Sprick R. In: Motivational interviewing for effective classroom management: the classroom check-up. Riley-Tillman TC, editor. New York: Guilford Press; 2011.
    1. Walton GM, Cohen GL. A brief social-belonging intervention improves academic and health outcomes of minority students. Science. 2011;331:1447–1451. doi: 10.1126/science.1198364.
    1. Stein BD, Kataoka S, Jaycox L, Steiger M, Wong M, Flink A, et al. The mental health for immigrants program: program design and participatory research in the real world. Handbook of school mental health: advancing practice and research. New York: Kluwer/Plenum; 2003. pp. 179–190.
    1. Stein BD, Jaycox LH, Kataoka SH, Wong M, Tu W, Elliott MN, et al. A mental health intervention for schoolchildren exposed to violence: a randomized controlled trial. JAMA. 2003;290:603–611. doi: 10.1001/jama.290.5.603.
    1. Ngo V, Langley A, Kataoka SH, Nadeem E, Escudero P, Stein BD. Providing evidence-based practice to ethnically diverse youths: examples from the cognitive behavioral intervention for trauma in schools (CBITS) program. J Am Acad Child Adolesc Psychiatry. 2008;47:858–862. doi: 10.1097/CHI.0b013e3181799f19.
    1. Vona P, Wilmoth P, Jaycox LH, McMillen JS, Kataoka SH, Wong M, et al. A web-based platform to support an evidence-based mental health intervention: lessons from the CBITS web site. Psychiatr Serv. 2014;65:1381–1384. doi: 10.1176/appi.ps.201300512.
    1. Herschell AD, Kolko DJ, Baumann BL, Davis AC. The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations ☆. Clin Psychol Rev. 2010;30:448–466. doi: 10.1016/j.cpr.2010.02.005.
    1. Cook CR, Davis C, Brown EC, Locke J, Ehrhart MG, Aarons GA, Larson M, Lyon AR. Confirmatory factor analysis of the Evidence-Based Practice Attitudes Scale with school-based behavioral health consultants. Implementation Science. 2018(1):116.
    1. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the evidence-based practice attitude scale (EBPAS). Mental health services research. 2004. pp. 61–74.
    1. Ajzen I. Constructing a TPB questionnaire: conceptual and methodological considerations. 2006.
    1. Francis J, Eccles MP, Johnston M, Walker AE, Grimshaw JM, Foy R, et al. Constructing questionnaires based on the theory of planned behaviour: a manual for health services researchers [internet] 2004.
    1. Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Administration and policy in mental health. 2011. pp. 44–53.
    1. Lyon AR, Cook CR, Brown EC, Locke J, Davis C, Ehrhart M, et al. Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implement Sci. 2018;13:5. doi: 10.1186/s13012-017-0705-6.
    1. Ehrhart MG, Aarons GA, Farahnak LR. Going above and beyond for implementation: the development and validity testing of the implementation citizenship behavior scale (ICBS) Implement Sci. 2015;10:65. doi: 10.1186/s13012-015-0255-8.
    1. Kortteisto T, Kaila M, Komulainen J, Mäntyranta T, Rissanen P. Healthcare professionals’ intentions to use clinical guidelines: a survey using the theory of planned behaviour. Implement Sci. 2010;5:51. doi: 10.1186/1748-5908-5-51.
    1. Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the implementation climate scale (ICS) Implement Sci. 2014;9:157. doi: 10.1186/s13012-014-0157-1.
    1. Yarnold P. ODA vs. π and κ: paradoxes of kappa. Optimal Data Anal. 2016;5:160–161.
    1. Tomasone JR, Martin Ginis KA, Estabrooks PA, Domenicucci L‘. Changing minds’: determining the effectiveness and key ingredients of an educational intervention to enhance healthcare professionals’ intentions to prescribe physical activity to patients with physical disabilities. Implement Sci. 2014;9:30. doi: 10.1186/1748-5908-9-30.
    1. Armitage CJ, Conner M. Efficacy of the theory of planned behaviour: a meta-analytic review. Br J Soc Psychol. 2001;40:471–499. doi: 10.1348/014466601164939.
    1. Sparks P, Shepherd R, Wieringa N, Zimmermanns N. Perceived behavioural control, unrealistic optimism and dietary change: an exploratory study. Appetite. 1995;24:243–255. doi: 10.1016/S0195-6663(95)99787-3.
    1. White KM, Smith JR, Terry DJ, Greenslade JH, McKimmie BM. Social influence in the theory of planned behaviour: the role of descriptive, injunctive, and in-group norms. Br J Soc Psychol. 2009;48:135–158. doi: 10.1348/014466608X295207.
    1. Lyon AR, Stirman SW, Kerns SEU, Bruns EJ. Developing the mental health workforce: review and application of training approaches from multiple disciplines. Admin Pol Ment Health. 2010;38:238–253. doi: 10.1007/s10488-010-0331-y.
    1. Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9:45. doi: 10.1186/1748-5908-9-45.
    1. Beidas RS, Edmunds J, Ditty M, Watkins J, Walsh L, Marcus S, et al. Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Admin Pol Ment Health. 2014;41:788–799. doi: 10.1007/s10488-013-0529-x.
    1. Lyon Aaron R., Pullmann Michael D., Walker Sarah Cusworth, D’Angelo Gabrielle. Community-Sourced Intervention Programs: Review of Submissions in Response to a Statewide Call for “Promising Practices”. Administration and Policy in Mental Health and Mental Health Services Research. 2015;44(1):16–28. doi: 10.1007/s10488-015-0650-0.
    1. Helfrich CD, Kohn MJ, Stapleton A, Allen CL, Hammerback KE, Chan KCG, et al. Readiness to change over time: change commitment and change efficacy in a workplace health-promotion trial. Front Public Health. 2018:6.
    1. Schwarzer R. Modeling health behavior change: how to predict and modify the adoption and maintenance of health behaviors. Appl Psychol. 2008;57:1–29.
    1. Schwarzer R, Lippke S, Luszczynska A. Mechanisms of health behavior change in persons with chronic illness or disability: the health action process approach (HAPA) Rehabil Psychol. 2011;56:161–170. doi: 10.1037/a0024509.
    1. Potthoff S, Presseau J, Sniehotta FF, Johnston M, Elovainio M, Avery L. Planning to be routine: habit as a mediator of the planning-behaviour relationship in healthcare professionals. Implement Sci. 2017;12:24. doi: 10.1186/s13012-017-0551-6.
    1. Barrett PM, Farrell LJ, Ollendick TH, Dadds M. Long-term outcomes of an Australian universal prevention trial of anxiety and depression symptoms in children and youth: an evaluation of the friends program. J Clin Child Adolesc Psychol. 2006;35:403–411. doi: 10.1207/s15374424jccp3503_5.
    1. Bradshaw C, Reinke W, Brown L, Bevans K, Leaf P. Implementation of school-wide positive behavioral interventions and supports (PBIS) in elementary schools: observations from a randomized trial. Educ Treat Child. 2008;31:1–26. doi: 10.1353/etc.0.0025.
    1. Hagger MS, Luszczynska A. Implementation intention and action planning interventions in health contexts: state of the research and proposals for the way forward. Appl Psychol. 2014;6:1–47.
    1. Masia-Warner C, Klein RG, Dent HC, Fisher PH, Alvir J, Albano AM, et al. School-based intervention for adolescents with social anxiety disorder: results of a controlled study. J Abnorm Child Psychol. 2005;33:707–722. doi: 10.1007/s10802-005-7649-z.
    1. Dijkstra M, Mesters I, De Vries H, van Breukelen G, Parcel GS. Effectiveness of a social influence approach and boosters to smoking prevention. Health Educ Res. 1999;14:791–802. doi: 10.1093/her/14.6.791.
    1. Tolan PH, Gorman-Smith D, Henry D, Schoeny M. The benefits of booster interventions: evidence from a family-focused prevention program. Prev Sci. 2009;10:287–297. doi: 10.1007/s11121-009-0139-8.
    1. Aliabad HO, Vafaeinasab M, Morowatisharifabad MA, Afshani SA, Firoozabadi MG, Forouzannia SK. Maintenance of physical activity and exercise capacity after rehabilitation in coronary heart disease: a randomized controlled trial. Glob J Health Sci. 2014;6:198–208. doi: 10.5539/gjhs.v6n6p198.
    1. Fleig L, Pomp S, Schwarzer R, Lippke S. Promoting exercise maintenance: how interventions with booster sessions improve long-term rehabilitation outcomes. Rehabil Psychol. 2013;58:323–333. doi: 10.1037/a0033885.
    1. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50:217–226. doi: 10.1097/MLR.0b013e3182408812.
    1. McNeish D. Thanks coefficient alpha, we’ll take it from here. Psychol Methods. 2018;23:412–433. doi: 10.1037/met0000144.

Source: PubMed

3
Tilaa