The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions

Shannon Wiltsey Stirman, Ana A Baumann, Christopher J Miller, Shannon Wiltsey Stirman, Ana A Baumann, Christopher J Miller

Abstract

Background: This paper describes the process and results of a refinement of a framework to characterize modifications to interventions. The original version did not fully capture several aspects of modification and adaptation that may be important to document and report. Additionally, the earlier framework did not include a way to differentiate cultural adaptation from adaptations made for other reasons. Reporting additional elements will allow for a more precise understanding of modifications, the process of modifying or adapting, and the relationship between different forms of modification and subsequent health and implementation outcomes.

Discussion: We employed a multifaceted approach to develop the updated FRAME involving coding documents identified through a literature review, rapid coding of qualitative interviews, and a refinement process informed by multiple stakeholders. The updated FRAME expands upon Stirman et al.'s original framework by adding components of modification to report: (1) when and how in the implementation process the modification was made, (2) whether the modification was planned/proactive (i.e., an adaptation) or unplanned/reactive, (3) who determined that the modification should be made, (4) what is modified, (5) at what level of delivery the modification is made, (6) type or nature of context or content-level modifications, (7) the extent to which the modification is fidelity-consistent, and (8) the reasons for the modification, including (a) the intent or goal of the modification (e.g., to reduce costs) and (b) contextual factors that influenced the decision. Methods of using the framework to assess modifications are outlined, along with their strengths and weaknesses, and considerations for research to validate these measurement strategies.

Conclusion: The updated FRAME includes consideration of when and how modifications occurred, whether it was planned or unplanned, relationship to fidelity, and reasons and goals for modification. This tool that can be used to support research on the timing, nature, goals and reasons for, and impact of modifications to evidence-based interventions.

Keywords: Adaptation; Cultural adaptation; Implementation outcomes; Modification.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
The Framework for Reporting Adaptations and Modifications-Expanded (FRAME). New elements are outlined in black lines, while the original aspects of the 2013 framework are outlined in gray. Additions and refinements within categories included in the 2013 framework are italicized. Recommended elements of reporting were as follows: (1) when and how in the implementation process the modification was made, (2) whether the modification was planned/proactive (i.e., an adaptation) or unplanned/reactive, (3) who determined that the modification should be made, (4) what is modified, (5) at what level of delivery the modification is made, (6) type or nature of context or content-level modifications, (7) the extent to which the modification is fidelity-consistent, and (8) the reasons for the modification, including (a) the intent or goal of the modification (e.g., cultural adaptations, to reduce costs, etc.) and (b) contextual factors that influenced the decision. Adapted from (Baumann A, Cabassa LJ & Stirman SW, 2017; Stirman SW, Miller CJ, Toder K & Calloway A, 2013)

References

    1. Stirman SW, Gamarra JM, Bartlett BA, Calloway A, Gutner CA. Empirical examinations of modifications and adaptations to evidence-based psychotherapies: methodologies, impact, and future directions. Clin Psychol Sci Pract. 2017;24(4):396–420.
    1. Stirman SW, Gutner C, Edmunds J, Evans AC, Beidas R. Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy. Implementation Sci. 2015;10(1):115.
    1. Barrera M, Berkel C, Castro FG. Directions for the advancement of culturally adapted preventive interventions: local adaptations, engagement, and sustainability. Prev Sci. 2017;18(6):640–648.
    1. Cooper BR, Shrestha G, Hyman L, Hill L. Adaptations in a community-based family intervention: replication of two coding schemes. J Primary Prevent. 2016;37(1):33–52.
    1. von Thiele Schwarz U, Förberg U, Sundell K, Hasson H. Colliding ideals–an interview study of how intervention researchers address adherence and adaptations in replication studies. BMC Med Res Methodol. 2018;18(1):36.
    1. Sundell K, Beelmann A, Hasson H, von Thiele Schwarz U. Novel programs, international adoptions, or contextual adaptations? Meta-analytical results from German and Swedish intervention research. J Clin Child Adolesc Psychol. 2016;45(6):784–796.
    1. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implementation Sci. 2013;8(1):117.
    1. Steinka-Fry KT, Tanner-Smith EE, Dakof GA, Henderson C. Culturally sensitive substance use treatment for racial/ethnic minority youth: a meta-analytic review. J Subst Abus Treat. 2017;75:22–37.
    1. Rathod S, Gega L, Degnan A, Pikard J, Khan T, Husain N, et al. The current status of culturally adapted mental health interventions: a practice-focused review of meta-analyses. Neuropsychiatr Dis Treat. 2018;14:165–178.
    1. Bernal GE, Domenech Rodríguez MM. Cultural adaptations: tools for evidence-based practice with diverse populations: American Psychological Association; 2012.
    1. Pérez D, Van der Stuyft P, del Carmen Zabala M, Castro M, Lefèvre P. A modified theoretical framework to assess implementation fidelity of adaptive public health interventions. Implementation Sci. 2015;11(1):91.
    1. Castro FG, Barrera M, Jr, Martinez CR., Jr The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci. 2004;5(1):41–45.
    1. Kumpfer KL, Scheier LM, Brown J. Strategies to avoid replication failure with evidence-based prevention interventions: case examples from the strengthening families program. Eval Health Prof. 2018:1–34.
    1. Barrera M, Castro FG. A heuristic framework for the cultural adaptation of interventions. Clin Psychol: Sci and Pract. 2006;13(4):311–316.
    1. Baumann A, Cabassa LJ, Stirman SW. Adaptation in dissemination and implementation science. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. Oxford: Oxford University Press; 2017. pp. 286–300.
    1. Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Sci. 2013;8:65.
    1. Baumann AA, Powell BJ, Kohl PL, Tabak RG, Penalba V, Proctor EK, et al. Cultural adaptation and implementation of evidence-based parent-training: a systematic review and critique of guiding evidence. Child Youth Serv Rev. 2015;53:113–120.
    1. Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 2014;383(9913):267–276.
    1. Baumann AA, Domenech Rodríguez MM, Amador NG, Forgatch MS, Parra-Cardona JR. Parent management training-Oregon model (PMTO™) in Mexico City: integrating cultural adaptation activities in an implementation model. Clin Psychol: Sci and Pract. 2014;21(1):32–47.
    1. Rabin BA, McCreight M, Battaglia C, Ayele R, Burke RE, Hess PL, et al. Systematic, multimethod assessment of adaptations across four diverse health systems interventions. Front Health Policy Res. 2018;6:102.
    1. Escoffery C, Lebow-Skelley E, Haardoerfer R, Boing E, Udelson H, Wood R, et al. A systematic review of adaptations of evidence-based public health interventions globally. Implement Sci. 2018;13(1):125.
    1. Lau A, Barnett M, Stadnick N, Saifan D, Regan J, Wiltsey Stirman S, et al. Therapist report of adaptations to delivery of evidence-based practices within a system-driven reform of publicly funded children’s mental health services. J Consult Clin Psychol. 2017;85(7):664.
    1. Cook JM, Dinnen S, Thompson R, Simiola V, Schnurr PP. Changes in implementation of two evidence-based psychotherapies for PTSD in VA residential treatment programs: a national investigation. J Trauma Stress. 2014;27(2):137–143.
    1. Roscoe JN, Shapiro VB, Whitaker K, Kim BE. Classifying changes to preventive interventions: applying adaptation taxonomies. J Prim Prev. 2019:1–21.
    1. Parra-Cardona R, López-Zerón G, Leija SG, Maas MK, Villa M, Zamudio E, et al. A culturally adapted intervention for Mexican-origin parents of adolescents: the need to overtly address culture and discrimination in evidence-based practice. Fam Process. 2018.
    1. Rodríguez MMD, Baumann AA, Schwartz AL. Cultural adaptation of an evidence based intervention: from theory to practice in a Latino/a community context. Am J Community Psychol. 2011;47(1–2):170–186.
    1. Ivanich JD, Mousseau AC, Walls M, Whitbeck L, Whitesell NR. Pathways of adaptation: two case studies with one evidence-based substance use prevention program tailored for indigenous youth. Prev Sci. 2018:1–11.
    1. Rabin B, McCreight M, Glasgow R, editors. Systematic multi-method documentation of adaptations in five health system interventions. Implementation Sci 2018;13.
    1. Escoffery C, Lebow-Skelley E, Udelson H, Böing EA, Wood R, Fernandez ME, et al. A scoping study of frameworks for adapting public health evidence-based interventions. Transl Behav Med. 2018;9(1):1–10.
    1. Brown CH, Curran G, Palinkas LA, Aarons GA, Wells KB, Jones L, et al. An overview of research and evaluation designs for dissemination and implementation. Annu Rev Public Health. 2017;38:1–22.
    1. Ramsay JE, Janevic MR, Hogan CK, Edwards DL, Connell CM. Using the replicating effective programs framework to adapt a heart health intervention. Health Promot Pract. 2018.
    1. Kennedy-Martin T, Bae JP, Paczkowski R, Freeman E. Health-related quality of life burden of nonalcoholic steatohepatitis: a robust pragmatic literature review. Journal of Patient-Reported Outcomes. 2018;2(1):28–42.
    1. Chu J, Leino A. Advancement in the maturing science of cultural adaptations of evidence-based interventions. J Consult Clin Psychol. 2017;85(1):45.
    1. Miller-Day M, Pettigrew J, Hecht ML, Shin Y, Graham J, Krieger J. How prevention curricula are taught under real-world conditions: types of and reasons for teacher curriculum adaptations. Health Educ. 2013;113(4):324–344.
    1. Bernal G, Bonilla J, Bellido C. Ecological validity and cultural sensitivity for outcome research: issues for the cultural adaptation and development of psychosocial treatments with Hispanics. J Abnorm Child Psychol. 1995;23(1):67–82.
    1. World Health Organization. Social determinants of mental health: World Health Organization; 2014.
    1. Braveman P, Gottlieb L. The social determinants of health: it's time to consider the causes of the causes. Public Health Rep. 2014;129(1_suppl2):19–31.
    1. Stirman SW, Finley E, Shields N, Cook J, Suvak M, Dimeff L, Koerner K, Haine-Schlagel R, Gutner C, Burgess J, Gagnon D, Beristianos M, Mallard K, Ramirez V, Monson, C. M. Improving and sustaining delivery of CPT for PTSD in mental health systems: a cluster randomized trial. Implement Sci. 2017;12:3260.
    1. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implementation Sci. 2013;8(1):139.
    1. Kilbourne AM, Neumann MS, Pincus H, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implementation Sci. 2007;2(1):42.
    1. Aarons G, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Admin Pol Ment Health. 2011;38(1):4–23.
    1. Rogers EM. Diffusion of innovations: New York The Free Press, A Division of Simon & Schuster, Inc; 2010.
    1. Aarons GA, Sklar M, Mustanski B, Benbow N, Brown CH. “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implementation Sci. 2017;12(1):111.
    1. Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7(1):17.
    1. Gruen RL, Elliott JH, Nolan ML, Lawton PD, Parkhill A, McLaren CJ, et al. Sustainability science: an integrated approach for health-programme planning. Lancet. 2008;372(9649):1579–1589.
    1. Lee SJ, Altschul I, Mowbray CT. Using planned adaptation to implement evidence-based programs with new populations. Am J Community Psychol. 2008;41(3–4):290–303.
    1. Moore J, Bumbarger B, Cooper B. Examining adaptations of evidence-based programs in natural contexts. J Primary Prevent. 2013;34(3):147–161.
    1. Park AL, Chorpita BF, Regan J, Weisz JR. Research network on youth mental health. Integrity of evidence-based practice: are providers modifying practice content or practice sequencing? Admin Pol Ment Health. 2015;42(2):186–196.
    1. Shelton RC, Cooper BR, Stirman SW. The sustainability of evidence-based interventions and practices in public health and health care. Annu Rev Public Health. 2018;39:55–76.
    1. Mittman B. Evaluating complex interventions: confronting and guiding (versus ignoring and suppressing) heterogeneity and adaptation. In: Brown H, Smith JD, editors. Prevention Science Methods Group Webinar; 2018.
    1. Glisson C. Assessing and changing organizational culture and climate for effective services. Res Soc Work Pract. 2007;17(6):736–747.
    1. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Sci. 2009;4(1):50.
    1. Helfrich CD, Rose AJ, Hartmann CW, van Bodegom-Vos L, Graham ID, Wood SJ, et al. How the dual process model of human cognition can inform efforts to de-implement ineffective and harmful clinical practices: a preliminary model of unlearning and substitution. J Eval Clin Pract. 2018;24(1):198–205.
    1. Meza RD, Jungbluth N, Sedlar G, Martin P, Berliner L, Wiltsey-Stirman S, Dorsey S. Clinician-Reported Modification to a CBT Approach in Children’s Mental Health. J Emotion Behav Disord. 2019;1-10.
    1. Aarons GA, Miller EA, Green AE, Perrott JA, Bradway R. Adaptation happens: a qualitative case study of implementation of the incredible years evidence-based parent training program in a residential substance abuse treatment program. Journal of Children's Services. 2012;7(4):233–245.
    1. Stirman SW, Calloway A, Toder K, Miller CJ, DeVito AK, Meisel SN, et al. Community mental health provider modifications to cognitive therapy: implications for sustainability. Psychiatr Serv. 2013;64(10):1056–1059.
    1. Cook JM, Simiola V, McCarthy E, Ellis A, Stirman SW. Use of reflective journaling to understand decision making regarding two evidence-based psychotherapies for PTSD: practice implications. Pract Innov. 2018;3(3):153–167.
    1. Naeem F, Habib N, Gul M, Khalid M, Saeed S, Farooq S, et al. A qualitative study to explore patients’, carers’ and health professionals’ views to culturally adapt CBT for psychosis (CBTp) in Pakistan. Behav Cogn Psychother. 2016;44(1):43–55.
    1. Marques Luana, Valentine Sarah E., Kaysen Debra, Mackintosh Margaret-Anne, Dixon De Silva Louise E., Ahles Emily M., Youn Soo Jeong, Shtasel Derri L., Simon Naomi M., Wiltsey-Stirman Shannon. Provider fidelity and modifications to cognitive processing therapy in a diverse community health clinic: Associations with clinical change. Journal of Consulting and Clinical Psychology. 2019;87(4):357–369.
    1. Chambers DA, Norton WE. The adaptome: advancing the science of intervention adaptation. J of Prev Med. 2016;51(4):S124–SS31.

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera