The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare

Christopher J Miller, Miya L Barnett, Ana A Baumann, Cassidy A Gutner, Shannon Wiltsey-Stirman, Christopher J Miller, Miya L Barnett, Ana A Baumann, Cassidy A Gutner, Shannon Wiltsey-Stirman

Abstract

Background: Implementation strategies are necessary to ensure that evidence-based practices are successfully incorporated into routine clinical practice. Such strategies, however, are frequently modified to fit local populations, settings, and contexts. While such modifications can be crucial to implementation success, the literature on documenting and evaluating them is virtually nonexistent. In this paper, we therefore describe the development of a new framework for documenting modifications to implementation strategies.

Discussion: We employed a multifaceted approach to developing the Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS), incorporating multiple stakeholder perspectives. Development steps included presentations of initial versions of the FRAME-IS to solicit structured feedback from individual implementation scientists ("think-aloud" exercises) and larger, international groups of researchers. The FRAME-IS includes core and supplementary modules to document modifications to implementation strategies: what is modified, the nature of the modification (including the relationship to core elements or functions), the primary goal and rationale for the modification, timing of the modification, participants in the modification decision-making process, and how widespread the modification is. We provide an example of application of the FRAME-IS to an implementation project and provide guidance on how it may be used in future work.

Conclusion: Increasing attention is being given to modifications to evidence-based practices, but little work has investigated modifications to the implementation strategies used to implement such practices. To fill this gap, the FRAME-IS is meant to be a flexible, practical tool for documenting modifications to implementation strategies. Its use may help illuminate the pivotal processes and mechanisms by which implementation strategies exert their effects.

Keywords: Adaptation; Implementation strategy; Modification.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
The FRAME-IS (core modules)
Fig. 2
Fig. 2
The FRAME-IS (optional modules)

References

    1. Stirman SW, Gutner CA, Crits-Christoph P, Edmunds J, Evans AC, Beidas RS. Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy. Implement Sci. 2015;10(1):1–10. doi: 10.1186/s13012-014-0195-8.
    1. Wiltsey Stirman S, Gamarra JM, Bartlett BA, Calloway A, Gutner CA. Empirical examinations of modifications and adaptations to evidence-based psychotherapies: Methodologies, impact, and future directions. Clin Psychol Sci Pract. 2017;24(4):396–420.
    1. Barrera M, Berkel C, Castro FG. Directions for the advancement of culturally adapted preventive interventions: local adaptations, engagement, and sustainability. Prev Sci. 2017;18(6):640–648. doi: 10.1007/s11121-016-0705-9.
    1. Cooper BR, Shrestha G, Hyman L, Hill L. Adaptations in a community-based family intervention: replication of two coding schemes. J Prim Prev. 2016;37(1):33–52. doi: 10.1007/s10935-015-0413-4.
    1. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8(1):117. doi: 10.1186/1748-5908-8-117.
    1. Bernal GE, Domenech Rodríguez MM. Cultural adaptations: tools for evidence-based practice with diverse populations. Washington, DC: American Psychological Association; 2012.
    1. Escoffery C, Lebow-Skelley E, Haardoerfer R, Boing E, Udelson H, Wood R, Hartman M, Fernandez M, Mullen P. A systematic review of adaptations of evidence-based public health interventions globally. Implement Sci. 2018;13(1):125. doi: 10.1186/s13012-018-0815-9.
    1. Escoffery C, Lebow-Skelley E, Udelson H, Böing EA, Wood R, Fernandez ME, Mullen PD. A scoping study of frameworks for adapting public health evidence-based interventions. Transl Behav Med. 2019;9(1):1–10. doi: 10.1093/tbm/ibx067.
    1. Miller CJ, Wiltsey-Stirman S, Baumann AA. Iterative Decision-making for Evaluation of Adaptations (IDEA): a decision tree for balancing adaptation, fidelity, and intervention impact. J Community Psychol. 2020;48(4):1163–1177. doi: 10.1002/jcop.22279.
    1. Stirman SW, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. 2019;14(1):1–10. doi: 10.1186/s13012-018-0842-6.
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, Proctor EK, Kirchner JE. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):21. doi: 10.1186/s13012-015-0209-1.
    1. Hysong SJ, Best RG, Pugh JA. Audit and feedback and clinical practice guideline adherence: making feedback actionable. Implement Sci. 2006;1(1):9. doi: 10.1186/1748-5908-1-9.
    1. Kirchner JE, Ritchie MJ, Pitcock JA, Parker LE, Curran GM, Fortney JC. Outcomes of a partnered facilitation strategy to implement primary care–mental health. J Gen Intern Med. 2014;29(4):904–912. doi: 10.1007/s11606-014-3027-2.
    1. Waltz TJ, Powell BJ, Fernández ME, Abadie B, Damschroder LJ. Choosing implementation strategies to address contextual barriers: diversity in recommendations and future directions. Implement Sci. 2019;14(1):1–15. doi: 10.1186/s13012-019-0892-4.
    1. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76. doi: 10.1007/s10488-010-0319-7.
    1. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8(1):1–11. doi: 10.1186/1748-5908-8-1.
    1. Rogal SS, Yakovchenko V, Morgan T, Bajaj JS, Gonzalez R, Park A, Beste L, Miech EJ, Lamorte C, Neely B. Getting to implementation: a protocol for a Hybrid III stepped wedge cluster randomized evaluation of using data-driven implementation strategies to improve cirrhosis care for Veterans. Implement Sci. 2020;15(1):1–10. doi: 10.1186/s13012-019-0962-7.
    1. Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, Mandell DS. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2017;44(2):177–194. doi: 10.1007/s11414-015-9475-6.
    1. Boyd MR, Powell BJ, Endicott D, Lewis CC. A method for tracking implementation strategies: an exemplar implementing measurement-based care in community behavioral health clinics. Behav Ther. 2018;49(4):525–537. doi: 10.1016/j.beth.2017.11.012.
    1. Bunger AC, Powell BJ, Robertson HA, MacDowell H, Birken SA, Shea C. Tracking implementation strategies: a description of a practical approach and early findings. Health Res Policy Syst. 2017;15(1):15. doi: 10.1186/s12961-017-0175-y.
    1. Jull J, Giles A, Graham ID. Community-based participatory research and integrated knowledge translation: advancing the co-creation of knowledge. Implement Sci. 2017;12(1):1–9. doi: 10.1186/s13012-017-0696-3.
    1. Engell T, Follestad IB, Andersen A, Hagen KA. Knowledge translation in child welfare—improving educational outcomes for children at risk: study protocol for a hybrid randomized controlled pragmatic trial. Trials. 2018;19(1):1–17. doi: 10.1186/s13063-018-3079-4.
    1. Nicholas G, Foote J, Kainz K, Midgley G, Prager K, Zurbriggen C. Towards a heart and soul for co-creative research practice: a systemic approach. Evidence Policy. 2019;15(3):353–370. doi: 10.1332/174426419X15578220630571.
    1. Greenhalgh T, Jackson C, Shaw S, Janamian T. Achieving research impact through co-creation in community-based health services: literature review and case study. Milbank Q. 2016;94(2):392–429. doi: 10.1111/1468-0009.12197.
    1. Chambers DA, Norton WE. The adaptome: advancing the science of intervention adaptation. Am J Prev Med. 2016;51(4):S124–S131. doi: 10.1016/j.amepre.2016.05.011.
    1. Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013;8(1):65. doi: 10.1186/1748-5908-8-65.
    1. Baumann AA, Domenech Rodríguez MM, Amador NG, Forgatch MS, Parra-Cardona JR. Parent management training-oregon model (PMTO™) in Mexico City: integrating cultural adaptation activities in an implementation model. Clin Psychol Sci Pract. 2014;21(1):32–47. doi: 10.1111/cpsp.12059.
    1. Rodriguez MMD, Baumann AA, Schwartz AL. Cultural adaptation of an evidence based intervention: from theory to practice in a Latino/a community context. Am J Community Psychol. 2011;47(1-2):170–186. doi: 10.1007/s10464-010-9371-4.
    1. Corbin J, Strauss A. Basics of qualitative research: techniques and procedures for developing grounded theory. Boston: Sage Publications; 2014.
    1. Glaser, B.G. and Strauss, A.L., Discovery of grounded theory: strategies for qualitative research. 2017: Routledge.
    1. Barnett M, Miranda J, Kia-Keating M, Saldana L, Landsverk J, Lau AS. Developing and evaluating a lay health worker delivered implementation intervention to decrease engagement disparities in behavioural parent training: a mixed methods study protocol. BMJ Open. 2019;9(7):e028988. doi: 10.1136/bmjopen-2019-028988.
    1. Brownson RC, Proctor EK, Luke DA, Baumann AA, Staub M, Brown MT, Johnson M. Building capacity for dissemination and implementation research: one university’s experience. Implement Sci. 2017;12(1):104. doi: 10.1186/s13012-017-0634-4.
    1. US Department of Veterans Affairs, QUERI Implementation Research Group (IRG). 2020 [cited 2020 December 1st]; Available from: .
    1. Van Someren M, Barnard Y, Sandberg J. The think aloud method: a practical approach to modelling cognitive processes. London: AcademicPress; 1994.
    1. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–1327. doi: 10.2105/AJPH.89.9.1322.
    1. Aarons GA, Ehrhart MG, Farahnak LR, Hurlburt MS. Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implement Sci. 2015;10(1):11. doi: 10.1186/s13012-014-0192-y.
    1. Smith JL, R.M., Miller CJ, Chinman MJ, Landes S, Kelly PA, Kirchner JE. Getting to fidelity: identifying core components of implementation facilitation strategies. In Innovation to Impact: Research to Advance VA’s Learning Healthcare Community (VA HSR&D / QUERI National Conference). 2019 (October). Washington, DC.
    1. Iverson KM, Dichter ME, Stolzmann K, Adjognon OL, Lew RA, Bruce LE, Gerber MR, Portnoy GA, Miller CJ. Assessing the Veterans Health Administration’s response to intimate partner violence among women: protocol for a randomized hybrid type 2 implementation-effectiveness trial. Implement Sci. 2020;15:1–10. doi: 10.1186/s13012-020-0969-0.
    1. Jolles MP, Lengnick-Hall R, Mittman BS. Core functions and forms of complex health interventions: a patient-centered medical home illustration. J Gen Intern Med. 2019;34(6):1032–1038. doi: 10.1007/s11606-018-4818-7.
    1. Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3-4):327–350. doi: 10.1007/s10464-008-9165-0.
    1. Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci. 2007;2(1):42. doi: 10.1186/1748-5908-2-42.
    1. Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the exploration, preparation, implementation, sustainment (EPIS) framework. Implement Sci. 2019;14(1):1. doi: 10.1186/s13012-018-0842-6.
    1. Lee SJ, Altschul I, Mowbray CT. Using planned adaptation to implement evidence-based programs with new populations. Am J Community Psychol. 2008;41(3-4):290–303. doi: 10.1007/s10464-008-9160-5.
    1. Moore JE, Bumbarger BK, Cooper BR. Examining adaptations of evidence-based programs in natural contexts. J Prim Prev. 2013;34(3):147–161. doi: 10.1007/s10935-013-0303-6.
    1. Salloum RG, Shenkman EA, Louviere JJ, Chambers DA. Application of discrete choice experiments to enhance stakeholder engagement as a strategy for advancing implementation: a systematic review. Implement Sci. 2017;12(1):140. doi: 10.1186/s13012-017-0675-8.
    1. Woodward EN, Matthieu MM, Uchendu US, Rogal S, Kirchner JE. The health equity implementation framework: proposal and preliminary study of hepatitis C virus treatment. Implement Sci. 2019;14(1):1–8. doi: 10.1186/s13012-019-0861-y.
    1. Rogers L, De Brún A, Birken SA, Davies C, McAuliffe The micropolitics of implementation; a qualitative study exploring the impact of power, authority, and influence when implementing change in healthcare teams. BMC Health Serv Res. 2020;20(1):1–13. doi: 10.1186/s12913-019-4778-6.
    1. Barnett ML, Davis EM, Callejas LM, White JV, Acevedo-Polakovich ID, Niec LN, Jent JF. The development and evaluation of a natural helpers' training program to increase the engagement of urban, Latina/o families in parent-child interaction therapy. Children Youth Serv Review. 2016;65:17–25. doi: 10.1016/j.childyouth.2016.03.016.
    1. Thomas R, Abell B, Webb HJ, Avdagic E, Zimmer-Gembeck MJ. Parent-child interaction therapy: a meta-analysis. Pediatrics. 2017;140(3):e20170352. doi: 10.1542/peds.2017-0352.
    1. Barnett ML, Lau AS, Miranda J. Lay health worker involvement in evidence-based treatment delivery: a conceptual model to address disparities in care. Annu Rev Clin Psychol. 2018;14(1):185–208. doi: 10.1146/annurev-clinpsy-050817-084825.
    1. Smith S, Almirall D, Bauer M, Liebrecht C, Kilbourne A. (When) Is more better? comparative effectiveness of external vs external+ internal facilitation on site-level uptake of a collaborative care model in community-based practices that are slow to adopt. Health Serv Res. 2020;55(S1):61–62. doi: 10.1111/1475-6773.13413.
    1. Baumann AA, Cabassa LJ. Reframing implementation science to address inequities in healthcare delivery. BMC Health Serv Res. 2020;20(1).

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera