An Extension of RE-AIM to Enhance Sustainability: Addressing Dynamic Context and Promoting Health Equity Over Time

Rachel C Shelton, David A Chambers, Russell E Glasgow, Rachel C Shelton, David A Chambers, Russell E Glasgow

Abstract

RE-AIM is a widely adopted, robust implementation science (IS) framework used to inform intervention and implementation design, planning, and evaluation, as well as to address short-term maintenance. In recent years, there has been growing focus on the longer-term sustainability of evidence-based programs, policies and practices (EBIs). In particular, investigators have conceptualized sustainability as the continued health impact and delivery of EBIs over a longer period of time (e.g., years after initial implementation) and incorporated the complex and evolving nature of context. We propose a reconsideration of RE-AIM to integrate recent conceptualizations of sustainability with a focus on addressing dynamic context and promoting health equity. In this Perspective, we present an extension of the RE-AIM framework to guide planning, measurement/evaluation, and adaptations focused on enhancing sustainability. We recommend consideration of: (1) extension of "maintenance" within RE-AIM to include recent conceptualizations of dynamic, longer-term intervention sustainability and "evolvability" across the life cycle of EBIs, including adaptation and potential de-implementation in light of changing and evolving evidence, contexts, and population needs; (2) iterative application of RE-AIM assessments to guide adaptations and enhance long-term sustainability; (3) explicit consideration of equity and cost as fundamental, driving forces that need to be addressed across RE-AIM dimensions to enhance sustainability; and (4) use or integration of RE-AIM with other existing frameworks that address key contextual factors and examine multi-level determinants of sustainability. Finally, we provide testable hypotheses and detailed research questions to inform future research in these areas.

Keywords: RE-AIM; adaptation; evaluation; frameworks; health equity; implementation science; sustainability; sustainment.

Copyright © 2020 Shelton, Chambers and Glasgow.

Figures

Figure 1
Figure 1
An extension of RE-AIM to enhance sustainability: Cross-cutting issues and iterative application of RE-AIM for sustainability, to guide adaptations and evolvability of EBIs/implementation strategies, address dynamic context, and promote equity across the life cycle of an EBI.

References

    1. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. (1999) 89:1322–7. 10.2105/AJPH.89.9.1322
    1. Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. (2012) 43:337–50. 10.1016/j.amepre.2012.05.024
    1. Harden SM, Smith ML, Ory MG, Smith-Ray RL, Estabrooks PA, Glasgow RE. RE-AIM in clinical, community, and corporate settings: perspectives, strategies, and recommendations to enhance public health impact. Front Public Health. (2018) 6:71. 10.3389/fpubh.2018.00071
    1. Glasgow RE, Harden SM, Gaglio B, Rabin BA, Smith ML, Porter GC, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a twenty-year review. Front Public Health. (2019) 7:64 10.3389/fpubh.2019.00064
    1. Vinson CA, Stamatakis K, Kerner J. Dissemination and implementation research in community and public health settings. In: Brownson Rc CG, editor. Dissemination and Implementation Research in Health: Translating Research to Practice. Proctor Ea Oxford University Press; (2018). p. 355–70. 10.1093/oso/9780190683214.003.0021
    1. Mccreight MS, Rabin BA, Glasgow RE, Ayele RA, Leonard CA, Gilmartin HM, et al. . Using the Practical, Robust Implementation and Sustainability Model (PRISM) to qualitatively assess multilevel contextual factors to help plan, implement, evaluate, and disseminate health services programs. Transl Behav Med. (2019) 9:1002–11. 10.1093/tbm/ibz085
    1. Glasgow RE, Estabrooks PE. Pragmatic applications of RE-AIM for health care initiatives in community and clinical settings. Prev Chronic Dis. (2018) 15:E02. 10.5888/pcd15.170271
    1. Holtrop JS, Rabin BA, Glasgow RE. Qualitative approaches to use of the RE-AIM framework: rationale and methods. BMC Health Services Res. (2018) 18:177. 10.1186/s12913-018-2938-8
    1. Scheirer M, Dearing J. An agenda for research on the sustainability of public health programs. Am J Public Health. (2011) 101:e300193. 10.2105/AJPH.2011.300193
    1. Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. (2012) 7:17 10.1186/1748-5908-7-17
    1. Shelton RC, Cooper BR, Stirman SW. The sustainability of evidence-based interventions and practices in public health and health care. Ann Rev Public Health. (2018) 39:55–76. 10.1146/annurev-publhealth-040617-014731
    1. Shelton RC, Lee M. Prioritizing sustainability research: innovations and future directions in implementation science. Am J Public Health. (2019) 109:S132–4. 10.2105/AJPH.2018.304913
    1. Proctor EK, Luke DA, Calhoun A, Mcmillen C, Brownson RC, Mccrary S, et al. . Sustainability of evidence-based healthcare: research agenda, methodological advances, and infrastructure support. Implement Sci. (2015) 10:88. 10.1186/s13012-015-0274-5
    1. Johnson AM, Moore JE, Chambers DA, Rup J, Dinyarian C, Straus SE. How do researchers conceptualize and plan for the sustainability of their NIH R01 implementation projects? Implement Sci. (2019) 14:50. 10.1186/s13012-019-0895-1
    1. Moore JE, Mascarenhas A, Bain J, Straus SE. Developing a comprehensive definition of sustainability. Implementation Sci. (2017) 12:110. 10.1186/s13012-017-0637-1
    1. Stirman SW, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. (2019) 14:58 10.1186/s13012-019-0898-y
    1. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. (2013) 8:117. 10.1186/1748-5908-8-117
    1. Bopp M, Saunders RP, Lattimore D. The tug-of-war: fidelity versus adaptation throughout the health promotion program life cycle. J Primary Prev. (2013) 34:193–207. 10.1007/s10935-013-0299-y
    1. Allen JD, Shelton RC, Emmons KM, Linnan L. Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. 2 ed. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. New York, NY: Oxford University Press; (2018). p. 267–84. 10.1093/oso/9780190683214.003.0016
    1. Stange KC. Refocusing knowledge generation, application, and education: raising our gaze to promote health across boundaries. Am J Prev Med. (2011) 41:S164–9. 10.1016/j.amepre.2011.06.022
    1. Niven DJ, Mrklas KJ, Holodinsky JK, Straus SE, Hemmelgarn BR, Jeffs LP, et al. . Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. (2015) 13:255. 10.1186/s12916-015-0488-z
    1. Norton WE, Chambers DA, Kramer BS. Conceptualizing de-implementation in cancer care delivery. J Clin Oncol. (2019) 37:93–6. 10.1200/JCO.18.00589
    1. Strifler L, Cardoso R, Mcgowan J, Cogo E, Nincic V, Khan PA, et al. . Scoping review identifies significant number of knowledge translation theories, models, and frameworks with limited use. J Clin Epidemiol. (2018) 100:92–102. 10.1016/j.jclinepi.2018.04.008
    1. Damschroder LJ. Clarity out of chaos: use of theory in implementation research. Psychiatr Res. (2019) 283:11246. 10.1016/j.psychres.2019.06.036
    1. Blase K, Fixsen D. Core Intervention Components: Identifying and Operationalizing What Makes Programs Work. ASPE Research Brief. Washington, DC: US Department of Health and Human Services; (2013).
    1. Jolles MP, Lengnick-Hall R, Mittman BS. Core functions and forms of complex health interventions: a patient-centered medical home illustration. J General Internal Med. (2019) 34:1032–8. 10.1007/s11606-018-4818-7
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. . A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. (2015) 10:21. 10.1186/s13012-015-0209-1
    1. Baumann A, Cabassa LJ, Stirman SW. Adaptation in dissemination and implementation science. Dissemin Implement Res Health. (2017) 2:286–300. 10.1093/oso/9780190683214.003.0017
    1. Castro FG, Barrera M, Martinez CR. The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci. (2004) 5:41–5. 10.1023/B:
    1. Glasgow RE, Battaglia C, McCreight M, Ayele RA, Rabin BA. Making implementation science more rapid: Use of the RE-AIM framework for mid-course adaptations across five health services research projects in the Veterans Health Administration. Front Public Health. (2020).
    1. Waltz TJ, Powell BJ, Matthieu MM, Damschroder LJ, Chinman MJ, Smith JL, et al. . Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study. Implement Sci. (2015) 10:109. 10.1186/s13012-015-0295-0
    1. Balasubramanian BA, Cohen DJ, Davis MM, Gunn R, Dickinson LM, Miller WL, et al. . Learning evaluation: blending quality improvement and implementation research methods to study healthcare innovations. Implement Sci. (2015) 10:31. 10.1186/s13012-015-0219-z
    1. Coury J., Schneider J. L., Rivelli J. S., Petrik A. F., Seibel E., D'agostini B., et al. . (2017). Applying the Plan-Do-Study-Act (PDSA) approach to a large pragmatic study involving safety net clinics. BMC Health Services Res. 17:411. 10.1186/s12913-017-2364-3
    1. Nilsen P. Making sense of implementation theories, models and frameworks. Implementat Sci. (2015) 10:53. 10.1186/s13012-015-0242-0
    1. Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Joint Commission J Qual Patient Safety. (2008) 34:228–43. 10.1016/S1553-7250(08)34030-6
    1. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. (2009) 4:50–50. 10.1186/1748-5908-4-50
    1. Luke DA, Calhoun A, Robichaux CB, Elliott MB, Moreland-Russell S. The Program Sustainability Assessment Tool: a new instrument for public health programs. Prevent Chronic Dis. (2014) 11:130184. 10.5888/pcd11.130184
    1. Braveman P. A new definition of health equity to guide future efforts and measure progress. Health Affairs Blog. (2017) 22:1–4.
    1. Chinman M, Woodward EN, Curran GM, Hausmann LR. Harnessing implementation science to increase the impact of health disparity research. Medical Care. (2017) 55:S16 10.1097/MLR.0000000000000769
    1. Dumont K, Metz A, Woo B. Five Recommendations for How Implementation Science Can Better Advance Equity (2019). Available from: 2019-04/five-recommendations-how-implementation-science-can-better-advance-equity (accessed September 26, 2019).
    1. Ritzwoller DP, Sukhanova AS, Glasgow RE, Strycker LA, King DK, Gaglio B, et al. . Intervention costs and cost-effectiveness for a multiple-risk-factor diabetes self-management trial for Latinas: economic analysis of ¡Viva Bien! Transl Behav Med. (2011) 1:427–35. 10.1007/s13142-011-0037-z
    1. Jones Rhodes WC, Ritzwoller DP, Glasgow RE. Stakeholder perspectives on costs and resource expenditures: tools for addressing economic issues most relevant to patients, providers, and clinics. Transl Behav Med. (2018) 8:675–82. 10.1093/tbm/ibx003
    1. Saldana L, Chamberlain P, Bradford WD, Campbell M, Landsverk J. The Cost of Implementing New Strategies (COINS): a method for mapping implementation resources using the stages of implementation completion. Children Youth Services Rev. (2014) 39:177–82. 10.1016/j.childyouth.2013.10.006
    1. Dopp AR, Mundey P, Beasley LO, Silovsky JF, Eisenberg D. Mixed-method approaches to strengthen economic evaluations in implementation research. Implement Sci. (2019) 14:2. 10.1186/s13012-018-0850-6
    1. May CR, Johnson M, Finch T. Implementation, context and complexity. Implement Sci. (2016) 11:141. 10.1186/s13012-016-0506-3
    1. Braithwaite J, Churruca K, Long JC, Ellis LA, Herkes J. When complexity science meets implementation science: a theoretical and empirical analysis of systems change. BMC Med. (2018) 16:63. 10.1186/s12916-018-1057-z

Source: PubMed

Sponsorit ja yhteistyökumppanit

Sairaudet

Huumeiden interventiot

3
Tilaa