Systematic, Multimethod Assessment of Adaptations Across Four Diverse Health Systems Interventions

Borsika A Rabin, Marina McCreight, Catherine Battaglia, Roman Ayele, Robert E Burke, Paul L Hess, Joseph W Frank, Russell E Glasgow, Borsika A Rabin, Marina McCreight, Catherine Battaglia, Roman Ayele, Robert E Burke, Paul L Hess, Joseph W Frank, Russell E Glasgow

Abstract

Background: Many health outcomes and implementation science studies have demonstrated the importance of tailoring evidence-based care interventions to local context to improve fit. By adapting to local culture, history, resources, characteristics, and priorities, interventions are more likely to lead to improved outcomes. However, it is unclear how best to adapt evidence-based programs and promising innovations. There are few guides or examples of how to best categorize or assess health-care adaptations, and even fewer that are brief and practical for use by non-researchers.

Materials and methods: This study describes the importance and potential of assessing adaptations before, during, and after the implementation of health systems interventions. We present a promising multilevel and multimethod approach developed and being applied across four different health systems interventions. Finally, we discuss implications and opportunities for future research.

Results: The four case studies are diverse in the conditions addressed, interventions, and implementation strategies. They include two nurse coordinator-based transition of care interventions, a data and training-driven multimodal pain management project, and a cardiovascular patient-reported outcomes project, all of which are using audit and feedback. We used the same modified adaptation framework to document changes made to the interventions and implementation strategies. To create the modified framework, we started with the adaptation and modification model developed by Stirman and colleagues and expanded it by adding concepts from the RE-AIM framework. Our assessments address the intuitive domains of Who, How, When, What, and Why to classify and organize adaptations. For each case study, we discuss how the modified framework was operationalized, the multiple methods used to collect data, results to date and approaches utilized for data analysis. These methods include a real-time tracking system and structured interviews at key times during the intervention. We provide descriptive data on the types and categories of adaptations made and discuss lessons learned.

Conclusion: The multimethod approaches demonstrate utility across diverse health systems interventions. The modified adaptations model adequately captures adaptations across the various projects and content areas. We recommend systematic documentation of adaptations in future clinical and public health research and have made our assessment materials publicly available.

Keywords: RE-AIM framework; Stirman framework; adaptation; assessment; mixed methods; pragmatic measures.

References

    1. Bauman LJ, Stein RE, Ireys HT. Reinventing fidelity: The transfer of social technology among settings. Am J Community Psychol (1991) 19(4):619–39.
    1. Bauman AE, Cabassa LJ, Wiltsey Stirman S. Adaptation in dissemination and implementation science. In: Brownson RC, Colditz G, Proctor EK, editors. Dissemination and Implementation Research in Health. New York: Oxford University Press; (2017). p. 285–300.
    1. Chambers DA, Norton WE. The adaptome: advancing the science of intervention adaptation. Am J Prev Med (2016) 51(4 Suppl 2):S124–31.10.1016/j.amepre.2016.05.011
    1. Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci (2013) 8:65.10.1186/1748-5908-8-65
    1. Castro FG, Barrera M, Jr, Martinez CR, Jr. The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci (2004) 5(1):41–5.10.1023/B:
    1. Aarons GA, Sklar M, Mustanski B, Benbow N, Brown CH. “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implement Sci (2017) 12(1):111.10.1186/s13012-017-0640-6
    1. Glasgow RE, Riley WT. Pragmatic measures: what they are and why we need them. Am J Prev Med (2013) 45(2):237–43.10.1016/j.amepre.2013.03.010
    1. Kilbourne AM, Elwy AR, Sales AE, Atkins D. Accelerating research impact in a learning health care system: VA’s quality enhancement research initiative in the choice act era. Med Care (2017) 55(Suppl 7 Suppl 1):S4–12.10.1097/MLR.0000000000000683
    1. Bradley SM, Rumsfeld JS, Ho PM. Incorporating health status in routine care to improve health care value: the VA patient reported health status assessment (PROST) system. JAMA (2016) 316(5):487–8.10.1001/jama.2016.6495
    1. U.S. Department of Veterans Affairs HSRaD. Quality Enhancement Research Initiative (QUERI). Building Pain Management Expertise in VA Primary Care. QUERI E-news. 2017. Available from: (Accessed: December 27, 2017).
    1. Ayele RA, Lawrence E, McCreight M, Fehling K, Peterson J, Glasgow RE, et al. Study protocol: improving the transition of care from a non-network hospital back to the patient’s medical home. BMC Health Serv Res (2017) 17(1):123.10.1186/s12913-017-2048-z
    1. Leonard C, Lawrence E, McCreight M, Lippmann B, Kelley L, Mayberry A, et al. Implementation and dissemination of a transition of care program for rural veterans: a controlled before and after study. Implement Sci (2017) 12(1):123.10.1186/s13012-017-0653-1
    1. Hall TL, Holtrop JS, Dickinson LM, Glasgow RE. Understanding adaptations to patient-centered medical home activities: the PCMH adaptations model. Transl Behav Med (2017) 7(4):861–72.10.1007/s13142-017-0511-3
    1. Glasgow RE, Klesges LM, Dzewaltowski DA, Estabrooks PA, Vogt TM. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res (2006) 21(5):688–94.10.1093/her/cyl081
    1. Brownson RC, Colditz G, Proctor EK. Dissemination and Implementation Research in Health. New York: Oxford University Press; (2017).
    1. Glasgow RE, Chambers DA, Cynkin L. News from the NIH: highlights in implementation science from the National Cancer Institute and the National Institute of Mental Health. Transl Behav Med (2013) 3(4):335–7.10.1007/s13142-013-0218-z
    1. Glasgow RE. What does it mean to be pragmatic? Opportunities and challenges for pragmatic approaches. Health Educ Behav (2013) 40(3):257–65.10.1177/1090198113486805
    1. Lewis CC, Stanick CF, Martinez RG, Weiner BJ, Kim M, Barwick M, et al. The Society for Implementation Research Collaboration Instrument Review Project: a methodology to promote rigorous evaluation. Implement Sci (2015) 10:2.10.1186/s13012-014-0193-x
    1. Rabin BA, Purcell P, Naveed S, Moser RP, Henton MD, Proctor EK, et al. Advancing the application, quality and harmonization of implementation science measures. Implement Sci (2012) 7:119.10.1186/1748-5908-7-119
    1. Glasgow RE, Kessler RS, Ory MG, Roby D, Gorin SS, Krist A. Conducting rapid, relevant research: lessons learned from the My Own Health Report project. Am J Prev Med (2014) 47(2):212–9.10.1016/j.amepre.2014.03.007
    1. Rabin BA, Lewis CC, Norton WE, Neta G, Chambers D, Tobin JN, et al. Measurement resources for dissemination and implementation research in health. Implement Sci (2016) 11:42.10.1186/s13012-016-0401-y
    1. Rhodes W, Ritzwoller DP, Glasgow RE. Stakeholder perspectives on costs and resource expenditures: addressing economic issues most relevant to patients, providers and clinics. Transl Behav Med (Forthcoming) (in press).
    1. Powell BJ, Stanick CF, Halko HM, Dorsey CN, Weiner BJ, Barwick MA, et al. Toward criteria for pragmatic measurement in implementation research and practice: a stakeholder-driven approach using concept mapping. Implement Sci (2017) 12(1):118.10.1186/s13012-017-0649-x
    1. Ovretveit J, Mittman B, Rubenstein L, Ganz DA. Using implementation tools to design and conduct quality improvement projects for faster and more effective improvement. Int J Health Care Qual Assur (2017) 30(8):755–68.10.1108/IJHCQA-01-2017-0019
    1. Gillman MW, Hammond RA. Precision treatment and precision prevention: integrating “below and above the skin”. JAMA Pediatr (2016) 170(1):9–10.10.1001/jamapediatrics.2015.2786
    1. Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE, Fortney JC, et al. Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implement Sci (2014) 9:132.10.1186/s13012-014-0132-x
    1. Riley WT, Rivera DE. Methodologies for optimizing behavioral interventions: introduction to special section. Transl Behav Med (2014) 4(3):234–7.10.1007/s13142-014-0281-0
    1. Kirchner JE, Waltz TJ, Powell BJ, Smith JL, Proctor EK. Implementation strategies. In: Brownson RC, Colditz G, Proctor EK, editors. Dissemination and Implementation Research in Health. New York: Oxford University Press; (2017). p. 245–66.
    1. Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: a systematic review of use over time. Am J Public Health (2013) 103(6):e38–46.10.2105/AJPH.2013.301299
    1. Gaglio B, Glasgow RE. Evaluation approaches for dissemination and implementation research. In: Brownson RC, Colditz G, Proctor EK, editors. Dissemination and Implementation Research in Health. New York: Oxford University Press; (2017). p. 317–34.
    1. Cresswell JW. Qualitative Inquiry and Research Design: Choosing Among Five Approaches. 2nd ed Thousand Oaks, CA: SAGE; (2007).
    1. Palinkas LA, Cooper BR. Mixed methods evaluation in dissemination and implementation science. In: Brownson RC, Colditz G, Proctor EK, editors. Dissemination and Implementation Research in Health. New York: Oxford University Press; (2017). p. 335–53.
    1. Holtrop JS, Rabin BA, Glasgow RE. Qualitative approaches to use of the RE-AIM framework: rationale and methods. BMC Health Serv Res (2018) 18:177.10.1186/s12913-018-2938-8

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe