Implementation and modification of an organizational-level intervention: a prospective analysis

Elisa J Gordon, Jefferson J Uriarte, Naomi Anderson, Elida Romo, Juan Carlos Caicedo, Michelle Shumate, Elisa J Gordon, Jefferson J Uriarte, Naomi Anderson, Elida Romo, Juan Carlos Caicedo, Michelle Shumate

Abstract

Background: Modifications to interventions can jeopardize intervention outcomes. Pre-existing perceived barriers and facilitators to the intervention arising in the implementation preparation phase may help explain why modifications to the intervention may occur during the implementation phase. This two-site comparative case study describes modifications made to a complex organizational-level intervention and examines how known implementation science factors may have enabled such changes to occur.

Methods: Northwestern Medicine'sTM Hispanic Kidney Transplant Program (HKTP) is a culturally competent transplant center-based intervention designed to reduce disparities in living donor kidney transplantation among Hispanics. In-depth qualitative interviews and discussions were longitudinally conducted with transplant stakeholders (i.e., physicians, administrators, clinicians) at two kidney transplant programs with large Hispanic populations during implementation preparation and implementation phases. The Consolidated Framework for Implementation Research (CFIR) guided interview design and qualitative analysis, and Stirman's Framework for Reporting Adaptations and Modifications-Expanded (FRAME) guided modification classification.

Results: Across sites, 57 stakeholders participated in an interview, group discussion, and/or learning collaborative discussion. Site-B made more modifications than Site-A (n = 29 versus n = 18). Sites differed in the proportions of delaying/skipping (Site-A 50% versus Site-B 28%) and adding (Site-A 11% versus Site-B 28%) but had comparable substituting (Site-A 17% versus Site-B 17%) and tweaking (Site-A 17% versus Site-B 14%) modification types. Across sites, the transplant team consistently initiated the most modifications (Site-A 66%; Site-B 62%). While individuals initiated slightly more modifications at Site-B (21% versus Site-A 17%), institutions instigated proportionately slightly more modifications at Site-A (17% versus Site-B 10%). CFIR inner setting factors (i.e., structural characteristics, culture, available resources, implementation climate) that prominently emerged during the implementation preparation phase explained similarities and differences in sites' modification numbers, types, and agents in the implementation phase.

Conclusion: Organizations implementing a culturally competent care intervention made modifications. CFIR inner setting factors emerging in the implementation preparation phase largely explained similarities and differences in study sites' modifications. Identifying factors contributing to modifications may help institutions become better prepared to implement an intervention by addressing known factors in advance, which may foster greater fidelity leading to desired outcomes.

Trial registration: ClinicalTrials.gov NCT03276390 . We registered the study retrospectively on 9-7-17.

Keywords: Complex interventions; Culturally competent care; End-stage kidney disease; Equity; Health disparities; Hospital-based intervention; Hybrid study; Organizational culture; Organizational-level intervention.

Conflict of interest statement

The authors declare that they have no competing interests.

© 2022. The Author(s).

Figures

Fig. 1
Fig. 1
Data collection timeline
Fig. 2
Fig. 2
Data collection approaches by frequency

References

    1. Cohen DJ, Crabtree BF, Etz RS, et al. Fidelity versus flexibility: translating evidence-based research into practice. Am J Prev Med. 2008;35(5 Suppl):S381–S389. doi: 10.1016/j.amepre.2008.08.005.
    1. Breitenstein SM, Gross D, Garvey CA, Hill C, Fogg L, Resnick B. Implementation fidelity in community-based interventions. Res. Nurs. Health. 2010;33(2):164–173. doi: 10.1002/nur.20373.
    1. Carvalho ML, Honeycutt S, Escoffery C, Glanz K, Sabbs D, Kegler MC. Balancing fidelity and adaptation: implementing evidence-based chronic disease prevention programs. J. Public Health Manag. Pract. 2013;19(4):348–356. doi: 10.1097/PHH.0b013e31826d80eb.
    1. Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013;8:65. doi: 10.1186/1748-5908-8-65.
    1. Aarons GA, Sklar M, Mustanski B, Benbow N, Brown CH. "Scaling-out" evidence-based interventions to new populations or new health care delivery systems. Implement Sci. 2017;12(1):111. doi: 10.1186/s13012-017-0640-6.
    1. Bernal G, Adames C. Cultural adaptations: conceptual, ethical, contextual, and methodological issues for working with ethnocultural and majority-world populations. Prev Sci. 2017;18:681–688. doi: 10.1007/s11121-017-0806-0.
    1. Wiltsey Stirman S, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. 2019;(1):58. 10.1186/s13012-019-0898-y.
    1. Chambers DA, Norton WE. The adaptome: advancing the science of intervention adaptation. Am J Prev Med. 2016;51(4 Suppl 2):S124–S131. doi: 10.1016/j.amepre.2016.05.011.
    1. Castro FG, Barrera M, Jr, Martinez CR., Jr The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci. 2004;5(1):41–45. doi: 10.1023/B:.
    1. Parra-Cardona JR, Bybee D, Sullivan CM, et al. Examining the impact of differential cultural adaptation with Latina/o immigrants exposed to adapted parent training interventions. J Consult Clin Psychol. 2017;85(1):58–71. doi: 10.1037/ccp0000160.
    1. Castro FG, Yasui M. Advances in EBI development for diverse populations: towards a science of intervention adaptation. Prev Sci. 2017;18:623–629. doi: 10.1007/s11121-017-0809-x.
    1. Escoffery C, Lebow-Skelley E, Haardoerfer R, et al. A systematic review of adaptations of evidence-based public health interventions globally. Implement. Sci. 2018;13:125. doi: 10.1186/s13012-018-0815-9.
    1. Cooper BR, Shrestha G, Hyman L, Hill L. Adaptations in a community-based family intervention: replication of two coding schemes. J. Prim. Prev. 2016;37(1):33–52. doi: 10.1007/s10935-015-0413-4.
    1. Rabin BA, McCreight M, Battaglia C, et al. Systematic, multimethod assessment of adaptations across four diverse health systems interventions. Front. Public Health. 2018;6:102. doi: 10.3389/fpubh.2018.00102.
    1. Lau A, Barnett M, Stadnick N, et al. Therapist report of adaptations to delivery of evidence-based practices within a system-driven reform of publicly funded children's mental health services. J. Consult. Clin. Psychol. 2017;85(7):664–675. doi: 10.1037/ccp0000215.
    1. Damschroder LJ, Reardon CM, Opra Widerquist MA, Lowery J. Conceptualizing outcomes for use with the Consolidated Framework for Implementation Research (CFIR): the CFIR Outcomes Addendum. Implement Sci. 2022;17(1):7. doi: 10.1186/s13012-021-01181-5.
    1. Hasson H, Blomberg S, Dunér A. Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care. Implement Sci. 2012;7:23. doi: 10.1186/1748-5908-7-23.
    1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. doi: 10.1136/bmj.a1655.
    1. Paskett E, Thompson B, Ammerman AS, Ortega AN, Marsteller J, Richardson D. Multilevel interventions to address health disparities show promise in improving population health. Health Aff. 2016;35(8):1429–1434. doi: 10.1377/hlthaff.2015.1360.
    1. Chin MH, Clarke AR, Nocon RS, et al. A roadmap and best practices for organizations to reduce racial and ethnic disparities in health care. J. Gen. Intern. Med. 2012;27(8):992–1000. doi: 10.1007/s11606-012-2082-9.
    1. American Hospital Association. Hospitals Fast Facts on U.S, 2019. . Accessed on 30 July 19.
    1. Coley A, Parry G. Evaluating complex health interventions: a guide to rigorous research designs. Academy Health; 2017. . Accessed 18 Apr 22.
    1. Bauman AE, Cabassa LJ, Stirman SW. In: Adaptation in dissemination and implementation science. Brownson RC, Colditz G, Proctor EK, editors. Dissemination and Implementation Research in Health. Oxford University Press; 2017. pp. 285–300.
    1. Brownson R, Colditz G, Proctor E. Dissemination and Implementation Research in Health. Oxford University Press; 2012.
    1. Damschroder L, Aron D, Keith R, Kirsh S, Alexander J, Lowery J. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. doi: 10.1186/1748-5908-4-50.
    1. Gordon EJ, Lee J, Kang RH, et al. A complex culturally targeted intervention to reduce Hispanic disparities in living kidney donor transplantation: an effectiveness-implementation hybrid study protocol. BMC Health Serv. Res. 2018;18(1):368. doi: 10.1186/s12913-018-3151-5.
    1. Gordon EJ, Uriarte J, Lee J, et al. Effectiveness of a culturally competent care intervention in reducing disparities in Hispanic live donor kidney transplantation: A hybrid trial. Am J Transplant. 2022;22(2):474–488. doi: 10.1111/ajt.16857.
    1. Purnell TS, Hall YN, Boulware LE. Understanding and overcoming barriers to living kidney donation among racial and ethnic minorities in the United States. Adv. Chronic Kidney Dis. 2012;19(4):244–251. doi: 10.1053/j.ackd.2012.01.008.
    1. Gordon EJ, Mullee J, Ramirez D, et al. Hispanic/Latino concerns about living kidney donation: a focus group study. Prog. Transplant. 2014;24(2):152–162. doi: 10.7182/pit2014946.
    1. Gordon EJ, Caicedo JC, Ladner DP, Reddy E, Abecassis MM. Transplant center provision of education and culturally and linguistically competent care: a national study. Am. J. Transplant. 2010;10(12):2701–2707. doi: 10.1111/j.1600-6143.2010.03304.x.
    1. Gordon E, Romo E, Amortegui D, et al. Implementing culturally competent transplant care and implications for reducing health disparities: a prospective qualitative study. Health Expect. 2020;23(6):1450–1465. doi: 10.1111/hex.13124.
    1. Gordon EJ, Lee J, Kang R, et al. Hispanic/Latino disparities in living donor kidney transplantation: role of a culturally competent transplant program. Transplant. Direct. 2015;1(8):e29. doi: 10.1097/TXD.0000000000000540.
    1. Alhalel N, Francone NO, Salazar A, et al. Perceptions of a culturally targeted hispanic kidney transplant program: a mixed methods study. Clin. Transplant. 2019;33(6).
    1. Gordon EJ, Wolder LB. Contextualizing ethical dilemmas: ethnographic methods in bioethics. In: Jacoby L, Siminoff L, editors. Empirical Methods for Bioethics: A Primer, vol. 11. Emerald Group Publishing Limited; 2008. p. 83–116.
    1. Hoffmann TC, Glasziou PP, Boutron I, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. Bmj. 2014;348:g1687. doi: 10.1136/bmj.g1687.
    1. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int. J. Qual. Health Care. 2007;19(6):349–357. doi: 10.1093/intqhc/mzm042.
    1. The Commonwealth Fund. Improving health care delivery: the "learning collaborative" approach. 2005; Accessed at .
    1. Becker DRDR, Bond GR. The IPS supported employment learning collaborative. Psychiatr Rehabil J. 2014;37(2):79–85. doi: 10.1037/prj0000044.
    1. CFIR. Interview Guide. CFIR Interview Guide. .
    1. Lincoln Y, Guba E. Naturalistic Inquiry. Sage Publications; 1985.
    1. Guest G, MacQueen K, Namey E. Applied Thematic Analysis. Sage Publications; 2012.
    1. Bradley E, Curry L, Devers K. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv. Res. 2007;42(4):1758–1772. doi: 10.1111/j.1475-6773.2006.00684.x.
    1. Campbell JL, Quincy C, Osserman J, Pedersen OK. Coding in-depth semistructured interviews: problems of unitization and intercoder reliability and agreement. Sociol. Methods Res. 2013;42(3):294–320. doi: 10.1177/0049124113500475.
    1. Strauss A, Corbin J. Basics of qualitative research: Techniques and procedures for developing grounded theory. Thousand Oaks: Sage Publications; 1998.
    1. Bernard H, Ryan G. Text analysis: Qualitative and quantitative methods. In: Bernard H, editor. Handbook of Methods in Cultural Anthropology. Altamira Press; 1998. pp. 595–646.
    1. Luborsky M. The identification and analysis of themes and patterns. In: Gubrium JS, A, ed. Qualitative Methods in Aging Research. Sage Publications; 1994:189–210.
    1. Anderson LR, Tolson J, Fields MW, Thacker JW. Extension of the Pelz effect: the impact of leader's upward influence on group members' control within the organization. Basic Appl. Soc. Psychol. 1990;11(1):19–32. doi: 10.1207/s15324834basp1101_2.
    1. Rabin BA, McCreight M, Battaglia C, et al. Systematic, multimethod assessment of adaptations across four diverse health systems interventions. Front. Public Health. 2018;6:102. doi: 10.3389/fpubh.2018.00102.
    1. Pawson R, Tilley N. Realistic Evaluation. Sage Publications; 1997.
    1. Schoenwald SK, et al. Toward the effective and efficient measurement of implementation fidelity. Adm Policy Ment Health. 2011;38(1):32–43. doi: 10.1007/s10488-010-0321-0.
    1. Gordon E, Uriarte J, Anderson N, Smith J, Caicedo J, Shumate M. Sustainment of a complex culturally competent care intervention for hispanic living donor kidney transplantation: a longitudinal analysis of adaptations. J Clin Transl Sci. 2020;1–34. 10.1017/cts.2022.378.
    1. Shelton RC, Cooper BR, Stirman SW. The sustainability of evidence-based interventions and practices in public health and health care. Annu Rev Public Health. 2018;39:55–76. doi: 10.1146/annurev-publhealth-040617-014731.

Source: PubMed

Sponsorer og samarbejdspartnere

Medicinske tilstande

Narkotikainterventioner

3
Abonner