Formative evaluation and adaptation of pre-and early implementation of diabetes shared medical appointments to maximize sustainability and adoption

Christine P Kowalski, Miranda Veeser, Michele Heisler, Christine P Kowalski, Miranda Veeser, Michele Heisler

Abstract

Background: Understanding the many factors that influence implementation of new programs, in addition to their success or failure, is extraordinarily complex. This qualitative study examines the implementation and adaptation process of two linked clinical programs within Primary Care, diabetes shared medical appointments (SMAs) and a reciprocal Peer-to-Peer (P2P) support program for patients with poorly controlled diabetes, through the lens of the Consolidated Framework for Implementation Research (CFIR). We illustrate the role and importance of pre-implementation interviews for guiding ongoing adaptations to improve implementation of a clinical program, achieve optimal change, and avoid type III errors.

Methods: We conducted 28 semi-structured phone interviews between September of 2013 and May of 2016, four to seven interviewees at each site. The interviewees were physician champions, chiefs of primary care, pharmacists, dieticians, nurses, health psychologists, peer facilitators, and research coordinators. Modifiable barriers and facilitators to implementation were identified and adaptations documented. Data analysis started with immersion in the data to obtain a sense of the whole and then by cataloging principal themes per CFIR constructs. An iterative consensus-building process was used to code. CFIR constructs were then ranked and compared by the researchers.

Results: We identified a subset of CFIR constructs that are most likely to play a role in the effectiveness of the diabetes SMAs and P2P program based on our work with the participating sites to date. Through the identification of barriers and facilitators, a subset of CFIR constructs arose, including evidence strength and quality, relative advantage, adaptability, complexity, patient needs and resources, compatibility, leadership engagement, available resources, knowledge and beliefs, and champions.

Conclusions: We described our method for identification of contextual factors that influenced implementation of complex diabetes clinical programs - SMAs and P2P. The qualitative phone interviews aided implementation through the identification of modifiable barriers or conversely, actionable findings. Implementation projects, and certainly clinical programs, do not have unlimited resources and these interviews allowed us to determine which facets to target and act on for each site. As the study progresses, these findings will be compared and correlated to outcome measures. This comprehensive adaptation data collection will also facilitate and enhance understanding of the future success or lack of success of implementation and inform potential for translation and public health impact. The approach of using the CFIR to guide us to actionable findings and help us better understand barriers and facilitators has broad applicability and can be used by other projects to guide, adapt, and improve implementation of research into practice.

Trial registration: ClinicalTrials.gov ID: NCT02132676 .

Keywords: Adaptation; CFIR; Diabetes; Facilitation; Formative evaluation; Implementation; Qualitative research; Shared medical appointments.

Conflict of interest statement

Author’s information

CPK was trained in epidemiology at the University of Michigan and works for the Center for Clinical Management Research (CCMR) at the Ann Arbor Veterans Affairs Healthcare System. She leads a national Implementation Research Group (IRG) of 250 members for the Center for Evaluation and Implementation Resources (CEIR) that provides continuning education, training, and sharing of best practices in implementation science. Her expertise over the last 15 years includes formative evaluation, qualitative interviewing and analysis, adaptations and fidelity, and implementation science.

MV obtained her Bachelor of Science from the University of Michigan and currently works as the research associate on the SHARES study.

MK is a physician Research Scientist at the Ann Arbor Center for Clinical Management Research (CCMR). She is also Director of the Community Engagement and Outreach Core of the Michigan Center for Diabetes Translational Research (MCDTR), one of five DTRs funded by the National Institutes of Health to provide assistance to researchers conducting novel interventions to improve diabetes care. MK has expertise in the development and evaluation of health system and behavioral interventions to improve between-clinic visit chronic disease self-management and outcomes. She has served as PI on multiple multi-site effectiveness and implementation studies evaluating different peer support models and health team outreach programs to improve glycemic, blood pressure, and other risk factor control in diabetes. She is also PI on an AHRQ grant that developed a diabetes web-based decision aid that peer mentors and other outreach workers can use with patients to improve diabetes treatment decision-making.

Ethics approval and consent to participate

The SHARES study was approved by the Veterans Affairs Central Institutional Review Board (C-IRB) (reference number 13–21). All participants consented to participate and were informed that their participation was completely voluntary. The consent process was executed as governed by the Central IRB. Staff members were provided with a Study Information Sheet at the time of recruitment and verbal consent was obtained prior to the start of the interview. Verbal consent for staff interviews was approved by the CIRB, as the study is considered minimal risk and obtaining written consent would place an additional burden on participants.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

    1. Stetler CB, et al. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006;21(Suppl 2):S1–S8. doi: 10.1007/s11606-006-0267-9.
    1. Glasgow RE, Lichtenstein E, Marcus AC. Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93(8):1261–1267. doi: 10.2105/AJPH.93.8.1261.
    1. Hasson H. Systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010;5:67. doi: 10.1186/1748-5908-5-67.
    1. Hulscher ME, Laurant MG, Grol RP. Process evaluation on quality improvement interventions. Qual Saf Health Care. 2003;12(1):40–46. doi: 10.1136/qhc.12.1.40.
    1. Mitchell SE, et al. Implementation and adaptation of the re-engineered discharge (RED) in five California hospitals: a qualitative research study. BMC Health Serv Res. 2017;17(1):291. doi: 10.1186/s12913-017-2242-z.
    1. Brown CH, et al. An overview of research and evaluation designs for dissemination and implementation. Annu Rev Public Health. 2017;38:1–22. doi: 10.1146/annurev-publhealth-031816-044215.
    1. Chambers, D.A., R.E. Glasgow, and K.C. Stange, The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci, 2013. 8: p. 117.
    1. Chambers DA, Norton WE. The Adaptome: advancing the science of intervention adaptation. Am J Prev Med. 2016;
    1. Aarons GA, et al. Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implement Sci. 2012;7:32. doi: 10.1186/1748-5908-7-32.
    1. Chambers DA, Norton WE. The Adaptome: advancing the science of intervention adaptation. Am J Prev Med. 2016;51(4 Suppl 2):S124–S131. doi: 10.1016/j.amepre.2016.05.011.
    1. Lau R, et al. Achieving change in primary care--causes of the evidence to practice gap: systematic reviews of reviews. Implement Sci. 2016;11:40. doi: 10.1186/s13012-016-0396-4.
    1. Heisler M, et al. The shared health appointments and reciprocal enhanced support (SHARES) study: study protocol for a randomized trial. Trials. 2017;18(1):239. doi: 10.1186/s13063-017-1959-7.
    1. Heisler M, et al. Diabetes control with reciprocal peer support versus nurse care management: a randomized trial. Ann Intern Med. 2010;153(8):507–515. doi: 10.7326/0003-4819-153-8-201010190-00007.
    1. Heisler M, et al. Randomized controlled effectiveness trial of reciprocal peer support in heart failure. Circ Heart Fail. 2013;6(2):246–253. doi: 10.1161/CIRCHEARTFAILURE.112.000147.
    1. Damschroder LJ, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. doi: 10.1186/1748-5908-4-50.
    1. Maxwell, J.A., Qualitative Research Design: An Interactive Approach. 3 ed. applied social research methods. 2013: Sage Publications. 232.
    1. Mason J. Qualitative researching. Thousand Oaks: Sage Publications; 2002.
    1. Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999;34(5):1189–1208.
    1. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–1288. doi: 10.1177/1049732305276687.
    1. Damschroder LJ, et al. Implementation evaluation of the telephone lifestyle coaching (TLC) program: organizational factors associated with successful implementation. Transl Behav Med. 2017;7(2):233–241. doi: 10.1007/s13142-016-0424-6.
    1. Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53. doi: 10.1186/s13012-015-0242-0.
    1. CFIRguide. Consolidated Framework for Implementation Research - Qualitative Data Analysis. [cited 2017 April 18, 2017]; available from: .
    1. Lenfant C, lecture S. Clinical research to clinical practice--lost in translation? N Engl J Med. 2003;349(9):868–874. doi: 10.1056/NEJMsa035507.

Source: PubMed

3
Iratkozz fel