Fidelity evaluation of the compared procedures for conducting the PVS-PREDIAPS implementation strategy to optimize diabetes prevention in primary care

Alvaro Sánchez, Heather L Rogers, Susana Pablo, Esther García, Inmaculada Rodríguez, Mª Antonia Flores, Olga Galarza, Ana B Gaztañaga, Pedro A Martínez, Eider Alberdi, Elena Resines, Ana I Llarena, Gonzalo Grandes, PREDIAPS Group, Amaia Bengoetxea, Olga Galarza, Elsa Martínez, Itziar Zalduegi, Dorothea Chausson, Agurtzane Gorroño, Alicia Pollán, Marisol Bernabéu, Mª Yolanda Calvo, Ander Artiagoitia, Nerea Zaramillo, Lidia Gonzalez, Asier Aurrekoetexea, Jon Azkarate, María Muñoa, Mar Bilbao, Vicki Camineiro, Gonzalo Gómez de Iturriaga, Fernando Gago, Iciar Ochoa de Retana, Ana Zorrilla, Mª Luisa Gutiérrez, Jone Capetillo Serra, Mª Nieves Lopez, Nekane Iguerregui, Dolores López, Maite Gastañaga, Antonia Flores, Marcos Pereda, Amaya González, Ana Castresana, Laura Saiz, Nerea Regulez, Estibaliz Peciña, Jasone De la Plaza, Lucía Irastoza, Jose Contreras, Idoia Etxebarria, Begoña Oleaga, Cristina Herrero, Nora Cabezón, Fátima Calvo, J Manuel Llamazares, Mª Ángeles Gutierrez, Monica Prieto, Concepción Estébanez, María José Cordovilla, Alicia Domínguez, Isabel Lázaro, Elena Resines, Yolanda Villalba, Begoña Ayerdi, Florencia Martín, Magdalena Presmanes, Floreal Crespo, Araceli Benito, Mª Belén Molina, Mª Mar García, Mª Gracia Díaz, Mª Luisa Rodriguez Ortiz de Zarate, Rebeca San Cristóbal, M Zugazaga Prieto, Pedro Martínez, Mercedes Crespo, Estíbaliz Albitre, Adelina García-Roldán, Amaia García, Maite Castro, Iñaki Gorospe, Amelia V Hernández, Maite López, Mirian Sainz, Irene Marín, María Jesús Aragón, Leire Ulayar, Encarnación Santamaría, Carmen Sánchez, Javier Bayo, Begoña Urkullu, Ana Inés Pereda, Mercedes Garcia, Pilar Blanco, Silvia Soler Valverde, Jose I Atela, Hiart Trespalacios, Anabel Llarena, Verónica Ruiz, Begoña Cabieces, Concepción Ugarte, Guadalupe Icaza, Edurne Zubeldia, Idoia González, Ángeles Gayo, Itxaso Arévalo, Gloria Intxausti, Esther García, Teresa Sánchez, Igone Lobato, Noelia Fuente, Naiara Ortolachipi, Edelweiss Sánchez, Victoria Cosgaya, Ángeles Gayo, Arantza Azazeta, Patricia Zaballa, Ana Isabel Ramila, Teresa Rodeño, Inmaculada Rodríguez, Teresa Vázquez, Raquel Ruíz, Rosa Herrero, María Valvanera, Saioa Setién, Begoña Ruíz, Juan José Casas, Joana Clemente, Javier Amiama, Javier Angulo, Belén Aramendia, Soledad Asenjo, Mª Sonia Mayoral, Remedios Oyarzun, Bergoi Calvar, Belinda Zulueta, Edurne Elola, Josu Egaña, Gemma Díaz, Mª Ángeles Sola, Laura Balague, Mª Ángeles Ganzarain, Arantxa Aramburu, Ana Mª Guinea, Edurne Lizarazu, Inma Valverde, Nekane Arenas, Susana Alonso, Rosa Salaberria, Javier Merino, Mercedes Álvarez, Ester Lázaro, Juncal Izcara, Leire González, Ainhoa García Leunda, Idoia Sánchez, Esther Usandiaga, Eluska Yetano, Jaione Larrea, Inés Mendinueta, Asún Uria, Ana Belén Gaztañaga, Eva Mayo, Onintza Aranzadi, Eulalia Medina, Rosa González, Ione Gutiérrez, Arantxa Perez, Mª Ángeles Izquierdo, Alejandro García, Ainhoa Ugarte, Mª Teresa Zubeldia, Bingen Uriondo, Mª Carmen Aranegui, Arantxa Mendiguren, Yolanda Fernández, Maite Zapirain, Mª Jose Garín, Aitziber Ayerbe, Jon Urkia, Alvaro Sánchez, Josep Cortada, Susana Pablo, Heather Lynn Rogers, Arturo García-Alvarez, Gonzalo Grandes, Alicia Cortazar, Patxi Ezkurra, Rafa Rotaetxe, Alvaro Sánchez, Heather L Rogers, Susana Pablo, Esther García, Inmaculada Rodríguez, Mª Antonia Flores, Olga Galarza, Ana B Gaztañaga, Pedro A Martínez, Eider Alberdi, Elena Resines, Ana I Llarena, Gonzalo Grandes, PREDIAPS Group, Amaia Bengoetxea, Olga Galarza, Elsa Martínez, Itziar Zalduegi, Dorothea Chausson, Agurtzane Gorroño, Alicia Pollán, Marisol Bernabéu, Mª Yolanda Calvo, Ander Artiagoitia, Nerea Zaramillo, Lidia Gonzalez, Asier Aurrekoetexea, Jon Azkarate, María Muñoa, Mar Bilbao, Vicki Camineiro, Gonzalo Gómez de Iturriaga, Fernando Gago, Iciar Ochoa de Retana, Ana Zorrilla, Mª Luisa Gutiérrez, Jone Capetillo Serra, Mª Nieves Lopez, Nekane Iguerregui, Dolores López, Maite Gastañaga, Antonia Flores, Marcos Pereda, Amaya González, Ana Castresana, Laura Saiz, Nerea Regulez, Estibaliz Peciña, Jasone De la Plaza, Lucía Irastoza, Jose Contreras, Idoia Etxebarria, Begoña Oleaga, Cristina Herrero, Nora Cabezón, Fátima Calvo, J Manuel Llamazares, Mª Ángeles Gutierrez, Monica Prieto, Concepción Estébanez, María José Cordovilla, Alicia Domínguez, Isabel Lázaro, Elena Resines, Yolanda Villalba, Begoña Ayerdi, Florencia Martín, Magdalena Presmanes, Floreal Crespo, Araceli Benito, Mª Belén Molina, Mª Mar García, Mª Gracia Díaz, Mª Luisa Rodriguez Ortiz de Zarate, Rebeca San Cristóbal, M Zugazaga Prieto, Pedro Martínez, Mercedes Crespo, Estíbaliz Albitre, Adelina García-Roldán, Amaia García, Maite Castro, Iñaki Gorospe, Amelia V Hernández, Maite López, Mirian Sainz, Irene Marín, María Jesús Aragón, Leire Ulayar, Encarnación Santamaría, Carmen Sánchez, Javier Bayo, Begoña Urkullu, Ana Inés Pereda, Mercedes Garcia, Pilar Blanco, Silvia Soler Valverde, Jose I Atela, Hiart Trespalacios, Anabel Llarena, Verónica Ruiz, Begoña Cabieces, Concepción Ugarte, Guadalupe Icaza, Edurne Zubeldia, Idoia González, Ángeles Gayo, Itxaso Arévalo, Gloria Intxausti, Esther García, Teresa Sánchez, Igone Lobato, Noelia Fuente, Naiara Ortolachipi, Edelweiss Sánchez, Victoria Cosgaya, Ángeles Gayo, Arantza Azazeta, Patricia Zaballa, Ana Isabel Ramila, Teresa Rodeño, Inmaculada Rodríguez, Teresa Vázquez, Raquel Ruíz, Rosa Herrero, María Valvanera, Saioa Setién, Begoña Ruíz, Juan José Casas, Joana Clemente, Javier Amiama, Javier Angulo, Belén Aramendia, Soledad Asenjo, Mª Sonia Mayoral, Remedios Oyarzun, Bergoi Calvar, Belinda Zulueta, Edurne Elola, Josu Egaña, Gemma Díaz, Mª Ángeles Sola, Laura Balague, Mª Ángeles Ganzarain, Arantxa Aramburu, Ana Mª Guinea, Edurne Lizarazu, Inma Valverde, Nekane Arenas, Susana Alonso, Rosa Salaberria, Javier Merino, Mercedes Álvarez, Ester Lázaro, Juncal Izcara, Leire González, Ainhoa García Leunda, Idoia Sánchez, Esther Usandiaga, Eluska Yetano, Jaione Larrea, Inés Mendinueta, Asún Uria, Ana Belén Gaztañaga, Eva Mayo, Onintza Aranzadi, Eulalia Medina, Rosa González, Ione Gutiérrez, Arantxa Perez, Mª Ángeles Izquierdo, Alejandro García, Ainhoa Ugarte, Mª Teresa Zubeldia, Bingen Uriondo, Mª Carmen Aranegui, Arantxa Mendiguren, Yolanda Fernández, Maite Zapirain, Mª Jose Garín, Aitziber Ayerbe, Jon Urkia, Alvaro Sánchez, Josep Cortada, Susana Pablo, Heather Lynn Rogers, Arturo García-Alvarez, Gonzalo Grandes, Alicia Cortazar, Patxi Ezkurra, Rafa Rotaetxe

Abstract

Background: Assessing the fidelity of an implementation strategy is important to understand why and how the strategy influences the uptake of evidence-based interventions. The present study aims to assess the fidelity of the two procedures for engaging primary care (PC) professionals and for the deployment of an implementation strategy for optimizing type 2 diabetes prevention in routine PC within the PREDIAPS randomized cluster implementation trial.

Method: We conducted a mixed-method fidelity evaluation study of the PVS-PREDIAPS implementation strategy. Nine PC centers from the Basque Health Service (Osakidetza) were allocated to two different procedures to engage physicians and nurses and deploy a implementation strategy to model and adapt the clinical intervention and its implementation to their specific contexts: a Global procedure, promoting the cooperation of all healthcare professionals from the beginning; or a Sequential procedure, centered first on nurses who then pursued the pragmatic cooperation of physicians. Process indicators of the delivery and receipt of implementation strategy actions, documented modifications to the planned implementation strategy, and a structured group interview with centers' leaders were all used to assess the following components of fidelity: adherence, dose, quality of delivery, professionals' responsiveness and program differentiation.

Results: Generally, the procedures compared for professionals engagement and deployment of the implementation strategy were carried out with the planned differentiation. Nonetheless, some unexpected between-group differences were observed, the initial rate of collaboration of nurses being higher in the Sequential (93%) than in the Global (67%) groups. Exposure rate to the programed implementation actions (% of hours received out of those delivered) were similar in both groups by professional category, with nurses (86%) having a higher rate of exposure than physicians (75%). Professionals identified half of the planned discrete strategies and their rating of strategies' perceived usefulness was overwhelmingly positive, with few differences between Sequential and Global centers.

Conclusions: The PVS-PREDIAPS implementation strategy has been implemented with high fidelity and minor unplanned reactive modifications. Professionals' exposure to the implementation strategy was high in both groups. The centers' organizational context (i.e., work overload) led to small mismatches between groups in participation and exposure of professionals to implementation actions.

Trial registration: Clinicaltrials.gov identifier: NCT03254979 . Registered 16 August 2017.

Keywords: Diabetes prevention; Fidelity; Implementation strategy; Primary healthcare.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1.
Fig. 1.
Participation of PC professionals in the PREDIAPS strategy in the planned implementation sessions (n = 10)

References

    1. Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2:40. doi: 10.1186/1748-5908-2-40.
    1. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38:65–76. doi: 10.1007/s10488-010-0319-7.
    1. Cross WF, West JC. Examining implementer fidelity: conceptualizing and measuring adherence and competence. J Child Serv. 2011;6:18–33. doi: 10.5042/jcs.2011.0123.
    1. Slaughter SE, Hill JN, Snelgrove-Clarke E. What is the extent and quality of documentation and reporting of fidelity to implementation strategies: a scoping review. Implement Sci. 2015;10:129. doi: 10.1186/s13012-015-0320-3.
    1. Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18:237–256. 2.
    1. Kemp CG, Wagenaar BH, Haroz EE. Expanding hybrid studies for implementation research: intervention, implementation strategy, and context. Front Public Health. 2019;7:325. doi: 10.3389/fpubh.2019.00325.
    1. Gearing RE, El-Bassel N, Ghesquiere A, Baldwin S, Gillies J, Ngeow E. Major ingredients of fidelity: a review and scientific guide to improving quality of intervention research implementation. Clin Psychol Rev. 2011;31:79–88. doi: 10.1016/j.cpr.2010.09.007.
    1. Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18:23–45. doi: 10.1016/S0272-7358(97)00043-3.
    1. Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:15. doi: 10.1186/1745-6215-14-15.
    1. Saunders RP, Evans MH, Joshi P. Developing a process-evaluation plan for assessing health promotion program implementation: a how-to guide. Health Promot Pract. 2005;6:134–147. doi: 10.1177/1524839904273387.
    1. Dobson KS, Singer AR. Definitional and practical issues in the assessment of treatment fidelity. Clin Psychol Rev. 2005;12:384–387.
    1. Glasgow RE, Lichenstein E, Marcus AC. Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93:1261–1267. doi: 10.2105/AJPH.93.8.1261.
    1. Sánchez A, Silvestre C, Campo N, Grandes G. PreDE research group. Type-2 diabetes primary prevention program implemented in routine primary care: a process evaluation study. Trials. 2016;17(1):254. doi: 10.1186/s13063-016-1379-0.
    1. Butel J, Braun KL, Novotny R, Acosta M, Castro R, Fleming T, Powers J, Nigg CR. Assessing intervention fidelity in a multi-level, multi-component, multi-site program: the Children’s healthy living (CHL) program. Transl Behav Med. 2015;5(4):460–469. doi: 10.1007/s13142-015-0334-z.
    1. Sanchez A, Grandes G, Pablo S, Espinosa M, Torres A, García-Alvarez A. PREDIAPS Group. Engaging primary care professionals in collaborative processes for 28rioritiza type 2 diabetes prevention practice: the PREDIAPS cluster 28rioritiza type II hybrid implementation trial. Implement Sci. 2018;13(1):94. doi: 10.1186/s13012-018-0783-0.
    1. Sanchez A, Silvestre C, Cortazar A, Bellido V, Ezkurra P, Rotaeche Del Campo R, et al. Prevención de la diabetes mellitus tipo 2 en Atención Primaria de Salud mediante estilos de vida saludables: cuidados e intervención clínica recomendada. Vitoria-Gasteiz: Department of Health, Government of the Basque Country; 2016.
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, Proctor EK, Kirchner JE. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci. 2015;10:21. doi: 10.1186/s13012-015-0209-1.
    1. Wiltsey Stirman S, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. 2019;14(1):58. doi: 10.1186/s13012-019-0898-y.
    1. Huynh AK, Hamilton AB, Farmer MM, Bean-Mayberry B, Stirman SW, Moin T, Finley EP. A pragmatic approach to guide implementation evaluation research: strategy mapping for complex interventions. Front Public Health. 2018;6:134. doi: 10.3389/fpubh.2018.00134.
    1. Domínguez-Berjón MF, Borrell C, Cano-Serral G, Esnaola S, Nolasco A, et al. Constructing a deprivation index based on census data in large Spanish cities (the MEDEA project) Gac Sanit. 2008;22:179–187. doi: 10.1157/13123961.
    1. Parchman ML, Anderson ML, Dorr DA, Fagnan LJ, O’Meara ES, Tuzzio L, Penfold RB, Cook AJ, Hummel J, Conway C, Cholan R, Baldwin LM. A randomized trial of external practice support to improve cardiovascular risk factors in primary care. Ann Fam Med. 2019;17(Suppl 1):S40–S49. doi: 10.1370/afm.2407.
    1. Taylor EF, Peikes D, Genevro J, Meyers D. Creating Capacity for Improvement in Primary Care. The Case for Developing a Quality Improvement Infrastructure. Rockville: Agency for Healthcare Research and Quality; 2013. . Published Apr 2013. Accessed May 9, 2020.
    1. Mold JW, Walsh M, Chou AF, Homco JB. The alarming rate of major disruptive events in primary care practices in Oklahoma. Ann Fam Med. 2018;16(Suppl 1):S52–S57. doi: 10.1370/afm.2201.
    1. Egeland KM, Ruud T, Ogden T, Färdig R, Lindstrøm JC, Heiervang KS. How to implement illness management and recovery (IMR) in mental health service settings: evaluation of the implementation strategy. Int J Ment Health Syst. 2017;11:13. doi: 10.1186/s13033-017-0120-z.
    1. Cohen DJ, Crabtree BF, Etz RS, Balasubramanian BA, Donahue KE, Leviton LC, et al. Fidelity versus flexibility: translating evidence-based research into practice. Am J Prev Med. 2008;35:S381–S389. doi: 10.1016/j.amepre.2008.08.005.
    1. Liddy C, Singh J, Guo M, Hogg W. Physician perspectives on a tailored multifaceted primary care practice facilitation intervention for improvement of cardiovascular care. Fam Pract. 2016;33(1):89–94. doi: 10.1093/fampra/cmv095.
    1. Nguyen AM, Cuthel A, Padgett DK, Niles P, Rogers E, Pham-Singer H, Ferran D, Kaplan SA, Berry C, Shelley D. How Practice Facilitation Strategies Differ by Practice Context. J Gen Intern Med. 2019 Oct 21. Doi: 10.1007/s11606-019-05350-7. [Epub ahead of print].
    1. Rogers ES, Cuthel AM, Berry CA, Kaplan SA, Shelley DR. Clinician perspectives on the benefits of practice facilitation for small primary care practices. Ann Fam Med. 2019;17(Suppl 1):S17–S23. doi: 10.1370/afm.2427.

Source: PubMed

3
Tilaa