What strategies are used to build practitioners' capacity to implement community-based interventions and are they effective?: a systematic review

Jennifer Leeman, Larissa Calancie, Marieke A Hartman, Cam T Escoffery, Alison K Herrmann, Lindsay E Tague, Alexis A Moore, Katherine M Wilson, Michelle Schreiner, Carmen Samuel-Hodge, Jennifer Leeman, Larissa Calancie, Marieke A Hartman, Cam T Escoffery, Alison K Herrmann, Lindsay E Tague, Alexis A Moore, Katherine M Wilson, Michelle Schreiner, Carmen Samuel-Hodge

Abstract

Background: Numerous agencies are providing training, technical assistance, and other support to build community-based practitioners' capacity to adopt and implement evidence-based prevention interventions. Yet, little is known about how best to design capacity-building interventions to optimize their effectiveness. Wandersman et al. (Am J Community Psychol.50:445-59, 2102) proposed the Evidence-Based System of Innovation Support (EBSIS) as a framework to guide research and thereby strengthen the evidence base for building practitioners' capacity. The purpose of this review was to contribute to further development of the EBSIS by systematically reviewing empirical studies of capacity-building interventions to identify (1) the range of strategies used, (2) variations in the way they were structured, and (3) evidence for their effectiveness at increasing practitioners' capacity to use evidence-based prevention interventions.

Methods: PubMed, EMBASE, and CINAHL were searched for English-language articles reporting findings of empirical studies of capacity-building interventions that were published between January 2000 and January 2014 and were intended to increase use of evidence-based prevention interventions in non-clinical settings. To maximize review data, studies were not excluded a priori based on design or methodological quality. Using the EBSIS as a guide, two researchers independently extracted data from included studies. Vote counting and meta-summary methods were used to summarize findings.

Results: The review included 42 publications reporting findings from 29 studies. In addition to confirming the strategies and structures described in the EBSIS, the review identified two new strategies and two variations in structure. Capacity-building interventions were found to be effective at increasing practitioners' adoption (n = 10 of 12 studies) and implementation (n = 9 of 10 studies) of evidence-based interventions. Findings were mixed for interventions' effects on practitioners' capacity or intervention planning behaviors. Both the type and structure of capacity-building strategies may have influenced effectiveness. The review also identified contextual factors that may require variations in the ways capacity-building interventions are designed.

Conclusions: Based on review findings, refinements are suggested to the EBSIS. The refined framework moves the field towards a more comprehensive and standardized approach to conceptualizing the types and structures of capacity-building strategies. This standardization will assist with synthesizing findings across studies and guide capacity-building practice and research.

Figures

Fig. 1
Fig. 1
Conceptual framework of capacity-building interventions (adapted from the ISF and EBSIS) [8, 9]
Fig. 2
Fig. 2
Full string of terms used to search PubMed
Fig. 3
Fig. 3
PRISMA flow diagram
Fig. 4
Fig. 4
Revised framework for capacity-building interventions

References

    1. Rabin BA, Brownson RC, Haire-Joshu D, Kreuter MW, Weaver NL. A glossary for dissemination and implementation research in health. J Public Health Manag Pract. 2008;14:117–23. doi: 10.1097/.
    1. Dodson EA, Baker EA, Brownson RC. Use of evidence-based interventions in state health departments: a qualitative assessment of barriers and solutions. J Public Health Manag Pract. 2010;16:E9–15. doi: 10.1097/PHH.0b013e3181d1f1e2.
    1. Steele CB, Rose JM, Chovnick G, Townsend JS, Stockmyer CK, Fonseka J, Richardson LC. Use of evidence-based practices and resources among Comprehensive Cancer Control Programs. J Public Health Manag Pract. 2014. Epub ahead of print
    1. Collins C, Harshbarger C, Sawyer R, Hamdallah M. The diffusion of effective behavioral interventions project: development, implementation, and lessons learned. AIDS Educ Prev. 2006;18(supp):5–20.
    1. Rabin BA, Glasgow RE, Kerner JF, Klump MP, Brownson RC. Dissemination and implementation research on community-based cancer prevention: a systematic review. Am J Prev Med. 2010;38:443–56. doi: 10.1016/j.amepre.2009.12.035.
    1. Flaspohler P, Duffy J, Wandersman A, Stillman L, Maras MA. Unpacking prevention capacity: an intersection of research-to-practice models and community-centered models. Am J Community Psychol. 2008;41:182–96. doi: 10.1007/s10464-008-9162-3.
    1. Mitton C, Adair CE, McKenzie E, Patten SB, Perry BW. Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007;85:729–68. doi: 10.1111/j.1468-0009.2007.00506.x.
    1. Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, et al. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41:171–81. doi: 10.1007/s10464-008-9174-z.
    1. Wandersman A, Chien VH, Katz J. Toward an evidence-based system for innovation support for implementing innovations with quality: tools, training, technical assistance, and quality assurance/quality improvement. Am J Community Psychol. 2012;50(3-4):445–59. doi: 10.1007/s10464-012-9509-7.
    1. Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50. doi: 10.1007/s10464-008-9165-0.
    1. Brownson RC, Fielding JE, Maylahn CM. Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009;30:175–201. doi: 10.1146/annurev.publhealth.031308.100134.
    1. Orleans CT, Barker DC, Kaufman NJ, & Marx JF. Helping pregnant smokers quit: meeting the challenge in the next decade. Tobacco Control. 2000; 9: iii6-iii11.ᅟ
    1. Ekwenugo L, Benard VB, Vinson C. News from the CDC: collaborations to build capacity at the community level in cancer prevention and control. Transl Behav Med. 2013;3:3–5. doi: 10.1007/s13142-012-0185-9.
    1. Ali MK, Rabadán-Diehl C, Flanigan J, Blanchard C, Narayan KM, Engelgau M. Systems and capacity to address noncommunicable diseases in low- and middle-income countries. Sci Transl Med. 2013;5:181–4. doi: 10.1126/scitranslmed.3005121.
    1. McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, et al. A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel. Implement Sci. 2010;5:16. doi: 10.1186/1748-5908-5-16.
    1. Cooper H, Hedges LV, Valentine JC. The Handbook of research synthesis and meta-analysis. New York: Russell Sage Foundation; 2009.
    1. Sandelowski M, Barroso J. Handbook for synthesizing qualitative research. New York: Springer Publishing Company; 2007.
    1. Pluye P, Gagnon MP, Griffiths F, Johnson-Lafleur J. A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in mixed studies reviews. Int J Nurs Stud. 2009;46:529–46. doi: 10.1016/j.ijnurstu.2009.01.009.
    1. Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15:1277–88. doi: 10.1177/1049732305276687.
    1. Chinman M, Hunter SB, Ebener P, Paddock SM, Stillman L, Imm P, et al. The Getting to Outcomes demonstration and evaluation: an illustration of the prevention support system. Am J Community Psychol. 2008;41:206–24. doi: 10.1007/s10464-008-9163-2.
    1. Harshbarger C, Simmons G, Coelho H, Sloop K, Collins C. An empirical assessment of implementation, adaptation, and tailoring: the evaluation of CDC’s National diffusion of VOICES/VOCES. AIDS Educ Prev. 2006;18(supp):184–97.
    1. Beam M, Ehrlich G, Donze Black J, Block A, Leviton LC. Evaluation of the healthy schools program: part I. Interim progress. Prev Chronic Dis. 2012;9:110106.
    1. Beam M, Ehrlich G, Donze Black J, Block A, Leviton LC. Evaluation of the healthy schools program: part II. The role of technical assistance. Prev Chronic Dis. 2012;9
    1. Glanz K, Steffen A, Elliott T, O’Riordan D. Diffusion of an effective skin cancer prevention program: design, theoretical foundations, and first-year implementation. Health Psychol. 2005;24:477–87. doi: 10.1037/0278-6133.24.5.477.
    1. Emmons KM, Geller AC, Viswanath V, Rutsch L, Zwirn J, Gorham S, et al. The SunWise policy intervention for school-based sun protection: a pilot study. J Sch Nurs. 2008;24:215–21. doi: 10.1177/1059840508319627.
    1. Hannon PA, Harris JR, Sopher CJ, Kuniyuki A, Ghosh DL, Henderson S, et al. Improving low-wage, midsized employers’ health promotion practices: a randomized controlled trial. Am J Prev Med. 2012;43:125–33. doi: 10.1016/j.amepre.2012.04.014.
    1. Brown LD, Feinberg ME, Greenberg MT. Determinants of community coalition ability to support evidence-based programs. Prev Sci. 2010;11:287–97. doi: 10.1007/s11121-010-0173-6.
    1. Flaspohler PD, Meehan C, Maras MA, Keller KE. Ready, willing, and able: developing a support system to promote implementation of school-based prevention programs. Am J Community Psychol. 2012;50:428–44. doi: 10.1007/s10464-012-9520-z.
    1. Mihalic SF, Fagan AA, Argamaso S, et al. Implementing the LifeSkills training drug prevention program: factors related to implementation fidelity. Implement Sci. 2008;3:1–16. doi: 10.1186/1748-5908-3-5.
    1. Riggs NR, Nakawatase M, Pentz MA. Promoting community coalition functioning: effects of project STEP. Prev Sci. 2008;9:63–72. doi: 10.1007/s11121-008-0088-7.
    1. Duffy JL, Prince MS, Johnson EE, Alton FL, Flynn S, Faye AM, et al. Enhancing teen pregnancy prevention in local communities: capacity building using the interactive systems framework. Am J Community Psychol. 2012;50:370–85. doi: 10.1007/s10464-012-9531-9.
    1. Florin P, Friend KB, Buka S, Egan C, Barovier L, Amodei B. The Interactive Systems Framework Applied to the Strategic Prevention Framework: the Rhode Island experience. Am J Community Psychol. 2012;50:402–14. doi: 10.1007/s10464-012-9527-5.
    1. Rabin BA, Nehl E, Elliott T, Deshpande AD, Brownson RC, Glanz K. Individual and setting level predictors of the implementation of a skin cancer prevention program: a multilevel analysis. Implement Sci. 2010;5:40. doi: 10.1186/1748-5908-5-40.
    1. Rohrbach LA, Gunning M, Sun P, Sussman S. The Project Towards No Drug Abuse (TND) dissemination trial: implementation fidelity and immediate outcomes. Prev Sci. 2010;11:77–88. doi: 10.1007/s11121-009-0151-z.
    1. Feinberg ME, Ridenour TA, Greenberg MT. The longitudinal effect of technical assistance dosage on the functioning of Communities That Care prevention boards in Pennsylvania. J Prim Prev. 2008;29:145–65. doi: 10.1007/s10935-008-0130-3.
    1. Spoth R, Guyll M, Redmond C, Greenberg M, Feinberg M. Six-year sustainability of evidence-based intervention implementation quality by community-university partnerships: the PROSPER study. Am J Community Psychol. 2011;48:412–25. doi: 10.1007/s10464-011-9430-5.
    1. Chinman M, Acosta J, Ebener P, Burkhart Q, Malone PS, Paddock SM, et al. Intervening with practitioners to improve the quality of prevention: one-year findings from a randomized trial of assets-getting to outcomes. J Prim Prev. 2013;34:173–91. doi: 10.1007/s10935-013-0302-7.
    1. Chinman M, Ebener P, Burkhart Q, Osilla KC, Imm P, Paddock SM, et al. Evaluating the impact of Getting to Outcomes—underage drinking on prevention capacity and alcohol merchant attitudes and selling behaviors. Prev Sci. 2014;15:485–96. doi: 10.1007/s11121-013-0389-3.
    1. Fagan AA, Hanson K, Briney JS, Hawkins JD. Sustaining the utilization and high quality implementation of tested and effective prevention programs using the Communities that Care prevention system. Am J Community Psychol. 2012;49:365–77. doi: 10.1007/s10464-011-9463-9.
    1. Elinder LS, Heinemans N, Hagberg J, Quetel A-K, Hagströmer M. A participatory and capacity-building approach to healthy eating and physical activity—SCIP-school: a 2-year controlled trial. Int J Behav Nutr Phys Act. 2012;9:145. doi: 10.1186/1479-5868-9-145.
    1. Little MA, Sussman S, Sun P, Rohrbach LA. The effects of implementation fidelity in the Towards No Drug Abuse dissemination trial. Am J Health Educ. 2013;113:281–296. doi: 10.1108/09654281311329231.
    1. Crowley DM, Greenberg MT, Feinberg ME, Spoth RL, Redmond CR. The effect of the PROSPER partnership model on cultivating local stakeholder knowledge of evidence-based programs: a five-year longitudinal study of 28 communities. Prev Sci. 2012;13:96–105. doi: 10.1007/s11121-011-0250-5.
    1. Acosta J, Chinman M, Ebener P, Malone PS, Paddock S, Phillips A, et al. An intervention to improve program implementation: findings from a two-year cluster randomized trial of Assets—Getting to Outcomes. Implement Sci IS. 2013;8:87. doi: 10.1186/1748-5908-8-87.
    1. Brownson RC, Ballew P, Dieffenderfer B, Haire-Joshu D, Heath GW, Kreuter MW, et al. Evidence-based interventions to promote physical activity: what contributes to dissemination by state health departments. Am J Prev Med. 2007;33(1 Suppl):S66–73. quiz S74–78.
    1. Gingiss P, Boerm M, Roberts-Gray C. Follow-up comparisons of intervention and comparison schools in a state tobacco prevention and control initiative. J Sch Health. 2006;76:98–103. doi: 10.1111/j.1746-1561.2006.00076.x.
    1. Batchelor K, Freeman AC, Robbins A, Dudley T, Phillips N. Formative assessment of use of behavioral data in HIV prevention: Texas. AIDS Behav. 2005;9:S29–40. doi: 10.1007/s10461-005-3943-6.
    1. Kelly JA, Somlai AM, DiFranceisco WJ, Otto-Salaj LL, McAuliffe TL, Hackl KL, et al. Bridging the gap between the science and service of HIV prevention: transferring effective research-based HIV prevention interventions to community AIDS service providers. Am J Public Health. 2000;90:1082–8. doi: 10.2105/AJPH.90.7.1082.
    1. Philliber S, Nolte K. Implementation science: promoting science-based approaches to prevent teen pregnancy. Prev Sci. 2008;9:166–77. doi: 10.1007/s11121-008-0094-9.
    1. Buller DB, Reynolds KD, Ashley JL, Buller MK, Kane IL, Stabell CL, et al. Motivating public school districts to adopt sun protection policies: a randomized controlled trial. Am J Prev Med. 2011;41:309–16. doi: 10.1016/j.amepre.2011.04.019.
    1. Cooper BR, Bumbarger BK, Moore JE. Sustaining evidence-based prevention programs: correlates in a large-scale dissemination initiative. Prev Sci. 2013;16:145–157. doi: 10.1007/s11121-013-0427-1.
    1. Nargiso JE, Friend KB, Egan C, Florin P, Stevenson J, Amodei B, et al. Coalitional capacities and environmental strategies to prevent underage drinking. Am J Community Psychol. 2013;51:222–31. doi: 10.1007/s10464-012-9536-4.
    1. Pope C, Mays N, Popay J. Synthesizing qualitative and quantitative health evidence: a guide to methods. Berkshire, England: McGraw Hill; 2007.
    1. Clavier C, Sénéchal Y, Vibert S, Potvin L. A theory-based model of translation practices in public health participatory research. Sociol Health Illn. 2012;34:791–805. doi: 10.1111/j.1467-9566.2011.01408.x.
    1. Armstrong R, Waters E, Moore L, Riggs E, Cuervo LG, Lumbiganon P, et al. Improving the reporting of public health intervention research: advancing TREND and CONSORT. J Public Health. 2008;30:103–9. doi: 10.1093/pubmed/fdm082.
    1. Hoffmann TC. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687–7. doi: 10.1136/bmj.g1687.
    1. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629. doi: 10.1111/j.0887-378X.2004.00325.x.
    1. Leeman J, Jackson B, Sandelowski M. An evaluation of how well research reports facilitate the use of findings in practice. J Nurs Scholarsh. 2006;38:171–7. doi: 10.1111/j.1547-5069.2006.00096.x.
    1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. doi: 10.1136/bmj.a1655.
    1. Davidson KW, Goldstein M, Kaplan RM, Kaufmann PG, Knatterud GL, Orleans CT, et al. Evidence-based behavioral medicine: what is it and how do we achieve it? Ann Behav Med. 2003;26:161–71. doi: 10.1207/S15324796ABM2603_01.
    1. Escoffery C, Glanz K, Elliott T. Process evaluation of the Pool Cool diffusion trial for skin cancer prevention across 2 years. Health Educ Res. 2008;23:732–43. doi: 10.1093/her/cym060.
    1. Escoffery C, Glanz K, Hall D, Elliott T. A multi-method process evaluation for a skin cancer prevention diffusion trial. Eval Health Prof. 2009;32:184–203. doi: 10.1177/0163278709333154.
    1. Hall D, Dubruiel N, Elliott T, Glanz K. Linking agents’ activities and communication patterns in a study of the dissemination of an effective skin cancer prevention program. J Public Health Manag Pract. 2009;15:409–15. doi: 10.1097/PHH.0b013e3181952178.
    1. Valente TW, Chou CP, Pentz MA. Community coalitions as a system: effects of network change on adoption of evidence-based substance abuse prevention. Am J Public Health. 2007;97:880. doi: 10.2105/AJPH.2005.063644.
    1. Hunter SB, Paddock SM, Ebener P, Burkhart AK, Chinman M. Promoting evidence-based practices: the adoption of a prevention support system in community settings. J Community Psychol. 2009;37:579–93. doi: 10.1002/jcop.20316.
    1. Hunter SB, Chinman M, Ebener P, Imm P, Wandersman A, Ryan GW. Technical assistance as a prevention capacity-building tool: a demonstration using the getting to outcomes framework. Health Educ Behav. 2009;36:810–28. doi: 10.1177/1090198108329999.
    1. Brown LD, Feinberg ME, Shapiro VB, Greenberg MT. Reciprocal relations between coalition functioning and the provision of implementation support. Prev Sci. 2013;16:101–109. doi: 10.1007/s11121-013-0447-x.
    1. McCracken JL, Friedman DB, Brandt HM, Adams SA, Xirasagar S, Ureda JR, et al. Findings from the Community Health Intervention Program in South Carolina: implications for reducing cancer-related health disparities. J Cancer Educ. 2013;28:412–9. doi: 10.1007/s13187-013-0479-8.
    1. Honeycutt S, Carvalho M, Glanz K, Daniel SD, Kegler MC. Research to reality: a process evaluation of a mini-grants program to disseminate evidence-based nutrition programs to rural churches and worksites. J Public Health Manag Pract JPHMP. 2012;18:431–9. doi: 10.1097/PHH.0b013e31822d4c69.
    1. Lee JG, Ranney LM, Goldstein AO, McCullough A, Fulton-Smith SM, Collins NO. Successful implementation of a wellness and tobacco cessation curriculum in psychosocial rehabilitation clubhouses. BMC Public Health. 2011;11:702. doi: 10.1186/1471-2458-11-702.

Source: PubMed

Sponsorzy i współpracownicy

Warunki medyczne

Interwencje lekowe

3
Subskrybuj