Implementation science and stigma reduction interventions in low- and middle-income countries: a systematic review

Christopher G Kemp, Brooke A Jarrett, Churl-Su Kwon, Lanxin Song, Nathalie Jetté, Jaime C Sapag, Judith Bass, Laura Murray, Deepa Rao, Stefan Baral, Christopher G Kemp, Brooke A Jarrett, Churl-Su Kwon, Lanxin Song, Nathalie Jetté, Jaime C Sapag, Judith Bass, Laura Murray, Deepa Rao, Stefan Baral

Abstract

Background: Interventions to alleviate stigma are demonstrating effectiveness across a range of conditions, though few move beyond the pilot phase, especially in low- and middle-income countries (LMICs). Implementation science offers tools to study complex interventions, understand barriers to implementation, and generate evidence of affordability, scalability, and sustainability. Such evidence could be used to convince policy-makers and donors to invest in implementation. However, the utility of implementation research depends on its rigor and replicability. Our objectives were to systematically review implementation studies of health-related stigma reduction interventions in LMICs and critically assess the reporting of implementation outcomes and intervention descriptions.

Methods: PubMed, CINAHL, PsycINFO, and EMBASE were searched for evaluations of stigma reduction interventions in LMICs reporting at least one implementation outcome. Study- and intervention-level characteristics were abstracted. The quality of reporting of implementation outcomes was assessed using a five-item rubric, and the comprehensiveness of intervention description and specification was assessed using the 12-item Template for Intervention Description and Replication (TIDieR).

Results: A total of 35 eligible studies published between 2003 and 2017 were identified; of these, 20 (57%) used qualitative methods, 32 (91%) were type 1 hybrid effectiveness-implementation studies, and 29 (83%) were evaluations of once-off or pilot implementations. No studies adopted a formal theoretical framework for implementation research. Acceptability (20, 57%) and feasibility (14, 40%) were the most frequently reported implementation outcomes. The quality of reporting of implementation outcomes was low. The 35 studies evaluated 29 different interventions, of which 18 (62%) were implemented across sub-Saharan Africa, 20 (69%) focused on stigma related to HIV/AIDS, and 28 (97%) used information or education to reduce stigma. Intervention specification and description was uneven.

Conclusion: Implementation science could support the dissemination of stigma reduction interventions in LMICs, though usage to date has been limited. Theoretical frameworks and validated measures have not been used, key implementation outcomes like cost and sustainability have rarely been assessed, and intervention processes have not been presented in detail. Adapted frameworks, new measures, and increased LMIC-based implementation research capacity could promote the rigor of future stigma implementation research, helping the field deliver on the promise of stigma reduction interventions worldwide.

Keywords: Stigma; implementation science; intervention; low- and middle-income countries; systematic review.

Conflict of interest statement

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Figures

Fig. 1
Fig. 1
Continuum of study designs from effectiveness to implementation. As defined by Curran et al. [31]
Fig. 2
Fig. 2
PRISMA flow diagram

References

    1. Link BG, Phelan JC. Conceptualizing stigma. Ann Rev Sociol. 2001;27:363–385. doi: 10.1146/annurev.soc.27.1.363.
    1. Hatzenbuehler ML, Phelan JC, Link BG. Stigma as a fundamental cause of population health inequalities. Am J Public Health. 2013;103(5):813–821. doi: 10.2105/AJPH.2012.301069.
    1. Stangl AL, Lloyd JK, Brady LM, Holland CE, Baral S. A systematic review of interventions to reduce HIV-related stigma and discrimination from 2002 to 2013: how far have we come? J Int AIDS Soc. 2013;16(3 Suppl 2):18734. doi: 10.7448/IAS.16.3.18734.
    1. Thornicroft G, Mehta N, Clement S, Evans-Lacko S, Doherty M, Rose D, Koschorke M, Shidhaye R, O'Reilly C, Henderson C. Evidence for effective interventions to reduce mental-health-related stigma and discrimination. Lancet. 2016;387(10023):1123–32.
    1. Sermrittirong S, Van Brakel WH, Bunbers-Aelen JF. How to reduce stigma in leprosy–a systematic. Lepr Rev. 2014;85:149–157.
    1. Livingston JD, Milne T, Fang ML, Amari E. The effectiveness of interventions for reducing stigma related to substance use disorders: a systematic review. Addiction. 2012;107:39–50. doi: 10.1111/j.1360-0443.2011.03601.x.
    1. Birbeck G. Interventions to reduce epilepsy-associated stigma. Psychol Health Med. 2006;11(3):364–366. doi: 10.1080/13548500600595343.
    1. Sommerland N, Wouters E, Mitchell E, Ngicho M, Redwood L, Masquillier C, van Hoorn R, van den Hof S, Van Rie A. Evidence-based interventions to reduce tuberculosis stigma: a systematic review. Int J Tubercul Lung Dis. 2017;21(11):S81–S86. doi: 10.5588/ijtld.16.0788.
    1. Hickling FW, Robertson-Hickling H, Paisley V. Deinstitutionalization and attitudes toward mental illness in Jamaica: a qualitative study. Rev Panam Salud Publica. 2011;29(3):169–176.
    1. Shilling S, Bustamante JA, Salas A, Acevedo C, Cid P, Tapia T, Tapia E, Alvarado R, Sapag JC, Yang LH. Development of an intervention to reduce self-stigma in outpatient mental health service users in Chile. Rev Fac Cien Med Univ Nac Cordoba. 2016;72(4):284–294.
    1. Gronholm PC, Henderson C, Deb T, Thornicroft G. Interventions to reduce discrimination and stigma: the state of the art. Soc Psychiatry Psychiatr Epidemiol. 2017;52(3):249–258. doi: 10.1007/s00127-017-1341-9.
    1. Mak WW, Mo PK, Ma GY, Lam MY. Meta-analysis and systematic review of studies on the effectiveness of HIV stigma reduction programs. Soc Sci Med. 2017;188:30–40. doi: 10.1016/j.socscimed.2017.06.045.
    1. Bowleg L. The problem with the phrase women and minorities: intersectionality—an important theoretical framework for public health. Am J Public Health. 2012;102(7):1267–1273. doi: 10.2105/AJPH.2012.300750.
    1. Pfadenhauer LM, Gerhardus A, Mozygemba K, Lysdahl KB, Booth A, Hofmann B, Wahlster P, Polus S, Burns J, Brereton L. Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework. Implement Sci. 2017;12:21. doi: 10.1186/s13012-017-0552-5.
    1. Mascayano F, Armijo JE, Yang LH. Addressing stigma relating to mental illness in low-and middle-income countries. Front Psych. 2015;6:38.
    1. Becker AE, Kleinman A. Mental health and the global agenda. New Engl J Med. 2013;369:66–73. doi: 10.1056/NEJMra1110827.
    1. Saxena S, Thornicroft G, Knapp M, Whiteford H. Resources for mental health: scarcity, inequity, and inefficiency. Lancet. 2007;370(9590):878–889. doi: 10.1016/S0140-6736(07)61239-2.
    1. Thornicroft G, Alem A, Dos Santos RA, Barley E, Drake RE, Gregorio G, Hanlon C, Ito H, Latimer E, Law A. WPA guidance on steps, obstacles and mistakes to avoid in the implementation of community mental health care. World Psychiatry. 2010;9(2):67–77. doi: 10.1002/j.2051-5545.2010.tb00276.x.
    1. Beyrer C. Pushback: the current wave of anti-homosexuality laws and impacts on health. PLoS Med. 2014;11(6):e1001658. doi: 10.1371/journal.pmed.1001658.
    1. Brown RP, Imura M, Mayeux L. Honor and the stigma of mental healthcare. Personal Soc Psychol Bull. 2014;40(9):1119–1131. doi: 10.1177/0146167214536741.
    1. Eccles MP, Mittman BS. Welcome to implementation science. Implement Sci. 2006;1:1. doi: 10.1186/1748-5908-1-1.
    1. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implementation Sci. 2013;8:139. doi: 10.1186/1748-5908-8-139.
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, Proctor EK, Kirchner JE. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21. doi: 10.1186/s13012-015-0209-1.
    1. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76.
    1. Lewis CC, Fischer S, Weiner BJ, Stanick C, Kim M, Martinez RG. Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria. Implementation Sci. 2015;10:155. doi: 10.1186/s13012-015-0342-x.
    1. Lewis CC, Weiner BJ, Stanick C, Fischer SM. Advancing implementation science through measure development and evaluation: a study protocol. Implementation Sci. 2015;10:102. doi: 10.1186/s13012-015-0287-0.
    1. Tetroe J. Knowledge translation at the Canadian Institutes of Health Research: a primer. Focus Technical Brief. 2007;18:1–8.
    1. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. doi: 10.1186/1748-5908-4-50.
    1. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–1327. doi: 10.2105/AJPH.89.9.1322.
    1. Nilsen P. Making sense of implementation theories, models and frameworks. Implementation Sci. 2015;10:53. doi: 10.1186/s13012-015-0242-0.
    1. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care. 2012;50(3):217. doi: 10.1097/MLR.0b013e3182408812.
    1. Wells KB. Treatment research at the crossroads: the scientific interface of clinical trials and effectiveness research. Am J Psychiatry. 1999;156:5–10. doi: 10.1176/ajp.156.1.5.
    1. Cosby JL. Improving patient care: the implementation of change in clinical practice. Qual Saf Health Care. 2006;15(6):447. doi: 10.1136/qshc.2005.016824.
    1. Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychology. 2015;3:32. doi: 10.1186/s40359-015-0089-9.
    1. Proctor E, Luke D, Calhoun A, McMillen C, Brownson R, McCrary S, Padek M. Sustainability of evidence-based healthcare: research agenda, methodological advances, and infrastructure support. Implement Sci. 2015;10:88. doi: 10.1186/s13012-015-0274-5.
    1. Leykum LK, Pugh JA, Lanham HJ, Harmon J, McDaniel RR. Implementation research design: integrating participatory action research into randomized controlled trials. Implement Sci. 2009;4:69. doi: 10.1186/1748-5908-4-69.
    1. Moher D, Liberati A, Tetzlaff J, Altman DG, Group P Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. doi: 10.1371/journal.pmed.1000097.
    1. World Bank Country and Lending Groups. . Accessed 20 March 2018.
    1. Covidence Systematic Review Software. . Accessed 8 June 2018.
    1. Turan B, Hatcher AM, Weiser SD, Johnson MO, Rice WS, Turan JM. Framing mechanisms linking HIV-related stigma, adherence to treatment, and health outcomes. Am J Public Health. 2017;107(6):863–869. doi: 10.2105/AJPH.2017.303744.
    1. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, Barbour V, Macdonald H, Johnston M. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687. doi: 10.1136/bmj.g1687.
    1. Wilson PM, Sales A, Wensing M, Aarons GA, Flottorp S, Glidewell L, Hutchinson A, Presseau J, Rogers A, Sevdalis N. Enhancing the reporting of implementation research. Implement Sci. 2017;12:13. doi: 10.1186/s13012-017-0546-3.
    1. el-Setouhy MA, Rio F. Stigma reduction and improved knowledge and attitudes towards filariasis using a comic book for children. J Egyptian Soc Parasitol. 2003;33:55–65.
    1. Norr KF, Norr JL, McElmurry BJ, Tlou S, Moeti MR. Impact of peer group education on HIV prevention among women in Botswana. Health Care Women Int. 2004;25(3):210–226. doi: 10.1080/07399330490272723.
    1. Witter S, Were B. Breaking the silence: using memory books as a counselling and succession-planning tool with AIDS-affected households in Uganda. Afr J AIDS Res. 2004;3(2):139–143. doi: 10.2989/16085900409490328.
    1. Lawoyin OO. Findings from an HIV/AIDS programme for young women in two Nigerian cities: a short report. Afr J Reprod Health. 2007;11(2):99–106. doi: 10.2307/25549721.
    1. Boulay M, Tweedie I, Fiagbey E. The effectiveness of a national communication campaign using religious leaders to reduce HIV-related stigma in Ghana. Afr J AIDS Res. 2008;7:133–141. doi: 10.2989/AJAR.2008.7.1.13.441.
    1. Finkelstein J, Lapshin O, Wasserman E. Randomized study of different anti-stigma media. Patient Educ Couns. 2008;71(2):204–214. doi: 10.1016/j.pec.2008.01.002.
    1. Khumalo-Sakutukwa G, Morin SF, Fritz K, Charlebois ED, van Rooyen H, Chingono A, Modiba P, Mrumbi K, Visrutaratna S, Singh B, et al. Project Accept (HPTN 043): a community-based intervention to reduce HIV incidence in populations at risk for HIV in sub-Saharan Africa and Thailand. J Acquir Immune Defic Syndr. 2008;49(4):422–431. doi: 10.1097/QAI.0b013e31818a6cb5.
    1. Lapinski MK, Nwulu P. Can a short film impact HIV-related risk and stigma perceptions? Results from an experiment in Abuja, Nigeria. Health Commun. 2008;23(5):403–412. doi: 10.1080/10410230802342093.
    1. Pappas-DeLuca KA, Kraft JM, Galavotti C, Warner GL, Mooki M, Hastings P, Koppenhaver T, Roels TH, Kilmarx PH. Entertainment-education radio serial drama and outcomes related to HIV Testing in Botswana. AIDS Educ Prev. 2008;20(6):486–503. doi: 10.1521/aeap.2008.20.6.486.
    1. Zeelen J, Wijbenga H, Vintges M, de Jong G. Beyond silence and rumor: Storytelling as an educational tool to reduce the stigma around HIV/AIDS in South Africa. Health Educ. 2010;110(5):382–398. doi: 10.1108/09654281011068531.
    1. Gurnani V, Beattie TS, Bhattacharjee P, Mohan HL, Maddur S, Washington R, Isac S, Ramesh BM, Moses S, Blanchard JF. An integrated structural intervention to reduce vulnerability to HIV and sexually transmitted infections among female sex workers in Karnataka state, south India. BMC Public Health. 2011;11:755. doi: 10.1186/1471-2458-11-755.
    1. Watt MH, Aronin EH, Maman S, Thielman N, Laiser J, John M. Acceptability of a group intervention for initiates of antiretroviral therapy in Tanzania. Global Public Health. 2011;6(4):433–446. doi: 10.1080/17441692.2010.494162.
    1. Denison JA, Tsui S, Bratt J, Torpey K, Weaver MA, Kabaso M. Do peer educators make a difference? An evaluation of a youth-led HIV prevention model in Zambian Schools. Health Educ Res. 2012;27(2):237–247. doi: 10.1093/her/cyr093.
    1. Rice RE, Wu Z, Li L, Detels R, Rotheram-Borus MJ. Reducing STD/HIV stigmatizing attitudes through community popular opinion leaders in Chinese markets. Human. Commun Res. 2012;38(4):379–405. doi: 10.1111/j.1468-2958.2012.01436.x.
    1. Al-Iryani B, Basaleem H, Al-Sakkaf K, Kok G, van den Borne B. Process evaluation of school-based peer education for HIV prevention among Yemeni adolescents. SAHARA J. 2013;10:55–64.
    1. Catalani C, Castaneda D, Spielberg F. Development and assessment of traditional and innovative media to reduce individual HIV/AIDS-related stigma attitudes and beliefs in India. Front Public Health. 2013;1:21. doi: 10.3389/fpubh.2013.00021.
    1. Li L, Lin C, Guan J, Wu Z. Implementing a stigma reduction intervention in healthcare settings. J Int AIDS Soc. 2013;16(3 Suppl 2):18710. doi: 10.7448/IAS.16.3.18710.
    1. Li L, Wu Z, Liang LJ, Lin C, Guan J, Jia M, Rou K, Yan Z. Reducing HIV-related stigma in health care settings: a randomized controlled trial in China. Am J Public Health. 2013;103(2):286–292. doi: 10.2105/AJPH.2012.300854.
    1. Murray LK, Dorsey S, Skavenski S, Kasoma M, Imasiku M, Bolton P, Bass J, Cohen JA. Identification, modification, and implementation of an evidence-based psychotherapy for children in a low-income country: the use of TF-CBT in Zambia. Int J Mental Health Syst. 2013;7:24. doi: 10.1186/1752-4458-7-24.
    1. Murray LK, Familiar I, Skavenski S, Jere E, Cohen J, Imasiku M, Mayeya J, Bass JK, Bolton P. An evaluation of trauma focused cognitive behavioral therapy for children in Zambia. Child Abuse Neglect. 2013;37(12):1175–1185. doi: 10.1016/j.chiabu.2013.04.017.
    1. Murray LK, Skavenski S, Michalopoulos LM, Bolton PA, Bass JK, Familiar I, Imasiku M, Cohen J. Counselor and client perspectives of trauma-focused cognitive behavioral therapy for children in Zambia: a qualitative study. J Clin Child Adolesc Psychol. 2014;43(6):902–914. doi: 10.1080/15374416.2013.859079.
    1. French H, Greeff M, Watson MJ. Experiences of people living with HIV and people living close to them of a comprehensive HIV stigma reduction community intervention in an urban and a rural setting. SAHARA J. 2014;11:105–115. doi: 10.1080/17290376.2014.938104.
    1. French H, Greeff M, Watson MJ, Doak CM. A comprehensive HIV stigma-reduction and wellness-enhancement community intervention: a case study. JANAC. 2015;26:81–96.
    1. Shah SM, Heylen E, Srinivasan K, Perumpil S, Ekstrand ML. Reducing HIV stigma among nursing students: a brief intervention. Western J Nursing Res. 2014;36(10):1323–1337. doi: 10.1177/0193945914523685.
    1. Lusli M, Peters RM, Zweekhorst MB, Van Brakel WH, Seda FS, Bunders JF, Irwanto Lay and peer counsellors to reduce leprosy-related stigma--lessons learnt in Cirebon. Indonesia. Lepr Rev. 2015;86:37–53.
    1. Lusli M, Peters R, van Brakel W, Zweekhorst M, Iancu S, Bunders J, Irwanto, Regeer B. The impact of a rights-based counselling intervention to reduce stigma in people affected by leprosy in Indonesia. PLoS Negl Trop Dis. 2016;10(12):e0005088. doi: 10.1371/journal.pntd.0005088.
    1. Peters RM, Dadun, Zweekhorst MB, Bunders JF, Irwanto, van Brakel WH. A cluster-randomized controlled intervention study to assess the effect of a contact intervention in reducing leprosy-related stigma in Indonesia. PLoS Negl Trop Dis. 2015;9(10):e0004003. doi: 10.1371/journal.pntd.0004003.
    1. Peters RMH, Zweekhorst MBM, van Brakel WH, Bunders JFG, Irwanto ‘People like me don't make things like that’: participatory video as a method for reducing leprosy-related stigma. Global Public Health. 2016;11(5/6):666–682. doi: 10.1080/17441692.2016.1153122.
    1. Salmen CR, Hickey MD, Fiorella KJ, Omollo D, Ouma G, Zoughbie D, Salmen MR, Magerenge R, Tessler R, Campbell H, et al. “Wan Kanyakla” (We are together): community transformations in Kenya following a social network intervention for HIV care. Social Sci Med. 2015;147:332–340. doi: 10.1016/j.socscimed.2015.11.021.
    1. Figueroa ME, Poppe P, Carrasco M, Pinho MD, Massingue F, Tanque M, Kwizera A. Effectiveness of community dialogue in changing gender and sexual norms for HIV prevention: evaluation of the Tchova Tchova Program in Mozambique. J Health Commun. 2016;21(5):554–563. doi: 10.1080/10810730.2015.1114050.
    1. Tekle-Haimanot R, Pierre-Marie P, Daniel G, Worku DK, Belay HD, Gebrewold MA. Impact of an educational comic book on epilepsy-related knowledge, awareness, and attitudes among school children in Ethiopia. Epilepsy Behavior. 2016;61:218–223. doi: 10.1016/j.yebeh.2016.05.002.
    1. Tora A, Ayode D, Tadele G, Farrell D, Davey G, McBride CM. Interpretations of education about gene-environment influences on health in rural Ethiopia: the context of a neglected tropical disease. Int Health. 2016;8(4):253–260. doi: 10.1093/inthealth/ihw016.
    1. Wilson JW, Ramos JG, Castillo F, Castellanos EF, Escalante P. Tuberculosis patient and family education through videography in El Salvador. J Clin Tuberc Other Mycobact Dis. 2016;4:14–20. doi: 10.1016/j.jctube.2016.05.001.
    1. Lyons CE, Ketende S, Diouf D, Drame FM, Liestman B, Coly K, Ndour C, Turpin G, Mboup S, Diop K, et al. Potential impact of integrated stigma mitigation interventions in improving HIV/AIDS service delivery and uptake for key populations in senegal. J Acquir Immune Defic Syndr. 2017;74:S52–S59. doi: 10.1097/QAI.0000000000001209.
    1. Oduguwa AO, Adedokun B, Omigbodun OO. Effect of a mental health training programme on Nigerian school pupils’ perceptions of mental illness. Child Adolesc Psychiatry. Mental Health. 2017;11:19.
    1. Martinez RG, Lewis CC, Weiner BJ. Instrumentation issues in implementation science. Implement Sci. 2014;9:118. doi: 10.1186/s13012-014-0118-8.
    1. Chaudoir SR, Dugan AG, Barr CH. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8:22. doi: 10.1186/1748-5908-8-22.
    1. Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the consolidated framework for implementation research. Implement Sci. 2015;11:72. doi: 10.1186/s13012-016-0437-z.
    1. Keith RE, Crosson JC, O’Malley AS, Cromp D, Taylor EF. Using the consolidated framework for implementation research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation. Implement Sci. 2017;12:15. doi: 10.1186/s13012-017-0550-7.
    1. Klafke N, Mahler C, Wensing M, Schneeweiss A, Müller A, Szecsenyi J, Joos S. How the consolidated framework for implementation research can strengthen findings and improve translation of research into practice: a case study. Oncol Nursing Forum. 2017;2017:E223–E231. doi: 10.1188/17.ONF.E223-E231.
    1. Ilott I, Gerrish K, Booth A, Field B. Testing the Consolidated Framework for Implementation Research on health care innovations from South Yorkshire. J Eval Clin Pract. 2013;19(5):915–924.
    1. Kimberlin CL, Winterstein AG. Validity and reliability of measurement instruments used in research. Am J Health Syst Pharmacy. 2008;65(23):2276–2284. doi: 10.2146/ajhp070364.
    1. Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, Boynton MH, Halko H. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12:108. doi: 10.1186/s13012-017-0635-3.
    1. Luke DA, Calhoun A, Robichaux CB, Elliott MB, Moreland-Russell S. The Program Sustainability Assessment Tool: a new instrument for public health programs. Prev Chronic Dis. 2014;11:130184. doi: 10.5888/pcd11.130184.
    1. Instrumentation: Dissemination and Implementation Science Measures. . Accessed 2 March 2018.
    1. Kemp CG, Weiner BJ, Sherr KH, Kupfer LE, Cherutich PK, Wilson D, Geng E, Wasserheit J. Implementation science for integration of HIV and non-communicable disease services in sub-Saharan Africa: a systematic review. AIDS. 2018;32(Suppl 1):S93–S105. doi: 10.1097/QAD.0000000000001897.
    1. Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2:40. doi: 10.1186/1748-5908-2-40.
    1. Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:17. doi: 10.1186/1748-5908-7-17.
    1. Iwelunmor J, Blackstone S, Veira D, Nwaozuru U, Airhihenbuwa C, Munodawafa D, Kalipeni E, Jutal A, Shelley D, Ogedegbe G. Toward the sustainability of health interventions implemented in sub-Saharan Africa: a systematic review and conceptual framework. Implement Sci. 2015;11:43. doi: 10.1186/s13012-016-0392-8.
    1. Green LW, Glasgow RE. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Eval Health Prof. 2006;29:126–153. doi: 10.1177/0163278705284445.
    1. Riley BL, MacDonald J, Mansi O, Kothari A, Kurtz D, Edwards NC. Is reporting on interventions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars. Implement Sci. 2008;3:27. doi: 10.1186/1748-5908-3-27.
    1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. doi: 10.1136/bmj.a1655.
    1. Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:40. doi: 10.1186/1748-5908-4-40.
    1. Patel V, Belkin GS, Chockalingam A, Cooper J, Saxena S, Unützer J. Grand challenges: integrating mental health services into priority health care platforms. PLoS Med. 2013;10(5):e1001448. doi: 10.1371/journal.pmed.1001448.
    1. Bond V, Chase E, Aggleton P, Stigma HIV. AIDS and prevention of mother-to-child transmission in Zambia. Eval Program Planning. 2002;25(4):347–356. doi: 10.1016/S0149-7189(02)00046-0.
    1. Winestone LE, Bukusi EA, Cohen CR, Kwaro D, Schmidt NC, Turan JM. Acceptability and feasibility of integration of HIV care services into antenatal clinics in rural Kenya: a qualitative provider interview study. Global Public Health. 2012;7(2):149–163. doi: 10.1080/17441692.2011.621964.
    1. Lobb R, Colditz GA. Implementation science and its application to population health. Ann Rev Public Health. 2013;34:235–251. doi: 10.1146/annurev-publhealth-031912-114444.

Source: PubMed

Sponsorer og samarbejdspartnere

Medicinske tilstande

Narkotikainterventioner

3
Abonner