Improving Community Health Worker performance by using a personalised feedback dashboard for supervision: a randomised controlled trial

Caroline Whidden, Kassoum Kayentao, Jenny X Liu, Scott Lee, Youssouf Keita, Djoumé Diakité, Alexander Keita, Samba Diarra, Jacqueline Edwards, Amanda Yembrick, Isaac Holeman, Salif Samaké, Boureima Plea, Mama Coumaré, Ari D Johnson, Caroline Whidden, Kassoum Kayentao, Jenny X Liu, Scott Lee, Youssouf Keita, Djoumé Diakité, Alexander Keita, Samba Diarra, Jacqueline Edwards, Amanda Yembrick, Isaac Holeman, Salif Samaké, Boureima Plea, Mama Coumaré, Ari D Johnson

Abstract

Background: Countries across sub-Saharan Africa are scaling up Community Health Worker (CHW) programmes, yet there remains little high-quality research assessing strategies for CHW supervision and performance improvement. This randomised controlled trial aimed to determine the effect of a personalised performance dashboard used as a supervision tool on the quantity, speed, and quality of CHW care.

Methods: We conducted a randomised controlled trial in a large health catchment area in peri-urban Mali. One hundred forty-eight CHWs conducting proactive case-finding home visits were randomly allocated to receive individual monthly supervision with or without the CHW Performance Dashboard from January to June 2016. Randomisation was stratified by CHW supervisor, level of CHW experience, and CHW baseline performance for monthly quantity of care (number of household visits). With regression analysis, we used a difference-in-difference model to estimate the effect of the intervention on monthly quantity, timeliness (percentage of children under five treated within 24 hours of symptom onset), and quality (percentage of children under five treated without protocol error) of care over a six-month post-intervention period relative to a three-month pre-intervention period.

Results: Use of the Dashboard during monthly supervision significantly increased the mean number of home visits by 39.94 visits per month (95% CI = 3.56-76.3; P = 0.031). Estimated effects on secondary outcomes of timeliness and quality were positive but not statistically significant. Across both study arms, CHW quantity, timeliness, and quality of care significantly improved over the study period, during which time all CHWs received dedicated monthly supervision, although effects plateaued over time.

Conclusions: Our findings suggest that dedicated monthly supervision and personalised feedback using performance dashboards can increase CHW productivity. Further operational research is needed to understand how to sustain the performance improvements over time.

Trial registration: ClinicalTrials.gov (NCT03684551).

Conflict of interest statement

Competing interests: CW, KK, YK, DD, AK, and AJ declare grants from Child Relief International Foundation; KK declares grants from USAID Development Innovation Ventures. The authors have completed the Unified Competing Interest form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare no other conflicts of interest.

Figures

Figure 1
Figure 1
CONSORT diagram.
Figure 2
Figure 2
Timeline of the intervention and related research activities.
Figure 3
Figure 3
360 Supervision strategy.
Figure 4
Figure 4
CHW Performance Dashboard, English translation.
Figure 5
Figure 5
Mean quantity (left), timeliness (middle), and quality (right) performance trends during pre- (left of dotted line) and post-intervention (right of dotted line) periods for CHWs in the control and intervention arms.

References

    1. Lassi ZS, Bhutta ZA. Community-based intervention packages for reducing maternal and neonatal morbidity and mortality and improving neonatal outcomes. Cochrane Database Syst Rev. 2010;10:CD007754.
    1. Lewin S, Munabi-Babigumira S, Glenton C, Daniels K, Bosch-Capblanch X, van Wyk BE, et al. Lay health workers in primary and community health care for maternal and child health and the management of infectious diseases. Cochrane Database Syst Rev. 2010;17:CD004015.
    1. Okwundu CI, Nagpal S, Musekiwa A, Sinclair D. Home- or community-based programmes for treating malaria. Cochrane Database Syst Rev. 2013;5:CD009527.
    1. Rasanathan K, Muniz M, Bakshi S, Kumar M, Solano A. Community case management of childhood illness in sub-Saharan Africa - findings from a cross-sectional survey on policy and implementation. J Glob Health. 2014;4:020401.
    1. Lehmann U, Sanders D. Community health workers: What do we know about them? The state of the evidence on programmes, activities, costs and impact on health outcomes of using community health workers. Geneva: Evidence and Information for Policy, Department of Human Resources for Health, World Health Organization; 2007.
    1. Ofosu-Amaah V. National Experience in the Use of Community Health Workers: A Review of Current Issues and Problems. Geneva: World Health Organization; 1983.
    1. Bhattacharyya K, LeBan K, Winch P, Tien M. Community Health Worker Incentives and Disincentives: How they affect motivation, retention, and sustainability. Arlington, VA: Basic Support for Institutionalizing Child Survival Project (BASICS II) for the United States Agency for International Development; 2001.
    1. Kok MC, Muula AS. Motivation and job satisfaction of Health Surveillance Assistants in Mwanza, Malawi: an explorative study. Malawi Med J. 2013;25:5–11.
    1. Ndima SD, Sidat M, Give C, Ormel H, Kok MC, Taegtmeyer M. Supervision of community health workers in Mozambique: a qualitative study of factors influencing motivation and programme implementation. Hum Resour Health. 2015;13:63. doi: 10.1186/s12960-015-0063-x.
    1. Condo J, Mugeni C, Naughton B, Hall K, Tuazon MA, Omwega A, et al. Rwanda’s evolving community health worker system: a qualitative assessment of client and provider perspectives. Hum Resour Health. 2014;12:71. doi: 10.1186/1478-4491-12-71.
    1. Mathauer I, Imhoff I. Health worker motivation in Africa: the role of non-financial incentives and human resource management tools. Hum Resour Health. 2006;4:24. doi: 10.1186/1478-4491-4-24.
    1. Strachan DL, Kallander K, ten Asbroek AHA, Kirkwood B, Meek SR, Benton L, et al. Interventions to improve motivation and retention of Community Health Workers delivering Integrated Community Case Management (iCCM): Stakeholder perceptions and priorities. Am J Trop Med Hyg. 2012;87(5) Suppl:111–9. doi: 10.4269/ajtmh.2012.12-0030.
    1. Stekelenburg J, Kyanamina SS, Wolffers I. Poor performance of community health workers in Kalabo District, Zambia. Health Policy. 2003;65:109–18. doi: 10.1016/S0168-8510(02)00207-5.
    1. Hill Z, Dumbaugh M, Benton L, Källander K, Strachan D, ten Asbroek A, et al. Supervising community health workers in low-income countries–a review of impact and implementation issues. Glob Health Action. 2014;7:24085. doi: 10.3402/gha.v7.24085.
    1. Kok MC, Dieleman M, Taegtmeyer M, Broerse JEW, Kane SS, Ormel H, et al. Which intervention design factors influence performance of community health workers in low- and middle-income countries? A systematic review. Health Policy Plan. 2015;30:1207–27. doi: 10.1093/heapol/czu126.
    1. Munos M, Guiella G, Roberton T, Maďga A, Tiendrebeogo A, Tam Y, et al. Independent evaluation of the Rapid Scale-Up Program to reduce under-five mortality in Burkina Faso. Am J Trop Med Hyg. 2016;94:584–95. doi: 10.4269/ajtmh.15-0585.
    1. Amouzou A, Hazel E, Shaw B, Miller NP, Tafesse M, Mekonnen Y, et al. Effects of the integrated Community Case Management of Childhood Illness Strategy on child mortality in Ethiopia: A cluster randomized trial. Am J Trop Med Hyg. 2016;94:596–604. doi: 10.4269/ajtmh.15-0586.
    1. Amouzou A, Kanyuka M, Hazel E, Heidkamp R, Marsh A, Mleme T, et al. Independent evaluation of the integrated Community Case Management of Childhood Illness Strategy in Malawi using a National Evaluation Platform design. Am J Trop Med Hyg. 2016;94:574–83. doi: 10.4269/ajtmh.15-0584.
    1. Braun R, Catalani C, Wimbush J, Israelski D. Community health workers and mobile technology: A systematic review of the literature. PLoS One. 2013;8:e65772. doi: 10.1371/journal.pone.0065772.
    1. Källander K, Tibenderana JK, Akpogheneta OJ, Strachan DL, Hill Z, ten Asbroek AHA, et al. Mobile Health (mHealth) Approaches and Lessons for Increased Performance and Retention of Community Health Workers in Low- and Middle-Income Countries: A Review. J Med Internet Res. 2013;15:e17. doi: 10.2196/jmir.2130.
    1. Ballard M, Montgomery P. Systematic review of interventions for improving the performance of community health workers in low- income and middle-income countries. BMJ Open. 2017;7:e014216. doi: 10.1136/bmjopen-2016-014216.
    1. Rapport de la Distribution des Moustiquaires: Centre de Santé Communautaire Yirimadio, Mali. 2016.
    1. Johnson AD, Thiero O, Whidden C, Poudiougou B, Diakité D, Traoré F, et al. Proactive community case management and child survival in periurban Mali. BMJ Glob Health. 2018;3:e000634. doi: 10.1136/bmjgh-2017-000634.
    1. Holeman I, Cookson TP, Pagliari C. Digital technology for health sector governance in low and middle income countries: a scoping review. J Glob Health. 2016;6:020408. doi: 10.7189/jogh.06.020408.
    1. The PLOS Medicine Editors A Reality Checkpoint for Mobile Health: Three Challenges to Overcome. PLoS Med. 2013;10:e1001395. doi: 10.1371/journal.pmed.1001395.
    1. Phiri SC, Prust ML, Chibawe CP, Misapa R, van den Broek JW, Wilmink N. An exploration of facilitators and challenges in the scale-up of a national, public sector community health worker cadre in Zambia: a qualitative study. Hum Resour Health. 2017;15:40. doi: 10.1186/s12960-017-0214-3.
    1. Miller NP, Amouzou A, Hazel E, Legesse H, Degefie T, Tafesse M, et al. Assessment of the impact of quality improvement interventions on the quality of sick child care provided by Health Extension Workers in Ethiopia. J Glob Health. 2016;6:020404. doi: 10.7189/jogh.06.020404.
    1. Callaghan-Koru JA, Gilroy K, Hyder AA, George A, Nsona H, Mtimuni A, et al. Health systems supports for community case management of childhood illness: lessons from an assessment of early implementation in Malawi. BMC Health Serv Res. 2013;13:55. doi: 10.1186/1472-6963-13-55.
    1. Bhutta Z, Lassi Z, Pariyo G, Huicho L. Global Experience of Community Health Workers for Delivery of Health Related Millennium Development Goals: A Systematic Review, Country Case Studies, and Recommendations for Integration into National Health Systems. Geneva: Global Health Workforce Alliance/WHO; 2010.
    1. DeRenzi B, Wacksman J, Dell N, Lee S, Lesh N, Borriello G, et al. Closing the Feedback Loop: A 12-month Evaluation of ASTA, a Self-Tracking Application for ASHAs. Proceedings of the Eighth International Conference on Information and Communication Technologies and Development. 2016;22.

Source: PubMed

3
Abonner