Measuring and understanding the effects of a performance based financing scheme applied to nutrition services in Burundi-a mixed method impact evaluation design

Manassé Nimpagaritse, Catherine Korachais, Dominique Roberfroid, Patrick Kolsteren, Moulay Driss Zine Eddine El Idrissi, Bruno Meessen, Manassé Nimpagaritse, Catherine Korachais, Dominique Roberfroid, Patrick Kolsteren, Moulay Driss Zine Eddine El Idrissi, Bruno Meessen

Abstract

Background: Malnutrition is a huge problem in Burundi. In order to improve the provision of services at hospital, health centre and community levels, the Ministry of Health is piloting the introduction of malnutrition prevention and care indicators within its performance based financing (PBF) scheme. Paying for units of services and for qualitative indicators is expected to enhance provision and quality of these nutrition services, as PBF has done, in Burundi and elsewhere, for several other services.

Methods: This paper presents the protocol for the impact evaluation of the PBF scheme applied to malnutrition. The research design consists in a mixed methods model adopting a sequential explanatory design. The quantitative component is a cluster-randomized controlled evaluation design: among the 90 health centres selected for the study, half receive payment related to their results in malnutrition activities, while the other half get a budget allocation. Qualitative research will be carried out both during the intervention period and at the end of the quantitative evaluation. Data are collected from 1) baseline and follow-up surveys of 90 health centres and 6,480 households with children aged 6 to 23 months, 2) logbooks filled in weekly in health centres, and 3) in-depth interviews and focus group discussions. The evaluation aims to provide the best estimate of the impact of the project on malnutrition outcomes in the community as well as outputs at the health centre level (malnutrition care outputs) and to describe quantitatively and qualitatively the changes that took place (or did not take place) within health centres as a result of the program.

Discussion: Although PBF schemes are blooming in low in-come countries, there is still a need for evidence, especially on the impact of revising the list of remunerated indicators. It is expected that this impact evaluation will be helpful for the national policy dialogue in Burundi, but it will also provide key evidence for countries with an existing PBF scheme and confronted with malnutrition problems on the appropriateness to extend the strategy to nutrition services.

Trial registration: ClinicalTrials.gov PRS Identifier: NCT02721160; registered March 2016.

Keywords: Burundi; Impact evaluation; Malnutrition; Mixed methods; Nutrition services; Performance-based financing; Research protocol.

Figures

Fig. 1
Fig. 1
The PBF Nutrition Scheme. ‘PBF Nut’ means ‘Under PBF Nutrition programme besides the existing PBF scheme’ while ‘Comp Nut’ means input based financing compensation besides the existing PBF scheme
Fig. 2
Fig. 2
Results chain of the introduction of nutrition criteria in the PBF grid
Fig. 3
Fig. 3
Gantt chart of the research

References

    1. World Health Organization. World Health Statistics 2010. Geneva: World Health Organization; 2010. Available at: .
    1. World Bank. World Development Indicators. , accessed in January 2016.
    1. Institut de Statistiques et d’Etudes Economiques du Burundi (ISTEEBU), Ministère de la Santé Publique et de la Lutte contre le Sida [Burundi] (MSPLS), ICF International. Enquête Démographique et de Santé Burundi 2010. Bujumbura, Burundi: ISTEEBU, MSPLS, et ICF International; 2012. Available at: .
    1. République du Burundi, Ministère de la Santé Publique et de la Lutte contre le Sida (MSPLS). Protocole national de prise en charge intégrée de la malnutrition aigüe globale. Bujumbura; 2010. Available at: .
    1. Basenya O, Nimpagaritse M, Busogoro F, Ndayishimiye J, Nkunzimana C, Ntahimpereye G, et al. Le Financement basé sur la performance comme stratégie pour améliorer la mise en oeuvre de la gratuité des soins: premières leçons de l’expérience du Burundi. PBF CoP Working Paper; 2011. Available at: .
    1. République du Burundi, Ministère de la Santé Publique et de la Lutte contre le Sida (MSPLS). Rapport de mise en œuvre du FBP et de la gratuité des soins pour l’année 2011. Bujumbura; 2012.
    1. Falisse J-B, Meessen B, Ndayishimiye J, Bossuyt M. Community participation and voice mechanisms under performance-based financing schemes in Burundi. Trop Med Int Heal. 2012;17:674–82. doi: 10.1111/j.1365-3156.2012.02973.x.
    1. Bonfrer I, Van de Poel E, Van Doorslaer E. The effects of performance incentives on the utilization and quality of maternal and child care in Burundi. Soc Sci Med. 2014;123:96–104. doi: 10.1016/j.socscimed.2014.11.004.
    1. Bonfrer I, Soeters R, Van de Poel E, Basenya O, Gashubije L, van de Looij F, van Doorslaer E. Introduction of performance-based financing in Burundi was associated with improvements in care and quality. Health Aff. 2014;33:2179–2187. doi: 10.1377/hlthaff.2014.0081.
    1. Falisse J-B, Ndayishimiye J, Kamenyero V, Bossuyt M. Performance-based financing in the context of selective free health-care: an evaluation of its effects on the use of primary health-care services in Burundi using routine data. Health Policy Plan. 2015;30:1251–1260. doi: 10.1093/heapol/czu132.
    1. Meessen B, Musango L, Kashala JPI, Lemlin J. Reviewing institutions of rural health centres: the performance initiative in Butare, Rwanda. Trop Med Int Heal. 2006;11:1303–1317. doi: 10.1111/j.1365-3156.2006.01680.x.
    1. Meessen B, Soucat A, Sekabaraga C. Performance-based financing: just a donor fad or a catalyst towards comprehensive health-care reform? Bull World Health Organ. 2011;89:153–156. doi: 10.2471/BLT.10.077339.
    1. Soeters R, Habineza C, Peerenboom PB. Performance-based financing and changing the district health system: experience from Rwanda. Bull World Health Organ. 2006;84:884–889.
    1. Witter S, Toonen J, Meessen B, Kagubare J, Fritsche G, Vaughan K. Performance-based financing as a health system reform: mapping the key dimensions for monitoring and evaluation. BMC Health Serv Res. 2013;13:367. doi: 10.1186/1472-6963-13-367.
    1. Eldridge C, Palmer N. Performance-based payment: some reflections on the discourse, evidence and unanswered questions. Health Policy Plan. 2009;24:160–166. doi: 10.1093/heapol/czp002.
    1. Basinga P, Mayaka S, Condo J. Performance-based financing: the need for more research. Bull World Health Organ. 2011;89:698–699. doi: 10.2471/BLT.11.089912.
    1. Witter S, Fretheim A, Kessy F, Lindahl A. Paying for performance to improve the delivery of health interventions in low- and middle-income countries (Cochrane Review). Cochrane Libr 2013:82
    1. République du Burundi, Ministère de la Santé Publique et de la Lutte contre le Sida (MSPLS). Note technique relative à l’intégration de la nutrition dans la stratégie nationale de financement basé sur la performance. Bujumbura; 2014. Available at: .
    1. Creswell JW, Plano Clark VL. Designing and Conducting Mixed Methods Research. London: Sage Publications Ltd; 2006.
    1. Ozawa S, Pongpirul K. 10 best resources on. mixed methods research in health systems. Health Policy Plan. 2014;29:323–327. doi: 10.1093/heapol/czt019.
    1. Borghi J, Mayumana I, Mashasi I, Binyaruka P, Patouillard E, Njau I, Maestad O, Abdulla S, Mamdani M. Protocol for the evaluation of a pay for performance programme in Pwani region in Tanzania: a controlled before and after study. Implement Sci. 2013;8:80. doi: 10.1186/1748-5908-8-80.
    1. Akwataghibe N, Samaranayake D, Lemiere C, Dieleman M. Assessing health workers’ revenues and coping strategies in Nigeria: a mixed-methods study. BMC Health Serv Res. 2013;13:387. doi: 10.1186/1472-6963-13-387.
    1. Ridde V, Turcotte-Tremblay A-M, Souares A, Lohmann J, Zombré D, Koulidiati JL, Yaogo M, Hien H, Hunt M, Zongo S, De Allegri M. Protocol for the process evaluation of interventions combining performance-based financing with health equity in Burkina Faso. Implement Sci. 2014;9:149. doi: 10.1186/s13012-014-0149-1.
    1. Brenner S, Muula AS, Robyn PJ, Bärnighausen T, Sarker M, Mathanga DP, Bossert T, De Allegri M. Design of an impact evaluation using a mixed methods model - an explanatory assessment of the effects of results-based financing mechanisms on maternal healthcare services in Malawi. BMC Health Serv Res. 2014;14:180. doi: 10.1186/1472-6963-14-180.
    1. Kaiser R, Woodruff BA, Bilukha O, Spiegel PB, Salama P. Using design effects from previous cluster surveys to guide sample size calculation in emergency settings. Disasters. 2006;30:199–211. doi: 10.1111/j.0361-3666.2006.00315.x.
    1. Hayes RJ, Bennett S. Simple sample size calculation for cluster-randomized trials. Int J Epidemiol. 1999;28:319–326. doi: 10.1093/ije/28.2.319.
    1. Bamberger M. Introduction to Mixed Methods in Impact Evaluation. 2012. Impact Evaluation Notes. InterAction. 2012;3:1-38. Available at: .

Source: PubMed

3
订阅