Impact Evaluation of the Nigeria Result-Based Financing Project

Impact Evaluation of the Nigeria State Health Program Investment Credit (NSHPIC)

The World Bank and the government of Nigeria are implementing a results-based financing (RBF) project for the states of Nasarawa, Adamawa, and Ondo. This project provides incentives for improving performance at critical levels within the Nigerian health system and aims to address some of these challenges. The primary goal of the impact evaluation of this project is to determine if providing financial incentives linked directly to performance increases the quantity and quality of maternal and child health (MCH) services.

In each of the three selected States,the project finances the following interventions:

1. Performance incentives to State Government and Local Government (LGA) agencies that are triggered by Disbursement Linked Indicators (DLIs) that reflect strengthened supervision and enhanced operational support for improving health systems performance. These performance incentives would be paid out on an annual basis.
2. In half of the LGAs in each state, one facility per ward will receive Performance-Based Financing (PBF) wherein payments are made directly to individual health facilities based on the quantity and quality of a set of pre-defined services provided by each facility. These performance incentives would be paid out on a quarterly basis.
3. In the other half of the LGAs in each state one facility per ward will receive Decentralized Facility Financing (DFF) or equivalent financing that is not be linked to any service delivery targets. These payments would be made on a quarterly basis.

The evaluation of the PBF arm, which consists of making payments to health facilities conditional on performance, but within an environment of comparable levels of overall financing, will rely on experimental assignment. The effect of the PBF intervention will be identified by comparing outcomes in the LGAs receiving PBF versus those receiving DFF in the three project states. In each of these three States, the LGAs will be randomly assigned to either the PBF package or to the DFF package.

Study Overview

• Status: Unknown
• Conditions: Maternal Care Patterns
• Intervention / Treatment: Behavioral: Performance-Based Financing; Behavioral: Decentralized Facility Financing

Detailed Description

A detailed description can be found in the attached project concept note.

• Study Type: Interventional
• Enrollment (Actual): 74
• Phase: Not Applicable

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 18 years to 65 years (ADULT, OLDER_ADULT)
• Accepts Healthy Volunteers: Yes
• Genders Eligible for Study: All

Description

Inclusion Criteria:

1. All health facility staff in the states of Nasarawa, Adamawa and Ondo attending to maternity patients in the study period.
2. Selected mothers recently utilizing the same facilities if consent is provided.

Exclusion Criteria:

1. None.

Study Plan

How is the study designed?

Design Details

• Primary Purpose: HEALTH_SERVICES_RESEARCH
• Allocation: RANDOMIZED
• Interventional Model: PARALLEL
• Masking: NONE

Number of Arms

3

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
EXPERIMENTAL: Performance-Based Financing; At least one primary healthcare centre per ward and one General Hospital per selected LGA (in 50% of LGAs in each of the 3 states) and one secondary hospital per State will be contracted by the State Primary Health Care Development Agency ) , to deliver specified services at an agreed price. Selection of which services to focus on is based on priorities identified by the Federal Government of Nigeria and the states in 2010-2015. Initial prices for each service were based on shadow prices of providing the service and have been adjusted based on implementation experience.	Behavioral: Performance-Based Financing; Incentive-based payments
EXPERIMENTAL: Decentralized Facility Financing; In the other half of the LGA's in each treated state, at least one facility per ward will receive Decentralized Facility Financing (DFF) or equivalent financing that is not be linked to any service delivery targets. These payments would be made on a quarterly basis.	Behavioral: Decentralized Facility Financing; Financing not linked to service delivery.
NO_INTERVENTION: Control; This is a pure control arm with no additional interventions.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Utilization of priority maternal and child health services	The utilization of priority MCH services, as defined by the quantitative checklist used by the project to measure and reward facility performance.	Each health facility assessed over a period of two days.

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Utilization of priority maternal and child health services, particularly by the poor	The utilization of priority MCH services, as defined by the quantitative checklist used by the project to measure and reward facility performance, by poor households.	Each health facility assessed over a period of two days.
Aggregated Provider Performance through Direct Clinical Observation	We use data on direct clinical observations of labor and delivery to construct an aggregate measure of provider performance.	Each health provider assessed over a period of one day.
Aggregate Structural and Process Quality Index	The quantitative checklist used in the government program is replicated to a large degree in the impact evaluation survey. We construct independent observations on aggregate structural and process quality measures in the same fashion as the program has constructed and rewarded.	Each health facility assessed over a period of two days.

Collaborators and Investigators

• Sponsor: World Bank
• Investigators: Principal Investigator: Eeshani Kandpal, PhD, World Bank

Publications and helpful links

General Publications

• Khanna M, Loevinsohn B, Pradhan E, Fadeyibi O, McGee K, Odutolu O, Fritsche GB, Meribole E, Vermeersch CMJ, Kandpal E. Decentralized facility financing versus performance-based payments in primary health care: a large-scale randomized controlled trial in Nigeria. BMC Med. 2021 Sep 21;19(1):224. doi: 10.1186/s12916-021-02092-4.

Study record dates

Study Major Dates

• Study Start (ACTUAL): August 20, 2013
• Primary Completion (ACTUAL): September 30, 2017
• Study Completion (ANTICIPATED): December 15, 2019

Study Registration Dates

• First Submitted: May 8, 2017
• First Submitted That Met QC Criteria: March 22, 2019
• First Posted (ACTUAL): March 26, 2019

Study Record Updates

• Last Update Posted (ACTUAL): March 26, 2019
• Last Update Submitted That Met QC Criteria: March 22, 2019
• Last Verified: March 1, 2019

More Information

Terms related to this study

• Other Study ID Numbers: P128175

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No