Impact of the Ananya program on reproductive, maternal, newborn and child health and nutrition in Bihar, India: early results from a quasi-experimental study

Gary L Darmstadt, Yingjie Weng, Kevin T Pepper, Victoria C Ward, Kala M Mehta, Evan Borkum, Jason Bentley, Hina Raheel, Anu Rangarajan, Debarshi Bhattacharya, Usha Kiran Tarigopula, Priya Nanda, Swetha Sridharan, Dana Rotz, Suzan L Carmichael, Safa Abdalla, Wolfgang Munar, Ananya Study Group, Yamini Atmavilas, Debarshi Bhattacharya, Jason Bentley, Evan Borkum, Suzan Carmichael, Indrajit Chaudhuri, Andreea Creanga, Gary L Darmstadt, Priyanka Dutt, Laili Irani, Tanmay Mahapatra, Kala M Mehta, Radharani Mitra, Wolfgang A Munar, Priya Nanda, Kevin T Pepper, Hina Raheel, Anu Rangarajan, Niranjan Saggurti, Padmapriya Sastry, New Delhi, Hemant Shah, Sridhar Srikantiah, Usha Kiran Tarigopula, Victoria Ward, Yingjie Weng, Dilys Walker, Jess Wilhelm, Gary L Darmstadt, Yingjie Weng, Kevin T Pepper, Victoria C Ward, Kala M Mehta, Evan Borkum, Jason Bentley, Hina Raheel, Anu Rangarajan, Debarshi Bhattacharya, Usha Kiran Tarigopula, Priya Nanda, Swetha Sridharan, Dana Rotz, Suzan L Carmichael, Safa Abdalla, Wolfgang Munar, Ananya Study Group, Yamini Atmavilas, Debarshi Bhattacharya, Jason Bentley, Evan Borkum, Suzan Carmichael, Indrajit Chaudhuri, Andreea Creanga, Gary L Darmstadt, Priyanka Dutt, Laili Irani, Tanmay Mahapatra, Kala M Mehta, Radharani Mitra, Wolfgang A Munar, Priya Nanda, Kevin T Pepper, Hina Raheel, Anu Rangarajan, Niranjan Saggurti, Padmapriya Sastry, New Delhi, Hemant Shah, Sridhar Srikantiah, Usha Kiran Tarigopula, Victoria Ward, Yingjie Weng, Dilys Walker, Jess Wilhelm

Abstract

Background: The Government of Bihar (GoB) in India, the Bill and Melinda Gates Foundation and several non-governmental organisations launched the Ananya program aimed to support the GoB to improve reproductive, maternal, newborn and child health and nutrition (RMNCHN) statewide. Here we summarise changes in indicators attained during the initial two-year pilot phase (2012-2013) of implementation in eight focus districts of approximately 28 million population, aimed to inform subsequent scale-up.

Methods: The quasi-experimental impact evaluation included statewide household surveys at two time points during the pilot phase: January-April 2012 ("baseline") including an initial cohort of beneficiaries and January-April 2014 ("midline") with a new cohort. The two arms were: 1) eight intervention districts, and 2) a comparison arm comprised of the remaining 30 districts in Bihar where Ananya interventions were not implemented. We analysed changes in indicators across the RMNCHN continuum of care from baseline to midline in intervention and comparison districts using a difference-in-difference analysis.

Results: Indicators in the two arms were similar at baseline. Overall, 40% of indicators (20 of 51) changed significantly from baseline to midline in the comparison districts unrelated to Ananya; two-thirds (n = 13) of secular indicator changes were in a direction expected to promote health. Statistically significant impact attributable to the Ananya program was found for 10% (five of 51) of RMNCHN indicators. Positive impacts were most prominent for mother's behaviours in contraceptive utilisation.

Conclusions: The Ananya program had limited impact in improving health-related outcomes during the first two-year period covered by this evaluation. The program's theories of change and action were not powered to observe statistically significant differences in RMNCHN indicators within two years, but rather aimed to help inform program improvements and scale-up. Evaluation of large-scale programs such as Ananya using theory-informed, equity-sensitive (including gender), mixed-methods approaches can help elucidate causality and better explain pathways through which supply- and demand-side interventions contribute to changes in behaviour among the actors involved in the production of population-level health outcomes. Evidence from Bihar indicates that deep structural constraints in health system organisation and delivery of interventions pose substantial limitations on behaviour change among health care providers and beneficiaries.

Study registration: ClinicalTrials.gov number NCT02726230.

Conflict of interest statement

Competing interests: The authors have completed the ICMJE Unified Competing Interest form (available on request from the corresponding author) and declare no conflict of interest.

Copyright © 2020 by the Journal of Global Health. All rights reserved.

Figures

Figure 1
Figure 1
Forest plot for difference-in-difference estimators for reproductive, maternal, newborn and child health and nutrition indicators across the continuum of care for Ananya program focus (intervention) and comparison districts at baseline (2012) and at midline (2014), Bihar, India, Mathematica data from maternal respondents with infants 0-11 months old. ANC – antenatal care, BCG – Bacillus Calmette-Guérin, DPT – diphtheria-pertussis-tetanus, FLW – frontline worker, IFA – iron-folic acid, IUD – intrauterine device, JSY – Janani Avam Bal Suraksha Yojana.

References

    1. Bitton A, Ratcliffe HL, Veillard JH, Kress DH, Barkley S, Kimball M, et al. Primary health care as a foundation for strengthening health systems in low- and middle-income countries. J Gen Intern Med. 2017;32:566-71. 10.1007/s11606-016-3898-5
    1. World Health Organization. Delivering quality health services: a global imperative for universal health coverage. Geneva: WHO; 2018.
    1. Alshamsan R, Lee JT, Rana S, Areabi H, Millett C.Comparative health system performance in six middle-income countries: cross-sectional analysis using World Health Organization study of global ageing and health. J R Soc Med. 2017;110:365-75. 10.1177/0141076817724599
    1. Das J, Holla A, Mohpal A, Muralidharan K.Quality and accountability in health care delivery: Audit-study evidence from primary care in India. Am Econ Rev. 2016;106:3765-99. 10.1257/aer.20151138
    1. Kruk ME, Gage AD, Arsenault C, Jordan K, Leslie HH, Roder-DeWan S, et al. High-quality health systems in the Sustainable Development Goals era: time for a revolution. Lancet Glob Health. 2018;6:e1196-252. 10.1016/S2214-109X(18)30386-3
    1. Bhutta ZA, Chopra M, Axelson H, Berman P, Boerma T, Bryce J, et al. Countdown to 2015 decade report (2000-10): taking stock of maternal, newborn, and child survival. Lancet. 2010;375:2032-44. 10.1016/S0140-6736(10)60678-2
    1. Burstein R, Henry NJ, Collison ML, Marczak LB, Sligar A, Watson S, et al. Mapping 123 million neonatal, infant and child deaths between 2000 and 2017. Nature. 2019;574:353-8. 10.1038/s41586-019-1545-0
    1. Countdown to 2030 Collaboration Countdown to 2030: tracking progress towards universal coverage for reproductive, maternal, newborn, and child health. Lancet. 2018;391:1538-48. 10.1016/S0140-6736(18)30104-1
    1. Arsenault C, Jordan K, Lee D, Dinsa G, Manzi F, Marchant T, et al. Equity in antenatal care quality: an analysis of 91 national household surveys. Lancet Glob Health. 2018;6:e1186-95. 10.1016/S2214-109X(18)30389-9
    1. Barros AJ, Ronsmans C, Axelson H, Loaiza E, Bertoldi AD, França GV, et al. Equity in maternal, newborn, and child health interventions in Countdown to 2015: a retrospective review of survey data from 54 countries. Lancet. 2012;379:1225-33. 10.1016/S0140-6736(12)60113-5
    1. Schleiff M, Kumapley R, Freeman PA, Gupta S, Rassekh BM, Perry HB.Comprehensive review of the evidence regarding the effectiveness of community-based primary health care in improving maternal, neonatal and child health: 5. equity effects for neonates and children. J Glob Health. 2017;7:010905. 10.7189/jogh.07.010905
    1. Gupta I, Chowdhury S, Prinja S, Prinja S, Trivedi M.Out-of-pocket spending on out-patient care in India: assessment and options based on results from a district level survey. PLoS One. 2016;11:e0166775. 10.1371/journal.pone.0166775
    1. Darmstadt GL, Pepper KT, Ward VC, Srikantiah S, Mahapatra T, Tarigopula UK, et al. Improving primary health care delivery in Bihar, India: Learning from piloting and statewide scale-up of Ananya. J Glob Health. 2020;10:021001 .10.7189/jogh.10.021001
    1. Jennings MC, Pradhan S, Schleiff M, Sacks E, Freeman PA, Gupta S, et al. Comprehensive review of the evidence regarding the effectiveness of community–based primary health care in improving maternal, neonatal and child health: 2. maternal health findings. J Glob Health. 2017;7:010902. 10.7189/jogh.07.010902
    1. Sacks E, Freeman P, Sakyi K, Jennings MC, Rassekh BM, Gupta S, et al. Comprehensive review of the evidence regarding the effectiveness of community-based primary health care in improving maternal, neonatal and child health: 3. neonatal health findings. J Glob Health. 2017;7:010903. 10.7189/jogh.07.010903
    1. Freeman PA, Schleiff M, Sacks E, Rassekh BM, Gupta S, Perry HB.Comprehensive review of the evidence regarding the effectiveness of community-based primary health care in improving maternal, neonatal and child health: 4. child health findings. J Glob Health. 2017;7:010904. 10.7189/jogh.07.010904
    1. Perry HB, Rassekh B, Gupta S, Kumapley R, Gupta S, Rassekh BM, et al. Comprehensive review of the evidence regarding the effectiveness of community-based primary health care in improving maternal, neonatal and child health: 6. strategies used by effective projects. J Glob Health. 2017;7:010906. 10.7189/jogh.07.010906
    1. Perry HB, Rassekh B, Gupta S, Freeman PA.Comprehensive review of the evidence regarding the effectiveness of community-based primary health care in improving maternal, neonatal and child health: 7. programs with evidence of long-term impact on mortality in children younger than five years of age. J Glob Health. 2017;7:010907. 10.7189/jogh.07.010907
    1. Carmichael SL, Mehta K, Raheel H, Srikantiah S, Chaudhuri I, Trehan S, et al. Effects of team-based goals and non-monetary incentives on frontline health worker performance and maternal health behaviors in Bihar, India: a cluster randomised controlled trial. BMJ Glob Health. 2019;4:e001146. 10.1136/bmjgh-2018-001146
    1. Carmichael SL, Mehta K, Srikantiah S, Mahapatra T, Chaudhuri I, Balakrishnan R, et al. Use of mobile technology by frontline health workers to promote reproductive, maternal, newborn and child health and nutrition: a cluster randomised controlled trial in Bihar, India. J Glob Health. 2019;9:020424. 10.7189/jogh.09.020424
    1. Story WT, LeBan K, Altobelli LC, Gebrian B, Hossain J, Lewis J, et al. Institutionalizing community-focused maternal, newborn, and child health strategies to strengthen health systems: A new framework for the Sustainable Development Goal era. Global Health. 2017;13:37. 10.1186/s12992-017-0259-z
    1. Bailey C, Blake C, Schriver M, Cubaka VK, Thomas T, Martin Hilber A.A systematic review of supportive supervision as a strategy to improve primary healthcare services in Sub-Saharan Africa. Int J Gynaecol Obstet. 2016;132:117-25. 10.1016/j.ijgo.2015.10.004
    1. Baqui AH, El-Arifeen S, Darmstadt GL, Saifuddin A, Williams EK, Seraji HR, et al. Effect of community-based newborn-care intervention package implemented through two service-delivery strategies in Sylhet district, Bangladesh: a cluster-randomised controlled trial. Lancet. 2008;371:1936-44. 10.1016/S0140-6736(08)60835-1
    1. Grilli R, Ramsay C, Minozzi S.Mass media interventions: effects on health services utilisation. Cochrane Database Syst Rev. 2002;CD000389. 10.1002/14651858.CD000389
    1. Head R, Murray J, Sarrassat S, et al. Can mass media interventions reduce child mortality? Lancet. 2015;386:97-100. 10.1016/S0140-6736(14)61649-4
    1. Schiffman J, Darmstadt GL, Agarwal S, Baqui AH.Community-based intervention packages for improving perinatal health in developing countries: a review of the evidence. Semin Perinatol. 2010;34:462-76. 10.1053/j.semperi.2010.09.008
    1. Lassi ZS, Bhutta ZA.Community-based intervention packages for reducing maternal and neonatal morbidity and mortality and improving neonatal outcomes. Cochrane Database Syst Rev. 2015;CD007754. 10.1002/14651858.CD007754.pub3
    1. Larson ARL, Ricca J. Lessons Learned from a Preliminary Analysis of the Scale-Up Experience of Six High-Impact Reproductive, Maternal, Newborn, and Child Health (RMNCH) Interventions. Baltimore, MD: Jhpiego; 2014.
    1. MCHIP End-of-Project Report: United States Agency for International Development 2015.
    1. Barker PM, Reid A, Schall MW.A framework for scaling up health interventions: lessons from large-scale improvement initiatives in Africa. Implement Sci. 2016;11:12. 10.1186/s13012-016-0374-x
    1. Bradley EH, Curry LA, Taylor LA, Wood Pallas S, Talbert-Slagle K, Yuan C, et al. A model for scale up of family health innovations in low-income and middle-income settings: a mixed methods study. BMJ Open. 2012;2:e000987. 10.1136/bmjopen-2012-000987
    1. Yamey G.Scaling up global health interventions: a proposed framework for success. PLoS Med. 2011;8:e1001049. 10.1371/journal.pmed.1001049
    1. Paina L, Peters DH.Understanding pathways for scaling up health services through the lens of complex adaptive systems. Health Policy Plan. 2012;27:365-73. 10.1093/heapol/czr054
    1. Simmons R, Shiffman J. Scaling up health service innovations: a framework for action. In: R. Simmons PF, and L. Ghiron, ed. Geneva: WHO and ExpandNet, 2007.
    1. Baqui A, Williams EK, Rosecrans AM, Agrawal PK, Ahmed S, Darmstadt GL, et al. Impact of an integrated nutrition and health programme on neonatal mortality in rural northern India. Bull World Health Organ. 2008;86:796-804. 10.2471/BLT.07.042226
    1. Acharya A, Lalwani T, Dutta R, Knoll Rajaratnam J, Ruducha J, Varkey LC, et al. Evaluating a large-scale community-based intervention to improve pregnancy and newborn health among the rural poor in India. Am J Public Health. 2015;105:144-52. 10.2105/AJPH.2014.302092
    1. Abdalla S, Weng Y, Mehta KM, Srikantiah S, Mahapatra T, Shah H, et al. Trends in reproductive, maternal, newborn and child health and nutrition indicators during five years of piloting and scaling-up of Ananya interventions in Bihar, India. J Glob Health. 2020;10:021003 .10.7189/jogh.10.021003
    1. Ward VC, Raheel H, Weng Y, Mehta KM, Dutt P, Mitra R, et al. Impact of mHealth interventions for maternal and child health at scale: BBC Media Action and the Ananya program in Bihar, India. J Glob Health. 2020;10:021005 .10.7189/jogh.10.021005
    1. Creanga AA, Srikantiah S, Mahapatra T, Das A, Sonthalia S, Maharana PR, et al. Statewide implementation of a quality improvement initiative for reproductive, maternal, nedwborn, and child health in Bihar, India. J Glob Health. 2020;10:021008 .10.7189/jogh.10.021008
    1. Creanga AA, Jiwani S, Das A, Mahapatra T, Sonthalia S, Gore A, et al. Using a mobile nurse mentoring and training program to address a health workforce capacity crisis in Bihar, India: Impact on essential intrapartum and newborn care practices. J Glob Health. 2020;10:021009 .10.7189/jogh.10.021009
    1. Borkum E, Rangarajan A, Rotz D, Sridharan S, Sethi S, Manoranjini M, Ramakrishnan L. Midline Findings from the Evaluation of the Ananya Program in Bihar. Final report submitted to the Bill & Melinda Gates Foundation. Princeton, NJ: Mathematica, December 2014.
    1. Dimick JB, Ryan AM.Methods for evaluating changes in health care policy: the difference-in-differences approach. JAMA. 2014;312:2401-2. 10.1001/jama.2014.16153
    1. Dandona R, Pandey A, Dandona L.A review of national health surveys in India. Bull World Health Organ. 2016;94:286. 10.2471/BLT.15.158493
    1. StataCorp. 2015. Stata Statistical Software: Release 14. College Station, TX: StataCorp LP.
    1. R Core Team R. A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. 2017. Available: . Accessed: 2 February 2020.
    1. Wickham H. ggplot2: Elegant Graphics for Data Analysis. New York: Springer-Verlag; 2009.
    1. Benjamini Y, Hochberg Y.Controlling the False Discovery Rate: A practical and powerful approach to multiple testing. J R Stat Soc B. 1995;57:289-300. 10.1111/j.2517-6161.1995.tb02031.x
    1. Mehta KM, Irani L, Chaudhuri I, Mahapatra T, Schooley J, Srikantiah S, et al. Health impact of self-help groups scaled up statewide in Bihar, India. J Glob Health. 2020;10:021006 10.7189/jogh.10.021006
    1. Mehta KM, Irani L, Chaudhuri I, Mahapatra T, Schooley J, Srikantiah S, et al. Health layering of self-help groups: impacts on reproductive, maternal, newborn and child health and nutrition in Bihar, India. J Glob Health. 2016;10:021007 .10.7189/jogh.10.021007
    1. Uttekar BP, Kumar N, Uttekar V, Sharma J, Shahane S. Assessment of Janani avam Bal Suraksha Yojana in Bihar. UNICEF. 2008. Available: . Accessed: 2 February 2020.
    1. Wahid SS, Munar W, Das S, Gupta M, Darmstadt GL.“Our village is dependent on us. That’s why we can’t leave our work.” Characterising mechanisms of motivation to perform among Accredited Social Health Activists (ASHA) in Bihar. Health Policy Plan. 2020;35:58-66.
    1. Veillard J, Cowling K, Bitton A, et al. Better Measurement for Performance Improvement in Low- and Middle-Income Countries: The Primary Health Care Performance Initiative (PHCPI) Experience of Conceptual Framework Development and Indicator Selection. Milbank Q. 2017;95:836-83. 10.1111/1468-0009.12301
    1. Munar W, Snilstveit B, Aranda LE, Biswas N, Baffour T, Stevenson J.Evidence gap map of performance measurement and management in primary healthcare systems in low-income and middle-income countries. BMJ Glob Health. 2019;4:e001451. 10.1136/bmjgh-2019-001451
    1. Bennett S, Agyepong IA, Sheikh K, Hanson K, Ssengooba F, Gilson L.Building the field of health policy and systems research: an agenda for action. PLoS Med. 2011;8:e1001081. 10.1371/journal.pmed.1001081
    1. Realist Evaluation – Better Evaluation Available: . Accessed: 2 February 2020.
    1. Atun R.Health systems, systems thinking and innovation. Health Policy Plan. 2012;27 Suppl 4:iv4-8. 10.1093/heapol/czs088
    1. Sheikh K, Gilson L, Agyepong IA, Hanson K, Ssengooba F, Bennett S.Building the field of health policy and systems research: framing the questions. PLoS Med. 2011;8:e1001073. 10.1371/journal.pmed.1001073
    1. Saprii L, Richards E, Kokho P, Theobald S.Community health workers in rural India: analysing the opportunities and challenges Accredited Social Health Activists (ASHAs) face in realising their multiple roles. Hum Resour Health. 2015;13:95. 10.1186/s12960-015-0094-3
    1. Heise L, Greene ME, Opper N, et al. Gender inequality and restrictive gender norms: framing the challenges to health. Lancet. 2019;393:2440-54. 10.1016/S0140-6736(19)30652-X
    1. Ward VC, Weng Y, Bentley J, Carmichael SL, Mehta KM, Mahmood W, et al. Evaluation of a large-scale reproductive, maternal, newborn and child health and nutrition program in Bihar, India through an equity lens. J Glob Health. 2020;10:021011 .10.7189/jogh.10.021011

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe