Cost-effectiveness and economic returns of group-based parenting interventions to promote early childhood development: Results from a randomized controlled trial in rural Kenya

Italo Lopez Garcia, Uzaib Y Saya, Jill E Luoto, Italo Lopez Garcia, Uzaib Y Saya, Jill E Luoto

Abstract

Background: Early childhood development (ECD) programs can help address disadvantages for the 43% of children under 5 in low- and middle-income countries (LMICs) experiencing compromised development. However, very few studies from LMIC settings include information on their program's cost-effectiveness or potential returns to investment. We estimated the cost-effectiveness, benefit-cost ratios (BCRs), and returns on investment (ROIs) for 2 effective group-based delivery models of an ECD parenting intervention that utilized Kenya's network of local community health volunteers (CHVs).

Methods and findings: Between October 1 and November 12, 2018, 1,152 mothers with children aged 6 to 24 months were surveyed from 60 villages in rural western Kenya. After baseline, villages were randomly assigned to one of 3 intervention arms: a group-only delivery model with 16 fortnightly sessions, a mixed-delivery model combining 12 group sessions with 4 home visits, and a control group. At endline (August 5 to October 31, 2019), 1,070 children were retained and assessed for primary outcomes including cognitive and receptive language development (with the Bayley Scales of Infant Development, Third Edition) and socioemotional development (with the Wolke scale). Children in the 2 intervention arms showed better developmental outcomes than children in the control arm, although the group-only delivery model generally had larger effects on children. Total program costs included provider's implementation costs collected during the intervention period using financial reports from the local nongovernmental organization (NGO) implementer, as well as societal costs such as opportunity costs to mothers and delivery agents. We combined program impacts with these total costs to estimate incremental cost-effectiveness ratios (ICERs), as well as BCRs and the program's ROI for the government based on predictions of future lifetime wages and societal costs. Total costs per child were US$140 in the group-only arm and US$145 in the mixed-delivery arm. Because of higher intention-to-treat (ITT) impacts at marginally lower costs, the group-only model was the most cost-effective across all child outcomes. Focusing on child cognition in this arm, we estimated an ICER of a 0.37 standard deviation (SD) improvement in cognition per US$100 invested, a BCR of 15.5, and an ROI of 127%. A limitation of our study is that our estimated BCR and ROI necessarily make assumptions about the discount rate, income tax rates, and predictions of intervention impacts on future wages and schooling. We examine the sensitivity of our results to these assumptions.

Conclusions: To the best of our knowledge, this study is the first economic evaluation of an effective ECD parenting intervention targeted to young children in sub-Saharan Africa (SSA) and the first to adopt a societal perspective in calculating cost-effectiveness that accounts for opportunity costs to delivery agents and program participants. Our cost-effectiveness and benefit-cost estimates are higher than most of the limited number of prior studies from LMIC settings providing information about costs. Our results represent a strong case for scaling similar interventions in impoverished rural settings, and, under reasonable assumptions about the future, demonstrate that the private and social returns of such investments are likely to largely outweigh their costs.

Trial registration: This trial is registered at ClinicalTrials.gov, NCT03548558, June 7, 2018. American Economic Association RCT Registry trial AEARCTR-0002913.

Conflict of interest statement

The authors have declared that no competing interests exist.

References

    1. Britto PR, Lye SJ, Proulx K, Yousafzai AK, Matthews SG, Vaivada T, et al.. Nurturing care: promoting early childhood development. Lancet. 2017;389(10064):91–102. doi: 10.1016/S0140-6736(16)31390-3
    1. Black MM, Walker SP, Fernald LCH, Andersen CT, DiGirolamo AM, Lu C, et al.. Early childhood development coming of age: science through the life course. Lancet [Internet]. 2017;389(10064):77–90. Available from: doi: 10.1016/S0140-6736(16)31389-7
    1. Aboud FE, Yousafzai AK. Global health and development in early childhood. Annu Rev Psychol. 2015;66:433–57. doi: 10.1146/annurev-psych-010814-015128
    1. Jeong J, Franchett E, Yousafzai AK. World Health Organization Recommendations on Caregiving Interventions to Support Early Child Development in the First Three Years of Life: Report on the Systematic Review of Evidence [Internet]. Geneva; 2018. Available from:
    1. Tomlinson M, Darmstadt GL, Yousafzai AK, Daelmans B, Britto P, Gordon SL, et al.. Global research priorities to accelerate programming to improve early childhood development in the sustainable development era: a CHNRI exercise. J Glob Health. 2019;9(3):020703. doi: 10.7189/jogh.09.020703
    1. Alderman H, Behrman JR, Grantham-McGregor S, Lopez-Boo F, Urzua S. Economic perspectives on integrating early child stimulation with nutritional interventions. Ann N Y Acad Sci [Internet]. 2014Jan1;1308(1):129–38. doi: 10.1111/nyas.12331
    1. Jeong J, Pitchik HO, Yousafzai AK. Stimulation interventions and parenting in low-and middle-income countries: a meta-analysis. Pediatrics. 2018;141(4):e20173510. doi: 10.1542/peds.2017-3510
    1. Horton S, Black MM. Chapter 24. Identifying an Essential Package for Early Child Development: Economic Analysis. In: Bundy D, Nd S, Horton S, Al E, editors. Child and Adolescent Health and Development, 3rd ed [Internet]. 3rd ed. Washington DC: The International Bank for Reconstruction and Development; 2017. p. Chapter 24. Available from:
    1. World Health Organization, United Nations Children’s Fund, World Bank. Nurturing Care for Early Childhood Development: A Framework for Helping Children Survive and Thrive to Transform Health and Human Potential. Geneva; 2018.
    1. Richter LM, Daelmans B, Lombardi J, Heymann J, Boo FL, Behrman JR, et al.. Investing in the foundation of sustainable development: pathways to scale up for early childhood development. Lancet. 2016;389(10064):103–18. doi: 10.1016/S0140-6736(16)31698-1
    1. Gustafsson-Wright E, Boggild-Jones I. Measuring the cost of investing in early childhood interventions and applications of a standardized costing tool. Ann N Y Acad Sci. 2018;1419(1):74–89. doi: 10.1111/nyas.13679
    1. Sanders GD, Neumann PJ, Basu A, Brock DW, Feeny D, Krahn M, et al.. Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: second panel on cost-effectiveness in health and medicine. JAMA. 2016;316(10):1093–103. doi: 10.1001/jama.2016.12195
    1. Gowani S, Yousafzai AK, Armstrong R, Bhutta ZA. Cost effectiveness of responsive stimulation and nutrition interventions on early child development outcomes in Pakistan. Ann N Y Acad Sci [Internet]. 2014Jan1;1308(1):149–61. doi: 10.1111/nyas.12367
    1. Grantham-McGregor SM, Adya A, Attanasio OP, Augsburg B, Behrman JR, Caeyers B, et al.. Group sessions or home visits for early childhood development in India: A Cluster RCT. Pediatrics. 2020;146(6). doi: 10.1542/peds.2020-002725
    1. Luoto JE, Lopez Garcia I, Aboud FE, Singla DR, Fernald LCH, Pitchik HO, et al.. Group-based parenting interventions to promote child development in rural Kenya: a multi-arm, cluster-randomised community effectiveness trial. Lancet Glob Health. [Internet]. 2020Dec17;9(e309–19). doi: 10.1016/S2214-109X(20)30469-1
    1. Bayley N. Bayley scales of infant and toddler development. 3rd ed. San Antonio, TX: Pearson Psychological Corporation; 2006.
    1. Wolke D, Skuse D, Mathisen B. Behavioral style in failure-to-thrive infants: a preliminary communication. J Pediatr Psychol. 1990;15(2):237–54. doi: 10.1093/jpepsy/15.2.237
    1. Luoto JE, Lopez Garcia I, Aboud FE, Fernald LCH, Singla DR. Testing means to scale early childhood development interventions in rural Kenya: the Msingi Bora cluster randomized controlled trial study design and protocol. BMC Public Health [Internet]. 2019;19(1):259. doi: 10.1186/s12889-019-6584-9
    1. Luoto JE, Lopez Garcia I, Aboud FE, Singla DR, Zhu R, Otieno R, et al.. An Implementation Evaluation of A Group-Based Parenting Intervention to Promote Early Childhood Development in Rural Kenya. Front Public Heal [Internet]. 2021May5;9:653106. Available from: doi: 10.3389/fpubh.2021.653106
    1. Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al.. CHEERS: Consolidated Health Economic Evaluation Reporting Standards. Eur J Health Econ. 2013;14(3):367–72. doi: 10.1007/s10198-013-0471-6
    1. Bhula R, Mahoney M, Murphy K. Conducting cost effectiveness analysis [Internet]. J-Pal Costing Guidelines. Cambridge, MA; 2020. Available from:
    1. Evans DK, Popova A. Cost-Effectiveness Analysis in Development: Accounting for Local Costs and Noisy Impacts. World Dev. 2016;77(September):262–76.
    1. Vassall A, Sweeney S, Kahn J, Gomez Guillen G, Bollinger L, Marseille E, et al.. Reference case for estimating the costs of global health services and interventions [Internet]. Global Health Cost Consortium; 2017. Available from:
    1. Gustafsson-Wright E, Boggild-Jones I, Gardiner S. The Standardized Early Childhood Development Costing Tool (SECT) A Global Good to Increase and Improve Investments in Young Children. Washington DC; Brookings Institution, 2017.
    1. Conteh L, Walker D. Cost and unit cost calculations using step-down accounting. Health Policy Plan. 2004Mar;19(2):127–35. doi: 10.1093/heapol/czh015
    1. Republic of Kenya. Republic of Kenya Kenya Gazette Supplement; Senate Bills, 2020 [Internet]. Nairobi; 2018. Available from:
    1. Hamory J, Miguel E, Walker M, Kremer M, Baird S. Twenty-year economic impacts of deworming. Proc Natl Acad Sci U S A [Internet]. 2021Apr6;118(14):e2023185118. Available from: doi: 10.1073/pnas.2023185118
    1. Baird S, Hicks JH, Kremer M, Miguel E. Worms at Work: Long-run Impacts of a Child Health Investment. Q J Econ. 2016Nov;131(4):1637–80. doi: 10.1093/qje/qjw022
    1. Nandi A, Behrman JR, Bhalotra S, Deolalikar AB, Laxminarayan R. The Human Capital and Productivity Benefits of Early Childhood Nutritional Interventions. Dis Control Priorities. In: Child and Adolescent Health and Development. 3rd ed. Volume 8. 2017. p. 385–402.
    1. WHO. Life tables by country—Kenya [Internet].World Health Organization. 2020. [cited 2020 Sep 16]. Available from:
    1. Behrman JR, Bhalotra S, Deolalikar AB, Laxminarayan R, Nandi A. Chapter 22. Human capital and productivity benefits of early childhood nutritional interventions. In: The Non-Health Benefits of Early Childhood Interventions [Internet]. 3rd ed. Disease Control Priorities. Disease Control Priorities in Developing Countries-DCP3; 2015. Available from:
    1. Berlinski S, Schady N. More bang for the buck: investing in early childhood : The Early Years. Springer; 2015. p. 149–78.
    1. Engle PL, Fernald LC, Alderman H, Behrman J, O’Gara C, Yousafzai A, et al.. Strategies for reducing inequalities and improving developmental outcomes for young children in low-income and middle-income countries. Lancet [Internet]. 2011;378(9799):1339–53. Available from: doi: 10.1016/S0140-6736(11)60889-1
    1. Ernst & Young N. Kenya enacts significant tax measures for 2021 | EY—Global [Internet]. (Kenya). [cited 2021 May 28]. Available from:
    1. Jeong J, Pitchik HO, Fink G. Short-term, medium-term and long-term effects of early parenting interventions in low-and middle-income countries: A systematic review. BMJ Glob Health. 2021;6(3). doi: 10.1136/bmjgh-2020-004067
    1. Otchia CS, Yamada S. Reconciling heterogeneous results on the returns to skills in Africa. J Educ Work. 2019;32(5):484–99.
    1. Yousafzai AK, Rasheed MA, Rizvi A, Armstrong R, Bhutta ZA. Effect of integrated responsive stimulation and nutrition interventions in the Lady Health Worker programme in Pakistan on child development, growth, and health outcomes: a cluster-randomised factorial effectiveness trial. Lancet. 2014Oct;384(9950):1282–93. doi: 10.1016/S0140-6736(14)60455-4
    1. Walker SP, Powell C, Chang SM, Baker-Henningham H, Grantham-McGregor S, Vera-Hernandez M, et al.. Delivering parenting interventions through health services in the Caribbean: Impact, acceptability and costs. IDB Work Pap Ser No IDB-WP-642 [Internet]. 2015. Available from:
    1. Lopez Boo F, Palloni G, Urzua S. Cost-benefit analysis of a micronutrient supplementation and early childhood stimulation program in Nicaragua. Ann N Y Acad Sci. 2014;1308(1):139–48. doi: 10.1111/nyas.12368
    1. Glazner J, Bondy J, Luckey D, Olds D. Final Report To The Administration For Children And Families: Effect of the Nurse Family Partnership on Government Expenditures for Vulnerable First-Time Mothers And their Children in Elmira, New York, Memphis, Tennessee, and Denver, Colorado (# 90XP0017) [Internet]. Research and Evaluation. 2004. [cited 2021 Jul 27]. Available from: doi: 10.1177/1356389004046292
    1. Heckman JJ, Holland ML, Makino KK, Pinto R, Rosales-Rueda M. An Analysis of the Memphis Nurse-Family Partnership Program. NBER Work Pap. 2017;(23610 (July)). doi: 10.3386/w23610

Source: PubMed

3
Sottoscrivi