The impact of a direct to beneficiary mobile communication program on reproductive and child health outcomes: a randomised controlled trial in India

Amnesty Elizabeth LeFevre, Neha Shah, Kerry Scott, Sara Chamberlain, Osama Ummer, Jean Juste Harrisson Bashingwa, Arpita Chakraborty, Anna Godfrey, Priyanka Dutt, Rajani Ved, Diwakar Mohan, Kilkari Impact Evaluation Team, Smisha Agarwal, Salil Arora, Jean Jh Bashingwa, Aarushi Bhatanagar, Sara Chamberlain, Rakesh Chandra, Arpita Chakraborty, Neha Dumke, Priyanka Dutt, Anna Godfrey, Suresh Gopalakrishnan, Nayan Kumar, Simone Honikman, Alain Labrique, Amnesty LeFevre, Jai Mendiratta, Molly Miller, Radharani Mitra, Diwakar Mohan, Deshen Moodley, Nicola Mulder, Angela Ng, Dilip Parida, Nehru Penugonda, Sai Rahul, Shiv Rajput, Neha Shah, Kerry Scott, Aashaka Shinde, Aaditya Singh, Nicki Tiffin, Osama Ummer, Rajani Ved, Falyn Weiss, Sonia Whitehead, Amnesty Elizabeth LeFevre, Neha Shah, Kerry Scott, Sara Chamberlain, Osama Ummer, Jean Juste Harrisson Bashingwa, Arpita Chakraborty, Anna Godfrey, Priyanka Dutt, Rajani Ved, Diwakar Mohan, Kilkari Impact Evaluation Team, Smisha Agarwal, Salil Arora, Jean Jh Bashingwa, Aarushi Bhatanagar, Sara Chamberlain, Rakesh Chandra, Arpita Chakraborty, Neha Dumke, Priyanka Dutt, Anna Godfrey, Suresh Gopalakrishnan, Nayan Kumar, Simone Honikman, Alain Labrique, Amnesty LeFevre, Jai Mendiratta, Molly Miller, Radharani Mitra, Diwakar Mohan, Deshen Moodley, Nicola Mulder, Angela Ng, Dilip Parida, Nehru Penugonda, Sai Rahul, Shiv Rajput, Neha Shah, Kerry Scott, Aashaka Shinde, Aaditya Singh, Nicki Tiffin, Osama Ummer, Rajani Ved, Falyn Weiss, Sonia Whitehead

Abstract

Background: Direct-to-beneficiary communication mobile programmes are among the few examples of digital health programmes to have scaled widely in low-resource settings. Yet, evidence on their impact at scale is limited. This study aims to assess whether exposure to mobile health information calls during pregnancy and postpartum improved infant feeding and family planning practices.

Methods: We conducted an individually randomised controlled trial in four districts of Madhya Pradesh, India. Study participants included Hindi speaking women 4-7 months pregnant (n=5095) with access to a mobile phone and their husbands (n=3842). Women were randomised to either an intervention group where they received up to 72 Kilkari messages or a control group where they received none. Intention-to-treat (ITT) and instrumental variable (IV) analyses are presented.

Results: An average of 65% of the 2695 women randomised to receive Kilkari listened to ≥50% of the cumulative content of calls answered. Kilkari was not observed to have a significant impact on the primary outcome of exclusive breast feeding (ITT, relative risk (RR): 1.04, 95% CI 0.88 to 1.23, p=0.64; IV, RR: 1.10, 95% CI 0.67 to 1.81, p=0.71). Across study arms, Kilkari was associated with a 3.7% higher use of modern reversible contraceptives (RR: 1.12, 95% CI 1.03 to 1.21, p=0.007), and a 2.0% lower proportion of men or women sterilised since the birth of the child (RR: 0.85, 95% CI 0.74 to 0.97, p=0.016). Higher reversible method use was driven by increases in condom use and greatest among those women exposed to Kilkari with any male child (9.9% increase), in the poorest socioeconomic strata (15.8% increase), and in disadvantaged castes (12.0% increase). Immunisation at 10 weeks was higher among the children of Kilkari listeners (2.8% higher; RR: 1.03, 95% CI 1.00 to 1.06, p=0.048). Significant differences were not observed for other maternal, newborn and child health outcomes assessed.

Conclusion: Study findings provide evidence to date on the effectiveness of the largest mobile health messaging programme in the world.

Trial registration number: Trial registration clinicaltrials.gov; ID 90075552, NCT03576157.

Keywords: child health; immunisation; individual randomized trial; nutrition.

Conflict of interest statement

Competing interests: All authors have completed the Unified Competing Interest form (available on request from the corresponding author) and declare that the research reported was funded by the Bill and Melinda Gates Foundation. AG, SC, PD are employed by BBC Media Action; one of the entities supporting program implementation. The authors do not have other relationships and are not engaged in activities that could appear to have influenced the submitted work.

© Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY. Published by BMJ.

Figures

Figure 1
Figure 1
Summary of Kilkari content during pregnancy and up to 1 year post partum. WASH, water and sanitation.
Figure 2
Figure 2
Consolidated Standards of Reporting Trials flow diagram.
Figure 3
Figure 3
The number of successful* Kilkari calls and per cent of listening by call over time for those randomised to the intervention arm in four districts of Madhya Pradesh, India. *Successful calls are those which are delivered to the handset and answered for 1 s or more.
Figure 4
Figure 4
Number of call attempts needed to reach subscribers by sociodemographic characteristic. Dark blue bars denote the more marginalised subscribers as compared with those in the lighter blue. OBC, other backward castes.
Figure 5
Figure 5
Proportion of those exposed versus not exposed using reversible modern contraceptive methods by sociodemographic characteristics. OBC, other backward castes.

References

    1. LeFevre AE, Dane P, Copley CJ, et al. . Unpacking the performance of a mobile health information messaging program for mothers (MomConnect) in South Africa: evidence on program reach and messaging exposure. BMJ Glob Health 2018;3:e000583. 10.1136/bmjgh-2017-000583
    1. Chamberlain S, Dutt P, Godfrey A, et al. . Ten lessons learnt: scaling and transitioning one of the largest mobile health communication programmes in the world to a national government. BMJ Glob Health 2021;6:e005341. 10.1136/bmjgh-2021-005341
    1. LeFevre AE, Mohan D, Hutchful D, et al. . Mobile technology for community health in Ghana: what happens when technical functionality threatens the effectiveness of digital health programs? BMC Med Inform Decis Mak 2017;17:27. 10.1186/s12911-017-0421-9
    1. Alam M, Banwell C, Lokuge K. The effect of women's differential access to messages on their adoption of mobile health services and pregnancy behavior in Bangladesh: retrospective cross-sectional study. JMIR Mhealth Uhealth 2020;8:e17665. 10.2196/17665
    1. Rajan R, Raihan A, Alam M. MAMA ‘Aponjon’ formative research report. Baltimore, MD: Johns Hopkins University Global mHealth Initiative, 2013.
    1. LeFevre A, Shah N, Scott K. Evidence on the effectiveness of stage-based health information messages in improving maternal newborn and child health outcomes in India? Findings from an individually randomized controlled trial 2020.
    1. Murthy N, Chandrasekharan S, Prakash MP, et al. . The impact of an mHealth voice message service (mMitra) on infant care knowledge, and practices among low-income women in India: findings from a Pseudo-Randomized controlled trial. Matern Child Health J 2019;23:1658–69. 10.1007/s10995-019-02805-5
    1. Blauvelt C, West M, Maxim L, et al. . Scaling up a health and nutrition Hotline in Malawi: the benefits of multisectoral collaboration. BMJ 2018;363:k4590. 10.1136/bmj.k4590
    1. Lund S, Nielsen BB, Hemed M, et al. . Mobile phones improve antenatal care attendance in Zanzibar: a cluster randomized controlled trial. BMC Pregnancy Childbirth 2014;14:29. 10.1186/1471-2393-14-29
    1. Lund S, Hemed M, Nielsen BB, et al. . Mobile phones as a health communication tool to improve skilled attendance at delivery in Zanzibar: a cluster-randomised controlled trial. BJOG 2012;119:1256–64. 10.1111/j.1471-0528.2012.03413.x
    1. Lund S, Rasch V, Hemed M, et al. . Mobile phone intervention reduces perinatal mortality in Zanzibar: secondary outcomes of a cluster randomized controlled trial. JMIR Mhealth Uhealth 2014;2:e15. 10.2196/mhealth.2941
    1. Murthy N, Chandrasekharan S, Prakash MP, et al. . Effects of an mHealth voice message service (mMitra) on maternal health knowledge and practices of low-income women in India: findings from a pseudo-randomized controlled trial. BMC Public Health 2020;20:820. 10.1186/s12889-020-08965-2
    1. LeFevre A, Chamberlain S, Singh NS, et al. . Avoiding the road to nowhere: policy insights on scaling up and sustaining digital health. Glob Policy 2021;12:110–4. 10.1111/1758-5899.12909
    1. LeFevre A, Chamberlain S, Singh NS, et al. . Avoiding the road to Nowhere: policy insights on scaling up and sustaining digital health. Glob Policy 2021;12:110–4. 10.1111/1758-5899.12909
    1. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci 2013;8:117. 10.1186/1748-5908-8-117
    1. Dutt P, Godfrey A, Chamberlain S. Using behavioural design to inform health communication solutions: evolution evidence and learnings from practice 2021.
    1. LeFevre A, Agarwal S, Chamberlain S, et al. . Are stage-based health information messages effective and good value for money in improving maternal newborn and child health outcomes in India? Protocol for an individually randomized controlled trial. Trials 2019;20:272. 10.1186/s13063-019-3369-5
    1. Mohan D, Harrisson-Bashingwa J, Tiffin N. Does the gender gap in mobile phone access explain health outcomes? An analysis of the Indian national family health survey 2019.
    1. MOHFW . National family health Survey-4 2015-16: state fact sheet Madhya Pradesh. Mumbai: International Institute for Population Sciences (Deemed University), 2017.
    1. Scott K, Shinde A, Ummer O, et al. . Freedom within a cage: how patriarchal gender norms limit women’s use of mobile phones in rural central India. BMJ Glob Health 2021;6:e005596. 10.1136/bmjgh-2021-005596
    1. Team RC . R: a language and environment for statistical computing. Vienna, Austria R Foundation for Statistical Computing, 2020.
    1. Mohan D, Scott K, Shah N, et al. . Can health information through mobile phones close the divide in health behaviours among the marginalised? an equity analysis of Kilkari in Madhya Pradesh, India. BMJ Glob Health 2021;6:e005512. 10.1136/bmjgh-2021-005512
    1. Scott K, Ummer O, Shinde A, et al. . Another voice in the crowd: the challenge of changing family planning and child feeding practices through mHealth messaging in rural central India. BMJ Glob Health 2021;6:e005868. 10.1136/bmjgh-2021-005868
    1. Scott K, Gharai D, Sharma M, et al. . Yes, no, maybe so: the importance of cognitive interviewing to enhance structured surveys on respectful maternity care in northern India. Health Policy Plan 2020;35:67–77. 10.1093/heapol/czz141
    1. Scott K, Ummer O, LeFevre AE. The devil is in the detail: reflections on the value and application of cognitive interviewing to strengthen quantitative surveys in global health. Health Policy Plan 2021;36:982–95. 10.1093/heapol/czab048
    1. Chamberlain S, Dutt P, Godfrey A. 10 lessons learned: scaling and transitioning one of the largest mobile health communication programmes in the world to the government of India 2021.
    1. Engelhard M, Copley C, Watson J. Optimizing the MomConnect Helpdesk in South Africa: towards automated message triage. BMJ Global Health 2018.
    1. Barron P, Peter J, LeFevre AE, et al. . Mobile health messaging service and helpdesk for South African mothers (MomConnect): history, successes and challenges. BMJ Glob Health 2018;3:e000559. 10.1136/bmjgh-2017-000559
    1. Scott K, Ummer O, Chamberlain S. At the frontlines of digitization: a qualitative study on the challenges and opportunities in maintaining accurate, complete, and timely digital health records for India’s rural government health system 2021.

Source: PubMed

3
Předplatit