SMS versus voice messaging to deliver MNCH communication in rural Malawi: assessment of delivery success and user experience

Jessica Crawford, Erin Larsen-Cooper, Zachariah Jezman, Stacey C Cunningham, Emily Bancroft, Jessica Crawford, Erin Larsen-Cooper, Zachariah Jezman, Stacey C Cunningham, Emily Bancroft

Abstract

Objective: To determine the difference in delivery success of health messages delivered through pushed SMS, pushed voice messages sent to personal phones, and voice messages retrieved from a community phone ("retrieved voice messaging"), as well as the difference in quality of the user experience.

Methods: We analyzed the project's electronic monitoring data between September 2011 and June 2013, including demographics, enrollment data, and messages sent and successfully delivered. We also collected and analyzed information from quarterly phone-based surveys with users to assess quality of the user experience, including acceptability, comprehension, new information learned, and reported behavior change.

Results: More than half of subscribers enrolled in the retrieved voice messaging service while nearly one-third enrolled in the pushed SMS service and less than 10% in pushed voice messaging. Message delivery success was highest among pushed SMS subscribers and lowest among retrieved voice subscribers. Overall, 99% of survey respondents reported trusting messages they received, and about 75% of respondents recalled the last message they received and learned something new. Almost 75% of respondents reported that they had already changed or intended to change their behavior based on received messages. Intended or actual behavior change was significantly higher among pushed SMS enrollees than among pushed or retrieved voice messaging enrollees (P = .01).

Conclusion: All message modalities led to high levels of satisfaction, comprehension, and new information learned. Due to lower cost, higher delivery success, and higher levels of intended or actual behavior change, SMS is the preferred delivery modality. However, the majority of users included in this study did not have access to a personal phone, and retrieved voice messages provided an opportunity to access a population that otherwise could not be served. Providing multiple methods by which users could access the service was crucial in extending reach beyond literate personal phone owners.

Conflict of interest statement

Competing Interests: None declared.

Figures

https://www.ncbi.nlm.nih.gov/pmc/articles/instance/4168599/bin/035fig3.jpg
A communication poster encourages caregivers of children to call the Chipatala Cha Pa Foni hotline to get answers to their health-related questions.
https://www.ncbi.nlm.nih.gov/pmc/articles/instance/4168599/bin/035fig4.jpg
A hotline worker answers an incoming calling using a touch screen device that prompts the worker to identify the client's symptoms and information needs.
https://www.ncbi.nlm.nih.gov/pmc/articles/instance/4168599/bin/035fig5.jpg
A woman uses a community volunteer's mobile phone to access the health message delivered by the Chipatala Cha Pa Foni project.
FIGURE 1.
FIGURE 1.
Delivery Success Rates of Messages Over Time, by Delivery Method, September 2011–June 2013 Success rate for pushed SMS and voice messages is the percent of messages successfully received within 3 attempts; for retrieved voice messages, the success rate is the percent of expected messages successfully retrieved.
FIGURE 2.
FIGURE 2.
Percentage of Successful Message Retrieval Attempts Among Retrieved Voice Message Subscribers, by Type of Subscriber, September 2011–June 2013

References

    1. National Statistical Office (NSO) [Malawi]; ICF Macro. Malawi demographic and health survey 2010. Zomba (Malawi): NSO; 2011. Co-published by ICF Macro. Available from:
    1. Combs Thorsen V, Sundby J, Malata A. Piecing together the maternal death puzzle through narratives: the three delays model revisited. PLoS One. 2012;7(12): e52090 10.1371/journal.pone.0052090
    1. Vital Wave Consulting. mHealth in the global south: landscape analysis. Washington (DC): Vodafone Group Foundation; 2008. Co-published by the United Nations Foundation Partnership. Available from:
    1. Cole-Lewis H, Kershaw T. Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev. 2010;32(1): 56–69 10.1093/epirev/mxq004
    1. Sloninsky D, Mechael PN. Towards the development of an mHealth strategy: a literature review. New York: Millennium Villages Project; 2008. Available from:
    1. Free C, Phillips G, Felix L, Galli L, Patel V, Edwards P. The effectiveness of M-health technologies for improving health and health services: a systematic review protocol. BMC Res Notes. 2010;3:250 10.1186/1756-0500-3-250
    1. Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS Med. 2013;10(1): e1001362 10.1371/journal.pmed.1001362
    1. Sharma R, Hebbal M, Ankola AV, Murugabupathy V. Mobile-phone text messaging (SMS) for providing oral health education to mothers of preschool children in Belgaum City. J Telemed Telecare. 2011;17(8): 432–436 10.1258/jtt.2011.110416
    1. Tamrat T, Kachnowski S. Special delivery: an analysis of mHealth in maternal and newborn health programs and their outcomes around the world. Matern Child Health J. 2012;16(5): 1092–1101 10.1007/s10995-011-0836-3
    1. Evans WD, Wallace JL, Snider J. Pilot evaluation of the text4baby mobile health program. BMC Public Health. 2012;12:1031 10.1186/1471-2458-12-1031
    1. Lund S, Hemed M, Nielsen BB, Said A, Said K, Makungu MH, et al. Mobile phones as a health communication tool to improve skilled attendance at delivery in Zanzibar: a cluster-randomised controlled trial. BJOG. 2012;119(10): 1256–1264 10.1111/j.1471-0528.2012.03413.x
    1. Kaewkungwal J, Singhasivanon P, Khamsiriwatchara A, Sawang S, Meankaew P, Wechsart A. Application of smart phone in “Better Border Healthcare Program”: a module for mother and child care. BMC Med Inform Decis Mak. 2010;10:69 10.1186/1472-6947-10-69
    1. GSMA Mobile for Development Intelligence (MDI). Scaling mobile for development: a developing world opportunity. London: MDI; 2013. Available from:
    1. GSMA Mobile for Development Intelligence (MDI). Value of voice – an unsung opportunity. London: MDI; [2013]. Available from:
    1. MAMA: Mobile Alliance for Maternal Action: the power of health in every mama's hand [Internet]. Washington (DC): United Nations Foundation; c2013. MAMA Bangladesh; [cited 2013 Jan 7]; [about 3 screens]. Available from:
    1. Greaney ML, Puleo E, Sprunck-Harrild K, Bennett GG, Cunningham MA, Gillman MW, et al. Electronic reminders for cancer prevention: factors associated with preference for automated voice reminders or text messages. Prev Med. 2012;55(2): 151–154 10.1016/j.ypmed.2012.05.014
    1. Grameen Foundation. Mobile technology for community health in Ghana: what it is and what Grameen Foundation has learned so far. 2nd edition. Washington (DC): Grameen Foundation; 2012. Available from:
    1. Cormick G, Kim NA, Rodgers A, Gibbons L, Buekens PM, Belizán JM, et al. Interest of pregnant women in the use of SMS (short message service) text messages for the improvement of perinatal and postnatal care. Reprod Health. 2012;9:9 10.1186/1742-4755-9-9
    1. Wesolowski A, Eagle N, Noor AM, Snow RW, Buckee CO. Heterogeneous mobile phone ownership and usage patterns in Kenya. PLoS One. 2012;7(4): e35319 10.1371/journal.pone.0035319
    1. Invest in Knowledge. Baseline report for an evaluation of the information and communications technology to improve health services for mothers and children project. Zomba (Malawi): Invest in Knowledge; 2012
    1. Noordam AC, Kuepper BM, Stekelenburg J, Milen A. Improvement of maternal health services through the use of mobile phones. Trop Med Int Health. 2011;16(5): 622–626 10.1111/j.1365-3156.2011.02747.x

Source: PubMed

3
Abonnieren