Qualitative evaluation of a text messaging intervention to support patients with active tuberculosis: implementation considerations

Sarah J Iribarren, Katherine A Sward, Susan L Beck, Patricia F Pearce, Diana Thurston, Cristina Chirico, Sarah J Iribarren, Katherine A Sward, Susan L Beck, Patricia F Pearce, Diana Thurston, Cristina Chirico

Abstract

Background: Tuberculosis (TB) remains a major global public health problem and mobile health (mHealth) interventions have been identified as a modality to improve TB outcomes. TextTB, an interactive text-based intervention to promote adherence with TB medication, was pilot-tested in Argentina with results supporting the implementation of trials at a larger scale.

Objective: The objective of this research was to understand issues encountered during pilot-testing in order to inform future implementation in a larger-scale trial.

Methods: A descriptive, observational qualitative design guided by a sociotechnical framework was used. The setting was a clinic within a public pulmonary-specialized hospital in Argentina. Data were collected through workflow observation over 115 days, text messages (n=2286), review of the study log, and stakeholder input. Emerging issues were categorized as organizational, human, technical, or sociotechnical considerations.

Results: Issues related to the intervention included workflow issues (eg, human, training, security), technical challenges (eg, data errors, platform shortcomings), and message delivery issues (eg, unintentional sending of multiple messages, auto-confirmation problems). System/contextual issues included variable mobile network coverage, electrical and Internet outages, and medication shortages.

Conclusions: Intervention challenges were largely manageable during pilot-testing, but need to be addressed systematically before proceeding with a larger-scale trial. Potential solutions are outlined. Findings may help others considering implementing an mHealth intervention to anticipate and mitigate certain challenges. Although some of the issues may be context dependent, other issues such as electrical/Internet outages and limited resources are not unique issues to our setting. Release of new software versions did not result in solutions for certain issues, as specific features used were removed. Therefore, other software options will need to be considered before expanding into a larger-scale endeavor. Improved automation of some features will be necessary, however, a goal will be to retain the intervention capability to be interactive, user friendly, and patient focused. Continued collaboration with stakeholders will be required to conduct further research and to understand how such an mHealth intervention can be effectively integrated into larger health systems.

Keywords: mHealth; sociotechnical evaluation; text messaging; tuberculosis.

Conflict of interest statement

Conflicts of Interest: None declared.

Figures

Figure 1
Figure 1
Steps required to input and create an automatic educational text message.
Figure 2
Figure 2
Number of texts and associated costs without (left) and with (right) accent marks.

References

    1. Bayer R, Wilkinson D. Directly observed therapy for tuberculosis: history of an idea. Lancet. 1995 Jun 17;345(8964):1545–1548.
    1. Morris K. WHO sees DOTS. The Lancet. 1997 Mar;349(9055):857. doi: 10.1016/S0140-6736(05)61765-5.
    1. Barclay E. Text messages could hasten tuberculosis drug compliance. Lancet. 2009 Jan 3;373(9657):15–16.
    1. Kaplan WA. Can the ubiquitous power of mobile phones be used to improve health outcomes in developing countries? Global Health. 2006;2:9. doi: 10.1186/1744-8603-2-9.
    1. Tuberculosis Coalition for Technical Assistance . International Standards for Tuberculosis Care (ISTC) The Hague: Tuberculosis Coalition for Technical Assistance; 2006. [2015-02-12]. .
    1. World Health Organization . Treatment of Tuberculosis: Guidelines. 4th edition. Geneva, Switzerland: Stop TB Department, World Health Organization; 2010. .
    1. Hill PC, Stevens W, Hill S, Bah J, Donkor SA, Jallow A, Lienhardt C. Risk factors for defaulting from tuberculosis treatment: a prospective cohort study of 301 cases in the Gambia. Int J Tuberc Lung Dis. 2005 Dec;9(12):1349–1354.
    1. Khan MA, Walley JD, Witter SN, Imran A, Safdar N. Costs and cost-effectiveness of different DOT strategies for the treatment of tuberculosis in Pakistan. Directly Observed Treatment. Health Policy Plan. 2002 Jun;17(2):178–186.
    1. Sanchez AI, Bertolozzi MR. Beyond DOTS (Directly Observed Treatment Short-Course) in tuberculosis' control: interfacing and sharing needs. Rev Lat Am Enfermagem. 2009;17(5):689–694.
    1. Källander K, Tibenderana Jk, Akpogheneta OJ, Strachan DL, Hill Z, ten Asbroek AH, Conteh L, Kirkwood BR, Meek SR. Mobile health (mHealth) approaches and lessons for increased performance and retention of community health workers in low- and middle-income countries: a review. J Med Internet Res. 2013;15(1):e17. doi: 10.2196/jmir.2130.
    1. World Health Organization . mHealth: New Horizons for Health Through Mobile Technologies. Geneva, Switzerland: WHO Press, World Health Organization; 2011. [2015-02-12]. .
    1. The World in 2014: ICT Facts and Figures. Geneva, Switzerland: International Telecommunication Union; 2014. Apr, [2015-02-12]. .
    1. de Jongh T, Gurol-Urganci I, Vodopivec-Jamsek V, Car J, Atun R. Mobile phone messaging for facilitating self-management of long-term illnesses. Cochrane Database Syst Rev. 2012;12:CD007459. doi: 10.1002/14651858.CD007459.pub2.
    1. Fiordelli M, Diviani N, Schulz PJ. Mapping mHealth research: a decade of evolution. J Med Internet Res. 2013;15(5):e95. doi: 10.2196/jmir.2430.
    1. Lester R, Karanja S. Mobile phones: exceptional tools for HIV/AIDS, health, and crisis management. Lancet Infect Dis. 2008 Dec;8(12):738–739. doi: 10.1016/S1473-3099(08)70265-2.
    1. Wei J, Hollin I, Kachnowski S. A review of the use of mobile phone text messaging in clinical and healthy behaviour interventions. J Telemed Telecare. 2011;17(1):41–48. doi: 10.1258/jtt.2010.100322.
    1. Kumar S, Nilsen W, Pavel M, Srivastava M. Mobile health: revolutionizing healthcare through transdisciplinary research. Computer. 2013 Jan;46(1):28–35.
    1. Chaiyachati KH, Loveday M, Lorenz S, Lesh N, Larkan LM, Cinti S, Friedland GH, Haberer JE. A pilot study of an mHealth application for healthcare workers: poor uptake despite high reported acceptability at a rural South African community-based MDR-TB treatment program. PLoS One. 2013;8(5):e64662. doi: 10.1371/journal.pone.0064662.
    1. Chib A, van Velthoven MH, Car J. mHealth adoption in low-resource environments: A review of the use of mobile healthcare in developing countries. J Health Commun. 2015 Jan;20(1):4–34. doi: 10.1080/10810730.2013.864735.
    1. DeMaio J, Schwartz L, Cooley P, Tice A. The application of telemedicine technology to a directly observed therapy program for tuberculosis: a pilot project. Clin Infect Dis. 2001 Dec 15;33(12):2082–2084. doi: 10.1086/324506.
    1. Hoffman JA, Cunningham JR, Suleh AJ, Sundsmo A, Dekker D, Vago F, Munly K, Igonya EK, Hunt-Glassman J. Mobile direct observation treatment for tuberculosis patients: a technical feasibility pilot using mobile phones in Nairobi, Kenya. Am J Prev Med. 2010 Jul;39(1):78–80. doi: 10.1016/j.amepre.2010.02.018.
    1. Wade VA, Karnon J, Eliott JA, Hiller JE. Home videophones improve direct observation in tuberculosis treatment: a mixed methods evaluation. PLoS One. 2012;7(11):e50155. doi: 10.1371/journal.pone.0050155.
    1. Kunawararak P, Pongpanich S, Chantawong S, Pokaew P, Traisathit P, Srithanaviboonchai K, Plipat T. Tuberculosis treatment with mobile-phone medication reminders in northern Thailand. Southeast Asian J Trop Med Public Health. 2011 Nov;42(6):1444–1451.
    1. Mohammed S, Siddiqi O, Ali O, Habib A, Haqqi F, Kausar M, Khan AJ. User engagement with and attitudes towards an interactive SMS reminder system for patients with tuberculosis. J Telemed Telecare. 2012 Oct;18(7):404–408. doi: 10.1258/jtt.2012.120311.
    1. Tomlinson M, Rotheram-Borus MJ, Swartz L, Tsai AC. Scaling up mHealth: where is the evidence? PLoS Med. 2013;10(2):e1001382. doi: 10.1371/journal.pmed.1001382.
    1. Kumar S, Nilsen WJ, Abernethy A, Atienza A, Patrick K, Pavel M, Riley WT, Shar A, Spring B, Spruijt-Metz D, Hedeker D, Honavar V, Kravitz R, Lefebvre RC, Mohr DC, Murphy SA, Quinn C, Shusterman V, Swendeman D. Mobile health technology evaluation: the mHealth evidence workshop. Am J Prev Med. 2013 Aug;45(2):228–236. doi: 10.1016/j.amepre.2013.03.017.
    1. Talmon J, Ammenwerth E, Brender J, de Keizer N, Nykänen P, Rigby M. STARE-HI -statement on reporting of evaluation studies in health informatics. Yearb Med Inform. 2009:23–31.
    1. Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000 Aug;23(4):334–340.
    1. Sandelowski M. What's in a name? Qualitative description revisited. Res Nurs Health. 2010 Feb;33(1):77–84. doi: 10.1002/nur.20362.
    1. Iribarren SJ, Beck S, Pearce PF, Chirico C, Etchevarria M, Cardinale D, Rubinstein F. TextTB: A mixed method pilot study evaluating acceptance, feasibility, and exploring initial efficacy of a text messaging intervention to support TB treatment adherence. Tuberc Res Treat. 2013;2013:349394. doi: 10.1155/2013/349394.
    1. Cornford T, Doukidis G, Forster D. Experience with a structure, process and outcome framework for evaluating an information system. Omega. 1994 Sep;22(5):491–504. doi: 10.1016/0305-0483(94)90030-2.
    1. Barber N, Cornford T, Klecun E. Qualitative evaluation of an electronic prescribing and administration system. Qual Saf Health Care. 2007 Aug;16(4):271–278. doi: 10.1136/qshc.2006.019505.
    1. Ash J, Sittig DF, McMullen CK, Guappone K, Dykstra R, Carpenter J. A rapid assessment process for clinical informatics interventions. AMIA Annu Symp Proc. 2008:26–30.
    1. Iribarren SJ, Beck SL, Pearce PF, Chirico C, Etchevarria M, Rubinstein F. mHealth intervention development to support patients with active tuberculosis. JournalMTM. 2014 Jul 28;3(2):16–27. doi: 10.7309/jmtm.3.2.4.
    1. Fisher JD, Amico KR, Fisher WA, Harman JJ. The information-motivation-behavioral skills model of antiretroviral adherence and its applications. Curr HIV/AIDS Rep. 2008 Nov;5(4):193–203.
    1. Fisher JD, Fisher WA, Bryan AD, Misovich SJ. Information-motivation-behavioral skills model-based HIV risk behavior change intervention for inner-city high school youth. Health Psychol. 2002 Mar;21(2):177–186.
    1. FrontlineSMS FrontlineCloud. Washington, DC: FrontlineSMS; [2015-02-12].
    1. NowSMS. WhyteLeafe, UK: Now Wireless Limited; [2015-02-12]. What is a GSM modem? (or GPRS modem? or 3G modem?) .
    1. Coiera E. Putting the technical back into socio-technical systems research. Int J Med Inform. 2007 Jun;76 Suppl 1:S98–S103. doi: 10.1016/j.ijmedinf.2006.05.026.
    1. Leon N, Schneider H, Daviaud E. Applying a framework for assessing the health system challenges to scaling up mHealth in South Africa. BMC Med Inform Decis Mak. 2012;12:123. doi: 10.1186/1472-6947-12-123.
    1. Hirschhorn LR, Talbot JR, Irwin AC, May MA, Dhavan N, Shady R, Ellner AL, Weintraub RL. From scaling up to sustainability in HIV: potential lessons for moving forward. Global Health. 2013;9:57. doi: 10.1186/1744-8603-9-57.
    1. Aranda-Jan CB, Mohutsiwa-Dibe N, Loukanova S. Systematic review on what works, what does not work and why of implementation of mobile health (mHealth) projects in Africa. BMC Public Health. 2014;14:188. doi: 10.1186/1471-2458-14-188.
    1. Mohr DC, Schueller SM, Montague E, Burns MN, Rashidi P. The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth interventions. J Med Internet Res. 2014;16(6):e146. doi: 10.2196/jmir.3077.

Source: PubMed

Sponsorer og samarbejdspartnere

Medicinske tilstande

Narkotikainterventioner

3
Abonner