Agile research to complement agile development: a proposal for an mHealth research lifecycle

Kumanan Wilson, Cameron Bell, Lindsay Wilson, Holly Witteman, Kumanan Wilson, Cameron Bell, Lindsay Wilson, Holly Witteman

Abstract

Mobile health (mHealth) technology is increasingly being used, but academic evaluations supporting its use are not keeping pace. This is partly due to the disconnect between the traditional pharmaceutical approach to product evaluation, with its incremental approach, and the flexible way in which mHealth products are developed. An important step to addressing these problems lies in establishing agile research methods that complement the agile development methodologies used to create modern digital health applications. We describe an mHealth research model that mirrors traditional clinical research methods in its attention to safety and efficacy, while also accommodating the rapid and iterative development and evaluation required to produce effective, evidence-based, and sustainable digital products. This approach consists of a project identification stage followed by four phases of clinical evaluation: Phase 1: User Experience Design, Development, & Alpha Testing; Phase 2: Beta testing; Phase 3: Clinical Trial Evaluation; and Phase 4: Post-Market Surveillance. These phases include sample gating questions and are adapted to accommodate the unique nature of digital product development.

Keywords: Medical research; Public health.

Conflict of interest statement

Competing interestsThe authors declare no competing interests.

Figures

Fig. 1
Fig. 1
The traditional four-phase pharmaceutical evaluation framework. (Adapted from K. Sagitova, 2009. Watching clinical trials liability. Risk Futures.)
Fig. 2
Fig. 2
The Agile System Development Lifecycle, courtesy of Ambler 2008 (ref)
Fig. 3
Fig. 3
mHealth Agile Development & Evaluation Lifecycle

References

    1. Robbins R, Krebs P, Jagannathan R, Jean-Louis G, Duncan DT. Health app use among US mobile phone users: analysis of trends by chronic disease status. JMIR mHealth uHealth. 2017;5:e197. doi: 10.2196/mhealth.7832.
    1. Carroll JK, et al. J. Med. Internet Res. 2017. Who uses mobile phone health apps and does use matter? a secondary data analytics approach.
    1. Market Research Reports. Digital Health Market Revenue of US$536. 6 bn by the end of 2025: Technology Advancement and Innovation - Press Release – Digital Journal. Market Research Reports (2017). . (Accessed 20 Dec 2017).
    1. Roess A. The promise, growth, and reality of mobile health — another data-free zone. N. Engl. J. Med. 2017;377:2010–2011. doi: 10.1056/NEJMp1713180.
    1. Tomlinson M, Rotheram-Borus MJ, Swartz L, Tsai AC. Scaling up mHealth: where is the evidence? PLoS Med. 2013;10:1–5. doi: 10.1371/journal.pmed.1001382.
    1. Desveaux L, et al. Examining tensions that affect the evaluation of technology in health care: considerations for system decision makers from the perspective of industry and evaluators. JMIR Med. Inform. 2017;5:e50. doi: 10.2196/medinform.8207.
    1. Mummah SA, Robinson TN, King AC, Gardner CD, Sutton S. IDEAS (integrate, design, assess, and share): a framework and toolkit of strategies for the development of more effective digital interventions to change health behavior. J. Med. Internet Res. 2016;18:e317. doi: 10.2196/jmir.5927.
    1. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J. Med. Internet Res. 2011;13:e126. doi: 10.2196/jmir.1923.
    1. Bradway M, et al. mHealth assessment: conceptualization of a global framework. JMIR mHealth uHealth. 2017;5:e60. doi: 10.2196/mhealth.7291.
    1. FDA. Mobile medical applications: guidance for industry and food and drug administration staff. Food Drug Adm. 1–7 (2015).
    1. U.S. Food and Drug Administration. Changes to Existing Medical Software Policies Resulting from Section 3060 of the 21 st Century Cures Act: Draft Guidance for Industry and Food and Drug Administration Staff. 1–14 (2017).
    1. US Food and Drug Administration. Digital health innovation action plan. (2017).
    1. Health Canada. Notice: Health Canada’s Approach to Digital Health Technologies - . (2018). . (Accessed 30 Apr 2018).
    1. Cortez NG, Cohen IG, Kesselheim AS. FDA regulation of mobile health technologies. N. Engl. J. Med. 2014;371:372–379. doi: 10.1056/NEJMhle1403384.
    1. Shuren J, Patel B, Gottlieb S. FDA regulation of mobile medical apps. JAMA. 2018;320:337. doi: 10.1001/jama.2018.8832.
    1. US Food and Drug Administration. CDRH Reports - National Evaluation System for HealthTechnology (NEST). (2018). . (Accessed 30 Apr 2018).
    1. Pocock, S. J. Clinical Trials: A Practical Approach. (John Wiley and Sons Inc.: Chichester, UK 2013).
    1. Dingsøyr T, Nerur S, Balijepally V, Moe NB. A decade of agile methodologies: towards explaining agile software development. J. Syst. Softw. 2012;85:1213–1221. doi: 10.1016/j.jss.2012.02.033.
    1. Beck, K. et al. Principles behind the Agile Manifesto. The Agile Manifesto (2001). . (Accessed 20 Dec 2017).
    1. US Food and Drug Administration. The Device Development Process. Learn about Drug and Device Approvals (2018). . (Accessed 30 Apr 2018).
    1. Apple Developer. App Store Review Guidelines. . (Accessed 12 June 2018).
    1. Witteman HO, et al. User-centered design and the development of patient decision aids: protocol for a systematic review. Syst. Rev. 2015;4:11. doi: 10.1186/2046-4053-4-11.
    1. Caldwell, B., Cooper, M., Reid, L. & Vanderheiden, G. Web Content Accessibility Guidelines (WCAG) 2.0. W3C Recommendation (2008). . (Accessed 20 Dec 2017).
    1. Parasuraman A. Technology Readiness Index (TRI): a multiple-item scale to measure readiness to embrace new technologies. J. Serv. Res. 2000;2:307–320. doi: 10.1177/109467050024001.
    1. Parasuraman A, Colby CL. An updated and streamlined technology readiness index. J. Serv. Res. 2015;18:59–74. doi: 10.1177/1094670514539730.
    1. World Health Organization. WHO | Medical Device – Full Definition. WHO (2013). . (Accessed 20 Dec 2017).
    1. Byambasuren O, Sanders S, Beller E, Glasziou P. Prescribable mHealth apps identified from an overview of systematic reviews. npj Digit. Med. 2018;1:12. doi: 10.1038/s41746-018-0021-9.
    1. Kohavi, R. & Thomke, S. The Surprising Power of Online Experiments. Harvard Business Review (2017). . (Accessed 26 July 2018).
    1. Bhatt DL, Mehta C. Adaptive designs for clinical trials. N. Engl. J. Med. 2016;375:65–74. doi: 10.1056/NEJMra1510061.
    1. Lin PH, et al. Adaptive intervention design in mobile health: intervention design and development in the Cell Phone Intervention for You trial. Clin. Trials J. Soc. Clin. Trials. 2015;12:634–645. doi: 10.1177/1740774515597222.
    1. Pallmann P, et al. Adaptive designs in clinical trials: why use them, and how to run and report them. BMC Med. 2018;16:29. doi: 10.1186/s12916-018-1017-7.
    1. Ambler S.W. Agile Software Development at Scale. In: Meyer B., Nawrocki J.R., Walter B. (eds) Balancing Agility and Formalismin Software Engineering. CEE-SET 2007. Lecture Notes in Computer Science, vol 5082. Springer, Berlin, Heidelberg (2008).

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera