Developing and Evaluating Digital Interventions to Promote Behavior Change in Health and Health Care: Recommendations Resulting From an International Workshop

Susan Michie, Lucy Yardley, Robert West, Kevin Patrick, Felix Greaves, Susan Michie, Lucy Yardley, Robert West, Kevin Patrick, Felix Greaves

Abstract

Devices and programs using digital technology to foster or support behavior change (digital interventions) are increasingly ubiquitous, being adopted for use in patient diagnosis and treatment, self-management of chronic diseases, and in primary prevention. They have been heralded as potentially revolutionizing the ways in which individuals can monitor and improve their health behaviors and health care by improving outcomes, reducing costs, and improving the patient experience. However, we are still mainly in the age of promise rather than delivery. Developing and evaluating these digital interventions presents new challenges and new versions of old challenges that require use of improved and perhaps entirely new methods for research and evaluation. This article discusses these challenges and provides recommendations aimed at accelerating the rate of progress in digital behavior intervention research and practice. Areas addressed include intervention development in a rapidly changing technological landscape, promoting user engagement, advancing the underpinning science and theory, evaluating effectiveness and cost-effectiveness, and addressing issues of regulatory, ethical, and information governance. This article is the result of a two-day international workshop on how to create, evaluate, and implement effective digital interventions in relation to health behaviors. It was held in London in September 2015 and was supported by the United Kingdom's Medical Research Council (MRC), the National Institute for Health Research (NIHR), the Methodology Research Programme (PI Susan Michie), and the Robert Wood Johnson Foundation of the United States (PI Kevin Patrick). Important recommendations to manage the rapid pace of change include considering using emerging techniques from data science, machine learning, and Bayesian approaches and learning from other disciplines including computer science and engineering. With regard to assessing and promoting engagement, a key conclusion was that sustained engagement is not always required and that for each intervention it is useful to establish what constitutes "effective engagement," that is, sufficient engagement to achieve the intended outcomes. The potential of digital interventions for testing and advancing theories of behavior change by generating ecologically valid, real-time objective data was recognized. Evaluations should include all phases of the development cycle, designed for generalizability, and consider new experimental designs to make the best use of rich data streams. Future health economics analyses need to recognize and model the complex and potentially far-reaching costs and benefits of digital interventions. In terms of governance, developers of digital behavior interventions should comply with existing regulatory frameworks, but with consideration for emerging standards around information governance, ethics, and interoperability.

Keywords: behavioral medicine; eHealth; health behavior; mHealth; mobile applications; psychological theory.

Conflict of interest statement

Conflicts of Interest: Susan Michie is Director of the Centre for Behaviour Change, UCL, which has received funds from industry and government agencies. Robert West has undertaken research and consultancy for, and received travel funds from, companies that develop and manufacture smoking cessation medications (Pfizer, GSK, and J&J). He is an unpaid advisor to the UK’s National Centre for Smoking Cessation and Training. His salary is funded by Cancer Research, UK. Felix Greaves is employed by Public Health England. Kevin Patrick and Lucy Yardley have none.

©Susan Michie, Lucy Yardley, Robert West, Kevin Patrick, Felix Greaves. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 29.06.2017.

References

    1. Yardley L, Choudhury T, Patrick K, Michie S. Current issues and future directions for research into digital behavior change interventions. Am J Prev Med. 2016 Nov;51(5):814–5. doi: 10.1016/j.amepre.2016.07.019.
    1. West R, Michie S. A Guide to the Development and Evaluation of Digital Behaviour Change Intervention. Great Britain: Silverback Publishing; 2016.
    1. Patrick K, Hekler EB, Estrin D, Mohr DC, Riper H, Crane D, Godino J, Riley WT. The pace of technologic change: implications for digital health behavior intervention research. Am J Prev Med. 2016 Nov;51(5):816–24. doi: 10.1016/j.amepre.2016.05.001.
    1. Hekler EB, Michie S, Pavel M, Rivera DE, Collins LM, Jimison HB, Garnett C, Parral S, Spruijt-Metz D. Advancing models and theories for digital behavior change interventions. Am J Prev Med. 2016 Nov;51(5):825–32. doi: 10.1016/j.amepre.2016.06.013.
    1. Murray E, Hekler EB, Andersson G, Collins LM, Doherty A, Hollis C, Rivera DE, West R, Wyatt JC. Evaluating digital health interventions: key questions and approaches. Am J Prev Med. 2016 Nov;51(5):843–51. doi: 10.1016/j.amepre.2016.06.008.
    1. Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, Merchant GC, Naughton F, Blandford A. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. 2016 Nov;51(5):833–42. doi: 10.1016/j.amepre.2016.06.015.
    1. McNamee P, Murray E, Kelly MP, Bojke L, Chilcott J, Fischer A, West R, Yardley L. Designing and undertaking a health economics study of digital health interventions. Am J Prev Med. 2016 Nov;51(5):852–60. doi: 10.1016/j.amepre.2016.05.007.
    1. Rivera DE, Pew MD, Collins LM. Using engineering control principles to inform the design of adaptive interventions: a conceptual introduction. Drug Alcohol Depend. 2007 May;88(Suppl 2):S31–40. doi: 10.1016/j.drugalcdep.2006.10.020.
    1. Collins LM, Dziak JJ, Kugler KC, Trail JB. Factorial experiments: efficient tools for evaluation of intervention components. Am J Prev Med. 2014 Oct;47(4):498–504. doi: 10.1016/j.amepre.2014.06.021.
    1. Collins LM, Murphy SA, Nair VN, Strecher VJ. A strategy for optimizing and evaluating behavioral interventions. Ann Behav Med. 2005 Aug;30(1):65–73. doi: 10.1207/s15324796abm3001_8.
    1. Shuman F. History of numerical weather prediction at the National Meteorological Center. Weather Forecast. 1989;4(3):286–96. doi: 10.1175/1520-0434(1989)004<0286:HONWPA>;2.
    1. Ellis K, Kerr J, Godbole S, Lanckriet G, Wing D, Marshall S. A random forest classifier for the prediction of energy expenditure and type of physical activity from wrist and hip accelerometers. Physiol Meas. 2014 Nov;35(11):2191–203. doi: 10.1088/0967-3334/35/11/2191.
    1. Mohr DC, Schueller SM, Montague E, Burns MN, Rashidi P. The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth interventions. J Med Internet Res. 2014;16(6):e146. doi: 10.2196/jmir.3077.
    1. Thomas JG, Bond DS. Behavioral response to a just-in-time adaptive intervention (JITAI) to reduce sedentary behavior in obese adults: implications for JITAI optimization. Health Psychol. 2015 Dec;34S:1261–7. doi: 10.1037/hea0000304.
    1. Morrison LG, Hargood C, Lin SX, Dennison L, Joseph J, Hughes S, Michaelides DT, Johnston D, Johnston M, Michie S, Little P, Smith PW, Weal MJ, Yardley L. Understanding usage of a hybrid website and smartphone app for weight management: a mixed-methods study. J Med Internet Res. 2014;16(10):e201. doi: 10.2196/jmir.3579.
    1. van Gemert-Pijnen JE, Nijland N, van Limburg M, Ossebaard HC, Kelders SM, Eysenbach G, Seydel ER. A holistic framework to improve the uptake and impact of eHealth technologies. J Med Internet Res. 2011;13(4):e111. doi: 10.2196/jmir.1672.
    1. Yardley L, Morrison L, Bradbury K, Muller I. The person-based approach to intervention development: application to digital health-related behavior change interventions. J Med Internet Res. 2015;17(1):e30. doi: 10.2196/jmir.4055.
    1. Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on Internet-based mental health interventions — a systematic review. Internet Interv. 2014 Oct;1(4):205–15. doi: 10.1016/j.invent.2014.08.003.
    1. Michie S, West R, Campbell R, Brown J, Gainforth H. ABC of Behaviour Change Theories: An Essential Resource for Researchers, Policy Makers and Practitioners. Great Britain: Silverback Publishing; 2014.
    1. Patrick K, Intille SS, Zabinski MF. An ecological framework for cancer communication: implications for research. J Med Internet Res. 2005 Jul 01;7(3):e23. doi: 10.2196/jmir.7.3.e23.
    1. Spruijt-Metz D, Nilsen W. Dynamic models of behavior for just-in-time adaptive interventions. IEEE Pervasive Comput. 2014 Jul;13(3):13–7. doi: 10.1109/MPRV.2014.46.
    1. Larsen KR, Michie S, Hekler EB, Gibson B, Spruijt-Metz D, Ahern D, Cole-Lewis H, Ellis RJ, Hesse B, Moser RP, Yi J. Behavior change interventions: the potential of ontologies for advancing science and practice. J Behav Med. 2016 Aug 01;40(1):6–22. doi: 10.1007/s10865-016-9768-0.
    1. Arp R, Smith B, Spear A. Building Ontologies with Basic Formal Ontology. Cambridge: The MIT Press; 2015. Jul,
    1. Human Behaviour Change Project (HBCP) UCL. [2016-11-25]. The human behaviour-change project website .
    1. Drink Less Alcohol. 2016. [2016-11-29]. .
    1. Garnett C, Crane D, Michie S, West R, Brown J. Evaluating the effectiveness of a smartphone app to reduce excessive alcohol consumption: protocol for a factorial randomised control trial. BMC Public Health. 2016 Jul 08;16:536. doi: 10.1186/s12889-016-3140-8.
    1. Christmas S, Michie S, West R. Thinking about behaviour change: an interdisciplinary dialogue. Great Britain: Silverback Publishing; 2015.
    1. Mohr DC, Schueller SM, Riley WT, Brown CH, Cuijpers P, Duan N, Kwasny MJ, Stiles-Shields C, Cheung K. Trials of intervention principles: evaluation methods for evolving behavioral intervention technologies. J Med Internet Res. 2015;17(7):e166. doi: 10.2196/jmir.4391.
    1. Ramsey SD, Willke RJ, Glick H, Reed SD, Augustovski F, Jonsson B, Briggs A, Sullivan SD. Cost-effectiveness analysis alongside clinical trials II-an ISPOR good research practices task force report. Value Health. 2015 Mar;18(2):161–72. doi: 10.1016/j.jval.2015.02.001.
    1. Petticrew M, Anderson L, Elder R, Grimshaw J, Hopkins D, Hahn R, Krause L, Kristjansson E, Mercer S, Sipe T, Tugwell P, Ueffing E, Waters E, Welch V. Complex interventions and their implications for systematic reviews: a pragmatic approach. J Clin Epidemiol. 2013 Nov;66(11):1209–14. doi: 10.1016/j.jclinepi.2013.06.004.
    1. Shiell A, Hawe P, Gold L. Complex interventions or complex systems? implications for health economic evaluation. BMJ. 2008 Jun 07;336(7656):1281–3. doi: 10.1136/.
    1. Committee on Federal Research Regulations and Reporting Requirements . Optimizing the Nation's Investment in Academic Research A New Regulatory Framework for the 21st Century. Washington, DC: The National Academies Press; 2016. Jul 27,
    1. Medicines and Healthcare products Regulatory Agency . Guidance: Medical device stand-alone software including apps. London, UK: MHRA; 2014. Aug 08,
    1. Federal Trade Commission FTC. 2016. [2017-06-08]. Mobile health apps interactive tool .
    1. National Information Board . Personalised Health and Care 2020: Using data and technology to transform outcomes for patients and citizens. London, UK: HM Government; 2014. Nov 13, Work stream 1.2: enable me to make the right health and care choices.
    1. European Commission Open stakeholder meeting on mHealth assessment guidelines: Presentations and survey. EU guidelines on assessment of the reliability of mobile health applications; Open stakeholder meeting on mHealth assessment guidelines; May 4, 2016; Brussels, Belgium. 2016.
    1. US Government Publishing Office Conference Report. Health Insurance Portability and Accountability Act of 1996; 104th Congress, 2d session; July 31, 1996; House of Representatives, Washington DC. 1996. Jul 31,
    1. Data Protection Act 1998. London: The London Stationary Office; 1998.
    1. European Union . Regulation (EU) of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data (General Data Protection Regulation) Brussels: Official Journal of the European Union Commission; 2016.
    1. Evans BJ. Barbarians at the gate: consumer-driven health data commons and the transformation of citizen science. Am J Law Med. 2016;42(4):1–32.
    1. Kostkova P, Brewer H, de LS, Fottrell E, Goldacre B, Hart G, Koczan P, Knight P, Marsolier C, McKendry RA, Ross E, Sasse A, Sullivan R, Chaytor S, Stevenson O, Velho R, Tooke J. Who owns the data? open data for healthcare. Front Public Health. 2016;4:7. doi: 10.3389/fpubh.2016.00007. doi: 10.3389/fpubh.2016.00007.
    1. Hekler EB, Klasnja P, Riley WT, Buman MP, Huberty J, Rivera DE, Martin CA. Agile science: creating useful products for behavior change in the real world. Transl Behav Med. 2016 Jun;6(2):317–28. doi: 10.1007/s13142-016-0395-7.
    1. Michie S, Wood CE, Johnston M, Abraham C, Francis JJ, Hardeman W. Behaviour change techniques: the development and evaluation of a taxonomic method for reporting and describing behaviour change interventions (a suite of five studies involving consensus methods, randomised controlled trials and analysis of qualitative data) Health Technol Assess. 2015 Nov;19(99):1–188. doi: 10.3310/hta19990. doi: 10.3310/hta19990.
    1. Agarwal S, LeFevre AE, Lee J, L'Engle K, Mehl G, Sinha C, Labrique A, WHO mHealth Technical Evidence Review Group Guidelines for reporting of health interventions using mobile phones: mobile health (mHealth) evidence reporting and assessment (mERA) checklist. BMJ. 2016;352:i1174.
    1. Eysenbach G, Consort- EHEALTH Group Consort-eHealth: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res. 2011;13(4):e126. doi: 10.2196/jmir.1923.

Source: PubMed

Sponsoren und Mitarbeiter

Krankheiten

Drogeninterventionen

3
Abonnieren