Context-Sensitive Ecological Momentary Assessment: Application of User-Centered Design for Improving User Satisfaction and Engagement During Self-Report

Preethi Srinivas, Kunal Bodke, Susan Ofner, NiCole R Keith, Wanzhu Tu, Daniel O Clark, Preethi Srinivas, Kunal Bodke, Susan Ofner, NiCole R Keith, Wanzhu Tu, Daniel O Clark

Abstract

Background: Ecological momentary assessment (EMA) can be a useful tool for collecting real-time behavioral data in studies of health and health behavior. However, EMA administered through mobile technology can be burdensome, and it tends to suffer from suboptimal user engagement, particularly in low health-literacy populations.

Objective: This study aimed to report a case study involving the design and evaluation of a mobile EMA tool that supports context-sensitive EMA-reporting of location and social situations accompanying eating and sedentary behavior.

Methods: An iterative, user-centered design process with obese, middle-aged women seeking care in a safety-net health system was used to identify the preferred format of self-report measures and the look, feel, and interaction of the mobile EMA tool. A single-arm feasibility field trial with 21 participants receiving 12 prompts each day for momentary self-reports over a 4-week period (336 total prompts per participant) was used to determine user satisfaction with interface quality and user engagement, operationalized as response rate. A second trial among 38 different participants randomized to receive or not to receive a feature designed to improve engagement was conducted.

Results: The feasibility trial results showed high interface satisfaction and engagement, with an average response rate of 50% over 4 weeks. Qualitative feedback pointed to the need for auditory alerts. We settled on 3 alerts at 10-min intervals to accompany each EMA-reporting prompt. The second trial testing this feature showed a statistically significant increase in the response rate between participants randomized to receive repeat auditory alerts versus those who were not (60% vs 40%).

Conclusions: This paper reviews the design research and a set of design constraints that may be considered in the creation of mobile EMA interfaces personalized to users' preferences. Novel aspects of the study include the involvement of low health-literacy adults in design research, the capture of data on time, place, and social context of eating and sedentary behavior, and reporting prompts tailored to an individual's location and schedule.

Trial registration: ClinicalTrials.gov NCT03083964; https://ichgcp.net/clinical-trials-registry/NCT03083964.

Keywords: ecological momentary assessment; health status; mhealth; obesity.

Conflict of interest statement

Conflicts of Interest: None declared.

©Preethi Srinivas, Kunal Bodke, Susan Ofner, NiCole R Keith, Wanzhu Tu, Daniel O Clark. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 03.04.2019.

Figures

Figure 1
Figure 1
Three versions of ecological momentary assessment questions resulting from iterative design process.
Figure 2
Figure 2
One-time onboarding screens (top) and example ecological momentary assessment question in device’s notification drawer (bottom left) and structure of an example ecological momentary assessment question (bottom right).
Figure 3
Figure 3
Flowchart depicting the logic used to identify the ecological momentary assessment questions in a group. EMA: ecological momentary assessment .
Figure 4
Figure 4
Mean weekly response rates for participants using version 3-simple in Field Trial 1.
Figure 5
Figure 5
Chart depicting mean weekly response rate comparison between groups version 3 (V3)-simple and V3-ding for participants in Field Trial 2. V: version.

References

    1. National Research Council . Toward Precision Medicine: Building a Knowledge Network for Biomedical Research and a New Taxonomy of Disease. Washington, DC: The National Academies Press; 2011.
    1. Riley K, Kalichman S. Mindfulness-based stress reduction for people living with HIV/AIDS: preliminary review of intervention trial methodologies and findings. Health Psychol Rev. 2015;9(2):224–43. doi: 10.1080/17437199.2014.895928.
    1. National Institutes of Health. [2019-02-18]. The future of health begins with you
    1. Manos D. Rocking the baseline: Verily, Duke, and Stanford aim to make medicine more predictive with a new baseline study. Clinical OMICs. 2017;4(3) doi: 10.1089/clinomi.04.03.01.
    1. Gambhir SS, Ge TJ, Vermesh O, Spitler R. Toward achieving precision health. Sci Transl Med. 2018 Feb 28;10(430) doi: 10.1126/scitranslmed.aao3612.
    1. McGovern L. Robert Wood Johnson Foundation. [2019-02-18]. A brief measure for assessing generalized anxiety disorder: the GAD-7 .
    1. Hektner JM, Hektner JA, Csikszentmihalyi M. Experience Sampling Method: Measuring the Quality of Everyday Life. Thousand Oaks, California: Sage Publications; 2007.
    1. Kahneman D, Krueger AB, Schkade DA, Schwarz N, Stone AA. A survey method for characterizing daily life experience: the day reconstruction method. Science. 2004 Dec 3;306(5702):1776–80. doi: 10.1126/science.1103572.
    1. Kahneman D. Thinking, Fast And Slow. New York: Farrar, Straus And Giroux; 2019.
    1. Csikszentmihalyi M, Larson R. Validity and reliability of the experience-sampling method. In: Csikszentmihalyi M, editor. Flow and the Foundations of Positive Psychology: The Collected Works of Mihaly Csikszentmihalyi. Netherlands: Springer; 2014. pp. 35–54.
    1. Dockray S, Grant N, Stone AA, Kahneman D, Wardle J, Steptoe A. A comparison of affect ratings obtained with ecological momentary assessment and the day reconstruction method. Soc Indic Res. 2010 Nov;99(2):269–83. doi: 10.1007/s11205-010-9578-7.
    1. Trull TJ, Ebner-Priemer UW. Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: introduction to the special section. Psychol Assess. 2009 Dec;21(4):457–62. doi: 10.1037/a0017653.
    1. Clark D, Srinivas P, Bodke K, Keith N, Hood S, Tu W. Addressing people and place microenvironments in weight loss disparities (APP-Me): design of a randomized controlled trial testing timely messages for weight loss behavior in low income Black and White Women. Contemp Clin Trials. 2018 Apr;67:74–80. doi: 10.1016/j.cct.2018.01.006.
    1. Clark D, Keith N, Chrysler L, Perkins AJ, Willis D. Design and reach of a primary care weight management program. J Health Care Poor Underserved. 2008 Feb;19(1):171–9. doi: 10.1353/hpu.2008.0014.
    1. Conner T, Tennen H, Fleeson W, Barrett LF. Experience sampling methods: a modern idiographic approach to personality research. Soc Personal Psychol Compass. 2009 May 1;3(3):292–313. doi: 10.1111/j.1751-9004.2009.00170.x.
    1. Gong J, Tarasewich P. Guidelines for handheld mobile device interface design. DSI 2004 Annual Meeting; November 2004; Boston Massachusetts. 2004. pp. 3751–6.
    1. Hansson R, Ljungstrand P, Redström J. Subtle and Public Notification Cues for Mobile Devices. Proceedings of the 3rd international conference on Ubiquitous Computing; UbiComp'01; September 30-October 2, 2001; Atlanta, Georgia, USA. 2001. Dec 1, pp. 240–6.
    1. Hofmann W, Baumeister RF, Förster G, Vohs KD. Everyday temptations: an experience sampling study of desire, conflict, and self-control. J Pers Soc Psychol. 2012 Jun;102(6):1318–35. doi: 10.1037/a0026545.
    1. Klasnja P, Pratt W. Healthcare in the pocket: mapping the space of mobile-phone health interventions. J Biomed Inform. 2012 Feb;45(1):184–98. doi: 10.1016/j.jbi.2011.08.017.
    1. Macht M, Haupt C, Salewsky A. Emotions and eating in everyday life: application of the experience-sampling method. Ecol Food Nutr. 2004 Jul;43(4):11–21. doi: 10.1080/03670240490454723.
    1. Saffer D. Microinteractions: Designing with Details. Sebastopol, California: O'Reilly Media; 2013.
    1. Stone A, Kessler RC, Haythornthwaite JA. Measuring daily events and experiences: decisions for the researcher. J Pers. 1991 Sep;59(3):575–607. doi: 10.1111/j.1467-6494.1991.tb00260.x.
    1. Tourangeau R, Rips L, Rasinski K. The Psychology of Survey Response. Cambridge, UK: Cambridge University Press; 2000.
    1. Vannette DL, Krosnick JA. Answering questions: a comparison of survey satisficing and mindlessness. In: Langer EJ, Ngnoumen CT, Ie A, editors. The Wiley Blackwell Handbook of Mindfulness. New Delhi, India: John Wiley & Sons; 2014. pp. 312–27.
    1. Weiss B, Mays MZ, Martz W, Castro KM, DeWalt DA, Pignone MP, Mockbee J, Hale FA. Quick assessment of literacy in primary care: the newest vital sign. Ann Fam Med. 2005;3(6):514–22. doi: 10.1370/afm.405.
    1. Lewis JR. Psychometric evaluation of an after-scenario questionnaire for computer usability studies: the ASQ. ACM SIGCHI Bulletin. 1991;23(1):78–81. doi: 10.1145/122672.122692.
    1. Lewis J. Psychometric evaluation of the post-study system usability questionnaire. The Human Factors and Ergonomics Society Annual Meeting; October 12-16, 1992; Atlanta, Georgia. 1992. pp. 1259–60.
    1. Connelly K, Stein KF, Chaudry B, Trabold N. Development of an ecological momentary assessment mobile app for a low-literacy, Mexican-American population to collect disordered eating behaviors. JMIR Public Health Surveill. 2016 Jul 14;2(2):e31. doi: 10.2196/publichealth.5511.
    1. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1–32. doi: 10.1146/annurev.clinpsy.3.022806.091415.
    1. Zhang P, Schmidt D, White J, Mulvaney S. Towards precision behavioral medicine with IoT: iterative design and optimization of a self-management tool for type 1 diabetes. 2018 IEEE International Conference on Healthcare Informatics; June 4-7, 2018; New York, NY, USA. 2015. Dec 1,
    1. Juarascio A, Manasse SM, Goldstein SP, Forman EM, Butryn ML. Review of smartphone applications for the treatment of eating disorders. Eur Eat Disord Rev. 2015 Jan;23(1):1–11. doi: 10.1002/erv.2327.
    1. Mitchell J, Dennis MF, English JS, Dennis PA, Brightwood A, Beckham JC, Kollins SH. Ecological momentary assessment of antecedents and consequences of smoking in adults with attention-deficit/hyperactivity disorder. Subst Use Misuse. 2014 Sep;49(11):1446–56. doi: 10.3109/10826084.2014.912229.
    1. Epstein D, Preston KL. Daily life hour by hour, with and without cocaine: an ecological momentary assessment study. Psychopharmacology (Berl) 2010 Aug;211(2):223–32. doi: 10.1007/s00213-010-1884-x.
    1. Epstein D, Tyburski M, Craig IM, Phillips KA, Jobes ML, Vahabzadeh M, Mezghanni M, Lin JL, Furr-Holden CD, Preston KL. Real-time tracking of neighborhood surroundings and mood in urban drug misusers: application of a new method to study behavior in its geographical context. Drug Alcohol Depend. 2014 Jan 1;134:22–9. doi: 10.1016/j.drugalcdep.2013.09.007.
    1. Preston K, Epstein DH. Stress in the daily lives of cocaine and heroin users: relationship to mood, craving, relapse triggers, and cocaine use. Psychopharmacology (Berl) 2011 Nov;218(1):29–37. doi: 10.1007/s00213-011-2183-x.
    1. Moore R, Depp CA, Wetherell JL, Lenze EL. Ecological momentary assessment versus standard assessment instruments for measuring mindfulness, depressed mood, and anxiety among older adults. J Psychiatr Res. 2016 Apr;75:116–23. doi: 10.1016/j.jpsychires.2016.01.011.

Source: PubMed

Sponsorit ja yhteistyökumppanit

Sairaudet

Huumeiden interventiot

3
Tilaa