Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis

Amit Baumel, Frederick Muench, Stav Edan, John M Kane, Amit Baumel, Frederick Muench, Stav Edan, John M Kane

Abstract

Background: Understanding patterns of real-world usage of mental health apps is key to maximizing their potential to increase public self-management of care. Although developer-led studies have published results on the use of mental health apps in real-world settings, no study yet has systematically examined usage patterns of a large sample of mental health apps relying on independently collected data.

Objective: Our aim is to present real-world objective data on user engagement with popular mental health apps.

Methods: A systematic engine search was conducted using Google Play to identify Android apps with 10,000 installs or more targeting anxiety, depression, or emotional well-being. Coding of apps included primary incorporated techniques and mental health focus. Behavioral data on real-world usage were obtained from a panel that provides aggregated nonpersonal information on user engagement with mobile apps.

Results: In total, 93 apps met the inclusion criteria (installs: median 100,000, IQR 90,000). The median percentage of daily active users (open rate) was 4.0% (IQR 4.7%) with a difference between trackers (median 6.3%, IQR 10.2%) and peer-support apps (median 17.0%) versus breathing exercise apps (median 1.6%, IQR 1.6%; all z≥3.42, all P<.001). Among active users, daily minutes of use were significantly higher for mindfulness/meditation (median 21.47, IQR 15.00) and peer support (median 35.08, n=2) apps than for apps incorporating other techniques (tracker, breathing exercise, psychoeducation: medians range 3.53-8.32; all z≥2.11, all P<.05). The medians of app 15-day and 30-day retention rates were 3.9% (IQR 10.3%) and 3.3% (IQR 6.2%), respectively. On day 30, peer support (median 8.9%, n=2), mindfulness/meditation (median 4.7%, IQR 6.2%), and tracker apps (median 6.1%, IQR 20.4%) had significantly higher retention rates than breathing exercise apps (median 0.0%, IQR 0.0%; all z≥2.18, all P≤.04). The pattern of daily use presented a descriptive peak toward the evening for apps incorporating most techniques (tracker, psychoeducation, and peer support) except mindfulness/meditation, which exhibited two peaks (morning and night).

Conclusions: Although the number of app installs and daily active minutes of use may seem high, only a small portion of users actually used the apps for a long period of time. More studies using different datasets are needed to understand this phenomenon and the ways in which users self-manage their condition in real-world settings.

Keywords: adherence; anxiety; depression; mHealth; mental health; retention; usage; user engagement.

Conflict of interest statement

Conflicts of Interest: None declared.

©Amit Baumel, Frederick Muench, Stav Edan, John M Kane. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 25.09.2019.

Figures

Figure 1
Figure 1
App inclusion flow diagram.
Figure 2
Figure 2
App 30-day retention by mental health focus. The percentages reflect the number of users who opened the app from day 1 to day 30 out of the number of users who installed and opened the app on day 0.
Figure 3
Figure 3
App 30-day retention by primary incorporated technique. The percentages reflect the number of users who opened the app from day 1 to day 30 out of the number of users who installed and opened the app on day 0.
Figure 4
Figure 4
Hourly usage pattern. Usage is presented by hour out of the total app usage; therefore, the sum of percentages within each category is 100%. Note: a subset of apps for which that data were available is included; “All apps” includes both categories and one app targeting happiness.
Figure 5
Figure 5
Daily usage pattern. Percentage of app usage is presented by day out of the total app usage; therefore, the sum of percentages within each category is 100%. Note: a subset of apps for which that data were available is included; “All apps” includes both categories and one app targeting happiness.

References

    1. Krishna S, Boren S, Balas E. Healthcare via cell phones: a systematic review. Telemed J E Health. 2009 Apr;15(3):231–240. doi: 10.1089/tmj.2008.0099.
    1. Norman GJ, Zabinski MF, Adams MA, Rosenberg DE, Yaroch AL, Atienza AA. A review of eHealth interventions for physical activity and dietary behavior change. Am J Prev Med. 2007 Oct;33(4):336–345. doi: 10.1016/j.amepre.2007.05.007. S0749-3797(07)00363-7
    1. Naslund J, Marsch L, McHugo G, Bartels S. Emerging mHealth and eHealth interventions for serious mental illness: a review of the literature. J Ment Health. 2015;24(5):321–332. doi: 10.3109/09638237.2015.1019054.
    1. Pew Research Center. 2019. Jun 12, [2019-01-07]. Mobile fact sheet
    1. WalkerSands Communications. 2019. [2019-01-07]. How technology is expanding the scope of online commerce beyond retail
    1. Anthes E. Mental health: there's an app for that. Nature. 2016 Apr 7;532(7597):20–23. doi: 10.1038/532020a.532020a
    1. Kazdin A. Addressing the treatment gap: a key challenge for extending evidence-based psychosocial interventions. Behav Res Ther. 2017 Jan;88:7–18. doi: 10.1016/j.brat.2016.06.004.S0005-7967(16)30099-7
    1. Baumel A, Baker J, Birnbaum ML, Christensen H, De Choudhury M, Mohr DC, Muench F, Schlosser D, Titov N, Kane JM. Summary of key issues raised in the Technology for Early Awareness of Addiction and Mental Illness (TEAAM-I) meeting. Psychiatr Serv. 2018 May 01;69(5):590–592. doi: 10.1176/appi.ps.201700270.
    1. Eysenbach G. The law of attrition. J Med Internet Res. 2005;7(1):e11. doi: 10.2196/jmir.7.1.e11. v7e11
    1. Christensen H, Mackinnon A. The law of attrition revisited. J Med Internet Res. 2006;8(3):e20.
    1. Baumeister R, Vohs K. Self-regulation, ego depletion, and motivation. Social Pers Psych Compass. 2007 Nov;1(1):115–128. doi: 10.1111/j.1751-9004.2007.00001.x.
    1. Kohl LF, Crutzen R, de Vries NK. Online prevention aimed at lifestyle behaviors: a systematic review of reviews. J Med Internet Res. 2013;15(7):e146. doi: 10.2196/jmir.2665. v15i7e146
    1. Mohr DC, Weingardt KR, Reddy M, Schueller SM. Three problems with current digital mental health research…and three things we can do about them. Psychiatr Serv. 2017 May 01;68(5):427–429. doi: 10.1176/appi.ps.201600541.
    1. Day J, Sanders M. Do prents benefit from help when completing a self-guided parenting program online? A randomized controlled trial comparing Triple P Online with and without telephone support. Behav Ther. 2018;49(6):1020–1038.
    1. Glasgow RE. eHealth evaluation and dissemination research. Am J Prev Med. 2007 May;32(5 Suppl):S119–S126. doi: 10.1016/j.amepre.2007.01.023.S0749-3797(07)00052-9
    1. Farvolden P, Denisoff E, Selby P, Bagby RM, Rudy L. Usage and longitudinal effectiveness of a Web-based self-help cognitive behavioral therapy program for panic disorder. J Med Internet Res. 2005;7(1):e7. doi: 10.2196/jmir.7.1.e7. v7e7
    1. Christensen H, Griffiths KM, Korten AE, Brittliffe K, Groves C. A comparison of changes in anxiety and depression symptoms of spontaneous users and trial participants of a cognitive behavior therapy website. J Med Internet Res. 2004 Dec 22;6(4):e46. doi: 10.2196/jmir.6.4.e46. v6e46
    1. Fleming T, Bavin L, Lucassen M, Stasiak K, Hopkins S, Merry S. Beyond the trial: systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. J Med Internet Res. 2018 Jun 06;20(6):e199. doi: 10.2196/jmir.9275. v20i6e199
    1. Owen JE, Jaworski BK, Kuhn E, Makin-Byrd KN, Ramsey KM, Hoffman JE. mHealth in the wild: using novel data to examine the reach, use, and impact of PTSD Coach. JMIR Ment Health. 2015;2(1):e7. doi: 10.2196/mental.3935. v2i1e7
    1. Carpenter J, Crutchley P, Zilca RD, Schwartz HA, Smith LK, Cobb AM, Parks AC. Seeing the "big" picture: big data methods for exploring relationships between usage, language, and outcome in internet intervention data. J Med Internet Res. 2016 Aug 31;18(8):e241. doi: 10.2196/jmir.5725. v18i8e241
    1. Ebert D, Baumeister H. Internet-based self-help interventions for depression in routine care. JAMA Psychiatry. 2017 Aug 01;74(8):852–853. doi: 10.1001/jamapsychiatry.2017.1394.2631888
    1. Christensen H, Griffiths K, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res. 2009 Apr 24;11(2):e13. doi: 10.2196/jmir.1194.v11i2e13
    1. Moller A, Merchant G, Conroy D, West R, Hekler E, Kugler KC, Michie S. Applying and advancing behavior change theories and techniques in the context of a digital health revolution: proposals for more effectively realizing untapped potential. J Behav Med. 2017 Feb;40(1):85–98. doi: 10.1007/s10865-016-9818-7. 10.1007/s10865-016-9818-7
    1. Baumel A, Yom-Tov E. Predicting user adherence to behavioral eHealth interventions in the real world: examining which aspects of intervention design matter most. Transl Behav Med. 2018 Sep 08;8(5):793–798. doi: 10.1093/tbm/ibx037.4868564
    1. Demyttenaere K, Bruffaerts R, Posada-Villa J, Gasquet I, Kovess V, Lepine JP, Angermeyer MC, Bernert S, de Girolamo G, Morosini P, Polidori G, Kikkawa T, Kawakami N, Ono Y, Takeshima T, Uda H, Karam EG, Fayyad JA, Karam AN, Mneimneh ZN, Medina-Mora ME, Borges G, Lara C, de Graaf R, Ormel J, Gureje O, Shen Y, Huang Y, Zhang M, Alonso J, Haro JM, Vilagut G, Bromet EJ, Gluzman S, Webb Ch, Kessler RC, Merikangas KR, Anthony JC, Von Korff MR, Wang PS, Brugha TS, Aguilar-Gaxiola S, Lee S, Heeringa S, Pennell B, Zaslavsky AM, Ustun TB, Chatterji S, WHO World Mental Health Survey Consortium Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization World Mental Health Surveys. JAMA. 2004 Jun 02;291(21):2581–2590. doi: 10.1001/jama.291.21.2581.291/21/2581
    1. World Health Organization . The World Health Report 2001. Mental Health: New Understanding, New Hope. Geneva: World Health Organization; 2001.
    1. . [2018-06-24].
    1. Baumel A, Kane J. Examining predictors of real-world user engagement with self-guided eHealth interventions: analysis of mobile apps and websites using a novel dataset. J Med Internet Res. 2018 Dec 14;20(12):e11491. doi: 10.2196/11491. v20i12e11491
    1. PsyberGuide. [2015-04-10].
    1. Baumel A, Birnbaum ML, Sucala M. A systematic review and taxonomy of published quality criteria related to the evaluation of user-facing eHealth programs. J Med Syst. 2017;41(8):128. doi: 10.1007/s10916-017-0776-6.10.1007/s10916-017-0776-6
    1. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006 Jan;3(2):77–101. doi: 10.1191/1478088706qp063oa.
    1. SimilarWeb. 2018. [2018-06-18].
    1. European Commission. [2018-06-18]. Data protection .
    1. Oath. [2018-10-14].
    1. Carlson KD, Herdman AO. Understanding the impact of convergent validity on research results. Organ Res Methods. 2010 Dec 30;15(1):17–32. doi: 10.1177/1094428110392383.
    1. Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, Merchant GC, Naughton F, Blandford A. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. 2016 Nov;51(5):833–842. doi: 10.1016/j.amepre.2016.06.015.S0749-3797(16)30243-4
    1. ADAA Mental Health Apps rates. [2016-11-01]. .
    1. Baumel A, Faber K, Mathur N, Kane JM, Muench F. Enlight: a comprehensive quality and therapeutic potential evaluation tool for mobile and web-based eHealth interventions. J Med Internet Res. 2017 Mar 21;19(3):e82. doi: 10.2196/jmir.7270. v19i3e82
    1. Baumel A, Muench F. Heuristic evaluation of eHealth interventions: establishing standards that relate to the therapeutic process perspective. JMIR Ment Health. 2016 Jan 13;3(1):e5. doi: 10.2196/mental.4563. v3i1e5
    1. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015;3(1):e27. doi: 10.2196/mhealth.3422. v3i1e27
    1. Torous JB, Chan SR, Gipson SY, Kim JW, Nguyen T, Luo J, Wang P. A hierarchical framework for evaluation and informed decision making regarding smartphone apps for clinical care. Psychiatr Serv. 2018 May 01;69(5):498–500. doi: 10.1176/appi.ps.201700423.
    1. Mohr DC, Tomasino KN, Lattie EG, Palac HL, Kwasny MJ, Weingardt K, Karr CJ, Kaiser SM, Rossom RC, Bardsley LR, Caccamo L, Stiles-Shields C, Schueller SM. IntelliCare:an eclectic, skills-based app suite for the treatment of depression and anxiety. J Med Internet Res. 2017 Jan 05;19(1):e10. doi: 10.2196/jmir.6645. v19i1e10
    1. Baumel A, Correll CU, Hauser M, Brunette M, Rotondi A, Ben-Zeev D, Gottlieb JD, Mueser KT, Achtyes ED, Schooler NR, Robinson DG, Gingerich S, Marcy P, Meyer-Kalos P, Kane JM. Health technology intervention after hospitalization for schizophrenia: service utilization and user satisfaction. Psychiatr Serv. 2016 Jun 1;67(9):1035–1038. doi: 10.1176/appi.ps.201500317.
    1. Fogg B. A behavior model for persuasive design. Persuasive '09 4th international Conference on Persuasive Technology; April 26-29, 2009; Claremont, CA. 2009.
    1. Cavanagh K, Millings A. (Inter)personal computing: the role of the therapeutic relationship in e-mental health. J Contemp Psychother. 2013 Jul 17;43(4):197–206. doi: 10.1007/s10879-013-9242-z.
    1. Holter MT, Johansen A, Brendryen H. How a fully automated eHealth program simulates three therapeutic processes: a case study. J Med Internet Res. 2016 Jun 28;18(6):e176. doi: 10.2196/jmir.5415. v18i6e176
    1. Barazzone N, Cavanagh K, Richards DA. Computerized cognitive behavioural therapy and the therapeutic alliance: a qualitative enquiry. Br J Clin Psychol. 2012 Nov;51(4):396–417. doi: 10.1111/j.2044-8260.2012.02035.x.
    1. Ernsting C, Dombrowski S, Oedekoven M, O Sullivan JL, Kanzler M, Kuhlmey A, Gellert P. Using smartphones and health apps to change and manage health behaviors: a population-based survey. J Med Internet Res. 2017 Apr 05;19(4):e101. doi: 10.2196/jmir.6838. v19i4e101
    1. Collins L, Murphy S, Strecher V. The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. Am J Prev Med. 2007 May;32(5 Suppl):S112–S118. doi: 10.1016/j.amepre.2007.01.022. S0749-3797(07)00051-7
    1. Cheung K, Ling W, Karr C, Weingardt K, Schueller S, Mohr D. Evaluation of a recommender app for apps for the treatment of depression and anxiety: an analysis of longitudinal user engagement. J Am Med Inform Assoc. 2018 Aug 01;25(8):955–962. doi: 10.1093/jamia/ocy023. 4963735
    1. Statistica. [2019-01-06]. Global mobile OS market share in sales to end users from 1st quarter 2009 to 2nd quarter 2018
    1. Statcounter GlobalStats. [2019-01-06]. Mobile operating system market share United States of America .

Source: PubMed

Sponsor e collaboratori

Condizioni mediche

Interventi farmacologici

3
Sottoscrivi