Usage and Weekly Attrition in a Smartphone-Based Health Behavior Intervention for Adolescents: Pilot Randomized Controlled Trial

Erlendur Egilsson, Ragnar Bjarnason, Urdur Njardvik, Erlendur Egilsson, Ragnar Bjarnason, Urdur Njardvik

Abstract

Background: The majority of adolescents own smartphones, although only 8% of them use health apps. Attrition rates from adolescent mobile health (mHealth) interventions for treating mental health problems such as anxiety and depression are an issue with a high degree of variation. Attrition in mHealth interventions targeting adolescent populations is frequently presented in a two-point fashion, from initiation of the intervention to the end of treatment, lacking more time-specific information on usage and times of attrition. Self-efficacy could provide an avenue to lower attrition rates, although a better understanding of the relationship between mental health factors and time-specific attrition rates is needed.

Objective: The aims of this study were to obtain time-specific attrition rates among adolescents in an mHealth intervention, and to describe the intervention's usage and feasibility in relation to adolescent self-efficacy levels, and emotional and physical health.

Methods: A single-center randomized controlled public school pilot trial was undertaken with 41 adolescents. Outcome measures were assessed at baseline and after 6 weeks, while in-app activity and attrition rates were continually assessed throughout the intervention period. The primary outcome was attrition based on time and type of in-app health behavior usage, and feasibility of the mHealth app. Secondary outcome measures were self-efficacy levels, depressive and anxiety symptoms, as well as standardized BMI and sleep. Analyses of group mean variances with adjusted α levels through Bonferroni corrections were used to assess main outcome effects.

Results: The attrition from initiation of the intervention to 6-week follow up was 35%. Attrition started in the third week of the intervention and was related to daily time of app usage (Rt=0.43, P<.001). The number of average weekly in-app health exercises completed decreased significantly from the first week of the intervention (mean 55.25, SD 10.96) to the next week (mean 13.63, SD 2.94). However, usage increased by 22% between week 2 and the last week of the intervention (mean 16.69, SD 8.37). Usability measures revealed satisfactory scores (mean 78.09, SD 9.82) without gender differences (P=.85). Self-reported daily physical activity increased by 19.61% in the intervention group but dropped by 26.21% among controls. Self-efficacy levels increased by 8.23% in the invention arm compared to a 3.03% decrease in the control group.

Conclusions: This pilot study demonstrated the feasibility and usability of an mHealth intervention among adolescent participants. Indications were toward beneficial effects on physical and mental health that warrant further research. Focus on time-specific attrition measures alongside daily times of usage and ways to increase participants' self-efficacy levels appear to be a promising avenue for research on mHealth interventions for adolescent populations with the aim to ultimately lower attrition rates.

Keywords: adolescent; attrition; behavior; intervention; mHealth; mental health; physical activity; self-efficacy; young adult.

Conflict of interest statement

Conflicts of Interest: EE is a minority shareholder and former employee of SidekickHealth AB. The other authors have no conflicts of interest to declare.

©Erlendur Egilsson, Ragnar Bjarnason, Urdur Njardvik. Originally published in JMIR Formative Research (http://formative.jmir.org), 17.02.2021.

Figures

Figure 1
Figure 1
Pilot intervention flow chart. mHealth: mobile health; m: male; f: female.
Figure 2
Figure 2
Weekly mean frequency of individual in-app exercises.

References

    1. Erskine HE, Baxter AJ, Patton G, Moffitt TE, Patel V, Whiteford HA, Scott JG. The global coverage of prevalence data for mental disorders in children and adolescents. Epidemiol Psychiatr Sci. 2017 Aug;26(4):395–402. doi: 10.1017/S2045796015001158.
    1. Polanczyk GV, Salum GA, Sugaya LS, Caye A, Rohde LA. Annual research review: A meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J Child Psychol Psychiatry. 2015 Mar;56(3):345–365. doi: 10.1111/jcpp.12381.
    1. Philipp J, Zeiler M, Waldherr K, Truttmann S, Dür W, Karwautz AFK, Wagner G. Prevalence of emotional and behavioral problems and subthreshold psychiatric disorders in Austrian adolescents and the need for prevention. Soc Psychiatry Psychiatr Epidemiol. 2018 Dec;53(12):1325–1337. doi: 10.1007/s00127-018-1586-y.
    1. Data and Statistics on Childrens Mental Health. Centers for Disease Control and Prevention (CDC) 2020. Jun 15, [2020-06-21]. .
    1. Clarke AM, Kuosmanen T, Barry MM. A systematic review of online youth mental health promotion and prevention interventions. J Youth Adolesc. 2015 Jan;44(1):90–113. doi: 10.1007/s10964-014-0165-0.
    1. Kieling C, Baker-Henningham H, Belfer M, Conti G, Ertem I, Omigbodun O, Rohde LA, Srinath S, Ulkuer N, Rahman A. Child and adolescent mental health worldwide: evidence for action. Lancet. 2011 Oct 22;378(9801):1515–1525. doi: 10.1016/S0140-6736(11)60827-1.
    1. Adolescent mental health. World Health Organization (WHO) 2020. Sep 28, [2020-11-04]. .
    1. U.S. Smartphone Use in 2015. Pew Research Center. 2015. Apr 1, [2019-12-04].
    1. Smartphone Ownership Is Growing Rapidly Around the World, but Not Always Equally. Pew Research Center. 2019. Feb 5, [2019-12-04].
    1. Chaffey D. Mobile marketing statistics compilation. Smart Insights. 2020. Sep 1, [2020-09-08].
    1. Körmendi A. Smartphone usage among adolescents. Psychiatr Hung. 2015;30(3):297–302.
    1. Larson RS. A path to better-quality mHealth apps. JMIR Mhealth Uhealth. 2018 Jul 30;6(7):e10414. doi: 10.2196/10414.
    1. Chan A, Kow R, Cheng JK. Adolescents’ perceptions on smartphone applications (Apps) for health management. Journal MTM. 2017 Aug 30;6(2):47–55. doi: 10.7309/jmtm.6.2.6.
    1. McLaughlin KA, Costello EJ, Leblanc W, Sampson NA, Kessler RC. Socioeconomic status and adolescent mental disorders. Am J Public Health. 2012 Sep;102(9):1742–1750. doi: 10.2105/AJPH.2011.300477.
    1. Radomski AD, Wozney L, McGrath P, Huguet A, Hartling L, Dyson MP, Bennett K, Newton AS. Design and delivery features that may improve the use of internet-based cognitive behavioral therapy for children and adolescents with anxiety: a realist literature synthesis with a persuasive systems design perspective. J Med Internet Res. 2019 Feb 05;21(2):e11128. doi: 10.2196/11128.
    1. World Health Organization (WHO) World Health Organization. Geneva, Switzerland: WHO Press; 2011. mHealth, New horizons for health through mobile technologies; pp. 1–111.
    1. Eysenbach G. The law of attrition. J Med Internet Res. 2005 Mar 31;7(1):e11. doi: 10.2196/jmir.7.1.e11.
    1. Meyerowitz-Katz G, Ravi S, Arnolda L, Feng X, Maberly G, Astell-Burt T. Rates of attrition and dropout in app-based interventions for chronic disease: systematic review and meta-analysis. J Med Internet Res. 2020 Sep 29;22(9):e20283. doi: 10.2196/20283.
    1. Topooco N, Byléhn S, Dahlström Nysäter E, Holmlund J, Lindegaard J, Johansson S, Åberg L, Bergman Nordgren L, Zetterqvist M, Andersson G. Evaluating the efficacy of internet-delivered cognitive behavioral therapy blended with synchronous chat sessions to treat adolescent depression: randomized controlled trial. J Med Internet Res. 2019 Nov 01;21(11):e13393. doi: 10.2196/13393.
    1. Adelman CB, Panza KE, Bartley CA, Bontempo A, Bloch MH. A meta-analysis of computerized cognitive-behavioral therapy for the treatment of DSM-5 anxiety disorders. J Clin Psychiatry. 2014 Jul;75(7):e695–e704. doi: 10.4088/JCP.13r08894.
    1. Mohr DC, Burns MN, Schueller SM, Clarke G, Klinkman M. Behavioral intervention technologies: evidence review and recommendations for future research in mental health. Gen Hosp Psychiatry. 2013;35(4):332–338. doi: 10.1016/j.genhosppsych.2013.03.008.
    1. Twomey C, O'Reilly G, Byrne M, Bury M, White A, Kissane S, McMahon A, Clancy N. A randomized controlled trial of the computerized CBT programme, MoodGYM, for public mental health service users waiting for interventions. Br J Clin Psychol. 2014 Nov;53(4):433–450. doi: 10.1111/bjc.12055.
    1. Melville KM, Casey LM, Kavanagh DJ. Dropout from Internet-based treatment for psychological disorders. Br J Clin Psychol. 2010 Nov;49(Pt 4):455–471. doi: 10.1348/014466509X472138.
    1. Mitchell AJ, Selmes T. Why don't patients attend their appointments? Maintaining engagement with psychiatric services. Adv Psychiatr Treat. 2018 Jan 02;13(6):423–434. doi: 10.1192/apt.bp.106.003202.
    1. Vigerland S, Lenhard F, Bonnert M, Lalouni M, Hedman E, Ahlen J, Olén O, Serlachius E, Ljótsson B. Internet-delivered cognitive behavior therapy for children and adolescents: A systematic review and meta-analysis. Clin Psychol Rev. 2016 Dec;50:1–10. doi: 10.1016/j.cpr.2016.09.005.
    1. Hans E, Hiller W. Effectiveness of and dropout from outpatient cognitive behavioral therapy for adult unipolar depression: a meta-analysis of nonrandomized effectiveness studies. J Consult Clin Psychol. 2013 Feb;81(1):75–88. doi: 10.1037/a0031080.
    1. Richardson T, Stallard P, Velleman S. Computerised cognitive behavioural therapy for the prevention and treatment of depression and anxiety in children and adolescents: a systematic review. Clin Child Fam Psychol Rev. 2010 Sep;13(3):275–290. doi: 10.1007/s10567-010-0069-9.
    1. Rooksby M, Elouafkaoui P, Humphris G, Clarkson J, Freeman R. Internet-assisted delivery of cognitive behavioural therapy (CBT) for childhood anxiety: systematic review and meta-analysis. J Anxiety Disord. 2015 Jan;29:83–92. doi: 10.1016/j.janxdis.2014.11.006.
    1. Bandura A. Self-Efficacy: The Exercise of Control. New York: W.H. Freeman & Company; 1197. Feb 15,
    1. Tak YR, Brunwasser SM, Lichtwarck-Aschoff A, Engels RCME. The prospective associations between self-efficacy and depressive symptoms from early to middle adolescence: a cross-lagged model. J Youth Adolesc. 2017 Apr;46(4):744–756. doi: 10.1007/s10964-016-0614-z.
    1. Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res. 2010 Feb 17;12(1):e4. doi: 10.2196/jmir.1376.
    1. Anderson-Bill ES, Winett RA, Wojcik JR. Social cognitive determinants of nutrition and physical activity among web-health users enrolling in an online intervention: the influence of social support, self-efficacy, outcome expectations, and self-regulation. J Med Internet Res. 2011 Mar 17;13(1):e28. doi: 10.2196/jmir.1551.
    1. Ashford S, Edmunds J, French DP. What is the best way to change self-efficacy to promote lifestyle and recreational physical activity? A systematic review with meta-analysis. Br J Health Psychol. 2010 May;15(Pt 2):265–288. doi: 10.1348/135910709X461752.
    1. Martos-Méndez MJ. Self-efficacy and adherence to treatment: the mediating effects of social support. J Behav Health Soc Issues. 2015 Nov;7(2):19–29. doi: 10.5460/jbhsi.v7.2.52889.
    1. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the System Usability Scale. Int J Hum Comput Interact. 2008 Jul 30;24(6):574–594. doi: 10.1080/10447310802205776.
    1. Lewis J, Sauro J. The Factor Structure of the System Usability Scale. In: Kurosu M, editor. Human Centered Design. Lecture Notes in Computer Science, vol 5619. Berlin: Springer-Verlag; 2009. pp. 94–103.
    1. Schwarzer R, Jerusalem M. Generalized self-efficacy scale. In: Johnston M, Weinman J, Wright SC, editors. Measures in Health Psychology: A User's Portfolio. Slough, Berkshire, UK: NFER-Nelson; 1995. pp. 35–37.
    1. Luszczynska A, Diehl M, Gutiérrez-Doña B, Kuusinen P, Schwarzer R. Measuring one component of dispositional self-regulation: attention control in goal pursuit. Person Ind Diff. 2004 Aug;37(3):555–566. doi: 10.1016/j.paid.2003.09.026.
    1. Arnarson EÖ, Smári J, Einarsdóttir H, Jónasdóttir E. The prevalence of depressive symptoms in pre-adolescent school children in Iceland. Scand J Behav Ther. 1994 Jan;23(3-4):121–130. doi: 10.1080/16506079409455969.
    1. Craighead WE, Smucker MR, Craighead LW, Ilardi SS. Factor analysis of the Children's Depression Inventory in a community sample. Psychol Assess. 1998;10(2):156–165. doi: 10.1037/1040-3590.10.2.156.
    1. March JS, Parker JD, Sullivan K, Stallings P, Conners CK. The Multidimensional Anxiety Scale for Children (MASC): factor structure, reliability, and validity. J Am Acad Child Adolesc Psychiatry. 1997 Apr;36(4):554–565. doi: 10.1097/00004583-199704000-00019.
    1. Olason DT, Sighvatsson MB, Smári J. Psychometric properties of the Multidimensional Anxiety Scale for Children (MASC) among Icelandic schoolchildren. Scand J Psychol. 2004 Nov;45(5):429–436. doi: 10.1111/j.1467-9450.2004.00424.x.
    1. Owens JA, Dalzell V. Use of the 'BEARS' sleep screening tool in a pediatric residents' continuity clinic: a pilot study. Sleep Med. 2005 Jan;6(1):63–69. doi: 10.1016/j.sleep.2004.07.015.
    1. Bloom T, Sharpe L, Mullan B, Zucker N. A pilot evaluation of appetite-awareness training in the treatment of childhood overweight and obesity: a preliminary investigation. Int J Eat Disord. 2013 Jan;46(1):47–51. doi: 10.1002/eat.22041.
    1. Gunnarsdottir T, Njardvik U, Olafsdottir A, Craighead L, Bjarnason R. Childhood obesity and co-morbid problems: effects of Epstein's family-based behavioural treatment in an Icelandic sample. J Eval Clin Pract. 2012 Apr;18(2):465–472. doi: 10.1111/j.1365-2753.2010.01603.x.

Source: PubMed

Sponsors en medewerkers

Medische omstandigheden

Geneesmiddelinterventies

3
Abonneren