Acceptability, Engagement, and Effects of a Mobile Digital Intervention to Support Mental Health for Young Adults Transitioning to College: Pilot Randomized Controlled Trial

Brian Suffoletto, Tina Goldstein, Dawn Gotkiewicz, Emily Gotkiewicz, Brandie George, David Brent, Brian Suffoletto, Tina Goldstein, Dawn Gotkiewicz, Emily Gotkiewicz, Brandie George, David Brent

Abstract

Background: The transition from high school to college can exacerbate mental health problems in young adults yet barriers prevent seamless mental health care. Existing digital support tools show promise but are not yet designed to optimize engagement or implementation.

Objective: The goal of the research was to test acceptability and effects of an automated digital Mobile Support Tool for Mental Health (MoST-MH) for young adults transitioning to college.

Methods: Youths aged 18 years and older with a current mental health diagnosis preparing to transition to college (n=52; 85% female [45/52], 91% White [48/52]) were recruited from a primary care (n=31) and a mental health clinic (n=21). Participants were randomized 2:1 to either receive MoST-MH (n=34) or enhanced Usual Care (eUC; n=18). MoST-MH included periodic text message and web-based check-ins of emotional health, stressors, negative impacts, and self-efficacy that informed tailored self-care support messages. Both eUC and MoST-MH participants received links to a library of psychoeducational videos and were asked to complete web-based versions of the Mental Health Self-Efficacy Scale (MHSES), College Counseling Center Assessment of Psychological Symptoms (CCAPS), and Client Service Receipt Inventory for Mental Health (C-SRI) monthly for 3 months and the Post-Study System Usability Scale (PSSUQ) at 3-months.

Results: MoST-MH participants were sent a median of 5 (range 3 to 10) text message check-in prompts over the 3-month study period and 100% were completed; participants were sent a median of 2 (range 1 to 8) web-based check-in prompts among which 78% (43/55) were completed. PSSUQ scores indicate high usability (mean score 2.0). Results from the completer analysis demonstrated reductions in mental health symptoms over time and significant between-group effects of MoST-MH compared to eUC on depressive symptom severity (d=0.36, 95% CI 0.08 to 0.64). No significant differences in mental health self-efficacy or mental health health care use were observed.

Conclusions: In this pilot trial, we found preliminary evidence that MoST-MH was engaged with at high rates and found to be highly usable and reduced depression symptoms relative to eUC among youth with mental health disorders transitioning to college. Findings were measured during the COVID-19 pandemic, and the study was not powered to detect differences in outcomes between groups; therefore, further testing is needed.

Trial registration: ClinicalTrials.gov NCT04560075; https://ichgcp.net/clinical-trials-registry/NCT04560075.

Keywords: college; digital intervention; mHealth; mental health; self-management.

Conflict of interest statement

Conflicts of Interest: TG received research funding from the National Institute of Mental Health, American Foundation for Suicide Prevention, and University Of Pittsburgh Clinical and Translational Science Institute and royalties from Guilford Press.

©Brian Suffoletto, Tina Goldstein, Dawn Gotkiewicz, Emily Gotkiewicz, Brandie George, David Brent. Originally published in JMIR Formative Research (https://formative.jmir.org), 14.10.2021.

Figures

Figure 1
Figure 1
Mobile Support Tool for Mental Health design diagram.
Figure 2
Figure 2
Mobile Support Tool for Mental Health example exchange.
Figure 3
Figure 3
Consolidated Standards of Reporting Trials diagram. eUC: enhanced usual care; MoST-MH: Mobile Support Tool for Mental Health.
Figure 4
Figure 4
Change over time in College Counseling Center Assessment of Psychological Symptoms subscales. eUC: enhanced usual care; MoST-MH: Mobile Support Tool for Mental Health.

References

    1. Auerbach RP, Alonso J, Axinn WG, Cuijpers P, Ebert DD, Green JG, Hwang I, Kessler RC, Liu H, Mortier P, Nock MK, Pinder-Amaker S, Sampson NA, Aguilar-Gaxiola S, Al-Hamzawi A, Andrade LH, Benjet C, Caldas-de-Almeida JM, Demyttenaere K, Florescu S, Gureje O, Haro JM, Karam EG, Kiejna A, Kovess-Masfety V, Lee S, McGrath JJ, O'Neill S, Pennell B, Scott K, Torres Y, Zaslavsky AM, Zarkov Z, Bruffaerts R. Mental disorders among college students in the World Health Organization World Mental Health Surveys. Psychol Med. 2016 Oct;46(14):2955–2970. doi: 10.1017/S0033291716001665. S0033291716001665
    1. National college health assessment: executive summary report. Silver Spring: American College Health Association; 2019. [2021-02-03]. .
    1. Duffy ME, Twenge JM, Joiner TE. Trends in mood and anxiety symptoms and suicide-related outcomes among U.S. undergraduates, 2007-2018: evidence from two national surveys. J Adolesc Health. 2019 Nov;65(5):590–598. doi: 10.1016/j.jadohealth.2019.04.033.S1054-139X(19)30254-X
    1. Keyes CLM, Eisenberg D, Perry GS, Dube SR, Kroenke K, Dhingra SS. The relationship of level of positive mental health with current mental disorders in predicting suicidal behavior and academic impairment in college students. J Am Coll Health. 2012 Feb;60(2):126–133. doi: 10.1080/07448481.2011.608393.
    1. Goodwin GM. Depression and associated physical diseases and symptoms. Dialogues Clin Neurosci. 2006;8(2):259–65.
    1. Liu CH, Stevens C, Wong SH, Yasui M, Chen JA. The prevalence and predictors of mental health diagnoses and suicide among U.S. college students: implications for addressing disparities in service use. Depress Anxiety. 2019 Jan 06;36(1):8–17. doi: 10.1002/da.22830.
    1. Karyotaki E, Cuijpers P, Albor Y, Alonso J, Auerbach RP, Bantjes J, Bruffaerts R, Ebert DD, Hasking P, Kiekens G, Lee S, McLafferty M, Mak A, Mortier P, Sampson NA, Stein DJ, Vilagut G, Kessler RC. Sources of stress and their associations with mental disorders among college students: results of the World Health Organization World Mental Health Surveys International College Student Initiative. Front Psychol. 2020 Jul 30;11:1759. doi: 10.3389/fpsyg.2020.01759. doi: 10.3389/fpsyg.2020.01759.
    1. Stewart JG, Shields GS, Esposito EC, Cosby EA, Allen NB, Slavich GM, Auerbach RP. Life stress and suicide in adolescents. J Abnorm Child Psychol. 2019 Oct 26;47(10):1707–1722. doi: 10.1007/s10802-019-00534-5. 10.1007/s10802-019-00534-5
    1. Eisenberg D, Downs MF, Golberstein E, Zivin K. Stigma and help seeking for mental health among college students. Med Care Res Rev. 2009 Oct 19;66(5):522–541. doi: 10.1177/1077558709335173.1077558709335173
    1. Xiao H, Carney DM, Youn SJ, Janis RA, Castonguay LG, Hayes JA, Locke BD. Are we in crisis? National mental health and treatment trends in college counseling centers. Psychol Serv. 2017 Nov;14(4):407–415. doi: 10.1037/ser0000130.2017-49948-002
    1. Salaheddin K, Mason B. Identifying barriers to mental health help-seeking among young adults in the UK: a cross-sectional survey. Br J Gen Pract. 2016 Sep 29;66(651):e686–e692. doi: 10.3399/bjgp16x687313.
    1. Herman S, Archambeau OG, Deliramich AN, Kim BSK, Chiu PH, Frueh BC. Depressive symptoms and mental health treatment in an ethnoracially diverse college student sample. J Am Coll Health. 2011 Nov;59(8):715–720. doi: 10.1080/07448481.2010.529625.
    1. Lattie EG, Adkins EC, Winquist N, Stiles-Shields C, Wafford QE, Graham AK. Digital mental health interventions for depression, anxiety, and enhancement of psychological well-being among college students: systematic review. J Med Internet Res. 2019 Jul 22;21(7):e12869. doi: 10.2196/12869. v21i7e12869
    1. Oliveira C, Pereira A, Vagos P, Nóbrega C, Gonçalves José, Afonso B. Effectiveness of mobile app-based psychological interventions for college students: a systematic review of the literature. Front Psychol. 2021 May 11;12:647606. doi: 10.3389/fpsyg.2021.647606.
    1. Torous J, Nicholas J, Larsen ME, Firth J, Christensen H. Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements. Evid Based Ment Health. 2018 Aug 05;21(3):116–119. doi: 10.1136/eb-2018-102891.eb-2018-102891
    1. Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol. 2010 Feb;15(Pt 1):1–39. doi: 10.1348/135910709X466063. bjhp696
    1. Lenhart A. Teens, smartphones and texting. Washington: Pew Internet and American Life Project; 2012. [2020-12-04]. .
    1. Hall AK, Cole-Lewis H, Bernhardt JM. Mobile text messaging for health: a systematic review of reviews. Annu Rev Public Health. 2015 Mar 18;36:393–415. doi: 10.1146/annurev-publhealth-031914-122855.
    1. Lewis JR. IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int J Human Comput Interact. 1995 Jan;7(1):57–78. doi: 10.1080/10447319509526110.
    1. Clarke J, Proudfoot J, Birch M, Whitton AE, Parker G, Manicavasagar V, Harrison V, Christensen H, Hadzi-Pavlovic D. Effects of mental health self-efficacy on outcomes of a mobile phone and web intervention for mild-to-moderate depression, anxiety and stress: secondary analysis of a randomised controlled trial. BMC Psychiatry. 2014;14:272. doi: 10.1186/s12888-014-0272-1. s12888-014-0272-1
    1. McAleavey AA, Nordberg SS, Hayes JA, Castonguay LG, Locke BD, Lockard AJ. Clinical validity of the counseling center assessment of psychological symptoms-62 (CCAPS-62): further evaluation and clinical applications. J Couns Psychol. 2012 Oct;59(4):575–590. doi: 10.1037/a0029855.2012-23734-001
    1. Beecham J, Knapp M. Costing psychiatric interventions. In: Thornicroft G, editor. Measuring Mental Health Needs. Bideford: Edward Gaskell Publishers; 2001. pp. 200–224.
    1. Hardin J, Hilbe J. Generalized Estimating Equations. Boca Raton: Chapman and Hall/CRC Press; 2003.
    1. Rickwood D, Bradford S. The role of self-help in the treatment of mild anxiety disorders in young people: an evidence-based review. Psychol Res Behav Manag. 2012;5:25–36. doi: 10.2147/PRBM.S23357. doi: 10.2147/PRBM.S23357.prbm-5-025
    1. Garrido S, Millington C, Cheers D, Boydell K, Schubert E, Meade T, Nguyen QV. What works and what doesn't work? A systematic review of digital mental health interventions for depression and anxiety in young people. Front Psychiatry. 2019 Nov 13;10:759. doi: 10.3389/fpsyt.2019.00759. doi: 10.3389/fpsyt.2019.00759.
    1. MacDougall S, Jerrott S, Clark S, Campbell LA, Murphy A, Wozney L. Text message interventions in adolescent mental health and addiction services: scoping review. JMIR Ment Health. 2021 Jan 08;8(1):e16508. doi: 10.2196/16508. v8i1e16508

Source: PubMed

3
Tilaa