A Smartphone Intervention for People With Serious Mental Illness: Fully Remote Randomized Controlled Trial of CORE

Dror Ben-Zeev, Ayesha Chander, Justin Tauscher, Benjamin Buck, Subigya Nepal, Andrew Campbell, Guy Doron, Dror Ben-Zeev, Ayesha Chander, Justin Tauscher, Benjamin Buck, Subigya Nepal, Andrew Campbell, Guy Doron

Abstract

Background: People with serious mental illness (SMI) have significant unmet mental health needs. Development and testing of digital interventions that can alleviate the suffering of people with SMI is a public health priority.

Objective: The aim of this study is to conduct a fully remote randomized waitlist-controlled trial of CORE, a smartphone intervention that comprises daily exercises designed to promote reassessment of dysfunctional beliefs in multiple domains.

Methods: Individuals were recruited via the web using Google and Facebook advertisements. Enrolled participants were randomized into either active intervention or waitlist control groups. Participants completed the Beck Depression Inventory-Second Edition (BDI-II), Generalized Anxiety Disorder-7 (GAD-7), Hamilton Program for Schizophrenia Voices, Green Paranoid Thought Scale, Recovery Assessment Scale (RAS), Rosenberg Self-Esteem Scale (RSES), Friendship Scale, and Sheehan Disability Scale (SDS) at baseline (T1), 30-day (T2), and 60-day (T3) assessment points. Participants in the active group used CORE from T1 to T2, and participants in the waitlist group used CORE from T2 to T3. Both groups completed usability and accessibility measures after they concluded their intervention periods.

Results: Overall, 315 individuals from 45 states participated in this study. The sample comprised individuals with self-reported bipolar disorder (111/315, 35.2%), major depressive disorder (136/315, 43.2%), and schizophrenia or schizoaffective disorder (68/315, 21.6%) who displayed moderate to severe symptoms and disability levels at baseline. Participants rated CORE as highly usable and acceptable. Intent-to-treat analyses showed significant treatment×time interactions for the BDI-II (F1,313=13.38; P<.001), GAD-7 (F1,313=5.87; P=.01), RAS (F1,313=23.42; P<.001), RSES (F1,313=19.28; P<.001), and SDS (F1,313=10.73; P=.001). Large effects were observed for the BDI-II (d=0.58), RAS (d=0.61), and RSES (d=0.64); a moderate effect size was observed for the SDS (d=0.44), and a small effect size was observed for the GAD-7 (d=0.20). Similar changes in outcome measures were later observed in the waitlist control group participants following crossover after they received CORE (T2 to T3). Approximately 41.5% (64/154) of participants in the active group and 60.2% (97/161) of participants in the waitlist group were retained at T2, and 33.1% (51/154) of participants in the active group and 40.3% (65/161) of participants in the waitlist group were retained at T3.

Conclusions: We successfully recruited, screened, randomized, treated, and assessed a geographically dispersed sample of participants with SMI entirely via the web, demonstrating that fully remote clinical trials are feasible in this population; however, study retention remains challenging. CORE showed promise as a usable, acceptable, and effective tool for reducing the severity of psychiatric symptoms and disability while improving recovery and self-esteem. Rapid adoption and real-world dissemination of evidence-based mobile health interventions such as CORE are needed if we are to shorten the science-to-service gap and address the significant unmet mental health needs of people with SMI during the COVID-19 pandemic and beyond.

Trial registration: ClinicalTrials.gov NCT04068467; https://ichgcp.net/clinical-trials-registry/NCT04068467.

Keywords: bipolar disorder; depression; mobile health; mobile phone; schizophrenia.

Conflict of interest statement

Conflicts of Interest: DBZ has an intervention content licensing agreement with Pear Therapeutics and has a financial interest in Merlin LLC and FOCUS technology. He has consulted with Trusst Health, K Health, eQuility, and Otsuka Pharmaceuticals Ltd. GD is the cofounder of GGtude Ltd and has a financial interest in the CORE app described in this paper. Data analyses were conducted by members of the team who were unaffiliated with GGtude Ltd. All the remaining authors have no conflicts of interest to declare.

©Dror Ben-Zeev, Ayesha Chander, Justin Tauscher, Benjamin Buck, Subigya Nepal, Andrew Campbell, Guy Doron. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 12.11.2021.

Figures

Figure 1
Figure 1
Screenshots of the (a) targeted beliefs menu, (b) an example of a maladaptive statement, and (c) a psychoeducational element.
Figure 2
Figure 2
CONSORT (Consolidated Standards of Reporting Trials) diagram.
Figure 3
Figure 3
Map of participants enrolled based on location.
Figure 4
Figure 4
Outcome measures (y-axis) at baseline (T1), 30 days (T2), and 60 days (T3) assessments points (x-axis) for active group and waitlist control group. BDI-II: Beck Depression Inventory-Second Edition; GAD-7: Generalized Anxiety Disorder-7; GPTS: Green Paranoid Thought Scale; HPSVQ: Hamilton Program for Schizophrenia Voices; RAS: Recovery Assessment Scale; RSES: Rosenberg Self-esteem Scale; SDS: Sheehan Disability Scale.

References

    1. Harvey PD, Heaton RK, Carpenter WT, Green MF, Gold JM, Schoenbaum M. Functional impairment in people with schizophrenia: focus on employability and eligibility for disability compensation. Schizophr Res. 2012 Sep;140(1-3):1–8. doi: 10.1016/j.schres.2012.03.025. S0920-9964(12)00178-8
    1. Folsom DP, Hawthorne W, Lindamer L, Gilmer T, Bailey A, Golshan S, Garcia P, Unützer J, Hough R, Jeste DV. Prevalence and risk factors for homelessness and utilization of mental health services among 10,340 patients with serious mental illness in a large public mental health system. Am J Psychiatry. 2005 Feb;162(2):370–6. doi: 10.1176/appi.ajp.162.2.370.162/2/370
    1. Sylvestre J, Notten G, Kerman N, Polillo A, Czechowki K. Poverty and serious mental illness: toward action on a seemingly intractable problem. Am J Community Psychol. 2018 Mar;61(1-2):153–65. doi: 10.1002/ajcp.12211.
    1. Rosenblatt RA, Andrilla CH, Curtin T, Hart LG. Shortages of medical personnel at community health centers: implications for planned expansion. JAMA. 2006 Mar 01;295(9):1042–9. doi: 10.1001/jama.295.9.1042.295/9/1042
    1. Rosenberg S, Rosenberg J. Community Mental Health: Challenges for the 21st Century. New York: Routledge; 2017.
    1. Mojtabai R, Fochtmann L, Chang S, Kotov R, Craig TJ, Bromet E. Unmet need for mental health care in schizophrenia: an overview of literature and new data from a first-admission study. Schizophr Bull. 2009 Jul;35(4):679–95. doi: 10.1093/schbul/sbp045. sbp045
    1. Mojtabai R, Olfson M, Sampson NA, Jin R, Druss B, Wang PS, Wells KB, Pincus HA, Kessler RC. Barriers to mental health treatment: results from the National Comorbidity Survey Replication. Psychol Med. 2011 Aug;41(8):1751–61. doi: 10.1017/S0033291710002291. S0033291710002291
    1. Ben-Zeev D, Young MA, Corrigan PW. DSM-V and the stigma of mental illness. J Ment Health. 2010 Aug;19(4):318–27. doi: 10.3109/09638237.2010.492484.
    1. Corrigan PW, Druss BG, Perlick DA. The impact of mental illness stigma on seeking and participating in mental health care. Psychol Sci Public Interest. 2014 Oct;15(2):37–70. doi: 10.1177/1529100614531398.15/2/37
    1. Firth J, Cotter J, Torous J, Bucci S, Firth JA, Yung AR. Mobile phone ownership and endorsement of "mHealth" among people with psychosis: a meta-analysis of cross-sectional studies. Schizophr Bull. 2016 Mar;42(2):448–55. doi: 10.1093/schbul/sbv132. sbv132
    1. Ben-Zeev D, Davis KE, Kaiser S, Krzsos I, Drake RE. Mobile technologies among people with serious mental illness: opportunities for future services. Adm Policy Ment Health. 2013 Jul;40(4):340–3. doi: 10.1007/s10488-012-0424-x.
    1. Ben-Zeev D. Mobile health for all: public-private partnerships can create a new mental health landscape. JMIR Ment Health. 2016 Jun 06;3(2):e26. doi: 10.2196/mental.5843. v3i2e26
    1. Aschbrenner KA, Naslund JA, Grinley T, Bienvenida JC, Bartels SJ, Brunette M. A survey of online and mobile technology use at peer support agencies. Psychiatr Q. 2018 Sep;89(3):539–48. doi: 10.1007/s11126-017-9561-4. 10.1007/s11126-017-9561-4
    1. Brunette MF, Achtyes E, Pratt S, Stilwell K, Opperman M, Guarino S, Kay-Lambkin F. Use of smartphones, computers and social media among people with SMI: opportunity for intervention. Community Ment Health J. 2019 Aug;55(6):973–8. doi: 10.1007/s10597-019-00431-7. 10.1007/s10597-019-00431-7
    1. Young AS, Cohen AN, Niv N, Nowlin-Finch N, Oberman RS, Olmos-Ochoa TT, Goldberg RW, Whelan F. Mobile phone and smartphone use by people with serious mental illness. Psychiatr Serv. 2020 Mar 01;71(3):280–3. doi: 10.1176/appi.ps.201900203.
    1. Noel VA, Acquilano SC, Carpenter-Song E, Drake RE. Use of mobile and computer devices to support recovery in people with serious mental illness: survey study. JMIR Ment Health. 2019 Feb 20;6(2):e12255. doi: 10.2196/12255. v6i2e12255
    1. Nicholas J, Larsen ME, Proudfoot J, Christensen H. Mobile apps for bipolar disorder: a systematic review of features and content quality. J Med Internet Res. 2015 Aug 17;17(8):e198. doi: 10.2196/jmir.4581. v17i8e198
    1. Camacho E, Levin L, Torous J. Smartphone apps to support coordinated specialty care for prodromal and early course schizophrenia disorders: systematic review. J Med Internet Res. 2019 Nov 12;21(11):e16393. doi: 10.2196/16393. v21i11e16393
    1. Fortuna KL, Naslund JA, LaCroix JM, Bianco CL, Brooks JM, Zisman-Ilani Y, Muralidharan A, Deegan P. Digital peer support mental health interventions for people with a lived experience of a serious mental illness: systematic review. JMIR Ment Health. 2020 Apr 03;7(4):e16460. doi: 10.2196/16460. v7i4e16460
    1. Gul RB, Ali PA. Clinical trials: the challenge of recruitment and retention of participants. J Clin Nurs. 2010 Jan;19(1-2):227–33. doi: 10.1111/j.1365-2702.2009.03041.x.JCN3041
    1. Caldwell PH, Hamilton S, Tan A, Craig JC. Strategies for increasing recruitment to randomised controlled trials: systematic review. PLoS Med. 2010 Nov 09;7(11):e1000368. doi: 10.1371/journal.pmed.1000368.
    1. Kreyenbuhl J, Nossel IR, Dixon LB. Disengagement from mental health treatment among individuals with schizophrenia and strategies for facilitating connections to care: a review of the literature. Schizophr Bull. 2009 Jul;35(4):696–703. doi: 10.1093/schbul/sbp046. sbp046
    1. Smith TE, Easter A, Pollock M, Pope LG, Wisdom JP. Disengagement from care: perspectives of individuals with serious mental illness and of service providers. Psychiatr Serv. 2013 Aug 01;64(8):770–5. doi: 10.1176/appi.ps.201200394.1684796
    1. Brøgger-Mikkelsen M, Ali Z, Zibert JR, Andersen AD, Thomsen SF. Online patient recruitment in clinical trials: systematic review and meta-analysis. J Med Internet Res. 2020 Nov 04;22(11):e22179. doi: 10.2196/22179. v22i11e22179
    1. Irvine AB, Gelatt VA, Seeley JR, Macfarlane P, Gau JM. Web-based intervention to promote physical activity by sedentary older adults: randomized controlled trial. J Med Internet Res. 2013 Feb 05;15(2):e19. doi: 10.2196/jmir.2158. v15i2e19
    1. Clarke J, Sanatkar S, Baldwin PA, Fletcher S, Gunn J, Wilhelm K, Campbell L, Zwar N, Harris M, Lapsley H, Hadzi-Pavlovic D, Christensen H, Proudfoot J. A web-based cognitive behavior therapy intervention to improve social and occupational functioning in adults with type 2 diabetes (The SpringboarD Trial): randomized controlled trial. J Med Internet Res. 2019 May 21;21(5):e12246. doi: 10.2196/12246. v21i5e12246
    1. Pratap A, Renn BN, Volponi J, Mooney SD, Gazzaley A, Arean PA, Anguera JA. Using mobile apps to assess and treat depression in Hispanic and Latino populations: fully remote randomized clinical trial. J Med Internet Res. 2018 Aug 09;20(8):e10130. doi: 10.2196/10130. v20i8e10130
    1. Arean PA, Hallgren KA, Jordan JT, Gazzaley A, Atkins DC, Heagerty PJ, Anguera JA. The use and effectiveness of mobile apps for depression: results from a fully remote clinical trial. J Med Internet Res. 2016 Dec 20;18(12):e330. doi: 10.2196/jmir.6482. v18i12e330
    1. Moberg C, Niles A, Beermann D. Guided self-help works: randomized waitlist controlled trial of Pacifica, a mobile app integrating cognitive behavioral therapy and mindfulness for stress, anxiety, and depression. J Med Internet Res. 2019 Jun 08;21(6):e12556. doi: 10.2196/12556. v21i6e12556
    1. Anguera JA, Jordan JT, Castaneda D, Gazzaley A, Areán PA. Conducting a fully mobile and randomised clinical trial for depression: access, engagement and expense. BMJ Innov. 2016 Jan;2(1):14–21. doi: 10.1136/bmjinnov-2015-000098. bmjinnov-2015-000098
    1. Beck AT, Steer RA, Brown GK. Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation; 1996.
    1. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006 May 22;166(10):1092–7. doi: 10.1001/archinte.166.10.1092.166/10/1092
    1. Van Lieshout RJ, Goldberg JO. Quantifying self-reports of auditory verbal hallucinations in persons with psychosis. Can J Behav Sci/ Revue canadienne des sciences du comportement. 2007;39(1):73–7. doi: 10.1037/cjbs2007006.
    1. Green CE, Freeman D, Kuipers E, Bebbington P, Fowler D, Dunn G, Garety PA. Measuring ideas of persecution and social reference: the Green et al. Paranoid Thought Scales (GPTS) Psychol Med. 2008 Jan;38(1):101–11. doi: 10.1017/S0033291707001638.S0033291707001638
    1. Salzer MS, Brusilovskiy E. Advancing recovery science: reliability and validity properties of the Recovery Assessment Scale. Psychiatr Serv. 2014 Apr 01;65(4):442–53. doi: 10.1176/appi.ps.201300089.1827874
    1. Corrigan PW, Salzer M, Ralph RO, Sangster Y, Keck L. Examining the factor structure of the recovery assessment scale. Schizophr Bull. 2004;30(4):1035–41. doi: 10.1093/oxfordjournals.schbul.a007118.
    1. Rosenberg M. Society and the Adolescent Self-Image. Princeton, NJ: Princeton University Press; 2015.
    1. Hawthorne G, Griffith P. The Friendship Scale: Development and Properties. Melbourne: Centre for Program Evaluation; 2000.
    1. Sheehan DV. The Anxiety Disease. New York: Scribner; 1983.
    1. Lewis J. Psychometric evaluation of the PSSUQ using data from five years of usability studies. Int J Human Comput Interac. 2002 Sep;14(3-4):463–88. doi: 10.1080/10447318.2002.9669130.
    1. Venkatesh V, Davis FD. A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag Sci. 2000 Feb;46(2):186–204. doi: 10.1287/mnsc.46.2.186.11926.
    1. Lund A. Measuring usability with the USE questionnaire. Usablity Interf. 2001;8(2):3–6. doi: 10.1177/1078087402250360.
    1. Ben-Zeev D, Brenner CJ, Begale M, Duffecy J, Mohr DC, Mueser KT. Feasibility, acceptability, and preliminary efficacy of a smartphone intervention for schizophrenia. Schizophr Bull. 2014 Nov;40(6):1244–53. doi: 10.1093/schbul/sbu033. sbu033
    1. Aboody D, Siev J, Doron G. Building resilience to body image triggers using brief cognitive training on a mobile application: a randomized controlled trial. Behav Res Ther. 2020 Nov;134:103723. doi: 10.1016/j.brat.2020.103723.S0005-7967(20)30177-7
    1. Cerea S, Ghisi M, Bottesi G, Carraro E, Broggio D, Doron G. Reaching reliable change using short, daily, cognitive training exercises delivered on a mobile application: the case of Relationship Obsessive Compulsive Disorder (ROCD) symptoms and cognitions in a subclinical cohort. J Affect Disord. 2020 Nov 01;276:775–87. doi: 10.1016/j.jad.2020.07.043.S0165-0327(20)32488-5
    1. Roncero M, Belloch A, Doron G. Can brief, daily training using a mobile app help change maladaptive beliefs? Crossover randomized controlled trial. JMIR Mhealth Uhealth. 2019 Feb 13;7(2):e11443. doi: 10.2196/11443. v7i2e11443
    1. Giraldo-O'Meara M, Doron G. Can self-esteem be improved using short daily training on mobile applications? Examining real world data of GG Self-esteem users. Clin Psychol. 2021 May 17;:131-139. doi: 10.1111/cp.12219.
    1. Gupta SK. Intention-to-treat concept: a review. Perspect Clin Res. 2011 Jul;2(3):109–12. doi: 10.4103/2229-3485.83221. PCR-2-109
    1. Cheema JR. Some general guidelines for choosing missing data handling methods in educational research. J Mod App Stat Meth. 2014 Nov 01;13(2):53–75. doi: 10.22237/jmasm/1414814520.
    1. Vallejo G, Fernández MP, Livacic-Rojas PE, Tuero-Herrero E. Comparison of modern methods for analyzing repeated measures data with missing values. Multivariate Behav Res. 2011 Nov 30;46(6):900–37. doi: 10.1080/00273171.2011.625320.
    1. Little RJ. Pattern-mixture models for multivariate incomplete data. J Am Stat Assoc. 1993 Mar 20;88(421):125–34. doi: 10.2307/2290705.
    1. Crosier BS, Brian RM, Ben-Zeev D. Using Facebook to reach people who experience auditory hallucinations. J Med Internet Res. 2016 Jun 14;18(6):e160. doi: 10.2196/jmir.5420. v18i6e160
    1. Ben-Zeev D, Buck B, Chander A, Brian R, Wang W, Atkins D, Brenner C, Cohen T, Campbell A, Munson J. Mobile RDoC: using smartphones to understand the relationship between auditory verbal hallucinations and need for care. Schizophr Bull Open. 2020 Nov 9;1(1):sgaa060. doi: 10.1093/schizbullopen/sgaa060. sgaa060
    1. Ben-Zeev D, Atkins DC. Bringing digital mental health to where it is needed most. Nat Hum Behav. 2017 Dec;1(12):849–51. doi: 10.1038/s41562-017-0232-0.10.1038/s41562-017-0232-0
    1. Bell IH, Lim MH, Rossell SL, Thomas N. Ecological momentary assessment and intervention in the treatment of psychotic disorders: a systematic review. Psychiatr Serv. 2017 Nov 01;68(11):1172–81. doi: 10.1176/appi.ps.201600523.
    1. Depp CA, Moore RC, Perivoliotis D, Granholm E. Technology to assess and support self-management in serious mental illness. Dialogues Clin Neurosci. 2016 Jun;18(2):171–83.
    1. Noel VA, Carpenter-Song E, Acquilano SC, Torous J, Drake RE. The technology specialist: a 21st century support role in clinical care. NPJ Digit Med. 2019 Jun 26;2:61. doi: 10.1038/s41746-019-0137-6. doi: 10.1038/s41746-019-0137-6.137
    1. Jonathan GK, Pivaral L, Ben-Zeev D. Augmenting mHealth with human support: notes from community care of people with serious mental illnesses. Psychiatr Rehabil J. 2017 Sep;40(3):336–8. doi: 10.1037/prj0000275. 2017-39812-003
    1. Ben-Zeev D, Buck B, Chu PV, Razzano L, Pashka N, Hallgren KA. Transdiagnostic mobile health: smartphone intervention reduces depressive symptoms in people with mood and psychotic disorders. JMIR Ment Health. 2019 Apr 12;6(4):e13202. doi: 10.2196/13202. v6i4e13202
    1. Brewin CR. Understanding cognitive behaviour therapy: a retrieval competition account. Behav Res Ther. 2006 Jun;44(6):765–84. doi: 10.1016/j.brat.2006.02.005.S0005-7967(06)00047-7
    1. Arean PA, Hallgren KA, Jordan JT, Gazzaley A, Atkins DC, Heagerty PJ, Anguera JA. The use and effectiveness of mobile apps for depression: results from a fully remote clinical trial. J Med Internet Res. 2016 Dec 20;18(12):e330. doi: 10.2196/jmir.6482. v18i12e330
    1. Mohr DC, Azocar F, Bertagnolli A, Choudhury T, Chrisp P, Frank R, Harbin H, Histon T, Kaysen D, Nebeker C, Richards D, Schueller SM, Titov N, Torous J, Areán PA, Banbury Forum on Digital Mental Health Banbury forum consensus statement on the path forward for digital mental health treatment. Psychiatr Serv. 2021 Jun;72(6):677–83. doi: 10.1176/appi.ps.202000561.
    1. Opportunities and challenges of developing information technologies on behavioral and social science clinical research. National Institute of Mental Health. 2018. [2021-10-21]. .
    1. Ben-Zeev D. The digital mental health genie is out of the bottle. Psychiatr Serv. 2020 Dec 01;71(12):1212–3. doi: 10.1176/appi.ps.202000306.
    1. Torous J, Jän Myrick K, Rauseo-Ricupero N, Firth J. Digital mental health and COVID-19: using technology today to accelerate the curve on access and quality tomorrow. JMIR Ment Health. 2020 Mar 26;7(3):e18848. doi: 10.2196/18848. v7i3e18848
    1. Enforcement policy for digital health devices for treating psychiatric disorders during the coronavirus disease 2019 (COVID-19) public health emergency. U.S Food & Drug Administration. 2020. [2021-10-20]. .

Source: PubMed

3
Abonnere