Effectiveness of Mental Health Apps for Distress During COVID-19 in US Unemployed and Essential Workers: Remote Pragmatic Randomized Clinical Trial

Katherine Anne Comtois, Felicia Mata-Greve, Morgan Johnson, Michael D Pullmann, Brittany Mosser, Patricia Arean, Katherine Anne Comtois, Felicia Mata-Greve, Morgan Johnson, Michael D Pullmann, Brittany Mosser, Patricia Arean

Abstract

Background: During the COVID-19 pandemic, the general public was concerned about the mental health impacts of unemployment due to COVID-19 and the stress essential workers experienced during this time. Several reports indicated that people in distress were turning to digital technology, but there was little evidence about the impact of these tools on mitigating distress.

Objective: This study seeks to determine the acceptability, feasibility, usability, and effectiveness of mobile mental health apps for decreasing mental health symptoms in essential workers and unemployed individuals with suicide risk.

Methods: We recruited participants who indicated that they were unemployed because of COVID-19 or were COVID-19-designated essential workers. Participants were randomized to 1 of 4 free commercial mobile apps for managing distress that were (1) highly rated by PsyberGuide and (2) met the criteria for intervention features these participants indicated were desirable in a previous survey. Participants used the apps for 4 weeks and completed baseline and 4-week self-assessments of depression, anxiety emotional regulation, and suicide risk.

Results: We found no differences between the apps in any outcome but did find significant changes in depression and anxiety over time (Patient Health Questionnaire [PHQ]-9: estimate=-1.5, SE 0.2, 95% CI -1.1 to -1.8, P<.001; Generalized Anxiety Disorder Scale [GAD]-7: estimate=-1.3, SE 0.2, 95% CI -1.0 to -1.6, P<.001). We found no significant changes in suicidal behavior (Suicide Behaviors Questionnaire-Revised [SBQ-R]) or emotional regulation (Difficulties in Emotion Regulation Scale - Short Form [DERS-SF]) for the 4 weeks. We did find a significant dose-response pattern for changes in depression and anxiety. Using the app at least once a week resulted in greater improvements in treatment conditions over time on depression (estimate=-0.6, SE 0.2, 95% CI 1.0-0.2, P=.003) and anxiety (estimate=0.1, SE 0.2, 95% CI 0.4-0.6, P=.78). There was no association between app frequency and changes in suicidal behavior (SBQ-R) or emotional regulation (DERS-SF). We further found a significant difference between the conditions with regard to app usability, with the control app being the most usable (meanBeautiful Mood 72.9, SD 16.7; meanCOVID Coach 71.2, SD 15.4; meanCalm 66.8, SD 17.3; mean7 Cups 65.2, SD 17.7). We found no significant differences for app acceptability or appropriateness.

Conclusions: Few studies have evaluated prospectively the utility and usability of commercial apps for mood. This study found that free, self-guided commercial mobile mental health apps are seen as usable, but no one app is superior to the other. Although we found that regular use is indicated for effects on depression and anxiety to occur in those who are more symptomatic, regression to the mean cannot be ruled out.

Trial registration: ClinicalTrials.gov NCT04536935; https://tinyurl.com/mr36zx3s.

Keywords: COVID; COVID-19; RCT; SARS-CoV-2; anxiety; commercial app; coronavirus; depression; distress; employee; employment; essential worker; frontline staff; health app; health care provider; health care worker; job; mHealth; mental health; mental health apps; mobile app; mobile health; occupational health; pandemic; pragmatic trial; randomized; stress; suicidal; suicide; unemployed; worker.

Conflict of interest statement

Conflicts of Interest: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

©Katherine Anne Comtois, Felicia Mata-Greve, Morgan Johnson, Michael D Pullmann, Brittany Mosser, Patricia Arean. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 07.11.2022.

Figures

Figure 1
Figure 1
Consolidated Standards of Reporting Trails (CONSORT) table.
Figure 2
Figure 2
Clinical outcome means. DERS-SF: Difficulties in Emotion Regulation Scale – Short Form; GAD: Generalized Anxiety Disorder Scale; PHQ: Patient Health Questionnaire; SBQ-R: Suicide Behaviors Questionnaire-Revised.

References

    1. Chaiton M, Musani I, Pullman M, Logie CH, Abramovich A, Grace D, Schwartz R, Baskerville B. Access to mental health and substance use resources for 2SLGBTQ+ youth during the covid-19 pandemic. Int J Environ Res Public Health. 2021 Oct 28;18(21):11315. doi: 10.3390/ijerph182111315. ijerph182111315
    1. Lucas D, Bamber J. Pandemics and maternal health: the indirect effects of COVID-19. Anaesthesia. 2021 Apr;76(Suppl 4):69–75. doi: 10.1111/anae.15408. doi: 10.1111/anae.15408.
    1. Saltzman LY, Lesen AE, Henry V, Hansel TC, Bordnick PS. COVID-19 mental health disparities. Health Secur. 2021 Jun 01;19(S1):S5–S13. doi: 10.1089/hs.2021.0017.
    1. Mata-Greve F, Johnson M, Pullmann MD, Friedman EC, Griffith Fillipo I, Comtois KA, Arean P. Mental health and the perceived usability of digital mental health tools among essential workers and people unemployed due to covid-19: cross-sectional survey study. JMIR Ment Health. 2021 Aug 05;8(8):e28360. doi: 10.2196/28360. v8i8e28360
    1. Sams N, Fisher DM, Mata-Greve F, Johnson M, Pullmann MD, Raue PJ, Renn BN, Duffy J, Darnell D, Fillipo IG, Allred R, Huynh K, Friedman E, Areán PA. Understanding psychological distress and protective factors amongst older adults during the covid-19 pandemic. Am J Geriatr Psychiatry. 2021 Sep;29(9):881–894. doi: 10.1016/j.jagp.2021.03.005. S1064-7481(21)00263-3
    1. Martinengo L, Stona A, Griva K, Dazzan P, Pariante CM, von Wangenheim F, Car J. Self-guided cognitive behavioral therapy apps for depression: systematic assessment of features, functionality, and congruence with evidence. J Med Internet Res. 2021 Jul 30;23(7):e27619. doi: 10.2196/27619. v23i7e27619
    1. Saad A, Bruno D, Camara B, D'Agostino J, Bolea-Alamanac B. Self-directed technology-based therapeutic methods for adult patients receiving mental health services: systematic review. JMIR Ment Health. 2021 Nov 26;8(11):e27404. doi: 10.2196/27404. v8i11e27404
    1. Malakouti S, Rasouli N, Rezaean M, Nojomi M, Ghanbari B, Shahraki Mohammadi A. Effectiveness of self-help mobile telephone applications (apps) for suicide prevention: a systematic review. Med J Islam Repub Iran. 2020 Oct 30;34:85. doi: 10.47176/mjiri.34.85.
    1. Moshe I, Terhorst Y, Philippi P, Domhardt M, Cuijpers P, Cristea I, Pulkki-Råback L, Baumeister H, Sander LB. Digital interventions for the treatment of depression: a meta-analytic review. Psychol Bull. 2021 Aug;147(8):749–786. doi: 10.1037/bul0000334.2022-09577-001
    1. Rathbone AL, Prescott J. The use of mobile apps and SMS messaging as physical and mental health interventions: systematic review. J Med Internet Res. 2017 Aug 24;19(8):e295. doi: 10.2196/jmir.7740. v19i8e295
    1. Baumel A, Muench F, Edan S, Kane JM. Objective user engagement with mental health apps: systematic search and panel-based usage analysis. J Med Internet Res. 2019 Sep 25;21(9):e14567. doi: 10.2196/14567. v21i9e14567
    1. One Mind PsyberGuide. [2022-08-03].
    1. American Psychiatric Association App Advisor: An American Psychiatric Association Initiative. [2022-08-03]. .
    1. Mohr DC, Azocar F, Bertagnolli A, Choudhury T, Chrisp P, Frank R, Harbin H, Histon T, Kaysen D, Nebeker C, Richards D, Schueller SM, Titov N, Torous J, Areán PA, Banbury Forum on Digital Mental Health Banbury forum consensus statement on the path forward for digital mental health treatment. Psychiatr Serv. 2021 Jun 20;72(6):677–683. doi: 10.1176/appi.ps.202000561.
    1. Torous J, Andersson G, Bertagnoli A, Christensen H, Cuijpers P, Firth J, Haim A, Hsin H, Hollis C, Lewis S, Mohr DC, Pratap A, Roux S, Sherrill J, Arean PA. Towards a consensus around standards for smartphone apps and digital mental health. World Psychiatry. 2019 Feb;18(1):97–98. doi: 10.1002/wps.20592. doi: 10.1002/wps.20592.
    1. Sharma M, Creutzfeldt C, Lewis A, Patel PV, Hartog C, Jannotta GE, Blissitt P, Kross EK, Kassebaum N, Greer DM, Curtis JR, Wahlster S. Health-care professionals' perceptions of critical care resource availability and factors associated with mental well-being during coronavirus disease 2019 (covid-19): results from a US survey. Clin Infect Dis. 2021 May 18;72(10):e566–e576. doi: 10.1093/cid/ciaa1311. 5900684
    1. Arean PA, Hallgren KA, Jordan JT, Gazzaley A, Atkins DC, Heagerty PJ, Anguera JA. The use and effectiveness of mobile apps for depression: results from a fully remote clinical trial. J Med Internet Res. 2016 Dec 20;18(12):e330. doi: 10.2196/jmir.6482. v18i12e330
    1. Lin Z, Althoff T, Leskovec J. I'll be back: on the multiple lives of users of a mobile activity tracking application. WWW '18: The Web Conference 2018; April 23-27, 2018; Lyon, France. 2018. Apr, pp. 1501–1511.
    1. Epstein D, Ping A, Fogarty J, Munson S. A lived informatics model of personal informatics. UbiComp '15: The 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing; September 7-11, 2015; Osak,a Japan. 2015. pp. 731–742.
    1. Palan S, Schitter C. —a subject pool for online experiments. J Behav Exp Finance. 2018 Mar;17:22–27. doi: 10.1016/j.jbef.2017.12.004.
    1. Peer E, Brandimarte L, Samat S, Acquisti A. Beyond the Turk: alternative platforms for crowdsourcing behavioral research. J Exp Soc Psychol. 2017 May;70:153–163. doi: 10.1016/j.jesp.2017.01.006.
    1. Prolific A Higher Standard of Online Research. [2022-10-05].
    1. Lettmann H, Lumsden J. Prolific’s Participant Pool - the Present and the Future. 2018. [2022-10-05].
    1. Oppenheimer DM, Meyvis T, Davidenko N. Instructional manipulation checks: detecting satisficing to increase statistical power. J Exp Soc Psychol. 2009 Jul;45(4):867–872. doi: 10.1016/j.jesp.2009.03.009.
    1. Kroenke K, Spitzer R, Williams J. The Patient Health Questionnaire-2: validity of a two-item depression screener. Med Care. 2003;41(11):1284–1292. doi: 10.1097/01.mlr.0000093487.78664.3c.
    1. Kroenke K, Spitzer RL, Williams JB, Monahan PO, Löwe B. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007 Mar 06;146(5):317. doi: 10.7326/0003-4819-146-5-200703060-00004.
    1. Osman A, Bagge CL, Gutierrez PM, Konick LC, Kopper BA, Barrios FX. The Suicidal Behaviors Questionnaire-Revised (SBQ-R): validation with clinical and nonclinical samples. Assessment. 2001 Dec 26;8(4):443–454. doi: 10.1177/107319110100800409.
    1. Millner AJ, Lee MD, Nock MK. Single-item measurement of suicidal behaviors: validity and consequences of misclassification. PLoS One. 2015;10(10):e0141606. doi: 10.1371/journal.pone.0141606. PONE-D-15-19604
    1. Patsopoulos NA. A pragmatic view on pragmatic trials. Dialogues Clin Neurosci. 2022 Apr 01;13(2):217–224. doi: 10.31887/dcns.2011.13.2/npatsopoulos.
    1. Dal-Ré Rafael, Janiaud P, Ioannidis J. Real-world evidence: how pragmatic are randomized controlled trials labeled as pragmatic? BMC Med. 2018 Apr 03;16(1):49. doi: 10.1186/s12916-018-1038-2. 10.1186/s12916-018-1038-2
    1. Patterson B, Boyle MH, Kivlenieks M, Van Ameringen M. The use of waitlists as control conditions in anxiety disorders research. J Psychiatr Res. 2016 Dec;83:112–120. doi: 10.1016/j.jpsychires.2016.08.015.S0022-3956(16)30244-8
    1. Bailey E, Mühlmann C, Rice S, Nedeljkovic M, Alvarez-Jimenez M, Sander L, Calear AL, Batterham PJ, Robinson J. Ethical issues and practical barriers in internet-based suicide prevention research: a review and investigator survey. BMC Med Ethics. 2020 May 13;21(1):37. doi: 10.1186/s12910-020-00479-1. 10.1186/s12910-020-00479-1
    1. Mohr DC, Spring B, Freedland KE, Beckner V, Arean P, Hollon SD, Ockene J, Kaplan R. The selection and design of control conditions for randomized controlled trials of psychological interventions. Psychother Psychosom. 2009;78(5):275–284. doi: 10.1159/000228248.000228248
    1. Areán P, Alvidrez J. Ethical considerations in psychotherapy effectiveness research: choosing the comparison group. Ethics Behav. 2002 Jan;12(1):63–73. doi: 10.1207/s15327019eb1201_4.
    1. Carlo AD, Hosseini Ghomi R, Renn BN, Areán PA. By the numbers: ratings and utilization of behavioral health mobile applications. NPJ Digit Med. 2019 Jun 17;2(1):54. doi: 10.1038/s41746-019-0129-6. doi: 10.1038/s41746-019-0129-6.129
    1. Pratap A, Renn BN, Volponi J, Mooney SD, Gazzaley A, Arean PA, Anguera JA. Using mobile apps to assess and treat depression in Hispanic and Latino populations: fully remote randomized clinical trial. J Med Internet Res. 2018 Aug 09;20(8):e10130. doi: 10.2196/10130. v20i8e10130
    1. Schlosser DA, Campellone TR, Truong B, Anguera JA, Vergani S, Vinogradov S, Arean P. The feasibility, acceptability, and outcomes of PRIME-D: a novel mobile intervention treatment for depression. Depress Anxiety. 2017 Jun 18;34(6):546–554. doi: 10.1002/da.22624.
    1. Graham AK, Greene CJ, Kwasny MJ, Kaiser SM, Lieponis P, Powell T, Mohr DC. Coached mobile app platform for the treatment of depression and anxiety among primary care patients: a randomized clinical trial. JAMA Psychiatry. 2020 Sep 01;77(9):906–914. doi: 10.1001/jamapsychiatry.2020.1011. 2766444
    1. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap): a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009 Apr;42(2):377–381. doi: 10.1016/j.jbi.2008.08.010. S1532-0464(08)00122-6
    1. U.S. Census Bureau The 2017 National Population Projections. 2017. [2022-08-03]. .
    1. Woerner M, Sams N, Rivera Nales C, Gorstein T, Johnson M, Mosser BA, Areán PA. Generational perspectives on technology's role in mental health care: a survey of adults with lived mental health experience. Front Digit Health. 2022;4:840169. doi: 10.3389/fdgth.2022.840169.
    1. National Research Council (US) Panel on DHHS Collection of Race and Ethnicity Data . Measuring race, ethnicity, socioeconomic position, and acculturation. In: Ver Ploeg M, Perrin W, editors. Eliminating Health Disparities: Measurement and Data Needs. Vol 3. Washington, DC: National Academies Press; 2004.
    1. Rosenfield S, Mouzon D. Handbook of the Sociology of Mental Health. Berlin: Springer; 2013. Gender and mental health; pp. 277–296.
    1. Kroenke K, Spitzer RL. The PHQ-9: a new depression diagnostic and severity measure. Psychiatric Annals. 2002 Sep 01;32(9):509–515. doi: 10.3928/0048-5713-20020901-06.
    1. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001 Sep;16(9):606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. jgi01114
    1. Plummer F, Manea L, Trepel D, McMillan D. Screening for anxiety disorders with the GAD-7 and GAD-2: a systematic review and diagnostic metaanalysis. Gen Hosp Psychiatry. 2016 Mar;39:24–31. doi: 10.1016/j.genhosppsych.2015.11.005.S0163-8343(15)00240-6
    1. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006 May 22;166(10):1092–1097. doi: 10.1001/archinte.166.10.1092.166/10/1092
    1. Kaufman EA, Xia M, Fosco G, Yaptangco M, Skidmore CR, Crowell SE. The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): validation and replication in adolescent and adult samples. J Psychopathol Behav Assess. 2015 Nov 23;38(3):443–455. doi: 10.1007/s10862-015-9529-3.
    1. Hallion LS, Steinman SA, Tolin DF, Diefenbach GJ. Psychometric properties of the Difficulties in Emotion Regulation Scale (DERS) and its short forms in adults with emotional disorders. Front Psychol. 2018 Apr 19;9:539. doi: 10.3389/fpsyg.2018.00539. doi: 10.3389/fpsyg.2018.00539.
    1. Erbe D, Eichert H, Rietz C, Ebert D. Interformat reliability of the Patient Health Questionnaire: validation of the computerized version of the PHQ-9. Internet Interv. 2016 Sep;5:1–4. doi: 10.1016/j.invent.2016.06.006. S2214-7829(16)30003-3
    1. Seo J, Park S. Validation of the Generalized Anxiety Disorder-7 (GAD-7) and GAD-2 in patients with migraine. J Headache Pain. 2015 Nov 23;16(1):97. doi: 10.1186/s10194-015-0583-8. 10.1186/s10194-015-0583-8
    1. Hesser H, Axelsson S, Bäcke V, Engstrand J, Gustafsson T, Holmgren E, Jeppsson U, Pollack M, Nordén K, Rosenqvist D, Andersson G. Preventing intimate partner violence via the internet: a randomized controlled trial of emotion-regulation and conflict-management training for individuals with aggression problems. Clin Psychol Psychother. 2017 Sep;24(5):1163–1177. doi: 10.1002/cpp.2082.
    1. Tsaousides T, Spielman L, Kajankova M, Guetta G, Gordon W, Dams-O'Connor K. Improving emotion regulation following web-based group intervention for individuals with traumatic brain injury. J Head Trauma Rehabil. 2017 Sep;32(5):354–365. doi: 10.1097/htr.0000000000000345.
    1. Cassidy SA, Bradley L, Cogger-Ward H, Rodgers J. Development and validation of the suicidal behaviours questionnaire - autism spectrum conditions in a community sample of autistic, possibly autistic and non-autistic adults. Mol Autism. 2021 Jun 21;12(1):46. doi: 10.1186/s13229-021-00449-3. 10.1186/s13229-021-00449-3
    1. Batterham PJ, Ftanou M, Pirkis J, Brewer JL, Mackinnon AJ, Beautrais A, Fairweather-Schmidt AK, Christensen H. A systematic review and evaluation of measures for suicidal ideation and behaviors in population-based research. Psychol Assess. 2015 Jun;27(2):501–512. doi: 10.1037/pas0000053.2014-55204-001
    1. Huen JMY, Yip PSF, Osman A, Leung ANM. The Suicidal Behaviors Questionnaire-Revised (SBQ-R) and its Chinese version (C-SBQ-R): further validity testing using the culture, comprehension, and translation bias procedure. Psychol Assess. 2022 Jul;34(7):704–710. doi: 10.1037/pas0001134.2022-55807-001
    1. Amini-Tehrani M, Nasiri M, Jalali T, Sadeghi R, Ghotbi A, Zamanian H. Validation and psychometric properties of Suicide Behaviors Questionnaire-Revised (SBQ-R) in Iran. Asian J Psychiatr. 2020 Jan;47:101856. doi: 10.1016/j.ajp.2019.101856.S1876-2018(19)30728-2
    1. Gómez-Romero MJ, Tomás-Sábado J, Montes-Hidalgo J, Brando-Garrido C, Limonero JT. The suicidal behaviors questionnaire-revised. Spanish form. Death Stud. 2021 Oct 01;45(8):623–629. doi: 10.1080/07481187.2019.1671544.
    1. Bjureberg J, Ljótsson B, Tull MT, Hedman E, Sahlin H, Lundh L, Bjärehed J, DiLillo D, Messman-Moore T, Gumpert CH, Gratz KL. Development and validation of a brief version of the Difficulties in Emotion Regulation Scale: the DERS-16. J Psychopathol Behav Assess. 2016 Jun 14;38(2):284–296. doi: 10.1007/s10862-015-9514-x.
    1. Semborski S, Henwood B, Rhoades H, Mason T, Wenzel S, Rice E. Construct, concurrent, and real-world predictive validity of the Difficulties in Emotion Regulation (DERS-18) among young adults with history of homelessness. Psychol Assess. 2021 May;33(5):385–394. doi: 10.1037/pas0000991. 2021-21358-001
    1. Xu L, Cheng F, Liu C, Jin R, Pan H, Zhang M, Liang Z. Psychometric properties and factor structures of the CERQ, DERS, and RESE measures: a bifactor approach. J Pers Assess. 2021 Mar 11;103(6):797–806. doi: 10.1080/00223891.2021.1887201.
    1. Li J, Han ZR, Gao MM, Sun X, Ahemaitijiang N. Psychometric properties of the Chinese version of the Difficulties in Emotion Regulation Scale (DERS): factor structure, reliability, and validity. Psychol Assess. 2018 May;30(5):e1–e9. doi: 10.1037/pas0000582.2018-21987-001
    1. McVey AJ, Schiltz HK, Coffman M, Antezana L, Magnus B. A preliminary psychometric analysis of the Difficulties with Emotion Regulation Scale (DERS) among autistic adolescents and adults: factor structure, reliability, and validity. J Autism Dev Disord. 2022 Mar 22;52(3):1169–1188. doi: 10.1007/s10803-021-05018-4.10.1007/s10803-021-05018-4
    1. Goldstein BL, Briggs-Gowan MJ, Greene CC, Chang R, Grasso DJ. An item response theory examination of the original and short forms of the Difficulties in Emotion Regulation Scale (DERS) in pregnant women. J Clin Psychol. 2021 Jul 10;77(7):1591–1606. doi: 10.1002/jclp.23167.
    1. Benfer N, Bardeen JR, Fergus TA, Rogers TA. Factor structure and incremental validity of the original and modified versions of the Difficulties in Emotion Regulation Scale. J Pers Assess. 2019 Aug 24;101(6):598–608. doi: 10.1080/00223891.2018.1492927.
    1. Staples AM, Mohlman J. Psychometric properties of the GAD-Q-IV and DERS in older, community-dwelling GAD patients and controls. J Anxiety Disord. 2012 Apr;26(3):385–392. doi: 10.1016/j.janxdis.2012.01.005.S0887-6185(12)00010-2
    1. Beautiful Mood. [2022-08-03].
    1. Mobile Mental Health Apps Team at the National Center for PTSD 30 Days of Self-Care with COVID Coach: Prioritize Your Well-Being and Mental Health with the COVID Coach. 2020. [2022-10-05]. .
    1. Smith L. Getting Started with Calm. [2022-08-03].
    1. 7 Cups Need Someone to Talk to? Our Counselors and Listeners Are Standing By. [2022-10-05].
    1. Lyon A, Pullmann M, Jacobson J, Osterhage K, Al AM, Renn B. Assessing the usability of complex psychosocial interventions: the Intervention Usability Scale. Implement Res Pr. 2021;2:2633489520987828. doi: 10.21203/-20758/v3.
    1. Brooke J. SUS: a quick and dirty usability scale. In: Weerdmeester B, McClelland IL, Thomas B, Jordan PW, editors. Usability Evaluation in Industry. London, UK: Taylor and Francis; 1996. p. 189.
    1. Sevilla-Gonzalez MDR, Moreno Loaeza L, Lazaro-Carrera LS, Bourguet Ramirez B, Vázquez Rodríguez A, Peralta-Pedrero ML, Almeda-Valdes P. Spanish version of the System Usability Scale for the assessment of electronic tools: development and validation. JMIR Hum Factors. 2020 Dec 16;7(4):e21161. doi: 10.2196/21161. v7i4e21161
    1. Pal D, Vanijja V. Perceived usability evaluation of Microsoft Teams as an online learning platform during COVID-19 using system usability scale and technology acceptance model in India. Child Youth Serv Rev. 2020 Dec;119:105535. doi: 10.1016/j.childyouth.2020.105535. S0190-7409(20)31399-2
    1. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the System Usability Scale. Int J Hum-Comput Interact. 2008 Jul 30;24(6):574–594. doi: 10.1080/10447310802205776.
    1. Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, Boynton MH, Halko H. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017 Aug 29;12(1):108. doi: 10.1186/s13012-017-0635-3. 10.1186/s13012-017-0635-3
    1. Wright JH, Owen JJ, Richards D, Eells TD, Richardson T, Brown GK, Barrett M, Rasku MA, Polser G, Thase ME. Computer-assisted cognitive-behavior therapy for depression: a systematic review and meta-analysis. J Clin Psychiatry. 2019 Mar 19;80(2):18r12188. doi: 10.4088/JCP.18r12188.
    1. Simon GE, Shortreed SM, Rossom RC, Beck A, Clarke GN, Whiteside U, Richards JE, Penfold RB, Boggs JM, Smith J. Effect of offering care management or online dialectical behavior therapy skills training vs usual care on self-harm among adult outpatients with suicidal ideation: a randomized clinical trial. JAMA. 2022 Feb 15;327(7):630–638. doi: 10.1001/jama.2022.0423. 2789028
    1. Moberg C, Niles A, Beermann D. Guided self-help works: randomized waitlist controlled trial of Pacifica, a mobile app integrating cognitive behavioral therapy and mindfulness for stress, anxiety, and depression. J Med Internet Res. 2019 Jun 08;21(6):e12556. doi: 10.2196/12556. v21i6e12556
    1. Stirratt MJ, Dunbar-Jacob J, Crane HM, Simoni JM, Czajkowski S, Hilliard ME, Aikens JE, Hunter CM, Velligan DI, Huntley K, Ogedegbe G, Rand CS, Schron E, Nilsen WJ. Self-report measures of medication adherence behavior: recommendations on optimal use. Transl Behav Med. 2015 Dec 9;5(4):470–482. doi: 10.1007/s13142-015-0315-2. 315
    1. Simoni JM, Huh D, Wang Y, Wilson IB, Reynolds NR, Remien RH, Goggin K, Gross R, Rosen MI, Schneiderman N, Arnsten J, Golin CE, Erlen JA, Bangsberg DR, Liu H. The validity of self-reported medication adherence as an outcome in clinical trials of adherence-promotion interventions: findings from the MACH14 study. AIDS Behav. 2014 Dec 4;18(12):2285–2290. doi: 10.1007/s10461-014-0905-x.
    1. Kassavou A, Mirzaei V, Brimicombe J, Edwards S, Massou E, Prevost AT, Griffin S, Sutton S. A highly tailored text and voice messaging intervention to improve medication adherence in patients with either or both hypertension and type 2 diabetes in a UK primary care setting: feasibility randomized controlled trial of clinical effectiveness. J Med Internet Res. 2020 May 19;22(5):e16629. doi: 10.2196/16629. v22i5e16629
    1. Lattie EG, Cohen KA, Hersch E, Williams KD, Kruzan KP, MacIver C, Hermes J, Maddi K, Kwasny M, Mohr DC. Uptake and effectiveness of a self-guided mobile app platform for college student mental health. Internet Interv. 2022 Mar;27:100493. doi: 10.1016/j.invent.2021.100493. S2214-7829(21)00133-0
    1. Lau N, O'Daffer A, Yi-Frazier JP, Rosenberg AR. Popular evidence-based commercial mental health apps: analysis of engagement, functionality, aesthetics, and information quality. JMIR Mhealth Uhealth. 2021 Jul 14;9(7):e29689. doi: 10.2196/29689. v9i7e29689
    1. Marshall JM, Dunstan DA, Bartik W. Smartphone psychological therapy during covid-19: a study on the effectiveness of five popular mental health apps for anxiety and depression. Front Psychol. 2021 Dec 13;12:775775. doi: 10.3389/fpsyg.2021.775775. doi: 10.3389/fpsyg.2021.775775.
    1. Di Carlo F, Sociali A, Picutti E, Pettorruso M, Vellante F, Verrastro V, Martinotti G, di Giannantonio M. Telepsychiatry and other cutting-edge technologies in COVID-19 pandemic: bridging the distance in mental health assistance. Int J Clin Pract. 2021 Jan;75(1):ijcp.13716. doi: 10.1111/ijcp.13716.
    1. Torous J, Jän Myrick Keris, Rauseo-Ricupero N, Firth J. Digital mental health and covid-19: using technology today to accelerate the curve on access and quality tomorrow. JMIR Ment Health. 2020 Mar 26;7(3):e18848. doi: 10.2196/18848. v7i3e18848
    1. Kondylakis H, Katehakis DG, Kouroubali A, Logothetidis F, Triantafyllidis A, Kalamaras I, Votis K, Tzovaras D. COVID-19 mobile apps: a systematic review of the literature. J Med Internet Res. 2020 Dec 09;22(12):e23170. doi: 10.2196/23170. v22i12e23170
    1. Terry NP, Gunter TD. Regulating mobile mental health apps. Behav Sci Law. 2018 Mar 16;36(2):136–144. doi: 10.1002/bsl.2339.

Source: PubMed

Sponsorer og samarbejdspartnere

Medicinske tilstande

Narkotikainterventioner

3
Abonner