Engagement, Use, and Impact of Digital Mental Health Resources for Diverse Populations in COVID-19: Community-Partnered Evaluation

Abstract

Background: The COVID-19 pandemic increased disparities for communities burdened by structural barriers such as reduced affordable housing, with mental health consequences. Limited data are available on digital resources for public mental health prevention during the COVID-19 pandemic.

Objective: The study aim was to evaluate engagement in and impact of free digital resources on the Together for Wellness/Juntos por Nuestro Bienestar (T4W/Juntos) website during COVID-19 in California.

Methods: A pilot evaluation of T4W/Juntos was performed, with partner agencies inviting providers, clients, and partners to visit the website and complete surveys at baseline (September 20, 2021, to April 4, 2022) and at 4-6-week follow-up (October 22, 2021, to May 17, 2022). Website use was assessed by three engagement items (ease of use, satisfaction, relevance), comfort in use, and use of six resource categories. Primary outcomes at follow-up were depression and anxiety (scores≥3 on Patient Health Questionnaire-2 item [PHQ2] and Generalized Anxiety Disorder-2 item [GAD2] scales). Secondary outcomes were post-pre differences in PHQ2 and GAD2 scores, and use of behavioral health hotlines and services the month before follow-up.

Results: Of 366 eligible participants, 315 (86.1%) completed baseline and 193 (61.3%) completed follow-up surveys. Of baseline participants, 72.6% identified as female, and 21.3% identified as lesbian, gay, bisexual, transgender, queer/questioning, and others (LGBTQ+). In terms of ethnicity, 44.0% identified as Hispanic, 17.8% as African American, 26.9% as non-Hispanic white, and 11.4% as other ethnicity. Overall, 32.7% had moderate anxiety or depression (GAD2/PHQ2≥3) at baseline. Predictors of baseline website engagement included being Hispanic versus other race/ethnicity (β=.27, 95% CI .10-.44; P=.002) and number of COVID-19-related behavior changes (β=.09, 95% CI .05-.13; P<.001). Predictors of comfort using the website were preferring English for website use (odds ratio [OR] 5.57, 95% CI 2.22-13.96; P<.001) and COVID-19-related behavior changes (OR 1.37, 95% CI 1.12-1.66; P=.002); receiving overnight behavioral health treatment in the prior 6 months (OR 0.15, 95% CI 0.03-0.69, P=.015) was associated with less comfort in website use. The main predictor of depression at follow-up (PHQ2≥3) was baseline depression (OR 6.24, 95% CI 2.77-14.09; P<.001). Engagement in T4W/Juntos was associated with lower likelihood of depression (OR 0.54, 95% CI 0.34-0.86; P=.01). Website use the month before follow-up was associated with a post-pre reduction in PHQ2 score (β=-.62, 95% CI -1.04 to -0.20; P=.004). The main predictor of GAD2≥3 at follow-up was baseline GAD2≥3 (OR 13.65, 95% CI 6.06-30.72; P<.001). Greater baseline website engagement predicted reduced hotline use (OR 0.36, 95% CI 0.18-0.71; P=.004).

Conclusions: Ethnicity/language and COVID-19-related behavior changes were associated with website engagement; engagement and use predicted reduced follow-up depression and behavioral hotline use. Findings are based on participants recommended by community agencies with moderate follow-up rates; however, significance was similar when weighting for nonresponse. This study may inform research and policy on digital mental health prevention resources.

Keywords: COVID-19; community health; depression; digital mental health; digital resource; ethnic; health disparity; health resource; hotline use; mental well-being; minority population; prevention; public health; website engagement.

Conflict of interest statement

Conflicts of Interest: AA is founder and CEO of Chorus Innovations and Arevian Technologies. The other authors have no conflicts to declare.

©Kenneth Wells, April Denise Thames, Alexander S Young, Lily Zhang, MarySue V Heilemann, Daniela Flores Romero, Adrian Oliva, Felica Jones, Lingqi Tang, Melissa Brymer, Thomas Elliott, Armen Arevian, Together for Wellness/Juntos Collaborators and Writing Group. Originally published in JMIR Formative Research (https://formative.jmir.org), 07.12.2022.