A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods

Kien Hoa Ly, Ann-Marie Ly, Gerhard Andersson, Kien Hoa Ly, Ann-Marie Ly, Gerhard Andersson

Abstract

Fully automated self-help interventions can serve as highly cost-effective mental health promotion tools for massive amounts of people. However, these interventions are often characterised by poor adherence. One way to address this problem is to mimic therapy support by a conversational agent. The objectives of this study were to assess the effectiveness and adherence of a smartphone app, delivering strategies used in positive psychology and CBT interventions via an automated chatbot (Shim) for a non-clinical population - as well as to explore participants' views and experiences of interacting with this chatbot. A total of 28 participants were randomized to either receive the chatbot intervention (n = 14) or to a wait-list control group (n = 14). Findings revealed that participants who adhered to the intervention (n = 13) showed significant interaction effects of group and time on psychological well-being (FS) and perceived stress (PSS-10) compared to the wait-list control group, with small to large between effect sizes (Cohen's d range 0.14-1.06). Also, the participants showed high engagement during the 2-week long intervention, with an average open app ratio of 17.71 times for the whole period. This is higher compared to other studies on fully automated interventions claiming to be highly engaging, such as Woebot and the Panoply app. The qualitative data revealed sub-themes which, to our knowledge, have not been found previously, such as the moderating format of the chatbot. The results of this study, in particular the good adherence rate, validated the usefulness of replicating this study in the future with a larger sample size and an active control group. This is important, as the search for fully automated, yet highly engaging and effective digital self-help interventions for promoting mental health is crucial for the public health.

Figures

Fig. 1
Fig. 1
Participant flow chart.

References

    1. Andersson G. Internet-delivered psychological treatments. Annu. Rev. Clin. Psychol. 2016;12:157–179.
    1. Bergsma A. Do self-help books help? J. Happiness Stud. 2008;9(3):341–360.
    1. Bickmore T., Gruber A., Picard R. Establishing the computer–patient working alliance in automated health behavior change interventions. Patient Educ. Couns. 2005;59(1):21–30.
    1. Bolier L., Haverman M., Westerhof G.J., Riper H., Smit F., Bohlmeijer E. Positive psychology interventions: a meta-analysis of randomized controlled studies. BMC Public Health. 2013;13(1):119.
    1. Braun V., Clarke V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006;3(2):77–101.
    1. Carlbring P., Brunt S., Bohman S., Austin D., Richards J., Öst L.-G., Andersson G. Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research. Comput. Hum. Behav. 2007;23(3):1421–1434.
    1. Christensen H., Griffiths K.M., Farrer L. Adherence in internet interventions for anxiety and depression: systematic review. J. Med. Internet Res. 2009;11(2)
    1. Cohen S., Kamarck T., Mermelstein R. Measuring Stress: A Guide for Health and Social Scientists. 1994. Perceived stress scale.
    1. Dahl J., Lundgren T. Mindfulness-Based Treatment Approaches: Clinician's Guide to Evidence Base and Applications. 2006. Acceptance and commitment therapy (ACT) in the treatment of chronic pain; pp. 285–306.
    1. den Boer P.C.A.M., Wiersma D., van den Bosch R.J. Why is self-help neglected in the treatment of emotional disorders? A meta-analysis. Psychol. Med. 2004;34(6):959–971.
    1. Diener E.D., Emmons R.A., Larsen R.J., Griffin S. The satisfaction with life scale. J. Pers. Assess. 1985;49(1):71–75.
    1. Diener E., Wirtz D., Biswas-Diener R., Tov W., Kim-Prieto C., Choi D., Oishi S. 2009. New Measures of Well-Being. Assessing Well-Being; pp. 247–266.
    1. Diener E., Wirtz D., Tov W., Kim-Prieto C., Choi D., Oishi S., Biswas-Diener R. New well-being measures: short scales to assess flourishing and positive and negative feelings. Soc. Indic. Res. 2010;97(2):143–156.
    1. Dunn E.W., Aknin L.B., Norton M.I. Spending money on others promotes happiness. Science. 2008;319(5870):1687–1688.
    1. Fava G.A., Rafanelli C., Cazzaro M., Conti S., Grandi S. Well-being therapy. A novel psychotherapeutic approach for residual symptoms of affective disorders. Psychol. Med. 1998;28(2):475–480.
    1. Fitzpatrick K.K., Darcy A., Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Ment. Health. 2017;4(2)
    1. Fordyce M.W. Development of a program to increase personal happiness. J. Couns. Psychol. 1977;24(6):511.
    1. Hayes N. Taylor & Francis Group Abingdon; 2000. Doing Psychological Research.
    1. Hedman E., Ljótsson B., Rück C., Furmark T., Carlbring P., Lindefors N., Andersson G. Internet administration of self-report measures commonly used in research on social anxiety disorder: a psychometric evaluation. Comput. Hum. Behav. 2010;26(4):736–740.
    1. Hertzog M.A. Considerations in determining sample size for pilot studies. Res. Nurs. Health. 2008;31(2):180–191.
    1. Hoermann S., McCabe K.L., Milne D.N., Calvo R.A. Application of synchronous text-based dialogue systems in mental health interventions: systematic review. J. Med. Internet Res. 2017;19(8)
    1. Holländare F., Andersson G., Engström I. A comparison of psychometric properties between internet and paper versions of two depression instruments (BDI-II and MADRS-S) administered to clinic patients. J. Med. Internet Res. 2010;12(5)
    1. Huppert F.A. A new approach to reducing disorder and improving well-being. Perspect. Psychol. Sci. 2009;4(1):108–111.
    1. Kelders S.M., Kok R.N., Ossebaard H.C., Van Gemert-Pijnen J.E.W.C. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J. Med. Internet Res. 2012;14(6)
    1. Keyes C.L.M., Grzywacz J.G. Health as a complete state: the added value in work performance and healthcare costs. J. Occup. Environ. Med. 2005;47(5):523–532.
    1. Kieser M., Wassmer G. On the use of the upper confidence limit for the variance from a pilot sample for sample size determination. Biom. J. 1996;38(8):941–949.
    1. Layous K., Lyubomirsky S. Positive Emotion: Integrating the Light Sides and Dark Sides. 2014. The how, why, what, when, and who of happiness: mechanisms underlying the success of positive activity interventions; pp. 473–495.
    1. Lewandowski G.W., Jr. Promoting positive emotions following relationship dissolution through writing. J. Posit. Psychol. 2009;4(1):21–31.
    1. Ly K.H., Trüschel A., Jarl L., Magnusson S., Windahl T., Johansson R., Carlbring P. Behavioural activation versus mindfulness-based guided self-help treatment administered through a smartphone application: a randomised controlled trial. BMJ Open. 2014;4(1) Retrieved from.
    1. Ly K.H., Janni E., Wrede R., Sedem M., Donker T., Carlbring P., Andersson G. Experiences of a guided smartphone-based behavioral activation therapy for depression: a qualitative study. Internet Interv. 2015;2(1):60–68.
    1. Mohr D.C., Duffecy J., Ho J., Kwasny M., Cai X., Burns M.N., Begale M. A randomized controlled trial evaluating a manualized TeleCoaching protocol for improving adherence to a web-based intervention for the treatment of depression. PLoS One. 2013;8(8)
    1. Morris R.R., Schueller S.M., Picard R.W. Efficacy of a web-based, crowdsourced peer-to-peer cognitive reappraisal platform for depression: randomized controlled trial. J. Med. Internet Res. 2015;17(3)
    1. Parks A.C., Della Porta M.D., Pierce R.S., Zilca R., Lyubomirsky S. Pursuing happiness in everyday life: The characteristics and behaviors of online happiness seekers. Emotion. 2012;12(6):1222–1234.
    1. Parks A.C., Schueller S.M., Tasimi A. 2012. Increasing Happiness in the General Population: Empirically Supported Self-Help?
    1. Schotanus-Dijkstra M., Peter M., Drossaert C.H.C., Pieterse M.E., Bolier L., Walburg J.A., Bohlmeijer E.T. Validation of the flourishing scale in a sample of people with suboptimal levels of mental well-being. BMC Psychol. 2016;4(1):12.
    1. Schueller S.M. Preferences for positive psychology exercises. J. Posit. Psychol. 2010;5(3):192–203.
    1. Schutte N.S., Searle T., Meade S., Dark N.A. The effect of meaningfulness and integrative processing in expressive writing on positive and negative affect and life satisfaction. Cognit. Emot. 2012;26(1):144–152.
    1. Sheldon K.M., Boehm J.K., Lyubomirsky S. Oxford Handbook of Happiness. 2012. Variety is the spice of happiness: the hedonic adaptation prevention (HAP) model; pp. 901–914.
    1. Sin N.L., Lyubomirsky S. Enhancing well-being and alleviating depressive symptoms with positive psychology interventions: a practice-friendly meta-analysis. J. Clin. Psychol. 2009;65(5):467–487.
    1. Smyth J.M. American Psychological Association; 1998. Written Emotional Expression: Effect Sizes, Outcome Types, and Moderating Variables.
    1. Weiss L.A., Westerhof G.J., Bohlmeijer E.T. Can we increase psychological well-being? The effects of interventions on psychological well-being: a meta-analysis of randomized controlled trials. PLoS One. 2016;11(6)
    1. Wood A.M., Froh J.J., Geraghty A.W.A. Gratitude and well-being: a review and theoretical integration. Clin. Psychol. Rev. 2010;30(7):890–905.

Source: PubMed

Sponsors en medewerkers

Medische omstandigheden

Geneesmiddelinterventies

3
Abonneren