Leveraging the Power of Nondisruptive Technologies to Optimize Mental Health Treatment: Case Study

Shiri Sadeh-Sharvit, Steven D Hollon, Shiri Sadeh-Sharvit, Steven D Hollon

Abstract

Regular assessment of the effectiveness of behavioral interventions is a potent tool for improving their relevance to patients. However, poor provider and patient adherence characterize most measurement-based care tools. Therefore, a new approach for measuring intervention effects and communicating them to providers in a seamless manner is warranted. This paper provides a brief overview of the available research evidence on novel ways to measure the effects of behavioral treatments, integrating both objective and subjective data. We highlight the importance of analyzing therapeutic conversations through natural language processing. We then suggest a conceptual framework for capitalizing on data captured through directly collected and nondisruptive methodologies to describe the client's characteristics and needs and inform clinical decision-making. We then apply this context in exploring a new tool to integrate the content of therapeutic conversations and patients' self-reports. We present a case study of how both subjective and objective measures of treatment effects were implemented in cognitive-behavioral treatment for depression and anxiety and then utilized in treatment planning, delivery, and termination. In this tool, called Eleos, the patient completes standardized measures of depression and anxiety. The content of the treatment sessions was evaluated using nondisruptive, independent measures of conversation content, fidelity to the treatment model, and the back-and-forth of client-therapist dialogue. Innovative applications of advances in digital health are needed to disseminate empirically supported interventions and measure them in a noncumbersome way. Eleos appears to be a feasible, sustainable, and effective way to assess behavioral health care.

Keywords: Eleos Health; anxiety; behavioral health; depression; digital health; mental health; natural language processing.

Conflict of interest statement

Conflicts of Interest: SSS is the Chief Clinical Officer of the commercial entity Eleos Health Inc that created the platform that is the subject of this case report. SDH is an unpaid advisor to Eleos Health Inc.

©Shiri Sadeh-Sharvit, Steven D Hollon. Originally published in JMIR Mental Health (http://mental.jmir.org), 26.11.2020.

Figures

Figure 1
Figure 1
Screenshots illustrating some of the Eleos Health platform process features. CBT: cognitive behavioral therapy; Speaking Ratio: proportion (%) of time spent speaking during the session; Speech Rate: speed of words per minute; Techniques Used: intervention strategies employed by the therapist during the session and automatically identified by the platform. Techniques used 3 times or more are indicated with a black checkmark, techniques used once or twice are denoted with a grey checkmark, and interventions not employed in the session do not have a checkmark.
Figure 2
Figure 2
Patient self-monitoring data graphed on the Eleos platform. GAD-7: Generalized Anxiety Disorder-7; PHQ-9: Patient Health Questionnaire-9.

References

    1. Trautmann S, Rehm J, Wittchen H. The economic costs of mental disorders: Do our societies react appropriately to the burden of mental disorders? EMBO Rep. 2016 Sep 04;17(9):1245–9. doi: 10.15252/embr.201642951. doi: 10.15252/embr.201642951.
    1. Ewbank MP, Cummins R, Tablan V, Bateup S, Catarino A, Martin AJ, Blackwell AD. Quantifying the Association Between Psychotherapy Content and Clinical Outcomes Using Deep Learning. JAMA Psychiatry. 2020 Jan 01;77(1):35–43. doi: 10.1001/jamapsychiatry.2019.2664.
    1. Kazdin A. Addressing the treatment gap: A key challenge for extending evidence-based psychosocial interventions. Behav Res Ther. 2017 Jan;88:7–18. doi: 10.1016/j.brat.2016.06.004. doi: 10.1016/j.brat.2016.06.004.
    1. Sadeh-Sharvit S. Use of Technology in the Assessment and Treatment of Eating Disorders in Youth. Child Adolesc Psychiatr Clin N Am. 2019 Oct;28(4):653–661. doi: 10.1016/j.chc.2019.05.011.
    1. Topol E. Deep medicine: how artificial intelligence can make healthcare human again. New York, NY: Basic Books; 2019.
    1. Scott K, Lewis CC. Using Measurement-Based Care to Enhance Any Treatment. Cogn Behav Pract. 2015 Feb;22(1):49–59. doi: 10.1016/j.cbpra.2014.01.010.
    1. Fortney JC, Unützer J, Wrenn G, Pyne JM, Smith GR, Schoenbaum M, Harbin HT. A Tipping Point for Measurement-Based Care. PS. 2017 Feb;68(2):179–188. doi: 10.1176/appi.ps.201500439.
    1. Nasrallah H, Aboraya A. It's time to implement measurement-based care in psychiatric practice. Current Psychiatry. 2019;18(6):6–8.
    1. Guo T, Xiang Y, Xiao L, Hu C, Chiu HFK, Ungvari GS, Correll CU, Lai KYC, Feng L, Geng Y, Feng Y, Wang G. Measurement-Based Care Versus Standard Care for Major Depression: A Randomized Controlled Trial With Blind Raters. Am J Psychiatry. 2015 Oct;172(10):1004–13. doi: 10.1176/appi.ajp.2015.14050652.
    1. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001 Sep;16(9):606–13. doi: 10.1046/j.1525-1497.2001.016009606.x.
    1. Spitzer RL, Kroenke K, Williams JBW, Löwe Bernd. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006 May 22;166(10):1092–7. doi: 10.1001/archinte.166.10.1092.
    1. Darcy A, Sadeh-Sharvit S. Mobile Device Applications for the AssessmentTreatment of Eating Disorders. In: Agras SW, Robinson A, editors. The Oxford Handbook of Eating Disorders, Second Edition. Oxford, UK: Oxford University Press; 2017. pp. 492–504.
    1. Anatchkova M, Donelson SM, Skalicky AM, McHorney CA, Jagun D, Whiteley J. Exploring the implementation of patient-reported outcome measures in cancer care: need for more real-world evidence results in the peer reviewed literature. J Patient Rep Outcomes. 2018 Dec 27;2(1):64. doi: 10.1186/s41687-018-0091-0.
    1. Haun JN, Alman AC, Melillo C, Standifer M, McMahon-Grenz J, Shin M, Lapcevic WA, Patel N, Elwy AR. Using Electronic Data Collection Platforms to Assess Complementary and Integrative Health Patient-Reported Outcomes: Feasibility Project. JMIR Med Inform. 2020 Jun 26;8(6):e15609. doi: 10.2196/15609.
    1. Cuijpers P, Li J, Hofmann SG, Andersson G. Self-reported versus clinician-rated symptoms of depression as outcome measures in psychotherapy research on depression: a meta-analysis. Clin Psychol Rev. 2010 Aug;30(6):768–78. doi: 10.1016/j.cpr.2010.06.001.
    1. Briffault X, Morgiève Margot, Courtet P. From e-Health to i-Health: Prospective Reflexions on the Use of Intelligent Systems in Mental Health Care. Brain Sci. 2018 May 31;8(6):98. doi: 10.3390/brainsci8060098.
    1. Crowe J. Reform, revolution and disruption in mental health care: a consumer's perspective. Public Health Res Pract. 2017 Apr 27;27(2) doi: 10.17061/phrp2721711. doi: 10.17061/phrp2721711.
    1. Piette JD, Krein SL, Striplin D, Marinec N, Kerns RD, Farris KB, Singh S, An L, Heapy AA. Patient-Centered Pain Care Using Artificial Intelligence and Mobile Health Tools: Protocol for a Randomized Study Funded by the US Department of Veterans Affairs Health Services Research and Development Program. JMIR Res Protoc. 2016 Apr 07;5(2):e53. doi: 10.2196/resprot.4995.
    1. Spanakis Emmanouil G, Santana Silvina, Tsiknakis Manolis, Marias Kostas, Sakkalis Vangelis, Teixeira António, Janssen Joris H, de Jong Henri, Tziraki Chariklia. Technology-Based Innovations to Foster Personalized Healthy Lifestyles and Well-Being: A Targeted Review. J Med Internet Res. 2016 Jun 24;18(6):e128. doi: 10.2196/jmir.4863.
    1. Horgan D, Romao M, Morré Servaas A, Kalra D. Artificial Intelligence: Power for Civilisation - and for Better Healthcare. Public Health Genomics. 2019;22(5-6):145–161. doi: 10.1159/000504785.
    1. Atkins DC, Steyvers M, Imel ZE, Smyth P. Scaling up the evaluation of psychotherapy: evaluating motivational interviewing fidelity via statistical text classification. Implement Sci. 2014 Apr 24;9:49. doi: 10.1186/1748-5908-9-49.
    1. Xiao B, Imel ZE, Georgiou PG, Atkins DC, Narayanan SS. "Rate My Therapist": Automated Detection of Empathy in Drug and Alcohol Counseling via Speech and Language Processing. PLoS One. 2015;10(12):e0143055. doi: 10.1371/journal.pone.0143055.
    1. Imel ZE, Steyvers M, Atkins DC. Computational psychotherapy research: scaling up the evaluation of patient-provider interactions. Psychotherapy (Chic) 2015 Mar;52(1):19–30. doi: 10.1037/a0036841.
    1. Gyani A, Shafran R, Layard R, Clark DM. Enhancing recovery rates: lessons from year one of IAPT. Behav Res Ther. 2013 Sep;51(9):597–606. doi: 10.1016/j.brat.2013.06.004.
    1. Clark DM, Fairburn CG, Wessely S. Psychological treatment outcomes in routine NHS services: a commentary on Stiles et al. (2007) Psychol Med. 2008 May;38(5):629–34. doi: 10.1017/S0033291707001869.
    1. Macaskill ND. Improving clinical outcomes in REBT/CBT: The therapeutic uses of tape-recording. J Rational-Emot Cognitive-Behav Ther. 1996 Sep;14(3):199–207. doi: 10.1007/bf02238271.
    1. Barnett JE. Utilizing technological innovations to enhance psychotherapy supervision, training, and outcomes. Psychotherapy (Chic) 2011 Jun;48(2):103–8. doi: 10.1037/a0023381.
    1. Haggerty G, Hilsenroth M. The use of video in psychotherapy supervision. British Journal of Psychotherapy. 2011/05/ 2011;27(2):01–210. doi: 10.1111/j.1752-0118.2011.01232.x.
    1. Shafranske E, Falender C. Clinical supervision. APA handbook of clinical psychologyducation and profession, Vol 5. American Psychological Association. APA handbooks in psychology®. 2016:175–196. doi: 10.1037/14774-012.
    1. Shepherd L, Salkovskis PM, Morris M. Recording therapy sessions: an evaluation of patient and therapist reported behaviours, attitudes and preferences. Behav Cogn Psychother. 2009 Mar;37(2):141–50. doi: 10.1017/S1352465809005190.
    1. Briggie A, Hilsenroth M, Conway F, Muran J, Jackson J. Patient comfort with audio or video recording of their psychotherapy sessions: Relation to symptomatology, treatment refusal, duration, and outcome. Professional Psychology: Research and Practice. 2016;47(1):66–76. doi: 10.1037/a0040063.
    1. Singla DR, Hollon SD. The importance of implementation science in scaling up psychological treatments. Behav Res Ther. 2020 Jul;130:103614. doi: 10.1016/j.brat.2020.103614.
    1. Kalmady SV, Greiner R, Agrawal R, Shivakumar V, Narayanaswamy JC, Brown MRG, Greenshaw AJ, Dursun SM, Venkatasubramanian G. Towards artificial intelligence in mental health by improving schizophrenia prediction with multiple brain parcellation ensemble-learning. NPJ Schizophr. 2019 Jan 18;5(1):2. doi: 10.1038/s41537-018-0070-8. doi: 10.1038/s41537-018-0070-8.
    1. Hill CE, Thompson BJ, Ladany N. Therapist use of silence in therapy: a survey. J Clin Psychol. 2003 Apr;59(4):513–24. doi: 10.1002/jclp.10155.
    1. Sexton H, Littauer H, Sexton A, Tømmerås E. Building an alliance: Early therapy process and the client–therapist connection. Psychotherapy Research. 2005 Jan;15(1-2):103–116. doi: 10.1080/10503300512331327083.
    1. Hollon S. Developing clinical practice guidelines to enhance clinical decision making. In: Magnavita JJ, editor. Clinical decision making in mental health practice. Arlington, VA: American Psychological Association; 2016. pp. 125–146.
    1. McCabe R, Howes C, Purver M. Linguistic indicators of severity and profess in online text-based therapy for depression. Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality; 2014; Baltimore, Maryland, USA. 2014. Jun, pp. 7–16.
    1. Funk B, Sadeh-Sharvit S, Fitzsimmons-Craft EE, Trockel MT, Monterubio GE, Goel NJ, Balantekin KN, Eichen DM, Flatt RE, Firebaugh M, Jacobi C, Graham AK, Hoogendoorn M, Wilfley DE, Taylor CB. A Framework for Applying Natural Language Processing in Digital Health Interventions. J Med Internet Res. 2020 Feb 19;22(2):e13855. doi: 10.2196/13855.
    1. Plateau C, Brookes F, Pugh M. Guided Recovery: An Interpretative Phenomenological Analysis of Service Users’ Experiences of Guided Self-Help for Bulimic and Binge Eating Disorders. Cognitive and Behavioral Practice. 2018 May;25(2):310–318. doi: 10.1016/j.cbpra.2017.08.004. doi: 10.1016/j.cbpra.2017.08.004.
    1. Garland AF, Kruse M, Aarons GA. Clinicians and outcome measurement: what's the use? J Behav Health Serv Res. 2003;30(4):393–405. doi: 10.1007/BF02287427.
    1. Fernandes J, Brunton I, Strudwick G, Banik S, Strauss J. Physician experience with speech recognition software in psychiatry: usage and perspective. BMC Res Notes. 2018 Oct 01;11(1):1–5. doi: 10.1186/s13104-018-3790-y.
    1. Hollon S, DeRubeis R. Outcome studies in cognitive therapy. In: Leahy RL, editor. Science and Practice in Cognitive Therapy: Foundations, Mechanisms, and Applications. New York, NY: Guilford Press; 2018. pp. 48–61.
    1. Clark GI, Egan SJ. The Socratic Method in Cognitive Behavioural Therapy: A Narrative Review. Cognitive Therapy and Research. 2015 Jul 25;39(6):863–879. doi: 10.1007/s10608-015-9707-3.
    1. Can D, Marín Rebeca A, Georgiou PG, Imel ZE, Atkins DC, Narayanan SS. "It sounds like...": A natural language processing approach to detecting counselor reflections in motivational interviewing. J Couns Psychol. 2016 Apr;63(3):343–350. doi: 10.1037/cou0000111.
    1. Thwaites R, Bennett-Levy J. Conceptualizing Empathy in Cognitive Behaviour Therapy: Making the Implicit Explicit. Behav. Cognit. Psychother. 2007 Jul 6;35(05) doi: 10.1017/s1352465807003785.
    1. Firth J, Torous J, Carney R, Newby J, Cosco TD, Christensen H, Sarris J. Digital Technologies in the Treatment of Anxiety: Recent Innovations and Future Directions. Curr Psychiatry Rep. 2018 May 19;20(6):44. doi: 10.1007/s11920-018-0910-2.
    1. Lattie EG, Nicholas J, Knapp AA, Skerl JJ, Kaiser SM, Mohr DC. Opportunities for and Tensions Surrounding the Use of Technology-Enabled Mental Health Services in Community Mental Health Care. Adm Policy Ment Health. 2020 Jan;47(1):138–149. doi: 10.1007/s10488-019-00979-2.
    1. Delgadillo J, Gonzalez Salas Duhne P. Targeted prescription of cognitive-behavioral therapy versus person-centered counseling for depression using a machine learning approach. J Consult Clin Psychol. 2020 Jan;88(1):14–24. doi: 10.1037/ccp0000476.
    1. Sadeh-Sharvit Shiri, Fitzsimmons-Craft Ellen E, Taylor CB, Yom-Tov Elad. Predicting eating disorders from Internet activity. Int J Eat Disord. 2020 Sep;53(9):1526–1533. doi: 10.1002/eat.23338.
    1. Chien I, Enrique A, Palacios J, Regan T, Keegan D, Carter D, Tschiatschek S, Nori A, Thieme A, Richards D, Doherty G, Belgrave D. A Machine Learning Approach to Understanding Patterns of Engagement With Internet-Delivered Mental Health Interventions. JAMA Netw Open. 2020 Jul 01;3(7):e2010791. doi: 10.1001/jamanetworkopen.2020.10791.
    1. Colombo D, Suso-Ribera C, Fernandez-Álvarez J. Exploring Affect Recall Bias and the Impact of Mild Depressive Symptoms: An Ecological Momentary Study. In: Cipresso P, Serino S, Villani D, editors. Pervasive Computing Paradigms for Mental Health. Cham: Springer; 2019. p. A.
    1. Jacobson NC, Chung YJ. Passive Sensing of Prediction of Moment-To-Moment Depressed Mood among Undergraduates with Clinical Levels of Depression Sample Using Smartphones. Sensors (Basel) 2020 Jun 24;20(12) doi: 10.3390/s20123572.
    1. Fuller-Tyszkiewicz M, Richardson B, Klein B, Skouteris H, Christensen H, Austin D, Castle D, Mihalopoulos C, O'Donnell R, Arulkadacham L, Shatte A, Ware A. A Mobile App-Based Intervention for Depression: End-User and Expert Usability Testing Study. JMIR Ment Health. 2018 Aug 23;5(3):e54. doi: 10.2196/mental.9445.

Source: PubMed

3
Abonnere