Development of the First Episode Digital Monitoring mHealth Intervention for People With Early Psychosis: Qualitative Interview Study With Clinicians

Ana Stefancic, R Tyler Rogers, Sarah Styke, Xiaoyan Xu, Richard Buchsbaum, Ilana Nossel, Leopoldo J Cabassa, T Scott Stroup, David Kimhy, Ana Stefancic, R Tyler Rogers, Sarah Styke, Xiaoyan Xu, Richard Buchsbaum, Ilana Nossel, Leopoldo J Cabassa, T Scott Stroup, David Kimhy

Abstract

Background: Mobile health (mHealth) technologies have been used extensively in psychosis research. In contrast, their integration into real-world clinical care has been limited despite the broad availability of smartphone-based apps targeting mental health care. Most apps developed for treatment of individuals with psychosis have focused primarily on encouraging self-management skills of patients via practicing cognitive behavioral techniques learned during face-to-face clinical sessions (eg, challenging dysfunctional thoughts and relaxation exercises), reminders to engage in health-promoting activities (eg, exercising, sleeping, and socializing), or symptom monitoring. In contrast, few apps have sought to enhance the clinical encounter itself to improve shared decision-making (SDM) and therapeutic relationships with clinicians, which have been linked to positive clinical outcomes.

Objective: This qualitative study sought clinicians' input to develop First Episode Digital Monitoring (FREEDoM), an app-based mHealth intervention. FREEDoM was designed to improve the quality, quantity, and timeliness of clinical and functional data available to clinicians treating patients experiencing first-episode psychosis (FEP) to enhance their therapeutic relationship and increase SDM.

Methods: Following the app's initial development, semistructured qualitative interviews were conducted with 11 FEP treatment providers at 3 coordinated specialty care clinics to elicit input on the app's design, the data report for clinicians, and planned usage procedures. We then generated a summary template and conducted matrix analysis to systematically categorize suggested adaptations to the evidence-based intervention using dimensions of the Framework for Reporting Adaptations and Modifications-Enhanced (FRAME) and documented the rationale for adopting or rejecting suggestions.

Results: The clinicians provided 31 suggestions (18 adopted and 13 rejected). Suggestions to add or refine the content were most common (eg, adding questions in the app). Adaptations to context were most often related to plans for implementing the intervention, how the reported data were displayed to clinicians, and with whom the reports were shared. Reasons for suggestions primarily included factors related to health narratives and priorities of the patients (eg, focus on the functional impact of symptoms vs their severity), providers' clinical judgment (eg, need for clinically relevant information), and organizations' mission and culture. Reasons for rejecting suggestions included requests for data and procedures beyond the intervention's scope, concerns regarding dilution of the intervention's core components, and concerns about increasing patient burden while using the app.

Conclusions: FREEDoM focuses on a novel target for the deployment of mHealth technologies in the treatment of FEP patients-the enhancement of SDM and improvement of therapeutic relationships. This study illustrates the use of the FRAME, along with methods and tools for rapid qualitative analysis, to systematically track adaptations to the app as part of its development process. Such adaptations may contribute to enhanced acceptance of the intervention by clinicians and a higher likelihood of integration into clinical care.

Trial registration: ClinicalTrials.gov NCT04248517; https://tinyurl.com/tjuyxvv6.

Keywords: coordinated specialty care; digital psychiatry; early psychosis; first-episode psychosis; mental health treatment; mobile health; mobile phone; qualitative; shared decision-making; smartphone apps.

Conflict of interest statement

Conflicts of Interest: None declared.

©Ana Stefancic, R Tyler Rogers, Sarah Styke, Xiaoyan Xu, Richard Buchsbaum, Ilana Nossel, Leopoldo J Cabassa, T Scott Stroup, David Kimhy. Originally published in JMIR Mental Health (https://mental.jmir.org), 04.11.2022.

Figures

Figure 1
Figure 1
Pragmatic analysis for rapid qualitative research. FRAME: Framework for Reporting Adaptations and Modifications-Enhanced.

References

    1. Kane JM, Robinson DG, Schooler NR, Mueser KT, Penn DL, Rosenheck RA, Addington J, Brunette MF, Correll CU, Estroff SE, Marcy P, Robinson J, Meyer-Kalos PS, Gottlieb JD, Glynn SM, Lynde DW, Pipes R, Kurian BT, Miller AL, Azrin ST, Goldstein AB, Severe JB, Lin H, Sint KJ, John M, Heinssen RK. Comprehensive versus usual community care for first-episode psychosis: 2-year outcomes from the NIMH raise early treatment program. Am J Psychiatry. 2016 Apr 01;173(4):362–72. doi: 10.1176/appi.ajp.2015.15050632.
    1. McGorry PD. Early intervention in psychosis: obvious, effective, overdue. J Nerv Ment Dis. 2015 May;203(5):310–8. doi: 10.1097/NMD.0000000000000284. 00005053-201505000-00002
    1. Dixon LB, Stroup TS. Medications for first-episode psychosis: making a good start. Am J Psychiatry. 2015 Mar 01;172(3):209–11. doi: 10.1176/appi.ajp.2014.14111465.
    1. Robinson DG, Schooler NR, John M, Correll CU, Marcy P, Addington J, Brunette MF, Estroff SE, Mueser KT, Penn D, Robinson J, Rosenheck RA, Severe J, Goldstein A, Azrin S, Heinssen R, Kane JM. Prescription practices in the treatment of first-episode schizophrenia spectrum disorders: data from the national RAISE-ETP study. Am J Psychiatry. 2015 Mar 01;172(3):237–48. doi: 10.1176/appi.ajp.2014.13101355.
    1. Aboraya A, Nasrallah HA, Elswick DE, Ahmed E, Estephan N, Aboraya D, Berzingi S, Chumbers J, Berzingi S, Justice J, Zafar J, Dohar S. Measurement-based care in psychiatry-past, present, and future. Innov Clin Neurosci. 2018 Nov 01;15(11-12):13–26.
    1. Lewis CC, Boyd M, Puspitasari A, Navarro E, Howard J, Kassab H, Hoffman M, Scott K, Lyon A, Douglas S, Simon G, Kroenke K. Implementing measurement-based care in behavioral health: a review. JAMA Psychiatry. 2019 Mar 01;76(3):324–35. doi: 10.1001/jamapsychiatry.2018.3329. 2718629
    1. Blum LH, Vakhrusheva J, Saperstein A, Khan S, Chang RW, Hansen MC, Zemon V, Kimhy D. Depressed mood in individuals with schizophrenia: a comparison of retrospective and real-time measures. Psychiatry Res. 2015 Jun 30;227(2-3):318–23. doi: 10.1016/j.psychres.2015.03.008. S0165-1781(15)00128-6
    1. Kimhy D, Delespaul P, Ahn H, Cai S, Shikhman M, Lieberman JA, Malaspina D, Sloan RP. Concurrent measurement of "real-world" stress and arousal in individuals with psychosis: assessing the feasibility and validity of a novel methodology. Schizophr Bull. 2010 Nov;36(6):1131–9. doi: 10.1093/schbul/sbp028. sbp028
    1. Kimhy D, Delespaul P, Corcoran C, Ahn H, Yale S, Malaspina D. Computerized experience sampling method (ESMc): assessing feasibility and validity among individuals with schizophrenia. J Psychiatr Res. 2006 Apr;40(3):221–30. doi: 10.1016/j.jpsychires.2005.09.007. S0022-3956(05)00128-7
    1. Abdel-Baki A, Lal S, D-Charron O, Stip E, Kara N. Understanding access and use of technology among youth with first-episode psychosis to inform the development of technology-enabled therapeutic interventions. Early Interv Psychiatry. 2017 Feb;11(1):72–6. doi: 10.1111/eip.12250.
    1. Greenland-White SE, Ragland JD, Niendam TA, Ferrer E, Carter CS. Episodic memory functions in first episode psychosis and clinical high risk individuals. Schizophr Res. 2017 Oct;188:151–7. doi: 10.1016/j.schres.2017.01.035. S0920-9964(17)30048-8
    1. Kimhy D, Lister A, Liu Y, Vakhrusheva J, Delespaul P, Malaspina D, Ospina LH, Mittal VA, Gross JJ, Wang Y. The impact of emotion awareness and regulation on psychotic symptoms during daily functioning. NPJ Schizophr. 2020 Mar 24;6(1):7. doi: 10.1038/s41537-020-0096-6. doi: 10.1038/s41537-020-0096-6.10.1038/s41537-020-0096-6
    1. Kimhy D, Myin-Germeys I, Palmier-Claus J, Swendsen J. Mobile assessment guide for research in schizophrenia and severe mental disorders. Schizophr Bull. 2012 May;38(3):386–95. doi: 10.1093/schbul/sbr186. sbr186
    1. Kimhy D, Vakhrusheva J, Khan S, Chang RW, Hansen MC, Ballon JS, Malaspina D, Gross JJ. Emotional granularity and social functioning in individuals with schizophrenia: an experience sampling study. J Psychiatr Res. 2014 Jun;53:141–8. doi: 10.1016/j.jpsychires.2014.01.020. S0022-3956(14)00029-6
    1. Vakhrusheva J, Khan S, Chang R, Hansen M, Ayanruoh L, Gross JJ, Kimhy D. Lexical analysis of emotional responses to "real-world" experiences in individuals with schizophrenia. Schizophr Res. 2020 Feb;216:272–8. doi: 10.1016/j.schres.2019.11.045. S0920-9964(19)30552-3
    1. Torous J, Andersson G, Bertagnoli A, Christensen H, Cuijpers P, Firth J, Haim A, Hsin H, Hollis C, Lewis S, Mohr DC, Pratap A, Roux S, Sherrill J, Arean PA. Towards a consensus around standards for smartphone apps and digital mental health. World Psychiatry. 2019 Feb;18(1):97–8. doi: 10.1002/wps.20592. doi: 10.1002/wps.20592.
    1. Torous J, Wisniewski H, Liu G, Keshavan M. Mental health mobile phone app usage, concerns, and benefits among psychiatric outpatients: comparative survey study. JMIR Ment Health. 2018 Nov 16;5(4):e11715. doi: 10.2196/11715. v5i4e11715
    1. Ben-Zeev D, Brian RM, Jonathan G, Razzano L, Pashka N, Carpenter-Song E, Drake RE, Scherer EA. Mobile health (mHealth) versus clinic-based group intervention for people with serious mental illness: a randomized controlled trial. Psychiatr Serv. 2018 Sep 01;69(9):978–85. doi: 10.1176/appi.ps.201800063.
    1. Ben-Zeev D, Kaiser SM, Brenner CJ, Begale M, Duffecy J, Mohr DC. Development and usability testing of FOCUS: a smartphone system for self-management of schizophrenia. Psychiatr Rehabil J. 2013 Dec;36(4):289–96. doi: 10.1037/prj0000019. 2013-32035-001
    1. Ben-Zeev D, Scherer EA, Gottlieb JD, Rotondi AJ, Brunette MF, Achtyes ED, Mueser KT, Gingerich S, Brenner CJ, Begale M, Mohr DC, Schooler N, Marcy P, Robinson DG, Kane JM. mHealth for schizophrenia: patient engagement with a mobile phone intervention following hospital discharge. JMIR Ment Health. 2016 Jul 27;3(3):e34. doi: 10.2196/mental.6348. v3i3e34
    1. Ben-Zeev D, Chander A, Tauscher J, Buck B, Nepal S, Campbell A, Doron G. A smartphone intervention for people with serious mental illness: fully remote randomized controlled trial of CORE. J Med Internet Res. 2021 Nov 12;23(11):e29201. doi: 10.2196/29201. v23i11e29201
    1. Berry N, Machin M, Ainsworth J, Berry K, Edge D, Haddock G, Lewis S, Morris R, Bucci S. Developing a theory-informed smartphone app for early psychosis: learning points from a multidisciplinary collaboration. Front Psychiatry. 2020;11:602861. doi: 10.3389/fpsyt.2020.602861. doi: 10.3389/fpsyt.2020.602861.
    1. Vaessen T, Steinhart H, Batink T, Klippel A, Van Nierop M, Reininghaus U, Myin-Germeys I. ACT in daily life in early psychosis: an ecological momentary intervention approach. Psychosis. 2019 Mar 19;11(2):93–104. doi: 10.1080/17522439.2019.1578401.
    1. Ahmed A, Ali N, Giannicchi A, Abd-alrazaq A, Ahmed M, Aziz S, Househ M. Mobile applications for mental health self-care: a scoping review. Comput Methods Programs Biomed Update. 2021;1:100041. doi: 10.1016/j.cmpbup.2021.100041. doi: 10.1016/j.cmpbup.2021.100041.
    1. Batra S, Baker R, Wang T, Forma F, DiBiasi F, Peters-Strickland T. Digital health technology for use in patients with serious mental illness: a systematic review of the literature. Med Devices (Auckl) 2017 Oct;10:237–51. doi: 10.2147/MDER.S144158. doi: 10.2147/MDER.S144158.mder-10-237
    1. Bell IH, Alvarez-Jimenez M. Digital technology to enhance clinical care of early psychosis. Curr Treat Options Psych. 2019 Jul 11;6(3):256–70. doi: 10.1007/s40501-019-00182-y.
    1. Jameel L, Valmaggia L, Barnes G, Cella M. mHealth technology to assess, monitor and treat daily functioning difficulties in people with severe mental illness: a systematic review. J Psychiatr Res. 2021 Nov 24;145:35–49. doi: 10.1016/j.jpsychires.2021.11.033.S0022-3956(21)00682-8
    1. Larsen ME, Huckvale K, Nicholas J, Torous J, Birrell L, Li E, Reda B. Using science to sell apps: evaluation of mental health app store quality claims. NPJ Digit Med. 2019;2:18. doi: 10.1038/s41746-019-0093-1. doi: 10.1038/s41746-019-0093-1.93
    1. Alvarez-Jimenez M, Bendall S, Koval P, Rice S, Cagliarini D, Valentine L, D'Alfonso S, Miles C, Russon P, Penn DL, Phillips J, Lederman R, Wadley G, Killackey E, Santesteban-Echarri O, Mihalopoulos C, Herrman H, Gonzalez-Blanch C, Gilbertson T, Lal S, Chambers R, Daglas-Georgiou R, Latorre C, Cotton SM, McGorry PD, Gleeson JF. HORYZONS trial: protocol for a randomised controlled trial of a moderated online social therapy to maintain treatment effects from first-episode psychosis services. BMJ Open. 2019 Feb 19;9(2):e024104. doi: 10.1136/bmjopen-2018-024104. bmjopen-2018-024104
    1. Buck B, Hallgren KA, Campbell AT, Choudhury T, Kane JM, Ben-Zeev D. mHealth-assisted detection of precursors to relapse in schizophrenia. Front Psychiatry. 2021;12:642200. doi: 10.3389/fpsyt.2021.642200. doi: 10.3389/fpsyt.2021.642200.
    1. Eisner E, Drake RJ, Berry N, Barrowclough C, Emsley R, Machin M, Bucci S. Development and long-term acceptability of ExPRESS, a mobile phone app to monitor basic symptoms and early signs of psychosis relapse. JMIR mHealth uHealth. 2019 Mar 29;7(3):e11568. doi: 10.2196/11568. v7i3e11568
    1. He-Yueya J, Buck B, Campbell A, Choudhury T, Kane JM, Ben-Zeev D, Althoff T. Assessing the relationship between routine and schizophrenia symptoms with passively sensed measures of behavioral stability. NPJ Schizophr. 2020 Nov 23;6(1):35. doi: 10.1038/s41537-020-00123-2. doi: 10.1038/s41537-020-00123-2.10.1038/s41537-020-00123-2
    1. Fiorillo A, Barlati S, Bellomo A, Corrivetti G, Nicolò G, Sampogna G, Stanga V, Veltro F, Maina G, Vita A. The role of shared decision-making in improving adherence to pharmacological treatments in patients with schizophrenia: a clinical review. Ann Gen Psychiatry. 2020 Aug 05;19(1):43. doi: 10.1186/s12991-020-00293-4. 293
    1. Stovell D, Morrison AP, Panayiotou M, Hutton P. Shared treatment decision-making and empowerment-related outcomes in psychosis: systematic review and meta-analysis. Br J Psychiatry. 2016 Jul;209(1):23–8. doi: 10.1192/bjp.bp.114.158931.S0007125000244309
    1. Bär Deucher A, Hengartner MP, Kawohl W, Konrad J, Puschner B, Clarke E, Slade M, Del Vecchio V, Sampogna G, Égerházi A, Süveges Á, Krogsgaard Bording M, Munk-Jørgensen P, Rössler W, CEDAR study group Participation in medical decision-making across Europe: an international longitudinal multicenter study. Eur Psychiatry. 2016 May;35:39–46. doi: 10.1016/j.eurpsy.2016.02.001.S0924-9338(16)02469-X
    1. Loos S, Arnold K, Slade M, Jordan H, Del Vecchio V, Sampogna G, Süveges A, Nagy M, Krogsgaard Bording M, Østermark Sørensen H, Rössler W, Kawohl W, Puschner B, CEDAR study group Courses of helping alliance in the treatment of people with severe mental illness in Europe: a latent class analytic approach. Soc Psychiatry Psychiatr Epidemiol. 2015 Mar;50(3):363–70. doi: 10.1007/s00127-014-0963-4.
    1. Matthias MS, Salyers MP, Rollins AL, Frankel RM. Decision making in recovery-oriented mental health care. Psychiatr Rehabil J. 2012;35(4):305–14. doi: 10.2975/35.4.2012.305.314. 480227857R448210
    1. O’Sullivan MJ, Rae S. Shared decision making in psychiatric medicines management. Mental Health Pract. 2014 May 09;17(8):16–22. doi: 10.7748/mhp2014.05.17.8.16.e889.
    1. Zielasek J, Reinhardt I, Schmidt L, Gouzoulis-Mayfrank E. Adapting and implementing apps for mental healthcare. Curr Psychiatry Rep. 2022 Sep;24(9):407–17. doi: 10.1007/s11920-022-01350-3. 10.1007/s11920-022-01350-3
    1. Lavallee DC, Lee JR, Austin E, Bloch R, Lawrence SO, McCall D, Munson SA, Nery-Hurwit MB, Amtmann D. mHealth and patient generated health data: stakeholder perspectives on opportunities and barriers for transforming healthcare. mHealth. 2020;6:8. doi: 10.21037/mhealth.2019.09.17. doi: 10.21037/-06-2019.09.17
    1. McClelland GT, Fitzgerald M. A participatory mobile application (app) development project with mental health service users and clinicians. Health Educ J. 2018 Jun 05;77(7):815–27. doi: 10.1177/0017896918773790.
    1. Ferrer-Wreder L, Sundell K, Mansoory S. Tinkering with perfection: theory development in the intervention cultural adaptation field. Child Youth Care Forum. 2011 Dec 25;41(2):149–71. doi: 10.1007/s10566-011-9162-6.
    1. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011 Mar;38(2):65–76. doi: 10.1007/s10488-010-0319-7.
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, Proctor EK, Kirchner JE. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015 Feb 12;10:21. doi: 10.1186/s13012-015-0209-1. 10.1186/s13012-015-0209-1
    1. Chambers DA, Norton WE. The Adaptome: advancing the science of intervention adaptation. Am J Prev Med. 2016 Oct;51(4 Suppl 2):S124–31. doi: 10.1016/j.amepre.2016.05.011. S0749-3797(16)30181-7
    1. Wiltsey Stirman S, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. 2019 Jun 06;14(1):58. doi: 10.1186/s13012-019-0898-y. 10.1186/s13012-019-0898-y
    1. Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013 Jun 10;8:65. doi: 10.1186/1748-5908-8-65. 1748-5908-8-65
    1. Mascayano F, Nossel I, Bello I, Smith T, Ngo H, Piscitelli S, Malinovsky I, Susser E, Dixon L. Understanding the implementation of coordinated specialty Care for Early Psychosis in New York state: a guide using the RE-AIM framework. Early Interv Psychiatry. 2019 Jun;13(3):715–9. doi: 10.1111/eip.12782.
    1. Read H, Kohrt BA. The history of coordinated specialty care for early intervention in psychosis in the united states: a review of effectiveness, implementation, and fidelity. Community Ment Health J. 2022 Jul;58(5):835–46. doi: 10.1007/s10597-021-00891-w.10.1007/s10597-021-00891-w
    1. Bello I, Lee R, Malinovsky I, Watkins L, Nossel I, Smith T, Ngo H, Birnbaum M, Marino L, Sederer LI, Radigan M, Gu G, Essock S, Dixon LB. OnTrackNY: the development of a coordinated specialty care program for individuals experiencing early psychosis. Psychiatr Serv. 2017 Apr 01;68(4):318–20. doi: 10.1176/appi.ps.201600512.
    1. Abraham T, Van Tiem J. Using qualitative summary templates and matrix displays to assess factors that impact the pace of implementation. U.S. Department of Veterans Affairs. 2021. Oct 6, [2022-05-02]. .
    1. Averill JB. Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qual Health Res. 2002 Jul;12(6):855–66. doi: 10.1177/104973230201200611.
    1. Gale RC, Wu J, Erhardt T, Bounthavong M, Reardon CM, Damschroder LJ, Midboe AM. Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the veterans health administration. Implement Sci. 2019 Feb 01;14(1):11. doi: 10.1186/s13012-019-0853-y. 10.1186/s13012-019-0853-y
    1. Creswell JW, Creswell JD. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. 5th edition. Thousand Oaks, CA: Sage Publications; 2018.
    1. Padgett D. Qualitative and Mixed Methods in Public Health. Thousand Oaks, CA: Sage Publications; 2011.

Source: PubMed

3
Abonneren