Effectiveness of Telepsychiatry With Randomized Waitlist Control Utilizing Patient Reported Outcome Measures (PROMs)

A Comparison of the Effectiveness of Telepsychiatry With a Randomized Waitlist Control Utilizing Patient Reported Outcome Measures (PROMs)

The utilization of patient reported outcome measures (PROMs) during in-person care allows for on-going assessment of the severity of mental illness and patient outcomes across treatment. Additionally, it provides immediate feedback on the patient's psychiatric status to both the patient and practitioner. Carilion Clinic - Psychiatry & Behavioral Medicine ambulatory clinic implemented PROMs prior to the start of the COVID-19 (Coronavirus Disease 2019) pandemic and continues to utilize them as part of patient care. All new patients are asked to complete an initial PROM bundle of assessments 24 hours before their initial appointment, including the Brief Adjustment Scale, Patient Health Questionnaire, Generalized Anxiety Disorder survey, US Alcohol Use Disorder Identification Test, and Drug Assessment Screening Test. Automatic monthly reminders to complete the assessments continue after the first visit with the clinician. Over the last 2 years, research members of Carilion Clinic Psychiatry and Virginia Tech Psychology have been actively using PROM data to assess psychiatric health outcomes before and after the outbreak of COVID-19 in the United States. Initial results indicate that patients who received care via telepsychiatry not only did not experience worsening symptoms, but showed improvements in depression, anxiety and psychological functioning. However, without a control group of untreated patients to compare, the impact of telepsychiatry plus PROMs remains unclear. A waitlist control group design would allow investigators to compare patients receiving telepsychiatry and repeated completion of PROMs (current practice) to patients referred to psychiatry, but not receiving telepsychiatry treatment or completing PROMs during the same period. In this study, investigators plan to randomize individuals on the waitlist to one of two groups to assess the influence of time alone awaiting initial psychiatric clinician assessment (no intervention) versus minimal intervention using repeated PROMs and microlearning patient education videos while awaiting initial psychiatric clinician assessment. This kind of design allows assessment for the influence of time and the type of health service contact that replicates the basics of measurement-based psychiatric services (measurement of symptomology and well-being), but with none of the benefits of psychiatric supports, interventions, and techniques.

Study Overview

• Status: Completed
• Conditions: Mental Health Disorder; Telemedicine; PROMs; Waitlist; Psychiatric or Mood Diseases or Conditions
• Intervention / Treatment: Behavioral: Patient-rated outcome measures and educational videos

Detailed Description

Patient-reported outcome measures are a component of Measurement-Based Care (MBC) that involves collaboration between patient and clinician using structured evaluations of patient symptoms to inform behavioral health treatment and clinical decisions. In clinical settings, MBC has been found to improve outcomes and decrease dropout. Since patient-reported outcome measures can be performed by patients or clinicians, in session or out of session, and in-person or via telemedicine, their application is particularly pertinent during or after a crisis. The COVID-19 pandemic abruptly accelerated the transition to telehealth for many and necessitated alterations to traditional therapeutic means. PROMs are a tool that can improve the telehealth experience by strengthening patient-clinician relationships strained by the use of telemedicine, and allows for tracking of patient symptoms, which can be discussed and intervened upon in session.

Over the last 2 years, research members of Carilion Clinic Psychiatry and Virginia Tech Psychology departments have been actively using PROM data to assess psychiatric health outcomes before and after the outbreak of COVID-19 in the United States (IRB approved protocol 20-905). Initial results indicate that patients who received care via telepsychiatry not only did not experience worsening symptoms, but showed improvements in depression, anxiety and psychological functioning. However, without a control group of untreated patients to compare, the impact of telemedicine plus PROMs remains unclear. A wait-list control group design would allow investigators to compare participants receiving telemedicine and repeated completion of PROMs (current practice) to participants referred to psychiatry, but not receiving telemedicine treatment or completing PROMs during the same time period. Investigators propose randomizing wait-list individuals to one of two groups to assess the influence of time alone awaiting initial psychiatric clinician assessment (no intervention) versus minimal intervention using repeated PROMs and reviewing microlearning patient education videos while awaiting initial psychiatric clinician assessment. This kind of design allows assessment for the influence of time and the type of health service contact that replicates the basics of measurement-based psychiatric services (measurement of symptomology and well-being), but with none of the benefits of psychiatric supports, interventions, and techniques.

As of July 2021, 32 Carilion psychiatric clinicians are engaged in Owl Insights, an MBC vendor. Approximately 500 unique individuals complete monthly PROMs through this system as part of routine clinical care. The research group recently conducted analyses of nearly 900 ambulatory adult psychiatric patients in ambulatory psychiatry at Carilion Clinic (CC&PBM) engaging in PROMs via telepsychiatry and in-person modalities. PROM results of a patient cohort in clinical care prior to the onset of COVID-19 (November 2019) through March 2021 demonstrated that depression, anxiety and psychological functioning did not decline as hypothesized but statistically improved. Data also show that the engagement rates range from 33 to 74% depending on demographic factors, and completion rates were significantly different for diagnostic group and payor status of the patient. The standard goal for MBC utilization is 80%, while the department goal is to have all patients participate in PROM completion. The research group has also completed focus groups of psychiatric clinicians and staff with regards to Owl Insights and PROMs within the past year, identifying barriers and facilitators to its use and plan training implementation for improved adherence and satisfaction (summary of focus group data and training outline- included in grant application, IRB approved protocol 20-1065). Since March 2020, CC-P&BM has been engaging with patients via telephone and several telehealth platforms. Currently, ambulatory psychiatry uses AmWell (Amwell telemedicine) service, a telehealth platform that provides secure telemedicine visits between clinician and patient. The department has documented between 2100-2300 adult telemedicine sessions monthly and 200-700 in-person visits per month between June 2020 and June 2021.

CC-P&BM currently has a wait-list of over 300 adults referred for mental health evaluation and treatment. Access to psychiatric clinicians remains insufficient despite increasing numbers of providers in the local clinic and the mental health needs associated with the pandemic are rising. As a result, a clinical intake coordinator (Licensed Professional Counselor) began in the CC-P&BM ambulatory clinic September 2021. This coordinator will individually contact people on the wait-list for psychiatric care by phone as part of routine care, beginning with the referrals most remote in time. The coordinator will complete an intake assessment for each wait-list individual who wants a psychiatric referral. Prior to the initial intake assessment by the intake coordinator, wait-list individuals will receive a bundle of PROMs automatically (through Owl Insights) to complete. These measures include the Patient Health Questionnaire (PHQ-9), Generalized Anxiety Disorder survey (GAD-7), Brief Adjustment Scale (BASE-6), Drug Assessment Screening Test (DAST-10), US Alcohol Use Disorder Identification Test (USAUDIT), Covid Event Checklist and the Adult Behavioral Health Screen (ABHS), all of which are currently used in routine ambulatory care. The intake coordinator will complete the intake assessment, noting the completion, and scores of, the PROMs. Scores of the PHQ-9, GAD-7 and BASE-6 will be utilized to triage the most severe referrals and move them up for a sooner appointment (the triage system of scores and Nurse-Practitioner vs Medical Doctor screening questions are attached to this application). Any concern about patient safety is also addressed immediately during this intake and is also noted in the materials attached to this application. Up to this point, all intake coordinator/referral interaction are part of routine care.

If eligible and capable of consent based on intake coordinator clinical judgement, individuals will then be randomized to participate to the no intervention group (completion of screening PROMs only during the intake coordinator assessment) or the minimal intervention group (intake coordinator assessment, including PROM screening and then prospective monthly PROM completion in addition to assigned microlearning patient education videos). Investigators will analyze changes in PROM scores for individuals engaged in both wait-list groups and compare results to their PROM scores at the initial provider telemedicine visit and over time (6 months post first provider assessment). Consent may be in-person with hard copy consent forms and signatures or through e-Consent either in-person or remotely.

The goals of this study are to (1) measure the symptomology and well-being of adult individuals on a waitlist group referred to CC-P&BM clinic from their initial referral to their initial psychiatric session with PROMs monthly versus only at entry to the waitlist and entry to clinic and (2) use PROMs to assess whether there is a difference in clinical symptomology and well-being for patients during tele-treatment with their practitioner compared to waitlist Individuals.

• Study Type: Interventional
• Enrollment (Actual): 148
• Phase: Not Applicable

Contacts and Locations

• Study Contact: Name: Daniel Harrington, MD; Phone Number: 540-526-2550; Email: irb@carilionclinic.org
• Study Contact Backup: Name: Anita Kablinger, MD; Phone Number: 540-981-8025; Email: askablinger@carilionclinic.org

Study Locations

• United States
  • Virginia
    • Roanoke, Virginia, United States, 24014
      • Anita Kablinger

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 16 years and older (Adult, Older Adult)
• Accepts Healthy Volunteers: No

Description

Inclusion Criteria: A:

• all patients referred and see in an academic outpatient psychiatry clinic who wish to enroll

Exclusion Criteria:

• patients unable to engage in measurement-based care, such as those with dementia or other cognitive disorder

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Treatment
• Allocation: Randomized
• Interventional Model: Parallel Assignment
• Masking: Single

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Experimental: Initial PROM plus monthly PROM plus educational video; These patients receive usual care plus monthly PROMs and educational video(s) while on the waitlist	Behavioral: Patient-rated outcome measures and educational videos; PROMs are scales that are validated in behavioral health for tracking symptoms of depression, anxiety, and other conditions. They can be self-administered or given by a clinician. Mytonomy videos are short, educational videos about the patient's primary condition. All patients receive PROMs on entering our clinic. The difference in this intervention is those randomized to the active treatment will receive monthly PROMs and mytonomy video(s) until their appointment with the clinician. Usual care patients will only have PROMs at the intake and then at the appointment with their assigned clinician.
No Intervention: Usual Care; Patients will complete the initial bundle of PROMs, then no further PROMs while they remain on the waitlist

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Measurement of symptomatology of patients on waitlist via Patient Health Questionnaire (PHQ-9)	assess symptoms of patients on waiting list to see psychiatry from their initial referral to their initial psychiatric session. Score 0-27, higher is more severe depression.	11 months
Measurement of symptomatology of patients on waitlist via Generalized Anxiety Disorder survey (GAD-7)	assess symptoms of patients on waiting list to see psychiatry from their initial referral to their initial psychiatric session. Score 0-21, higher is more anxious.	11 months
Measurement of symptomatology of patients on waitlist via Brief Adjustment Scale (BASE-6)	assess symptoms of patients on waiting list to see psychiatry from their initial referral to their initial psychiatric session. Score 6-42, higher is poorer function.	11 months
Measurement of symptomatology of patients on waitlist via US Alcohol Use Disorder Identification Test (USAUDIT)	assess symptoms of patients on waiting list to see psychiatry from their initial referral to their initial psychiatric session. Score 0-46, higher is greater alcohol use severity.	11 months
Measurement of symptomatology of patients on waitlist via Drug Assessment Screening Test (DAST-10)	assess symptoms of patients on waiting list to see psychiatry from their initial referral to their initial psychiatric session. Score 0-10, higher indicates greater substance use.	11 months
Difference between symptomatology of patients on waitlist who receive usual care versus those who record monthly Patient Health Questionnaire (PHQ-9) and watch an educational video (mytonomy)	determine whether an educational video and monthly symptom monitoring helps improve symptoms of patients randomized to the intervention group versus those in usual care	11 months
Difference between symptomatology of patients on waitlist who receive usual care versus those who record monthly Generalized Anxiety Disorder survey (GAD-7) and watch an educational video (mytonomy)	determine whether an educational video and monthly symptom monitoring helps improve symptoms of patients randomized to the intervention group versus those in usual care	11 months
Difference between symptomatology of patients on waitlist who receive usual care versus those who record monthly Brief Adjustment Scale (BASE-6) and watch an educational video (mytonomy)	determine whether an educational video and monthly symptom monitoring helps improve symptoms of patients randomized to the intervention group versus those in usual care	11 months

Collaborators and Investigators

• Sponsor: Carilion Clinic
• Collaborators: National Institutes of Health (NIH); Virginia Polytechnic Institute and State University; National Center for Advancing Translational Sciences (NCATS)
• Investigators: Principal Investigator: Virginia O'Brien, MD, Carilion Clinic

Publications and helpful links

General Publications

• Kalin ML, Garlow SJ, Thertus K, Peterson MJ. Rapid Implementation of Telehealth in Hospital Psychiatry in Response to COVID-19. Am J Psychiatry. 2020 Jul 1;177(7):636-637. doi: 10.1176/appi.ajp.2020.20040372. No abstract available.
• Lambert MJ, Whipple JL, Kleinstauber M. Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring. Psychotherapy (Chic). 2018 Dec;55(4):520-537. doi: 10.1037/pst0000167.
• Lewis CC, Boyd M, Puspitasari A, Navarro E, Howard J, Kassab H, Hoffman M, Scott K, Lyon A, Douglas S, Simon G, Kroenke K. Implementing Measurement-Based Care in Behavioral Health: A Review. JAMA Psychiatry. 2019 Mar 1;76(3):324-335. doi: 10.1001/jamapsychiatry.2018.3329.
• Torous J, Wykes T. Opportunities From the Coronavirus Disease 2019 Pandemic for Transforming Psychiatric Care With Telehealth. JAMA Psychiatry. 2020 Dec 1;77(12):1205-1206. doi: 10.1001/jamapsychiatry.2020.1640. No abstract available.
• Augusterfer EF, Mollica RF, Lavelle J. Leveraging Technology in Post-Disaster Settings: the Role of Digital Health/Telemental Health. Curr Psychiatry Rep. 2018 Aug 28;20(10):88. doi: 10.1007/s11920-018-0953-4.
• Douglas S, Jensen-Doss A, Ordorica C, Comer JS. Strategies to enhance communication with telemental health measurement-based care (tMBC). Pract Innov (Wash D C). 2020 Jun;5(2):143-149. doi: 10.1037/pri0000119.

Study record dates

Study Major Dates

• Study Start (Actual): October 18, 2021
• Primary Completion (Actual): January 31, 2023
• Study Completion (Actual): January 31, 2023

Study Registration Dates

• First Submitted: February 16, 2022
• First Submitted That Met QC Criteria: March 7, 2022
• First Posted (Actual): March 11, 2022

Study Record Updates

• Last Update Posted (Actual): January 3, 2024
• Last Update Submitted That Met QC Criteria: December 29, 2023
• Last Verified: December 1, 2023

More Information

Terms related to this study

• Keywords: Measurement-based Care
• Additional Relevant MeSH Terms: Mental Disorders
• Other Study ID Numbers: 21-1426; UL1TR003015 (U.S. NIH Grant/Contract)

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No