Summative Assessment of the BurntOut 3D Simulation With Medical Students

Burnout is a common problem for medical students and is associated with stress-related health problems and also potentially affects the quality of care delivered to their patients. Among the health problems commonly associated with burnout are substance use problems, and alcohol is the substance most often misused. The purpose of the evaluation is to document whether an educational intervention incorporating aspects of virtual reality (VR) via a 3D online simulation experience prevents or improves the primary endpoint of burnout and the secondary endpoints of burnout-related factors in medical students. The investigators will also will evaluate student satisfaction with the intervention to determine if it meets our standard of success. The hypothesis is that the intervention will improve the primary clinical endpoint of burnout from pre-intervention to post-intervention as measured by the Maslach Burnout Inventory, a validated inventory that is widely used to measure burnout. The related factors that will be measured as secondary clinical endpoints include quality of life, substance use (alcohol and drugs), depression, and resilience. Due to evidence that these endpoints are linked to burnout, the investigators also hypothesize that the measures will improve pre- to post-intervention. Satisfaction of the target audience after completing the simulation intervention will also be evaluated. The evaluation will be prior to and after use of the simulation by medical student participants, using a pre-/post intervention, wait-list control, parallel design.

Study Overview

• Status: Completed
• Conditions: Depression; Alcohol; Harmful Use; Quality of Life; Burnout, Professional; Burnout, Student; Drug Use; Resilience
• Intervention / Treatment: Other: Clinical Encounters Medical School 3D Simulation

Detailed Description

The investigators used a pre-/post-intervention design with wait-list controls who were able to use the intervention after the study, if they chose. The investigators recruited and enrolled 73 medical students. The number of participants selected is based on a power analysis of the design and experience of low dropout rate with this target audience; to reach a medium effect size the investigators plan for a final sample size of 68 medical students and 63 actually completed the study. During the intervention phase of the study, intervention group students 1) Completed the simulation experience: an interactive online simulation, interactive online case stories, and resilience-building activities (taking around 2 hours over a period of less than 2 weeks); and 2) Completed pre- assessments and 2-4 week post-assessments (each taking <1 hour). Controls completing pre-assessments and repeated the pre assessments after a 2 to 4 week wait period. The investigators screened for and excluded students with severe depression and suicidality but none needed to be excluded for this reason. The primary clinical endpoint was burnout as measured by the Maslach Burnout Inventory. Secondary endpoints were measured via adaptations of the following assessments: Alcohol Use Disorders Identification Test (AUDIT-C/AUDIT) for alcohol use disorder, Patient Health Questionaire (PHQ2/PHQ9) to screen for depression, Connor-Davidson Resilience Scale © (CD-RISC 2) for resiliency, two drug question screening for drug use, and Medical Student Quality of Life (MSQoL9). Control participants were invited to engage in the intervention after completing the study, that is, after completing their 2nd set of assessments. There were no adverse events.

• Study Type: Interventional
• Enrollment (Actual): 73
• Phase: Not Applicable

Contacts and Locations

Study Locations

• United States
  • North Carolina
    • Chapel Hill, North Carolina, United States, 27516
      • Clinical Tools, Inc.

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 18 years and older (Adult, Older Adult)
• Accepts Healthy Volunteers: Yes

Description

Inclusion Criteria:

• US Medical students in years 2-4
• Has access to a computer with Internet access

Exclusion Criteria:

--Self report of active symptoms of major depression

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Prevention
• Allocation: Randomized
• Interventional Model: Parallel Assignment
• Masking: None (Open Label)

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Experimental: Intervention; Participants completed the pre-assessments, used the intervention, waited 2-4 weeks, and then completed the assessments again.	Other: Clinical Encounters Medical School 3D Simulation; A 3D simulation related to coping with the stresses of medical school and burnout.
No Intervention: Wait Group; Participants completed the pre-assessments, waited 2-4 weeks, and completed the assessments again.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Burnout Change	Burnout was measured using the Maslach Burnout Inventory (modified). This scale uses items to assess emotional exhaustion, and depersonalization, and measure the sense of personal accomplishment. Selected items were used to make it relevant to medical students experience. It was modified so that for all questions, higher scores indicate higher, and thus more problematic, levels of burnout. A decrease means an improvement; lower values mean more improvement. A positive change means worsening; higher values mean more worsening. Range: Minimum total value 0, Maximum total value 96. The Outcome Measure is the amount of Burnout Change from baseline (evaluation point #1) to evaluation point #2. Burnout Change is calculated for the intervention group pre intervention and 2 weeks post intervention (case) and pre intervention and after a 2 week waiting period for the Wait Group (Control) . See Baseline for more details.	1 months

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Alcohol Use Change	Alcohol use was measured using the Alcohol Use Disorders Identification Test - Concise, (AUDIT-C). This instrument is a screening tool to identify users who are hazardous drinkers or who have active alcohol use disorder. Higher scores= greater frequency or amount of alcohol use or misuse Range: Minimum value: 0, Maximum value 12. High scores indicate worse outcomes. A score of over 4 for men, and over 3 for women is considered a positive screen for alcohol misuse. Higher scores suggest a higher likelihood that alcohol use is negatively impacting the person's health and safety. The Outcome Measure is the amount of Alcohol Use Change from baseline (evaluation point #1) to evaluation point #2. Alcohol Use Change was calculated for the intervention group pre intervention and 2 weeks post intervention (case) and pre intervention and after a 2 week waiting period for the Wait Group (Control) .	1 months
Depression Change	Depression was measured using the Patient Health Questionaire, PHQ-9 (modified to 6 questions). The PHQ is a screen where respondents indicate how often the respondent has experienced depressed mood and anhedonia over the prior two weeks. Selected questions (6) were used. Range: Minimum score: 0, Maximum score18. High scores indicate worse outcomes. The Outcome Measure is the amount of Depression Change from baseline (evaluation point #1) to evaluation point #2. Depression Change is calculated for the intervention group pre intervention and 2 weeks post intervention (case) and pre intervention and after a 2 week waiting period for the Wait Group (Control). See Baseline for more details	1 months
Resilience Change	Resilience was measured via the Connor-Davidson Resilience Scale - modified to use 2 questions from the scale. Range: Minimum score: 0, Maximum score: 8. An increase means an improvement and higher scores mean better outcomes. A decrease means worsening; and lower values mean worse outcomes. The Outcome Measure is the amount of Resilience Change from baseline (evaluation point #1) to evaluation point #2. Resilience Change was calculated for the intervention group pre intervention and 2 weeks post intervention (case) and pre intervention and after a 2 week waiting period for the Wait Group (Control). See Baseline for more details.	1 months
Drug Use Change	Drug use in the recent past was measured via the National Institute for Drug Abuse-Modified Alcohol, Smoking and Substance Involvement Screening Test (modified to use 2 questions from this scale). Range: Minimum 0, Maximum score 10. High scores indicate more drug use and an increase means worse outcomes. Low scores mean less drug use and a decrease means better outcomes. The Outcome Measure is the amount of Drug Use Change from baseline (evaluation point #1) to evaluation point #2. Drug Use Change is calculated for the intervention group pre intervention and 2 weeks post intervention (case) and pre intervention and after a 2 week waiting period for the Wait Group (Control). See Baseline for more details.	1 months
Happiness and Exhaustion (Quality of Life)	Happiness and Exhaustion (Quality of Life) were measured using the Medical Student Quality of Life Questionnaire with Nine Items (MSQoL9). The MSQoL is a linear self-assessment analog scale. It was modified to use only 5 of the questions from the scale that are on the domains of exhaustion and general happiness. Range for total score on the 5 questions: 1-25 Greater increase in scores means improvement; High scores indicate better outcomes. The analysis was modified so that high scores indicate a better quality of life for all questions. The Outcome Measure is the amount of Happiness and Exhaustion (Quality of Life) Change from baseline (evaluation point #1) to evaluation point #2. Happiness and Exhaustion (Quality of Life) Change was calculated for the intervention group pre intervention and 2 weeks post intervention (case) and pre intervention and after a 2 week waiting period for the Wait Group (Control).	2 weeks- 1 month

Collaborators and Investigators

• Sponsor: Clinical Tools, Inc.
• Collaborators: National Institute on Alcohol Abuse and Alcoholism (NIAAA)
• Investigators: Principal Investigator: Mary P Metcalf, PhD, Clinical Tools, Inc.

Study record dates

Study Major Dates

• Study Start (Actual): May 11, 2022
• Primary Completion (Actual): July 1, 2022
• Study Completion (Actual): July 31, 2022

Study Registration Dates

• First Submitted: July 10, 2020
• First Submitted That Met QC Criteria: July 28, 2020
• First Posted (Actual): July 31, 2020

Study Record Updates

• Last Update Posted (Estimated): December 15, 2023
• Last Update Submitted That Met QC Criteria: December 13, 2023
• Last Verified: December 1, 2023

More Information

Terms related to this study

• Additional Relevant MeSH Terms: Behavioral Symptoms; Stress, Psychological; Occupational Stress; Occupational Diseases; Burnout, Professional; Burnout, Psychological
• Other Study ID Numbers: 271330; R44AA026474 (U.S. NIH Grant/Contract)

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No