A Trial of a Video Game Intervention to Recalibrate Physician Heuristics

A Randomized Controlled Trial of a Video Game Intervention to Recalibrate Physician Heuristics

The objective of this study is to compare the efficacy of a video game designed to recalibrate physician heuristics in trauma triage with a standard educational program.

Study Overview

• Status: Completed
• Conditions: Wounds and Injuries
• Intervention / Treatment: Behavioral: Night Shift; Behavioral: Educational Module

Detailed Description

Treatment at trauma centers improves outcomes for patients with moderate-to-severe injuries. Accordingly, professional organizations, state authorities, and the federal government have endorsed the systematic triage and transfer of these patients to trauma centers either directly from the field or after evaluation at a non-trauma center. Nonetheless, between 30 to 40% of patients with moderate-to-severe injuries still only receive treatment at non-trauma centers, so-called under-triage. Most of this under-triage occurs because of physician decisions (rather than first-responder decisions). Existing efforts to change physician decision making focus primarily on knowledge of clinical practice guidelines and attitudes towards the guidelines. These strategies ignores the growing consensus that decision making reflects both knowledge as well as intuitive judgments (heuristics). Heuristics, mental short cuts based on pattern recognition, drive the majority of decision making. The investigators have developed an adventure video game (Night Shift) to serve as a novel method of recalibrating physician heuristics in trauma triage and will compare its efficacy with a standard educational program.

• Study Type: Interventional
• Enrollment (Actual): 368
• Phase: Not Applicable

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: Child; Adult; Older Adult
• Accepts Healthy Volunteers: Yes
• Genders Eligible for Study: All

Description

Inclusion Criteria:

• Physicians who care for adult patients in the Emergency Department.
• Physicians who work at a non-trauma center.
• Physicians who work at a Level III/IV trauma center.

Exclusion Criteria:

• Physicians who work at a Level I/II trauma center.
• Physicians who do not practice in the US.

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Treatment
• Allocation: Randomized
• Interventional Model: Parallel Assignment
• Masking: None (Open Label)

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Experimental: Adventure video game; Physicians in this arm of the trial will be asked to play Night Shift, an adventure video game, for one hour.	Behavioral: Night Shift; Night Shift is an adventure video game with the transformational goal of teaching physicians key characteristics of patients with non-representative severe injuries - injuries classified by the American College of Surgeons as life-threatening or critical but that do not fit the archetype of injuries typically requiring treatment at a trauma center. Players take on the persona of Andy Jordan, a young emergency physician who moves home after the disappearance of his estranged grandfather (Robert Jordan) and takes up a job in the local Emergency Department (ED). In the preamble, players learn they have two explicit objectives. First, they must diagnose and treat patients who present to their ED. Second they must solve the mystery of Robert's disappearance: was he murdered or has he simply chosen to disappear?
Active Comparator: Educational Module; Physicians in this arm of the trial will be asked to use myATLS, an app designed by the American College of Surgeons to serve as an adjunct to the ATLS course, and Trauma Life Support MCQ Review, an app designed to help students prepare for the ATLS exam. They will be asked to spend at least one hour on the combined tasks.	Behavioral: Educational Module; The educational module consists of two separate apps, both commercially available. myATLS includes a review of each chapter of the Advanced Trauma Life Support (ATLS) textbook, a series of videos demonstrating common trauma procedures, and clinical resources including checklists for use at the bedside. Trauma Life Support MCQ Review includes 550 multiple-choice questions with correct answers and explanations. The investigators will ask physicians to review the myATLS app and then complete questions in the Trauma Life Support MCQ Review, spending at least 1 hour on the combined tasks.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Under-triage rate	Physicians in both arms of the study will be randomized to complete one of two versions of a virtual simulation: a control version and a cognitive load version. They will complete the simulation upon completion of the intervention, ideally within one month of enrollment. The virtual simulation replicates the environment of the ED. Physicians have to manage 10 patients that appear concurrently, while also responding to a series of audio-visual distractors. Specifically, they must provide information on whether they will admit, transfer, or discharge the patients home. The investigators will calculate an under-triage rate for each physician (the number of simulated patients with severe injuries not transferred to a trauma center), summarize the under-triage rate by group (Night Shift v. educational control), and will compare the difference in those rates.	After completion of the intervention

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
The effect of cognitive load on the under-triage rate	As described above, participants will complete either a control or cognitive load version of the virtual simulation upon completion of the intervention, ideally within one month of the enrollment. As a secondary outcome measure, the investigators will assess the difference in under-triage rates of physicians who complete the simulation under control and cognitive load conditions, by intervention type.	After completion of the intervention

Collaborators and Investigators

• Sponsor: University of Pittsburgh
• Collaborators: Carnegie Mellon University

Publications and helpful links

General Publications

• Mohan D, Farris C, Fischhoff B, Rosengart MR, Angus DC, Yealy DM, Wallace DJ, Barnato AE. Efficacy of educational video game versus traditional educational apps at improving physician decision making in trauma triage: randomized controlled trial. BMJ. 2017 Dec 12;359:j5416. doi: 10.1136/bmj.j5416.
• Mohan D, Rosengart MR, Fischhoff B, Angus DC, Wallace DJ, Farris C, Yealy DM, Barnato AE. Using incentives to recruit physicians into behavioral trials: lessons learned from four studies. BMC Res Notes. 2017 Dec 28;10(1):776. doi: 10.1186/s13104-017-3101-z.
• Mohan D, Rosengart MR, Fischhoff B, Angus DC, Farris C, Yealy DM, Wallace DJ, Barnato AE. Testing a videogame intervention to recalibrate physician heuristics in trauma triage: study protocol for a randomized controlled trial. BMC Emerg Med. 2016 Nov 11;16(1):44. doi: 10.1186/s12873-016-0108-z.

Study record dates

Study Major Dates

• Study Start: October 1, 2016
• Primary Completion (Actual): November 1, 2016
• Study Completion (Actual): November 1, 2016

Study Registration Dates

• First Submitted: July 28, 2016
• First Submitted That Met QC Criteria: August 2, 2016
• First Posted (Estimate): August 5, 2016

Study Record Updates

• Last Update Posted (Actual): August 24, 2017
• Last Update Submitted That Met QC Criteria: August 22, 2017
• Last Verified: August 1, 2017

More Information

Terms related to this study

• Keywords: decision making; heuristics
• Additional Relevant MeSH Terms: Wounds and Injuries
• Other Study ID Numbers: PRO16070572

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: YES
• IPD Plan Description: De-identified data will be made available on application to the investigator team.