Learning From Errors During Simulation-based Ultrasound Training

During the past decades, simulation-based training has become essential for making trainees fit for clinical practice. Traditionally, trainees are instructed to practice with as few errors as possible during simulation-based training. However, recent evidence from the field of psychology suggests that transfer of learning may improve if trainees are encouraged to commit errors during training. The aim of this study is to assess on performances with real patients the effect of error-management instructions compared to error-avoidance instructions during simulation-based virtual reality ultrasound training.

This study is planned as a randomized controlled trial. Participants include medical students with no prior simulation practice at the fifth or sixth year of medical school. All participants receive 3 hours simulation-based ultrasound training focusing on fetal weight estimation. The participants (N=60) are randomized into two groups: Participants in group 1 are instructed to follow the simulator program step-by-step to achieve the highest possible simulator metric scores by making as few errors as possible. Participants in group 2 are instructed to experiment and explore and to deliberately make errors during training. A simulation-based pre- and post-test is administered before and after training.

Participants are scheduled to perform a transfer test seven to ten days after simulation training. The transfer test consists of fetal weight estimation on a real patient. The primary outcome is weight deviation of participant measurements compared to expert findings. Secondary outcomes include performance assessments of pre-, post- and transfer test performances by blinded ultrasound experts using the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale. Using an alpha level of 0.05, an effect size of 0.80, and a power of 0.80, 25 participants are needed in the two study groups. Loss to follow-up of up to 20% of study participants is anticipated, resulting in 30 participants in each study group.

Study Overview

• Status: Completed
• Conditions: Simulation-based Ultrasound Training, Error-management Training, Training With Errors, Skills Transfer
• Intervention / Treatment: Procedure: Error-management training vs error-avoidance training. Defined by training instructions.

• Study Type: Interventional
• Enrollment (Actual): 60
• Phase: Not Applicable

Contacts and Locations

Study Locations

• Denmark
  • Copenhagen, Denmark, 2100
    • Juliane Marie Center, Copenhagen University Hospital Rigshospitalet
  • Copenhagen O, Denmark, 2100
    • Dept. of Fetal Medicine, Juliane Marie Centre

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: Child; Adult; Older Adult
• Accepts Healthy Volunteers: Yes
• Genders Eligible for Study: All

Description

Inclusion Criteria:

• are enrolled during the fifth or sixth year of medical school
• provide written informed consent

Exclusion Criteria:

• have clinical or simulator ultrasound experience

Study Plan

How is the study designed?

Design Details

• Allocation: Randomized
• Interventional Model: Parallel Assignment
• Masking: Single

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Experimental: Error-avoidance training; Study group 1: Error-avoidance training (Focusing on achieving the highest possible metrics score by avoiding errors).	Procedure: Error-management training vs error-avoidance training. Defined by training instructions.; . Error-avoidance training: The participants are instructed to follow the simulator program step-by-step, to achieve the highest possible simulator metric scores by making as few errors as possible, and only to follow the task required in the training program. Study group 2. Error-management training: The participants are required to complete the same training program as study group 1. The participants are instructed to experiment and explore on their own and to deliberately make errors during the task that they are instructed to perform. Participants are instructed to reflect on their errors based on the simulator metrics that they do not pass. Errors are framed as positive events and instructor comments may include statements such as "the more errors you make, the more you learn!" or "you have made an error? Great! Because now you can learn something new!"
Experimental: Error-management training; Study group 2: Error-management training (Focusing on making errors and thinking of them in a positive way).	Procedure: Error-management training vs error-avoidance training. Defined by training instructions.; . Error-avoidance training: The participants are instructed to follow the simulator program step-by-step, to achieve the highest possible simulator metric scores by making as few errors as possible, and only to follow the task required in the training program. Study group 2. Error-management training: The participants are required to complete the same training program as study group 1. The participants are instructed to experiment and explore on their own and to deliberately make errors during the task that they are instructed to perform. Participants are instructed to reflect on their errors based on the simulator metrics that they do not pass. Errors are framed as positive events and instructor comments may include statements such as "the more errors you make, the more you learn!" or "you have made an error? Great! Because now you can learn something new!"

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
diagnostic accuracy	The primary outcome is diagnostic accuracy during the transfer test performances. Diagnostic accuracy is determined as the percentage deviation from the fetal weight estimation performed by an experienced sonographer (i.e. an ultrasound expert).	7-10 days later in a tranfer test

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
performance scores based on the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale	Secondary outcome measures include performance scores based on the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale.	7-10 days in a tranfer test

Collaborators and Investigators

• Sponsor: Rigshospitalet, Denmark

Study record dates

Study Major Dates

• Study Start: February 1, 2015
• Primary Completion (Actual): June 1, 2015
• Study Completion (Actual): June 1, 2015

Study Registration Dates

• First Submitted: February 17, 2015
• First Submitted That Met QC Criteria: February 17, 2015
• First Posted (Estimate): February 24, 2015

Study Record Updates

• Last Update Posted (Estimate): October 27, 2015
• Last Update Submitted That Met QC Criteria: October 26, 2015
• Last Verified: October 1, 2015

More Information

Terms related to this study

• Other Study ID Numbers: H-4-2015-FSP