Impact of a Simulation-based Training Curriculum of Non-technical Skills on Colonoscopy Performance

April 28, 2017 updated by: Samir Grover, Unity Health Toronto
The investigators aim to test a curriculum of non-technical skills (NTS) training for simulation-based training of colonoscopy. There is no known literature to date on the optimal approach on how to teach NTS in endoscopy. The objectives are to evaluate a simulation-based curriculum to teach NTS, to explore the relationship between NTS and other domains of competency, and understand how NTS are acquired in endoscopic training.

Study Overview

Status

Completed

Conditions

Intervention / Treatment

Detailed Description

This study will employ a randomized controlled two-arm design. All testing and training will take place at St. Michael's Hospital (30 Bond Street, Toronto, Ontario). During the study participants will be performing simulated lower endoscopic procedures on a virtual reality (VR) endoscopy simulator.

Description of Simulation Devices used

Low-Fidelity Simulator (Bench Top Model): The low-fidelity simulator is a validated bench-top endoscopy simulator that helps develop general endoscopic skills. The simulator is comprised of a series of vertical wooden barriers with numbered targets (holes) conforming to 27 different sequences of varying complexity. An Olympus paediatric videocolonoscope is used to navigate the defined sequences as quickly and accurately as possible, with visual output being displayed on a video monitor.

High-Fidelity Simulator: Virtual Reality Model: The high-fidelity simulator to be used for testing and training is the EndoVR® virtual reality (VR) endoscopy simulator. It models navigation through a colon, using a specialized endoscope that is inserted into a computer-based module with a screen showing the colonic lumen of a virtual patient. It provides both visual and haptic feedback related to the procedure. The VR simulator has a number of standardized case-based scenarios of varying complexity for colonoscopy.

Details of experimental design

Baseline questionnaire: A written questionnaire will be administered to all participants at the start of the project to collect demographic and background information including: age, sex, level of training, previous endoscopy experience and nature of experience (if applicable), and video game experience, which may correlate with baseline endoscopic skill.

Pre-test: All participants will then take part in a pre-test designed to assess their baseline (1) knowledge of colonoscopy; (2) technical skills; and (3) non-technical skills. No feedback will be provided at any point during the pre-test. The pre-test will consist of the following:

Knowledge Test: A 30 minute (20 questions) multiple-choice question test designed to assess participants' theoretical knowledge of colonoscopy, including indications, sedation, safety, findings, pathology and follow-up.

VR Simulation Test: Participants baseline endoscopic technical proficiency will be will be assessed through the completion of a colonoscopy procedure on the VR simulator. This scenario simulates a screening colonoscopy, without the need for any type of intervention such as biopsy. The procedure will be timed so that participants do not take longer than 30 minutes to complete the procedure. An expert rater will be present to assess performance, but will not provide assistance. All participants will be videotaped in order to obtain performance measures such that their faces are not captured to ensure anonymity. Prior to starting the procedure, participants will complete a questionnaire to measure their self-efficacy.

VR Simulation Based "Integrated Scenario" Test: Following the simulator-only test, participants will complete an Integrated Scenario format test to assess their baseline endoscopic non-technical proficiency. This test was modeled after another test during which participants perform a colonoscopy procedure on the VR simulator while interacting with an endoscopic nurse and a standardized patient (SP) portraying a patient. The simulated procedure will mimic the setup of an endoscopic suite, as the VR simulator will be positioned next to a patient bed. A standardized patient, who will receive instructions regarding their medical role, will act out a scenario on colon cancer screening. Trainees will be expected to explain the colonoscopy procedure, its benefits and risks, and obtain procedural consent. The trainee will then carry out the procedure on the VR simulator while responding to the patient and interacting with the standardized nurse (SN) as appropriate. The SP will act out cues from the VR simulator if the simulator signals that the procedure has exceeded its threshold for discomfort. The performance of all participants will be videotaped (in a manner that their faces are not captured to ensure anonymity) in order to obtain performance measures. Participants will be given a maximum of 45 minutes to complete the procedure. Prior to starting the procedure, participants will complete a questionnaire to measure their self-efficacy.

Training interventions: Subsequently participants will be randomized, using an online randomization algorithm, to one of two groups (following a 1:1 allocation distribution)

Sample size calculation: A power analysis was computed using G*Power version 3.1.9. Using a previous study that evaluated an NTS training curriculum in surgery as assessed by the Non-Technical Skills for Surgeons (NOTSS) and OSANTS forms, we conducted the analysis using the relevant effect size. Based on an effect size of 0.65 (effect size f), an alpha of 0.05 (two-tailed), a beta of 0.20, 2 groups, and 3 measurements, 16 participants are required to achieve a power of greater than 0.80 using repeated measures ANOVA (between-factors). Furthermore, a previous study comparing a curriculum in endoscopic simulation found that a minimum of 15 participants per group was sufficient to detect a significant difference. To accommodate for a projected 20% dropout and/or non-response that may occur, we therefore plan to recruit a total of 36 participants.

Statistical analysis: Statistical analyses will be performed using Statistical Package for the Social Sciences (SPSS) version 20. All statistical tests will be considered significant at p < 0.05. Baseline Questionnaire: Patient demographics and baseline variables will be compared between the two groups using Analysis of Variance (ANOVA) and chi-square tests for continuous and categorical variables respectively. (b)Clinical Performance (Technical and Non-Technical): Clinical performance during the live colonoscopies for each group will be determined by comparing the scores from the DOPS, GiECAT, NAPCOMS, and Modified-OSANTS. Specifically, a mixed factor 2 (NTS curriculum vs. TS curriculum) x 2 (procedure 1 vs. procedure 2) ANOVA will be used to determine whether there is a difference based on the rating scales. Tukey's honest significant difference (HSD) test will be used as a post-hoc analysis to determine any significant differences.

Technical Performance: Technical performance on the simulator for each group will be determined by comparing the scores from the DOPS, GiECAT, and GAGES. Specifically, a mixed factor 2 (NTS curriculum vs. TS curriculum) x 3 (pretest, posttest, retention test) ANOVA will be used to determine whether there is a difference based on the rating scales. Tukey HSD test will be used as a post-hoc analysis to determine any significant differences.

Non-Technical Performance: Non-technical performance on the simulator for each group will be determined by comparing the scores from the GiECAT and modified OSANTS. Specifically, a mixed factor 2 (NTS curriculum vs. TS curriculum) x 3 (pretest, posttest, retention test) ANOVA will be used to determine whether there is a difference based on the rating scales. Tukey HSD test will be used as a post-hoc analysis to determine any significant differences.

Study Type

Interventional

Enrollment (Actual)

42

Phase

  • Not Applicable

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Locations

  • Canada
    • Ontario
      • Toronto, Ontario, Canada, M5B1W8
        • St.Michael's Hospital

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

  • Child
  • Adult
  • Older Adult

Accepts Healthy Volunteers

No

Genders Eligible for Study

All

Description

Inclusion Criteria:

  • Novice endoscopists from general surgery, gastroenterology, or pediatrics gastroenterology residency programs at the University of Toronto

Exclusion Criteria:

  • If participants have performed more than 25 endoscopies

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

  • Primary Purpose: Other
  • Allocation: Randomized
  • Interventional Model: Parallel Assignment
  • Masking: Double

Arms and Interventions

Participant Group / Arm
Intervention / Treatment
Experimental: Non-Technical Skills Training Curriculum
This group will receive 4 hours of small-group and hands-on sessions and 1 hour of didactic NTS sessions. Participants will watch a video that demonstrates ideal endoscopic performance. They will use the E-NTS Checklist during the integrated scenario training. This checklist targets NTS. The group will be given 7 hours of expert-assisted instruction on the low-fidelity simulator (1 hour) and the high-fidelity VR simulator (6 hours). Six modules of increasing difficulty in colonoscopy and polypectomy will be taught with feedback from an expert endoscopist who will demonstrate techniques, answer questions and provide individualized performance feedback with a focus on NTS. The last three hours on the high fidelity simulator will be an integrated scenario (IG) featuring standardized patient (SP) and standardized nurse (SN). Feedback will be given after each IG by the instructor, SP and SN. Participants can view the E-NTS Checklist before and after each case.
Other: Non-Technical Skills Training Curriculum
Active Comparator: Conventional Simulation Training Group
This group will receive 4 hours of small-group and hands-on sessions on colonoscopy theory from an expert endoscopist. The core curriculum is designed on the basis of the American Society for Gastrointestinal Endoscopy colonoscopy curriculum and an endoscopic training textbook. This curriculum has been shown to be effective when compared to self-regulated learning on the simulator. The sessions will be interlaced with eight hours of expert-assisted instruction on both the low-fidelity simulator (1 hour) and on the high-fidelity VR simulator (7 hours). Six modules of increasing difficulty in colonoscopy and polypectomy will be taught with feedback from an expert endoscopist. The expert will demonstrate techniques, answer questions and provide feedback on global performance. Feedback, in the form of performance metrics, will be provided by the simulator upon completion/failure of each module.
Other: Conventional Simulation Training Group

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Difference in performance between two groups in clinical colonoscopy
Time Frame: During clinical colonoscopy 4-6 weeks after NTS training curriculum
Each videotaped clinical colonoscopy will be independently assessed by two experienced endoscopists using the Joint Advisory Group for GI Endoscopy Direct Observation of Procedural Skills (JAG/DOPS). The raters will be blinded to the group assignment. Training on how to use the tool will be provided for raters by the investigators of the study.
During clinical colonoscopy 4-6 weeks after NTS training curriculum

Secondary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Differences in procedural knowledge
Time Frame: One day
Assessed through multiple choice question tests
One day
Technical performance on a VR simulated colonoscopy - JAG/DOPS
Time Frame: 4-6 weeks
Assessed through a Joint Advisory Group for GI Endoscopy Direct Observation of Procedural Skills (JAG/DOPS).
4-6 weeks
Technical performance on a VR simulated colonoscopy - GiECAT
Time Frame: 4-6 weeks
Assessed through the Gastrointestinal Endoscopy Competency Assessment Tool for Pediatric Colonoscopy (GiECAT).
4-6 weeks
Patient comfort during clinical colonoscopies
Time Frame: 4-6 weeks
Assessed through Nurse-Assessed Patient Comfort Score (NAPCOMS).
4-6 weeks
Non-technical performance on clinical colonoscopies
Time Frame: 4-6 weeks
Assessed through the Modified Objective Structured Assessment of Nontechnical Skills (MOSANTS)
4-6 weeks
Clinical performance on clinical colonoscopies - GiECAT
Time Frame: 4-6 weeks
Assessed through GiECAT
4-6 weeks
Participant self-efficacy
Time Frame: 1 day
Assessed through an adapted scale based on the General Self-Efficacy Scale.
1 day
Practice case length on simulator
Time Frame: 1 day
Assessed through a time measurement of the length of the case. Experienced endoscopists will assess participants' colonoscopy-specific skills, technical skills and non-technical skills during the pre-training, immediate and delayed post-training simulation-based assessments
1 day

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Unity Health Toronto

Investigators

  • Principal Investigator: Samir C Grover, MD, MEd, Unity Health Toronto

Publications and helpful links

The person responsible for entering information about the study voluntarily provides these publications. These may be about anything related to the study.

General Publications

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

June 1, 2015

Primary Completion (Actual)

June 1, 2016

Study Completion (Actual)

June 1, 2016

Study Registration Dates

First Submitted

July 28, 2016

First Submitted That Met QC Criteria

August 18, 2016

First Posted (Estimate)

August 24, 2016

Study Record Updates

Last Update Posted (Actual)

May 2, 2017

Last Update Submitted That Met QC Criteria

April 28, 2017

Last Verified

April 1, 2017

More Information

Terms related to this study

Keywords

Other Study ID Numbers

  • 15-164c

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Endoscopy Simulation

Clinical Trials on Non-Technical Skills Training Curriculum

Search Similar Trials

Sponsors and Collaborators

Medical Conditions

Drug Interventions

CROs by country

CROs in Cyprus

Conditions

Rare Diseases

Drug Interventions

Dietary Supplements

Sponsor/Collaborators

Locations

Subscribe