A randomized comparison of video demonstration versus hands-on training of medical students for vacuum delivery using Objective Structured Assessment of Technical Skills (OSATS)

Ziad Hilal, Anne K Kumpernatz, Günther A Rezniczek, Cem Cetin, Eva-Katrin Tempfer-Bentz, Clemens B Tempfer, Ziad Hilal, Anne K Kumpernatz, Günther A Rezniczek, Cem Cetin, Eva-Katrin Tempfer-Bentz, Clemens B Tempfer

Abstract

Background: To compare medical students' skills for vaginal operative delivery by vacuum extraction (VE) after hands-on training versus video demonstration.

Methods: We randomized medical students to an expert demonstration (group 1) or a hands-on (group 2) training using a standardized VE algorithm on a pelvic training model. Students were tested with a 40-item Objective Structured Assessment of Technical Skills (OSATS) scoring system after training and 4 days later. OSATS scores were the primary outcome. Performance time, self-assessment, confidence, and global rating scale were secondary outcomes. We assessed the constructive validity of OSATS in this VE model comparing metric scores of experts and students.

Results: In all, 137 students were randomized. OSATS scores were higher in group 2 (n = 63) compared with group 1 (n = 74) (32.89 ± 6.39 vs 27.51 ± 10.27, respectively; P < 0.0001). Global rating scale (1.49 ± 0.76 vs 2.33 ± 0.94, respectively; P < 0.0001), confidence (2.22 ± 0.75 vs 3.26 ± 0.94, respectively; P = 0.04), self-assessment (2.03 ± 0.62 vs 2.51 ± 0.77, respectively; P < 0.0001), and performance time (38.81 ± 11.58 seconds vs 47.23 ± 17.35 seconds, respectively; P = 0.001) also favored group 2. After 4 days, this effect persisted with OSATS scores still being significantly higher in group 2 (30.00 ± 6.50 vs 25.59 ± 6.09, respectively; P = 0.001). The assessed OSATS scores showed constructive validity. In a multiple linear regression analysis, group assignment independently influenced OSATS scores, whereas sex, handedness, sports activities, and type of curriculum were not independently associated with OSATS scores.

Conclusions: Hands-on training is superior to video demonstration for teaching VE on a pelvic model.

Conflict of interest statement

The authors declare no conflict of interest.

Figures

Figure 1
Figure 1
Consort diagram of the students flow through the study.
Figure 2
Figure 2
Box plots with Objective Structured Assessment of Technical Skills (OSATS) scores in group 1 (demonstration) and group 2 (hands-on training), with the boxes representing 50% of cases and the whiskers representing 1.5× the interquartile range. Circles represent outliers.

References

    1. Popowski T, Porcher R, Fort J, et al. Influence of ultrasound determination of fetal head position on mode of delivery: a pragmatic randomized trial. Ultrasound Obstet Gynecol 2015;46:520–5.
    1. Williams MC, Knuppel RA, O’Brien WF, et al. A randomized comparison of assisted vaginal delivery by obstetric forceps and polyethylene vacuum cup. Obstet Gynecol 1991;78:789–94.
    1. O’Mahony F, Hofmeyr GJ, Menon V. Choice of instruments for assisted vaginal delivery. Cochrane Database Syst Rev 2010;CD005455.
    1. Ismail NA, Saharan WS, Zaleha MA, et al. Kiwi Omnicup versus Malmstrom metal cup in vacuum assisted delivery: a randomized comparative trial. J Obstet Gynaecol Res 2008;34:350–3.
    1. Kuit JA, Eppinga HG, Wallenburg HC, et al. A randomized comparison of vacuum extraction delivery with a rigid and a pliable cup. Obstet Gynecol 1993;82:280–4.
    1. Groom KM, Jones BA, Miller N, et al. A prospective randomised controlled trial of the Kiwi Omnicup versus conventional ventouse cups for vacuum-assisted vaginal delivery. BJOG 2006;113:183–9.
    1. Roberts MJ, Gale TC, McGrath JS, et al. Rising to the challenge: acute stress appraisals and selection centre performance in applicants to postgraduate specialty training in anaesthesia. Adv Health Sci Educ Theory Pract 2016;21:323–39.
    1. Nagendran M, Gurusamy KS, Aggarwal R, et al. Virtual reality training for surgical trainees in laparoscopic surgery. Cochrane Database Syst Rev 2013;8:CD006575.
    1. Agha RA, Fowler AJ. The role and validity of surgical simulation. Int Surg 2015;100:350–7.
    1. Goff BA, VanBlaricom A, Mandel L, et al. Comparison of objective, structured assessment of technical skills with a virtual reality hysteroscopy trainer and standard latex hysteroscopy model. J Reprod Med 2007;52:407–12.
    1. ACOG Committee on Obstetric Practice. ACOG Committee Opinion No. 340. Mode of term singleton breech delivery. Obstet Gynecol 2006;108:235–7.
    1. Buerkle B, Pueth J, Hefler LA, et al. Objective structured assessment of technical skills evaluation of theoretical compared with hands-on training of shoulder dystocia management: a randomized controlled trial. Obstet Gynecol 2012;120:809–14.
    1. Alici F, Buerkle B, Tempfer CB. Objective Structured Assessment of Technical Skills (OSATS) evaluation of hysteroscopy training: a prospective study. Eur J Obstet Gynecol Reprod Biol 2014;178:1–5.
    1. Buerkle B, Rueter K, Hefler LA, et al. Objective Structured Assessment of Technical Skills (OSATS) evaluation of theoretical versus hands-on training of vaginal breech delivery management: a randomized trial. Eur J Obstet Gynecol Reprod Biol 2013;171:252–6.
    1. Draycott TJ, Crofts JF, Ash JP, et al. Improving neonatal outcome through practical shoulder dystocia training. Obstet Gynecol 2008;112:14–20.
    1. Lavin JP, Jr, Eaton J, Hopkins M. Teaching vaginal breech delivery and external cephalic version. A survey of faculty attitudes. J Reprod Med 2000;45:808–12.
    1. Hefler L, Grimm C, Kueronya V, et al. A novel training model for the loop electrosurgical excision procedure. Am J Obstet Gynecol 2012;206:e1–4.
    1. Egi H, Tokunaga M, Hattori M, et al. Evaluating the correlation between the HUESAD and OSATS scores: concurrent validity study. Minim Invas Ther Allied Technol 2013;22:144–9.
    1. Steehler MK, Chu EE, Na H, et al. Teaching and assessing endoscopic sinus surgery skills on a validated low-cost task trainer. Laryngoscope 2013;123:841–4.
    1. Dhingra S, Raffi F. Obstetric trainees’ experience in VBD and ECV in the UK. J Obstet Gynaecol 2010;30:10–2.
    1. Larsen CR, Soerensen JL, Grantcharov TP, et al. Effect of virtual reality training on laparoscopic surgery: randomised controlled trial. BMJ 2009;338:b1802.

Source: PubMed

3
구독하다