'In situ simulation' versus 'off site simulation' in obstetric emergencies and their effect on knowledge, safety attitudes, team performance, stress, and motivation: study protocol for a randomized controlled trial

Jette Led Sørensen, Cees Van der Vleuten, Jane Lindschou, Christian Gluud, Doris Østergaard, Vicki LeBlanc, Marianne Johansen, Kim Ekelund, Charlotte Krebs Albrechtsen, Berit Woetman Pedersen, Hanne Kjærgaard, Pia Weikop, Bent Ottesen, Jette Led Sørensen, Cees Van der Vleuten, Jane Lindschou, Christian Gluud, Doris Østergaard, Vicki LeBlanc, Marianne Johansen, Kim Ekelund, Charlotte Krebs Albrechtsen, Berit Woetman Pedersen, Hanne Kjærgaard, Pia Weikop, Bent Ottesen

Abstract

Background: Unexpected obstetric emergencies threaten the safety of pregnant women. As emergencies are rare, they are difficult to learn. Therefore, simulation-based medical education (SBME) seems relevant. In non-systematic reviews on SBME, medical simulation has been suggested to be associated with improved learner outcomes. However, many questions on how SBME can be optimized remain unanswered. One unresolved issue is how 'in situ simulation' (ISS) versus 'off site simulation' (OSS) impact learning. ISS means simulation-based training in the actual patient care unit (in other words, the labor room and operating room). OSS means training in facilities away from the actual patient care unit, either at a simulation centre or in hospital rooms that have been set up for this purpose.

Methods and design: The objective of this randomized trial is to study the effect of ISS versus OSS on individual learning outcome, safety attitude, motivation, stress, and team performance amongst multi-professional obstetric-anesthesia teams.The trial is a single-centre randomized superiority trial including 100 participants. The inclusion criteria were health-care professionals employed at the department of obstetrics or anesthesia at Rigshospitalet, Copenhagen, who were working on shifts and gave written informed consent. Exclusion criteria were managers with staff responsibilities, and staff who were actively taking part in preparation of the trial. The same obstetric multi-professional training was conducted in the two simulation settings. The experimental group was exposed to training in the ISS setting, and the control group in the OSS setting. The primary outcome is the individual score on a knowledge test. Exploratory outcomes are individual scores on a safety attitudes questionnaire, a stress inventory, salivary cortisol levels, an intrinsic motivation inventory, results from a questionnaire evaluating perceptions of the simulation and suggested changes needed in the organization, a team-based score on video-assessed team performance and on selected clinical performance.

Discussion: The perspective is to provide new knowledge on contextual effects of different simulation settings.

Trial registration: ClincialTrials.gov NCT01792674.

Figures

Figure 1
Figure 1
Randomized trial of ‘in situ simulation’ (ISS) versus ‘off site simulation’ (OSS): randomization, intervention and outcome measurements.

References

    1. Hove LD, Bock J, Christoffersen JK, Hedegaard M. Analysis of 127 peripartum hypoxic brain injuries from closed claims registered by the Danish Patient Insurance Association. Acta Obstet Gynecol Scand. 2008;87:72–75. doi: 10.1080/00016340701797567.
    1. Berglund S, Grunewald C, Pettersson H, Cnattingius S. Severe asphyxia due to delivery-related malpractice in Sweden 1990–2005. BJOG. 2008;115:316–323. doi: 10.1111/j.1471-0528.2007.01602.x.
    1. Cantwell R, Clutton-Brock T, Cooper G, Dawson A, Drife J, Garrod D, Harper A, Hulbert D, Lucas S, McClure J. Saving mothers' lives: reviewing maternal deaths to make motherhood safer: 2006–2008. The Eighth Report of the Confidential Enquiries into Maternal Deaths in the United Kingdom. BJOG. 2011;118(Suppl 1):1–203.
    1. Bodker B, Hvidman L, Weber T, Moller M, Aarre A, Nielsen KM, Sorensen JL. Maternal deaths in Denmark 2002–2006. Acta Obstet Gynecol Scand. 2009;88:556–562. doi: 10.1080/00016340902897992.
    1. Johannsson H, Ayida G, Sadler C. Faking it? Simulation in the training of obstetricians and gynaecologists. Curr Opin Obstet Gynecol. 2005;17:557–561. doi: 10.1097/01.gco.0000188726.45998.97.
    1. Issenberg SB, McGaghie WC, Petrusa ER, Lee GD, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27:10–28. doi: 10.1080/01421590500046924.
    1. Drife J. Reducing risk in obstetrics. Qual Health Care. 1995;4:108–114. doi: 10.1136/qshc.4.2.108.
    1. Gold KJ, Kuznia AL, Hayward RA. How physicians cope with stillbirth or neonatal death: a national survey of obstetricians. Obstet Gynecol. 2008;112:29–34. doi: 10.1097/AOG.0b013e31817d0582.
    1. Committee opinion no. 497. Coping with the stress of medical professional liability litigation. Obstet Gynecol. 2011;118:389–391. doi: 10.1097/AOG.0b013e31822c992d.
    1. Veltman LL. Getting to havarti: moving toward patient safety in obstetrics. Obstet Gynecol. 2007;110:1146–1150. doi: 10.1097/01.AOG.0000287066.13389.8c.
    1. Pronovost PJ, Holzmueller CG, Ennen CS, Fox HE. Overview of progress in patient safety. Am J Obstet Gynecol. 2011;204:5–10. doi: 10.1016/j.ajog.2010.11.001.
    1. Merien AE, Mol BW, Houterman S, Oei SG. Multidisciplinary team training in a simulation setting for acute obstetric emergencies: a systematic review. Obstet Gynecol. 2010;115:1021–1031. doi: 10.1097/AOG.0b013e3181d9f4cd.
    1. Crofts JF, Ellis D, Draycott TJ, Winter C, Hunt LP, Akande VA. Change in knowledge of midwives and obstetricians following obstetric emergency training: a randomised controlled trial of local hospital, simulation centre and teamwork training. BJOG. 2007;114:1534–1541. doi: 10.1111/j.1471-0528.2007.01493.x.
    1. Ellis D, Crofts JF, Hunt LP, Read M, Fox R, James M. Hospital, simulation center, and teamwork training for eclampsia management: a randomized controlled trial. Obstet Gynecol. 2008;111:723–731. doi: 10.1097/AOG.0b013e3181637a82.
    1. McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. A critical review of simulation-based medical education research: 2003–2009. Med Educ. 2010;44:50–63. doi: 10.1111/j.1365-2923.2009.03547.x.
    1. Norman G, Dore K, Grierson L. The minimal relationship between simulation fidelity and transfer of learning. Med Educ. 2012;46:636–647. doi: 10.1111/j.1365-2923.2012.04243.x.
    1. Beaubien JM, Baker DP. The use of simulation for training teamwork skills in health care: how low can you go? Qual Saf Health Care. 2004;13(Suppl 1):i51–i56.
    1. Riley W, Davis S, Miller KM, Hansen H, Sweet RM. Detecting breaches in defensive barriers using in situ simulation for obstetric emergencies. Qual Saf Health Care. 2010;19(Suppl 3):i53–i56. doi: 10.1136/qshc.2010.040311.
    1. Walker ST, Sevdalis N, McKay A, Lambden S, Gautama S, Aggarwal R, Vincent C. Unannounced in situ simulations: integrating training and clinical practice. BMJ Qual Saf. 2013;22:453–8. doi: 10.1136/bmjqs-2012-000986.
    1. Patterson MD, Geis GL, Falcone RA, Lemaster T, Wears RL. In situ simulation: detection of safety threats and teamwork training in a high risk emergency department. BMJ Qual Saf. 2013;22:468–77. doi: 10.1136/bmjqs-2012-000942.
    1. Rosen MA, Hunt EA, Pronovost PJ, Federowicz MA, Weaver SJ. In situ simulation in continuing education for the health care professions: a systematic review. J Contin Educ Health Prof. 2012;32:243–254. doi: 10.1002/chp.21152.
    1. Guise JM, Lowe NK, Deering S, Lewis PO, O'Haire C, Irwin LK, Blaser M, Wood LS, Kanki BG. Mobile in situ obstetric emergency simulation and teamwork training to improve maternal-fetal safety in hospitals. Jt Comm J Qual Patient Saf. 2010;36:443–453.
    1. Bender GJ. In situ simulation for systems testing in newly constructed perinatal facilities. Semin Perinatol. 2011;35:80–83. doi: 10.1053/j.semperi.2011.01.007.
    1. Calhoun AW, Boone MC, Peterson EB, Boland KA, Montgomery VL. Integrated in-situ simulation using redirected faculty educational time to minimize costs: a feasibility study. Simul Healthc. 2011;6:337–344. doi: 10.1097/SIH.0b013e318224bdde.
    1. Van Schaik SM, Plant J, Diane S, Tsang L, O'Sullivan P. Interprofessional team training in pediatric resuscitation: a low-cost, in situ simulation program that enhances self-efficacy among participants. Clin Pediatr (Phila) 2011;50:807–815. doi: 10.1177/0009922811405518.
    1. Anderson ER, Black R, Brocklehurst P. Acute obstetric emergency drill in England and Wales: a survey of practice. BJOG. 2005;112:372–375. doi: 10.1111/j.1471-0528.2005.00432.x.
    1. Kusurkar RA, Ten Cate TJ, Van AM, Croiset G. Motivation as an independent and a dependent variable in medical education: a review of the literature. Med Teach. 2011;33:e242–e262. doi: 10.3109/0142159X.2011.558539.
    1. LeBlanc VR, Manser T, Weinger MB, Musson D, Kutzin J, Howard SK. The study of factors affecting human and systems performance in healthcare using simulation. Simul Healthc. 2011;6(Suppl):S24–S29.
    1. LeBlanc VR. The effects of acute stress on performance: implications for health professions education. Acad Med. 2009;84:S25–S33. doi: 10.1097/ACM.0b013e3181b37b8f.
    1. Ten Cate TJ, Kusurkar RA, Williams GC. How self-determination theory can assist our understanding of the teaching and learning processes in medical education. AMEE guide No. 59. Med Teach. 2011;33:961–973. doi: 10.3109/0142159X.2011.595435.
    1. Harvey A, Nathens AB, Bandiera G, LeBlanc VR. Threat and challenge: cognitive appraisal and stress responses in simulated trauma resuscitations. Med Educ. 2010;44:587–594. doi: 10.1111/j.1365-2923.2010.03634.x.
    1. Sørensen JL, Lokkegaard E, Johansen M, Ringsted C, Kreiner S, McAleer S. The implementation and evaluation of a mandatory multi-professional obstetric skills training program. Acta Obstet Gynecol Scand. 2009;88:1107–1117. doi: 10.1080/00016340903176834.
    1. Arora S, Sevdalis N, Aggarwal R, Sirimanna P, Darzi A, Kneebone R. Stress impairs psychomotor performance in novice laparoscopic surgeons. Surg Endosc. 2010;24:2588–2593. doi: 10.1007/s00464-010-1013-2.
    1. Harvey A, Bandiera G, Nathens AB, LeBlanc VR. Impact of stress on resident performance in simulated trauma scenarios. J Trauma Acute Care Surg. 2012;72:497–503.
    1. Keitel A, Ringleb M, Schwartges I, Weik U, Picker O, Stockhorst U, Deinzer R. Endocrine and psychological stress responses in a simulated emergency situation. Psychoneuroendocrinology. 2011;36:98–108. doi: 10.1016/j.psyneuen.2010.06.011.
    1. Finan E, Bismilla Z, Whyte HE, Leblanc V, McNamara PJ. High-fidelity simulator technology may not be superior to traditional low-fidelity equipment for neonatal resuscitation training. J Perinatol. 2012;32:287–292. doi: 10.1038/jp.2011.96.
    1. Ryan RM, Deci EL. Intrinsic and extrinsic motivations: classic definitions and new directions. Contemp Educ Psychol. 2000;25:54–67. doi: 10.1006/ceps.1999.1020.
    1. Stewart A. In: A Practical Guide for Medical Teachers. 3. Dent JA, Harden RM, editor. Edinburgh, London, New York, Oxford, Philadelphia, St Louis, Sydney, Toronto: Churchill Livingstone Elsevier; 2009. Instructional design; pp. 205–210.
    1. Cannon-Bowers JA. Recent advances in scenario-based training for medical education. Curr Opin Anaesthesiol. 2008;21:784–789. doi: 10.1097/ACO.0b013e3283184435.
    1. Anderson LW, Krathwohl DR, Airasan PW, Cruikshank KA, Mayer RE, PIntrinch PR, Raths J, Wittrock MC. A Taxonomy for Learning, Teaching, and Assessing. A Revision of Bloom's Taxonomy of Educational Objectives. New York, San Francisco, Boston, London, Toronto, Sydney, Tokoy, Singapore, Madrid, Mexico City, Munich, Paris, Cape Town, Hong Kong, Montreal: Addison Wesley Longman, Inc; 2001.
    1. Markova V, Sorensen JL, Holm C, Norgaard A, Langhoff-Roos J. Evaluation of multi-professional obstetric skills training for postpartum hemorrhage. Acta Obstet Gynecol Scand. 2012;91:346–352. doi: 10.1111/j.1600-0412.2011.01344.x.
    1. Plan of Strategy Juliane Marie Centre, Rigshospitalet, Copenhagen University Hospital. [ ]
    1. SimMom Mannequin. [ ]
    1. Chan AW, Tetzlaff JM, Gotzsche PC, Altman DG, Mann H, Berlin JA, Dickersin K, Hrobjartsson A, Schulz KF, Parulekar WR, Krleza-Jeric K, Laupacis A, Moher D. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586. doi: 10.1136/bmj.e7586.
    1. Remmen R, Scherpbier A, Denekens J, Derese A, Hermann I, Hoogenboom R, Van RP, Van D, Bossaert L. Correlation of a written test of skills and a performance based test: a study in two traditional medical schools. Med Teach. 2001;23:29–32. doi: 10.1080/0142159002005541.
    1. Kramer AW, Jansen JJ, Zuithoff P, Dusman H, Tan LH, Grol RP, van der Vleuten C. Predictive validity of a written knowledge test of skills for an OSCE in postgraduate training for general practice. Med Educ. 2002;36:812–819. doi: 10.1046/j.1365-2923.2002.01297.x.
    1. Case SM, Swanson DB. Constructing Written Test Questions For the Basic and Clinical Sciences. Philadelphia: National Board of Medical Examiners; 2002.
    1. Schuwirth LW, Van der Vleuten C. ABC of learning and teaching in medicine: written assessment. BMJ. 2003;326:643–645. doi: 10.1136/bmj.326.7390.643.
    1. Sexton JB, Helmreich RL, Neilands TB, Rowan K, Vella K, Boyden J, Roberts PR, Thomas EJ. The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006;6:44. doi: 10.1186/1472-6963-6-44.
    1. Deilkas E, Hofoss D. Patient safety culture lives in departments and wards: multilevel partitioning of variance in patient safety culture. BMC Health Serv Res. 2010;10:85. doi: 10.1186/1472-6963-10-85.
    1. Deilkas ET, Hofoss D. Psychometric properties of the Norwegian version of the Safety Attitudes Questionnaire (SAQ), Generic version (Short Form 2006) BMC Health Serv Res. 2008;8:191. doi: 10.1186/1472-6963-8-191.
    1. Spielberger CD, Gorsuch RL, Lushene RE. Manual for the State-Trait Anxiety Inventory. Palo Alto: CA, Consulting Psychologists Press; 1970.
    1. Bech P. Klinisk psykometri. København, Danmark: Munksgaard Danmark; 2011.
    1. Tomaka J, Blascovich J, Kibler J, Ernst JM. Cognitive and physiological antecedents of threat and challenge appraisal. J Pers Soc Psychol. 1997;73:63–72.
    1. Cooper S, Cant R, Porter J, Sellick K, Somers G, Kinsman L, Nestel D. Rating medical emergency teamwork performance: development of the Team Emergency Assessment Measure (TEAM) Resuscitation. 2010;81:446–452. doi: 10.1016/j.resuscitation.2009.11.027.
    1. McKay A, Walker ST, Brett SJ, Vincent C, Sevdalis N. Team performance in resuscitation teams: comparison and critique of two recently developed scoring tools. Resuscitation. 2012;83:1478–1483. doi: 10.1016/j.resuscitation.2012.04.015.
    1. Ukoumunne OC, Gulliford MC, Chinn S, Sterne JA, Burney PG. Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. Health Technol Assess. 1999;3(5)
    1. Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661. doi: 10.1136/bmj.e5661.
    1. Liang KY, Zeger SL. Longitudinal data analysis using generalized linear models. Biometrika. 1986;73:13–22. doi: 10.1093/biomet/73.1.13.
    1. Benjamin Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal StatisticaI Society Series B (Methodological) 1995;57:289–300.
    1. Randomised trial of 'in situ simulation' versus 'off site simulation. [ ]
    1. Mongelli M, Chung TK, Chang AM. Obstetric intervention and benefit in conditions of very low prevalence. Br J Obstet Gynaecol. 1997;104:771–774. doi: 10.1111/j.1471-0528.1997.tb12018.x.
    1. Ram P, der Vleuten V, Rethans JJ, Schouten B, Hobma S, Grol R. Assessment in general practice: the predictive value of written-knowledge tests and a multiple-station examination for actual medical performance in daily practice. Med Educ. 1999;33:197–203. doi: 10.1046/j.1365-2923.1999.00280.x.
    1. Wood L, Egger M, Gluud LL, Schulz KF, Juni P, Altman DG, Gluud C, Martin RM, Wood AJ, Sterne JA. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ. 2008;336:601–605. doi: 10.1136/.
    1. Savovic J, Jones HE, Altman DG, Harris RJ, Juni P, Pildal J, IS-Nielsen B, Balk EM, Gluud C, Gluud LL. Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials. Ann Intern Med. 2012;157:429–438.

Source: PubMed

3
订阅