Design of simulation-based medical education and advantages and disadvantages of in situ simulation versus off-site simulation

Jette Led Sørensen, Doris Østergaard, Vicki LeBlanc, Bent Ottesen, Lars Konge, Peter Dieckmann, Cees Van der Vleuten, Jette Led Sørensen, Doris Østergaard, Vicki LeBlanc, Bent Ottesen, Lars Konge, Peter Dieckmann, Cees Van der Vleuten

Abstract

Background: Simulation-based medical education (SBME) has traditionally been conducted as off-site simulation in simulation centres. Some hospital departments also provide off-site simulation using in-house training room(s) set up for simulation away from the clinical setting, and these activities are called in-house training. In-house training facilities can be part of hospital departments and resemble to some extent simulation centres but often have less technical equipment. In situ simulation, introduced over the past decade, mainly comprises of team-based activities and occurs in patient care units with healthcare professionals in their own working environment. Thus, this intentional blend of simulation and real working environments means that in situ simulation brings simulation to the real working environment and provides training where people work. In situ simulation can be either announced or unannounced, the latter also known as a drill. This article presents and discusses the design of SBME and the advantage and disadvantage of the different simulation settings, such as training in simulation-centres, in-house simulations in hospital departments, announced or unannounced in situ simulations.

Discussion: Non-randomised studies argue that in situ simulation is more effective for educational purposes than other types of simulation settings. Conversely, the few comparison studies that exist, either randomised or retrospective, show that choice of setting does not seem to influence individual or team learning. However, hospital department-based simulations, such as in-house simulation and in situ simulation, lead to a gain in organisational learning. To our knowledge no studies have compared announced and unannounced in situ simulation. The literature suggests some improved organisational learning from unannounced in situ simulation; however, unannounced in situ simulation was also found to be challenging to plan and conduct, and more stressful among participants. The importance of setting, context and fidelity are discussed. Based on the current limited research we suggest that choice of setting for simulations does not seem to influence individual and team learning. Department-based local simulation, such as simulation in-house and especially in situ simulation, leads to gains in organisational learning. The overall objectives of simulation-based education and factors such as feasibility can help determine choice of simulation setting.

Keywords: Context; Cross-training; Curriculum; Fidelity; In situ simulation; Inter-professional; Simulation-based medical education.

References

    1. Issenberg SB, McGaghie WC, Petrusa ER, Lee GD, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27:10–28. doi: 10.1080/01421590500046924.
    1. McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. A critical review of simulation-based medical education research: 2003-2009. Med Educ. 2010;44:50–63. doi: 10.1111/j.1365-2923.2009.03547.x.
    1. Motola I, Devine LA, Chung HS, Sullivan JE, Issenberg SB. Simulation in healthcare education: a best evidence practical guide. AMEE Guide No. 82. Med Teach. 2013;35:e1511–e1530. doi: 10.3109/0142159X.2013.818632.
    1. McGaghie WC, Issenberg SB, Barsuk JH, Wayne DB. A critical review of simulation-based mastery learning with translational outcomes. Med Educ. 2014;48:375–385. doi: 10.1111/medu.12391.
    1. Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, Erwin PJ, Hamstra SJ. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA. 2011;306:978–988.
    1. Cook DA, Hamstra SJ, Brydges R, Zendejas B, Szostek JH, Wang AT, Erwin PJ, Hatala R. Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med Teach. 2013;35:e867–e898. doi: 10.3109/0142159X.2012.714886.
    1. Brydges R, Hatala R, Zendejas B, Erwin PJ, Cook DA. Linking simulation-based educational assessments and patient-related outcomes: a systematic review and meta-analysis. Acad Med. 2015;90:246–256. doi: 10.1097/ACM.0000000000000549.
    1. Gaba DM. The future vision of simulation in healthcare. Simul Healthc. 2007;2:126–135. doi: 10.1097/01.SIH.0000258411.38212.32.
    1. Salas E, Paige JT, Rosen MA. Creating new realities in healthcare: the status of simulation-based training as a patient safety improvement strategy. BMJ Qual Saf. 2013;22:449–452. doi: 10.1136/bmjqs-2013-002112.
    1. Sollid SJ, Dieckman P, Aase K, Soreide E, Ringsted C, Ostergaard D. Five Topics Health Care Simulation Can Address to Improve Patient Safety: Results From a Consensus Process. J Patient Saf. 2016 Mar 28. [Epub ahead of print]
    1. Teunissen PW, Wilkinson TJ. Learning and teaching in workplaces. In: Dornan T, Mann K, Scherpbier A, Spencer J, editors. Medical Education: Theory and Practice. Edinburgh, London, New York, Oxford, Philadelphia, St Louis, Sydney, Toronto: Churchill Livingstone Elsevier; 2011. pp. 193–209.
    1. Glossary. In: Dornan T, Mann K, Scherpbier A, Spencer J, editors. Medical Education: Theory and Practice. Edinburgh, London, New York, Oxford, Philadelphia, St Louis, Sydney, Toronto: Churchill Livingstone Elsevier; 2011. p. 339-49
    1. Durning SJ, Artino AR. Situativity theory: a perspective on how participants and the environment can interact: AMEE Guide no. 52. Med Teach. 2011;33:188–199. doi: 10.3109/0142159X.2011.550965.
    1. Godden DR, Baddeley AD. Context-dependent memory in two natural environments: on land and underwater. Br J Psychol. 1975;66:325–331. doi: 10.1111/j.2044-8295.1975.tb01468.x.
    1. Koens F, Mann KV, Custers EJ, Ten Cate OT. Analysing the concept of context in medical education. Med Educ. 2005;39:1243–1249. doi: 10.1111/j.1365-2929.2005.02338.x.
    1. Grierson LE. Information processing, specificity of practice, and the transfer of learning: considerations for reconsidering fidelity. Adv Health Sci Educ Theory Pract. 2014;19:281–289. doi: 10.1007/s10459-014-9504-x.
    1. Norman G, Dore K, Grierson L. The minimal relationship between simulation fidelity and transfer of learning. Med Educ. 2012;46:636–647. doi: 10.1111/j.1365-2923.2012.04243.x.
    1. Rehmann A, Mitman RD, Reynolds MC. A handbook of flight simulation fidelity requirements for human factors research. Atlantic City Airport, NJ 08405: U.S. Department ofTransportation Federal Aviation Administration; 1995.
    1. Rosen MA, Hunt EA, Pronovost PJ, Federowicz MA, Weaver SJ. In situ simulation in continuing education for the health care professions: a systematic review. J Contin Educ Health Prof. 2012;32:243–254. doi: 10.1002/chp.21152.
    1. Ellis D, Crofts JF, Hunt LP, Read M, Fox R, James M. Hospital, simulation center, and teamwork training for eclampsia management: a randomized controlled trial. Obstet Gynecol. 2008;111:723–731. doi: 10.1097/AOG.0b013e3181637a82.
    1. Sørensen JL, Løkkegaard E, Johansen M, Ringsted C, Kreiner S, McAleer S. The implementation and evaluation of a mandatory multi-professional obstetric skills training program. Acta Obstet Gynecol Scand. 2009;88:1107–1117. doi: 10.1080/00016340903176834.
    1. Sørensen JL, Lottrup P, van der Vleuten C, Andersen KS, Simonsen M, Emmersen P, Rosthoj S, Ottesen B. Unannounced in situ simulation of obstetric emergencies: staff perceptions and organisational impact. Postgrad Med J. 2014;90:622–629. doi: 10.1136/postgradmedj-2013-132280.
    1. Crofts JF, Ellis D, Draycott TJ, Winter C, Hunt LP, Akande VA. Change in knowledge of midwives and obstetricians following obstetric emergency training: a randomised controlled trial of local hospital, simulation centre and teamwork training. BJOG. 2007;114:1534–1541. doi: 10.1111/j.1471-0528.2007.01493.x.
    1. Riley W, Davis S, Miller KM, Hansen H, Sweet RM. Detecting breaches in defensive barriers using in situ simulation for obstetric emergencies. Qual Saf Health Care. 2010;19(Suppl 3):i53–i56. doi: 10.1136/qshc.2010.040311.
    1. Anderson ER, Black R, Brocklehurst P. Acute obstetric emergency drill in England and Wales: a survey of practice. BJOG. 2005;112:372–375. doi: 10.1111/j.1471-0528.2005.00432.x.
    1. Spurr J, Gatward J, Joshi N, Carley SD. Top 10 (+1) tips to get started with in situ simulation in emergency and critical care departments. Emerg Med J. 2016;33:514–516. doi: 10.1136/emermed-2015-204845.
    1. Sørensen JL, van der Vleuten C, Rosthoj S, Oestergaard D, Leblanc V, Johansen M, Ekelund K, Starkopf L, Lindschou J, Gluud C, Weikop P, Ottesen B. Simulation-based multiprofessional obstetric anaesthesia training conducted in situ versus off-site leads to similar individual and team outcomes: results from a randomised educational trial. BMJ Open. 2015;5:e008344. doi: 10.1136/bmjopen-2015-008344.
    1. Sørensen JL, Navne LE, Martin HM, Ottesen B, Albrechtsen CK, Pedersen BW, Kjaergaard H, van der Vleuten C. Clarifying the learning experiences of healthcare professionals with in situ versus off-site simulation-based medical education: a qualitative study. BMJ Open. 2015;5:e008345. doi: 10.1136/bmjopen-2015-008345.
    1. Couto TB, Kerrey BT, Taylor RG, FitzGerald M, Geis GL. Teamwork skills in actual, in situ, and in-center pediatric emergencies: performance levels across settings and perceptions of comparative educational impact. Simul Healthc. 2015;10:76–84. doi: 10.1097/SIH.0000000000000081.
    1. Thomas PA. Goals and objectives. In: Kern DE, Thomas PA, Howard DM, Bass EB, editors. Curriculum development for medical education a six step approach. 2. London: The John Hopkins University Press; 2009. pp. 43–51.
    1. Bradley P, Bligh J. Clinical skills centres: where are we going? Med Educ. 2005;39:649–650. doi: 10.1111/j.1365-2929.2005.02189.x.
    1. Caro PW. Aircraft simulators and pilot training. Hum Factors. 1973;15:502–509. doi: 10.1177/001872087301500602.
    1. Carayon P, Schoofs HA, Karsh BT, Gurses AP, Alvarado CJ, Smith M, et al. Work system design for patient safety: the SEIPS model. Qual Saf Health Care. 2006;15(Suppl 1):i50–i58. doi: 10.1136/qshc.2005.015842.
    1. Bender GJ. In situ simulation for systems testing in newly constructed perinatal facilities. Semin Perinatol. 2011;35:80–83. doi: 10.1053/j.semperi.2011.01.007.
    1. Boet S, Bould MD, Layat BC, Reeves S. Twelve tips for a successful interprofessional team-based high-fidelity simulation education session. Med Teach. 2014;36:853–857. doi: 10.3109/0142159X.2014.923558.
    1. Larsen DP, Butler AC, Roediger HL., III Test-enhanced learning in medical education. Med Educ. 2008;42:959–966. doi: 10.1111/j.1365-2923.2008.03124.x.
    1. Draycott TJ, Collins KJ, Crofts JF, Siassakos D, Winter C, Weiner CP, et al. Myths and realities of training in obstetric emergencies. Best Pract Res Clin Obstet Gynaecol. 2015;29:1067–1076. doi: 10.1016/j.bpobgyn.2015.07.003.
    1. Sørensen JL, Thellensen L, Strandbygaard J, Svendsen KD, Christensen KB, Johansen M, Langhoff-Roos P, Ekelund K, Ottesen B, van der Vleuten C. Development of a knowledge test for multi-disciplinary emergency training: a review and an example. Acta Anaesthesiol Scand. 2015;59:123–133. doi: 10.1111/aas.12428.
    1. Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. The role of assessment in competency-based medical education. Med Teach. 2010;32:676–682. doi: 10.3109/0142159X.2010.500704.
    1. Fokkema JP, Teunissen PW, Westerman M, van der Lee N, van der Vleuten CP, Scherbier AJ, Dorr PJ, Scheele F. Exploration of perceived effects of innovations in postgraduate medical education. Med Educ. 2013;47:271–281. doi: 10.1111/medu.12081.
    1. Patterson MD, Geis GL, Falcone RA, Lemaster T, Wears RL. In situ simulation: detection of safety threats and teamwork training in a high risk emergency department. BMJ Qual Saf. 2013;22:468–477. doi: 10.1136/bmjqs-2012-000942.
    1. Sharma S, Boet S, Kitto S, Reeves S. Interprofessional simulated learning: the need for 'sociological fidelity'. J Interprof Care. 2011;25:81–83. doi: 10.3109/13561820.2011.556514.
    1. Bullough AS, Wagner S, Boland T, Waters TP, Kim K, Adams W. Obstetric team simulation program challenges. J Clin Anesth. 2016;35:564–570. doi: 10.1016/j.jclinane.2016.08.019.
    1. Savoldelli GL, Naik VN, Hamstra SJ, Morgan PJ. Barriers to use of simulation-based education. Can J Anaesth. 2005;52:944–950. doi: 10.1007/BF03022056.
    1. Dieckmann P, Molin FS, Lippert A, Ostergaard D. The art and science of debriefing in simulation: Ideal and practice. Med Teach. 2009;31:e287–e294. doi: 10.1080/01421590902866218.
    1. Møller TP, Østergaard D, Lippert A. Facts and fiction - Training in centres or in situ. Trends Anaesth Crit Care. 2012;2:174–179. doi: 10.1016/j.tacc.2012.03.006.
    1. Walker ST, Sevdalis N, McKay A, Lambden S, Gautama S, Aggarwal R, Vincent C. Unannounced in situ simulations: integrating training and clinical practice. BMJ Qual Saf. 2013;22:453–458. doi: 10.1136/bmjqs-2012-000986.
    1. Vincent C. Unannounced in situ simulations: integrating training and clinical practice. BMJ Qual Saf. 2013;22:453–8.
    1. Stocker M, Burmester M, Allen M. Optimisation of simulated team training through the application of learning theories: a debate for a conceptual framework. BMC Med Educ. 2014;14:69. doi: 10.1186/1472-6920-14-69.
    1. Kobayashi L, Dunbar-Viveiros JA, Sheahan BA, Rezendes MH, Devine J, Cooper MR, Martin PB, Jay GD. In situ simulation comparing in-hospital first responder sudden cardiac arrest resuscitation using semiautomated defibrillators and automated external defibrillators. Simul Healthc. 2010;5:82–90. doi: 10.1097/SIH.0b013e3181ccd75c.
    1. Manser T, Dieckmann P, Wehner T, Rallf M. Comparison of anaesthetists' activity patterns in the operating room and during simulation. Ergonomics. 2007;50:246–260. doi: 10.1080/00140130601032655.
    1. Dieckmann P, Gaba D, Rall M. Deepening the theoretical foundations of patient simulation as social practice. Simul Healthc. 2007;2:183–193. doi: 10.1097/SIH.0b013e3180f637f5.
    1. Wheeler DS, Geis G, Mack EH, Lemaster T, Patterson MD. High-reliability emergency response teams in the hospital: improving quality and safety using in situ simulation training. BMJ Qual Saf. 2013;22:507–514. doi: 10.1136/bmjqs-2012-000931.
    1. Geis GL, Pio B, Pendergrass TL, Moyer MR, Patterson MD. Simulation to assess the safety of new healthcare teams and new facilities. Simul Healthc. 2011;6:125–133. doi: 10.1097/SIH.0b013e31820dff30.
    1. Preston P, Lopez C, Corbett N. How to integrate findings from simulation exercises to improve obstetrics care in the institution. Semin Perinatol. 2011;35:84–88. doi: 10.1053/j.semperi.2011.01.008.
    1. Kobayashi L, Shapiro MJ, Sucov A, Woolard R, Boss RM, III, Dunbar J, et al. Portable advanced medical simulation for new emergency department testing and orientation. Acad Emerg Med. 2006;13:691–695. doi: 10.1111/j.1553-2712.2006.tb01035.x.
    1. Kobayashi L, Parchuri R, Gardiner FG, Paolucci GA, Tomaselli NM, Al-Rasheed RS, et al. Use of in situ simulation and human factors engineering to assess and improve emergency department clinical systems for timely telemetry-based detection of life-threatening arrhythmias. BMJ Qual Saf. 2013;22:72–83. doi: 10.1136/bmjqs-2012-001134.
    1. Cornthwaite K, Edwards S, Siassakos D. Reducing risk in maternity by optimising teamwork and leadership: an evidence-based approach to save mothers and babies. Best Pract Res Clin Obstet Gynaecol. 2013;27:571–581. doi: 10.1016/j.bpobgyn.2013.04.004.
    1. Raemer DB. Ignaz semmelweis redux? Simul Healthc. 2014;9:153–155. doi: 10.1097/SIH.0000000000000016.
    1. Moss C, Walsh K, Mitchell J. Plotting care: a modelling technique for visioning nursing practice in current and future contexts. Contemp Nurse. 2010;35:188–201. doi: 10.5172/conu.2010.35.2.188.
    1. Ecoff L, Thomason T. Moving into a new hospital: strategies for success. J Nurs Adm. 2009;39:499–503. doi: 10.1097/NNA.0b013e3181c17eec.
    1. Nordquist J, Sundberg K, Laing A. Aligning physical learning spaces with the curriculum: AMEE Guide No. 107. Med Teach. 2016:1-14
    1. Siassakos D, Crofts JF, Winter C, Weiner CP, Draycott TJ. The active components of effective training in obstetric emergencies. BJOG. 2009;116:1028–1032. doi: 10.1111/j.1471-0528.2009.02178.x.
    1. Bergh AM, Baloyi S, Pattinson RC. What is the impact of multi-professional emergency obstetric and neonatal care training? Best Pract Res Clin Obstet Gynaecol. 2015;29:1028–1043. doi: 10.1016/j.bpobgyn.2015.03.017.
    1. Konge L, Ringsted C, Bjerrum F, Tolsgaard MG, Bitsch M, Sorensen JL, et al. The simulation centre at rigshospitalet, Copenhagen, Denmark. J Surg Educ. 2015;72:362–365. doi: 10.1016/j.jsurg.2014.11.012.
    1. Calhoun AW, Boone MC, Peterson EB, Boland KA, Montgomery VL. Integrated in-situ simulation using redirected faculty educational time to minimize costs: a feasibility study. Simul Healthc. 2011;6:337–344. doi: 10.1097/SIH.0b013e318224bdde.
    1. van Schaik SM, Plant J, Diane S, Tsang L, O'Sullivan P. Interprofessional team training in pediatric resuscitation: a low-cost, in situ simulation program that enhances self-efficacy among participants. Clin Pediatr. 2011;50:807–815. doi: 10.1177/0009922811405518.
    1. Edler AA, Chen M, Honkanen A, Hackel A, Golianu B. Affordable simulation for small-scale training and assessment. Simul Healthc. 2010;5:112–115. doi: 10.1097/SIH.0b013e3181c76332.
    1. Patterson MD, Geis GL, Lemaster T, Wears RL. Impact of multidisciplinary simulation-based training on patient safety in a paediatric emergency department. BMJ Qual Saf. 2013;22:383–393. doi: 10.1136/bmjqs-2012-000951.
    1. Bergh AM, Allanson E, Pattinson RC. What is needed for taking emergency obstetric and neonatal programmes to scale? Best Pract Res Clin Obstet Gynaecol. 2015;29:1017–1027. doi: 10.1016/j.bpobgyn.2015.03.015.
    1. Hamstra SJ, Brydges R, Hatala R, Zendejas B, Cook DA. Reconsidering fidelity in simulation-based training. Acad Med. 2014;89:387–392. doi: 10.1097/ACM.0000000000000130.
    1. Sydor DT, Bould MD, Naik VN, Burjorjee J, Arzola C, Hayter M, et al. Challenging authority during a life-threatening crisis: the effect of operating theatre hierarchy. Br J Anaesth. 2013;110:463–471. doi: 10.1093/bja/aes396.
    1. Teteris E, Fraser K, Wright B, McLaughlin K. Does training learners on simulators benefit real patients? Adv Health Sci Educ Theory Pract. 2012;17:137–144. doi: 10.1007/s10459-011-9304-5.
    1. Wilson KA, Burke CS, Priest HA, Salas E. Promoting health care safety through training high reliability teams. Qual Saf Health Care. 2005;14:303–309. doi: 10.1136/qshc.2004.010090.
    1. Marks MA, Sabella MJ, Burke CS, Zaccaro SJ. The impact of cross-training on team effectiveness. J Appl Psychol. 2002;87:3–13. doi: 10.1037/0021-9010.87.1.3.
    1. Volpe CE, Cannon-Bowers JA, Salas E, Spector PE. The impact of cross-training on team functioning: an empirical investigation. Hum Factors. 1996;38:87–100. doi: 10.1518/001872096778940741.

Source: PubMed

3
구독하다