Simulation-Based Summative Assessment of Neonatal Resuscitation Providers Using the RETAIN Serious Board Game-A Pilot Study

Simran K Ghoman, Maria Cutumisu, Georg M Schmölzer, Simran K Ghoman, Maria Cutumisu, Georg M Schmölzer

Abstract

Background: Each year, 13-26 million newborn babies require help to breathe at birth. Healthcare professionals (HCPs) who provide neonatal resuscitative care must be frequently evaluated to maintain and improve the quality of healthcare delivered. While simulation-based competence assessment is preferred, resource constraints hinder uptake. We aimed to examine if the RETAIN simulation-based boardgame can be used to assess HCPs' neonatal resuscitation knowledge. Method: Twenty neonatal HCPs (19 females) from the Royal Alexandra Hospital (Edmonton, Canada) were recruited. First, they completed an open-answer written test of one neonatal resuscitation scenario. Then, they completed one neonatal resuscitation scenario of difficulty comparable to that of the open-answer written test, but this time using the RETAIN board game. In the RETAIN board game (https://playretain.com, RETAIN Labs Medical Inc, Edmonton, Canada), players perform simulated neonatal resuscitation scenarios based on real-life cases, using action cards, and equipment pieces. Sessions were video-recorded and scored using Neonatal Resuscitation Program 2015 guidelines. Data are reported as mean (standard deviation) for normally distributed continuous variables, and as median (interquartile range) for non-normal continuous variables. Results: Participants consisted of the following HCPs: 8 nurses, 4 respiratory therapists, 4 nurse practitioners, and 4 neonatal fellows with median (IQR) 10.5(3-17) years of clinical experience. Overall mean (SD) Open-answer test and Game Performance was 8.6(2.1) out of 16 possible points (53%) and 29(3.2) out of 40 possible points (74%), respectively. Out of the 10 actions shared between the open-answer test and game scenario, performance on the open-answer test was mean (SD) 7.2(1.3) (72%) and game performance was mean (SD) 8.8(1.4) (88%) (V = 17, p < 0.01). Conclusion: RETAIN may provide an enjoyable and standardized alternative toward summative assessment of neonatal resuscitation providers. RETAIN may be used to improve more frequent and ubiquitous uptake of simulation-based competence assessment in healthcare settings.

Keywords: infants; neonatal resuscitation; newborn; serious game; simulation based education; summative assessment.

Copyright © 2020 Ghoman, Cutumisu and Schmölzer.

Figures

Figure 1
Figure 1
A team playing the RETAIN collaborative board game.

References

    1. Wyckoff MH, Aziz K, Escobedo MB, Kapadia VS, Kattwinkel J, Perlman JM, et al. AHA neonatal RCP resuscitation 2015. Circulation. (2015) 132:S543–60. 10.1161/CIR.0000000000000267
    1. Cutumisu M, Brown MRG, Fray C, Schmölzer GM. Growth mindset moderates the effect of the neonatal resuscitation program on performance in a computer-based game training simulation. Front Pediatr. (2018) 6:195. 10.3389/fped.2018.00195
    1. Institute of Medicine Crossing the Quality Chasm: A New Health System for the 21th Century IOM. Washington, DC: National Academy Press; (2001). Available from:
    1. Weiner GM. Textbook of Neonatal Resuscitation (NRP). 7th ed Zaichkin J, editor. Chicago, IL: American Academy of Pediatrics; (2016).
    1. Joint Commission. Sentinel Event Alert: Preventing Infant Death and Injury During Delivery. (2010). Available online at: (accessed July 30, 2004).
    1. Yüksel HS, Gündüz N. Formative and summative assessment in higher education: opinions and practices of instructors. Online Submiss. (2017) 3:3 10.5281/zenodo.832999
    1. Steadman RH, Huang YM. Simulation for quality assurance in training, credentialing and maintenance of certification. Best Pract Res Clin Anaesthesiol. (2012) 26:3–15. 10.1016/j.bpa.2012.01.002
    1. Ward RC, Muckle TJ, Kremer MJ, Krogh MA. Computer-based case simulations for assessment in health care: a literature review of validity evidence. Eval Heal Prof. (2019) 42:82–102. 10.1177/0163278717718609
    1. Gorbanev I, González RA, Delgadillo V, Pomares A, Yepes FJ, Cortes A, et al. . A systematic review of serious games in medical education: quality of evidence and pedagogical strategy. Med Educ Online. (2018) 23:1438718. 10.1080/10872981.2018.1438718
    1. Graafland M, Schraagen J, Schijven M. Systematic review of serious games for medical education and surgical skills training. Br J Surg. (2012) 99:1322–30. 10.1002/bjs.8819
    1. Sipiyaruk K, Gallagher JE, Hatzipanagos S, Reynolds PA. A rapid review of serious games: from healthcare education to dental education. Eur J Dent Educ. (2018) 22:243–57. 10.1111/eje.12338
    1. The United States Medical Licensing Examination . InCUS - Invitational Conference on USMLE Scoring. In: Federation of State Medical Boards (FSMB) and National Board of Medical Examiners (NBME) (2019). Available online at: (accesssed October 2, 2019).
    1. Aziz K, Chadwick M, Baker M, Andrews W. Ante- and intra-partum factors that predict increased need for neonatal resuscitation. Resuscitation. (2008) 79:444–52. 10.1016/j.resuscitation.2008.08.004
    1. Thomas EJ, Sexton JB, Lasky RE, Helmreich RL, Crandell DS, Tyson J. Teamwork and quality during neonatal care in the delivery room. J Perinatol. (2006) 26:163–9. 10.1038/sj.jp.7211451
    1. Carbine DN, Finer NN, Knodel E, Rich W. Video recording as a means of evaluating neonatal resuscitation performance. Pediatrics. (2000) 106:654–8. 10.1542/peds.106.4.654
    1. Ades A, Lee HC. Update on simulation for the neonatal resuscitation program. Semin Perinatol. (2016) 40:447–54. 10.1053/j.semperi.2016.08.005
    1. Williams P. Squaring the circle: a new alternative to alternative- assessment. Teach High Educ. (2014) 19:565–77. 10.1080/13562517.2014.882894
    1. Ghoman SK, Patel SD, Cutumisu M, von Hauff P, Jeffery T, Brown MRG, et al. . Serious games, a game changer in teaching neonatal resuscitation? a review. Arch Dis Child - Fetal Neonatal Ed. (2019) 105:317011. 10.1136/archdischild-2019-317011
    1. Cutumisu M, Patel SD, Brown MRG, Fray C, von Hauff P, Jeffery T, et al. . RETAIN: a board game that improves neonatal resuscitation knowledge retention. Front Pediatr. (2019) 7:13. 10.3389/fped.2019.00013
    1. Ghoman SK, Schmölzer GM. The RETAIN simulation-based serious game-a review of the literature. Healthcare. (2019) 8:E3. 10.3390/healthcare8010003
    1. Earl L. Assessment as Learning. Thousand Oaks,CA: Corwin Press, Inc; (2004). p. 22.

Source: PubMed

Подписаться