Use of Extended Reality in Medical Education: An Integrative Review

Vernon R Curran, Xiaolin Xu, Mustafa Yalin Aydin, Oscar Meruvia-Pastor, Vernon R Curran, Xiaolin Xu, Mustafa Yalin Aydin, Oscar Meruvia-Pastor

Abstract

Extended reality (XR) has emerged as an innovative simulation-based learning modality. An integrative review was undertaken to explore the nature of evidence, usage, and effectiveness of XR modalities in medical education. One hundred and thirty-three (N = 133) studies and articles were reviewed. XR technologies are commonly reported in surgical and anatomical education, and the evidence suggests XR may be as effective as traditional medical education teaching methods and, potentially, a more cost-effective means of curriculum delivery. Further research to compare different variations of XR technologies and best applications in medical education and training are required to advance the field.

Supplementary information: The online version contains supplementary material available at 10.1007/s40670-022-01698-4.

Keywords: Augmented reality; Augmented virtuality; Extended reality; Medical education; Mixed reality; Virtual reality.

Conflict of interest statement

Conflict of InterestThe authors declare no competing interests.

© The Author(s) under exclusive licence to International Association of Medical Science Educators 2023, Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Figures

Fig. 1
Fig. 1
Summary of levels of evidence presented in reviewed studies and articles
Fig. 2
Fig. 2
Levels of evaluation evidence reported in studies and articles

References

    1. Moro C, Phelps C, Redmond P, Stromberga Z. Hololens and mobile augmented reality in medical and health science education: a randomised controlled trial. British Journal of Educational Technology. 2021;52(2):680–694. doi: 10.1111/bjet.13049.
    1. Kamphuis C, Barsom E, Schijven M, Christoph N. Augmented reality in medical education? Perspectives on medical education. 2014;3(4):300–311. doi: 10.1007/s40037-013-0107-7.
    1. Zackoff MW, Real FJ, Cruse B, Davis D, Klein M. Medical student perspectives on the use of immersive virtual reality for clinical assessment training. Academic Pediatrics. 2019;19(7):849–851. doi: 10.1016/j.acap.2019.06.008.
    1. Almousa O, Zhang R, Dimma M, Yao J, Allen A, Chen L, et al. Virtual reality technology and remote digital application for tele-simulation and global medical education: an innovative hybrid system for clinical training. Simulation and Gaming. 2021;52(5):614–634. doi: 10.1177/10468781211008258.
    1. Chang TP, Weiner D. Screen-based simulation and virtual reality for pediatric emergency medicine. Clinical Pediatric Emergency Medicine. 2016;17(3):224–230. doi: 10.1016/j.cpem.2016.05.002.
    1. Cecil J, Gupta A, Pirela-Cruz M. Design of VR based orthopedic simulation environments using emerging technologies. Annual IEEE International Systems Conference. 2018;2018:1–7. doi: 10.1109/SYSCON.2018.8369589.
    1. Kurul R, Ögün MN, Neriman Narin A, Avci Ş, Yazgan B. An alternative method for anatomy training: immersive virtual reality. Anatomical Sciences Education. 2020;13(5):648–656. doi: 10.1002/ase.1959.
    1. Pottle J. Virtual reality and the transformation of medical education. Future Healthcare Journal. 2019;6(3):181–185. doi: 10.7861/fhj.2019-0036.
    1. Zackoff MW, Real FJ, Sahay RD, Fei L, Guiot A, Lehmann C, et al. Impact of an immersive virtual reality curriculum on medical students’ clinical assessment of infants with respiratory distress. Pediatric Critical Care Medicine. 2020;21(5):477–485. doi: 10.1097/pcc.0000000000002249.
    1. Zackoff MW, Young D, Sahay RD, Fei L, Real FJ, Guiot A, et al. Establishing objective measures of clinical competence in undergraduate medical education through immersive virtual reality. Academic Pediatrics. 2020;21(3):575–579.10.1016/j.acap.2020.10.010.
    1. Shankar PR. Extended reality in educating the next generation of health professionals. Education in Medicine Journal. 2021;13(1):87–91. .
    1. Zweifach SM, Triola MM. Extended reality in medical education: driving adoption through provider-centered design. Digital Biomarkers. 2019;3(1):14–21. doi: 10.1159/000498923.
    1. Lareyre F, Chaudhuri A, Adam C, Carrier M, Mialhe C, Raffort J. Applications of head-mounted displays and smart glasses in vascular surgery. Annals of Vascular Surgery. 2021;75:497–512. doi: 10.1016/j.avsg.2021.02.033.
    1. Putnam EM, Rochlen LR, Alderink E, Augé J, Popov V, Levine R, et al. Virtual reality simulation for critical pediatric airway management training. Journal of Clinical and Translational Research. 2021;7(1):93–99.
    1. Barteit S, Lanfermann L, Bärnighausen T, Neuhann F, Beiersmann C. Augmented, mixed, and virtual reality-based head-mounted devices for medical education: systematic review. JMIR Serious Games. 2021;9(3):e29080. doi: 10.2196/29080.
    1. Vallurupalli S, Paydak H, Agarwal SK, Agrawal M, Assad-Kottner C. Wearable technology to improve education and patient outcomes in a cardiology fellowship program - a feasibility study. Health and Technology. 2013;3:267–270. doi: 10.1007/s12553-013-0065-4.
    1. Ros M, Trives JV, Lonjon N. From stereoscopic recording to virtual reality headsets: designing a new way to learn surgery. Neuro-Chirurgie. 2017;63(1):1–5. doi: 10.1016/j.neuchi.2016.08.004.
    1. Harrington CM, Kavanagh DO, Quinlan JF, Ryan D, Dicker P, O'Keeffe D, et al. Development and evaluation of a trauma decision-making simulator in Oculus virtual reality. The American Journal of Surgery. 2018;215(1):42–47. doi: 10.1016/j.amjsurg.2017.02.011.
    1. Huber T, Paschold M, Hansen C, Wunderling T, Lang H, Kneist W. New dimensions in surgical training: immersive virtual reality laparoscopic simulation exhilarates surgical staff. Surgical Endoscopy. 2017;31(11):4472–4477. doi: 10.1007/s00464-017-5500-6.
    1. Taubert M, Webber L, Hamilton T, Carr M, Harvey M. Virtual reality videos used in undergraduate palliative and oncology medical teaching: results of a pilot study. BMJ Supportive & Palliative Care. 2019;9(3):281–285. doi: 10.1136/bmjspcare-2018-001720.
    1. Uruthiralingam U, Rea PM. Augmented and virtual reality in anatomical education—a systematic review. Advances in Experimental Medicine and Biology. 2020;1235:89–101. doi: 10.1007/978-3-030-37639-0_5.
    1. Moro C, Štromberga Z, Stirling A. Virtualisation devices for student learning: comparison between desktop-based (Oculus Rift) and mobile-based (Gear VR) virtual reality in medical and health science education. Australasian journal of educational technology. 2017;33(6).10.14742/ajet.3840.
    1. Stojanovska M, Tingle G, Tan L, Ulrey L, Simonson-Shick S, Mlakar J, et al. Mixed reality anatomy using Microsoft HoloLens and cadaveric dissection: a comparative effectiveness study. Medical Science Educator. 2020;30:173–178. doi: 10.1007/s40670-019-00834-x.
    1. Lerner D, Mohr S, Schild J, Göring M, Luiz T. An immersive multi-user virtual reality for emergency simulation training: usability study. JMIR Serious Games. 2020;8(3):e18822. doi: 10.2196/18822.
    1. Munzer BW, Khan MM, Shipman B, Mahajan P. Augmented reality in emergency medicine: a scoping review. Journal of Medical Internet Research. 2019;21(4):e12368. doi: 10.2196/12368.
    1. Abbas JR, Kenth JJ, Bruce IA. The role of virtual reality in the changing landscape of surgical training. J Laryngol Otol. 2020:1–4.10.1017/s0022215120002078.
    1. Swann G, Jacobs C. Augmented reality medical student teaching within primary care. Future Healthcare Journal. 2021;8:15–16. doi: 10.7861/fhj.8-1-s15.
    1. Souza MTD, Silva MDD, Carvalho RD. Integrative review: what is it? How to do it? Einstein (São Paulo) 2010;8:102–106. doi: 10.1590/S1679-45082010RW1134.
    1. Harden RM, Grant J, Buckley G, Hart IR. BEME Guide No. 1: best evidence medical education. Med Teach. 1999;21(6): 553–562.
    1. Arskey H, O’Malley L. Scoping studies: towards a methodological framework. International Journal of Social Research Methodology. 2005;8(1):19–32. doi: 10.1080/1364557032000119616.
    1. Barr H, Koppel I, Reeves S, Hammick M, Freeth S. Effective interprofessional education: argument, assumption, and evidence. John Wiley & Sons; 2005.
    1. Ruthberg JS, Tingle G, Tan L, Ulrey L, Simonson-Shick S, Enterline R, et al. Mixed reality as a time-efficient alternative to cadaveric dissection. Medical Teacher. 2020;42(8):896–901. doi: 10.1080/0142159x.2020.1762032.
    1. O'Sullivan DM, Foley R, Proctor K, Gallagher S, Deery A, Eidem BW, et al. The use of virtual reality echocardiography in medical education. Pediatric Cardiology. 2021;42(4):723–726. doi: 10.1007/s00246-021-02596-z.
    1. Williams MA, McVeigh J, Handa AI, Lee R. Augmented reality in surgical training: a systematic review. Postgraduate Medical Journal. 2020;96(1139):537–542. doi: 10.1136/postgradmedj-2020-137600.
    1. Rizzetto F, Bernareggi A, Rantas S, Vanzulli A, Vertemati M. Immersive virtual reality in surgery and medical education: diving into the future. American Journal of Surgery. 2020;220(4):856–857. doi: 10.1016/j.amjsurg.2020.04.033.
    1. Real FJ, DeBlasio D, Ollberding NJ, Davis D, Cruse B, McLinden D, Klein MD. Resident perspectives on communication training that utilizes immersive virtual reality. Education for Health (Abingdon) 2017;30(3):228–231. doi: 10.4103/efh.EfH_9_17.
    1. Yoganathan S, Finch DA, Parkin E, Pollard J. 360° virtual reality video for the acquisition of knot tying skills: a randomised controlled trial. International Journal of Social Research Methodology. 2018;54(Pt A):24–27. doi: 10.1016/j.ijsu.2018.04.002.
    1. Chan V, Larson ND, Moody DA, Moyer DG, Shah NL. Impact of 360° vs 2D videos on engagement in anatomy education. Cureus. 2021;13(4):e14260. doi: 10.7759/cureus.14260.
    1. Borgmann H, Rodríguez Socarrás M, Salem J, Tsaur I, Gomez Rivas J, Barret E, et al. Feasibility and safety of augmented reality-assisted urological surgery using smartglass. World Journal of Urology. 2017;35(6):967–972. doi: 10.1007/s00345-016-1956-6.
    1. Lu S, Sanchez Perdomo YP, Jiang X, Zheng B. Integrating eye-tracking to augmented reality system for surgical training. Journal of Medical Systems. 2020;44(11):192. doi: 10.1007/s10916-020-01656-w.
    1. McKnight RR, Pean CA, Buck JS, Hwang JS, Hsu JR, Pierrie SN. Virtual reality and augmented reality-translating surgical training into surgical technique. Current Reviews in Musculoskeletal Medicine. 2020;13(6):663–674. doi: 10.1007/s12178-020-09667-3.
    1. Nagayo Y, Saito T, Oyama H. A novel suture training system for open surgery replicating procedures performed by experts using augmented reality. Journal of Medical Systems. 2021;45(5):60. doi: 10.1007/s10916-021-01735-6.
    1. Uppot RN, Laguna B, McCarthy CJ, De Novi G, Phelps A, Siegel E, et al. Implementing virtual and augmented reality tools for radiology education and training, communication, and clinical care. Radiology. 2019;291(3):570–580. doi: 10.1148/radiol.2019182210.
    1. Logishetty K, Rudran B, Cobb JP. Virtual reality training improves trainee performance in total hip arthroplasty: a randomized controlled trial. The Bone & Joint Journal. 2019;101-b(12):1585–1592.10.1302/0301-620x.101b12.bjj-2019-0643.r1.
    1. Weeks JK, Pakpoor J, Park BJ, Robinson NJ, Rubinstein NA, Prouty SM, et al. Harnessing augmented reality and CT to teach first-year medical students head and neck anatomy. Academic Radiology. 2020 doi: 10.1016/j.acra.2020.07.008.
    1. Rochlen LR, Levine R, Tait AR. First-person point-of-view-augmented reality for central line insertion training: a usability and feasibility study. Simulation in Healthcare. 2017;12(1):57–62. doi: 10.1097/sih.0000000000000185.
    1. Robinson B L, Mitchell T R, Brenseke B M. Evaluating the use of mixed reality to teach gross and microscopic respiratory anatomy. Medical Science Educator. 2020;1–4.10.1007/s40670-020-01064-2.
    1. Kumar N, Pandey S, Rahman E. A novel three-dimensional interactive virtual face to facilitate facial anatomy teaching using Microsoft HoloLens. Aesthetic Plastic Surgery. 2021;45(3):1005–1011. doi: 10.1007/s00266-020-02110-5.
    1. Gerup J, Soerensen CB, Dieckmann P. Augmented reality and mixed reality for healthcare education beyond surgery: an integrative review. International Journal of Medical Education. 2020;11:1–18. doi: 10.5116/ijme.5e01.eb1a.
    1. Evans HL, O'Shea DJ, Morris AE, Keys KA, Wright AS, Schaad DC, et al. A comparison of Google Glass and traditional video vantage points for bedside procedural skill assessment. The American Journal of Surgery. 2016;211(2):336–342. doi: 10.1016/j.amjsurg.2015.07.029.
    1. Ponce BA, Menendez ME, Oladeji LO, Fryberger CT, Dantuluri PK. Emerging technology in surgical education: combining real-time augmented reality and wearable computing devices. Orthopedics. 2014;37(11):751–757. doi: 10.3928/01477447-20141023-05.
    1. Hiranaka T, Nakanishi Y, Fujishiro T, Hida Y, Tsubosaka M, Shibata Y, et al. The use of Smart Glasses for surgical video streaming. Surgical Innovation. 2017;24(2):151–154. doi: 10.1177/1553350616685431.
    1. Carrera JF, Wang CC, Clark W, Southerland AM. A systematic review of the use of Google Glass in graduate medical education. Journal of Graduate Medical Education. 2019;11(6):637–648. doi: 10.4300/jgme-d-19-00148.1.
    1. Wang S, Parsons M, Stone-McLean J, Rogers P, Boyd S, Hoover K, et al. Augmented reality as a telemedicine platform for remote procedural training. Sensors (Basel). 2017;17(10).10.3390/s17102294.
    1. Barsom EZ, Graafland M, Schijven MP. Systematic review on the effectiveness of augmented reality applications in medical training. Surgical Endoscopy. 2016;30(10):4174–4183. doi: 10.1007/s00464-016-4800-6.
    1. Tang KS, Cheng DL, Mi E, Greenberg PB. Augmented reality in medical education: a systematic review. Canadian Medical Education Journal. 2020;11(1):e81-e96.10.36834/cmej.61705.
    1. McCoy CE, Alrabah R, Weichmann W, Langdorf MI, Ricks C, Chakravarthy B, et al. Feasibility of telesimulation and Google Glass for mass casualty triage education and training. The Western Journal of Emergency Medicine. 2019;20(3):512–519. doi: 10.5811/westjem.2019.3.40805.
    1. Dickerson P, Grande S, Evans D, Levine B, Coe M. Utilizing intraprocedural interactive video capture with Google Glass for immediate postprocedural resident coaching. Journal of Surgical Education. 2019;76(3):607–619. doi: 10.1016/j.jsurg.2018.10.002.
    1. Liu P, Li C, Xiao C, Zhang Z, Ma J, Gao J, et al. A wearable augmented reality navigation system for surgical telementoring based on Microsoft HoloLens. Annals of Biomedical Engineering. 2020;49:287–298. doi: 10.1007/s10439-020-02538-5.
    1. Rojas-Muñoz E, Cabrera ME, Lin C, Andersen D, Popescu V, Anderson K, et al. The System for Telementoring with Augmented Reality (STAR): a head-mounted display to improve surgical coaching and confidence in remote areas. Surgery. 2020;167(4):724–731. doi: 10.1016/j.surg.2019.11.008.
    1. Maniam P, Schnell P, Dan L, Portelli R, Erolin C, Mountain R, et al. Exploration of temporal bone anatomy using mixed reality (HoloLens): development of a mixed reality anatomy teaching resource prototype. Journal of Visual Communication in Medicine. 2020;43(1):17–26. doi: 10.1080/17453054.2019.1671813.
    1. Romand M, Dugas D, Gaudet-Blavignac C, Rochat J, Lovis C. Mixed and augmented reality tools in the medical anatomy curriculum. Studies in Health Technology Informatics. 2020;270:322–326. doi: 10.3233/shti200175.
    1. Bork F, Lehner A, Eck U, Navab N, Waschke J, Kugelmann D. The effectiveness of collaborative augmented reality in gross anatomy teaching: a quantitative and qualitative pilot study. Anatomical Sciences Education. 2020;14(5):590–604. doi: 10.1002/ase.2016.
    1. Moro C, Štromberga Z, Raikos A, Stirling A. The effectiveness of virtual and augmented reality in health sciences and medical anatomy. Anatomical Sciences Education. 2017;10(6):549–559. doi: 10.1002/ase.1696.
    1. Stepan K, Zeiger J, Hanchuk S, Del Signore A, Shrivastava R, Govindaraj S, et al. Immersive virtual reality as a teaching tool for neuroanatomy. International Forum of Allergy & Rhinology. 2017;7(10):1006–1013. doi: 10.1002/alr.21986.
    1. Le Van C, Hoa T H, Duc N M, Puri V, Nguyen T S, & Le D N. Design and development of collaborative AR system for anatomy training.Intelligent Automation and Soft Computing. 2021;27(3):853–871.10.32604/IASC.2021.013732.
    1. Wish-Baratz S, Crofton AR, Gutierrez J, Henninger E, Griswold MA. Assessment of mixed-reality technology use in remote online anatomy education. JAMA Network Open. 2020;3(9):e2016271. doi: 10.1001/jamanetworkopen.2020.16271.
    1. Duarte ML, Santos LR, Guimarães Júnior JB, Peccin MS. Learning anatomy by virtual reality and augmented reality. A scope review Morphologie. 2020;104(347):254–266. doi: 10.1016/j.morpho.2020.08.004.
    1. Brewer ZE, Fann HC, Ogden WD, Burdon TA, Sheikh AY. Inheriting the learner’s view: a Google Glass-based wearable computing platform for improving surgical trainee performance. Journal of Surgical Education. 2016;73(4):682–688. doi: 10.1016/j.jsurg.2016.02.005.
    1. Harrington CM, Kavanagh DO, Ballester WG, Ballester AW, Dicker P, Traynor O, et al. 360° Operative videos: a randomised cross-over study evaluating attentiveness and information retention. Journal of Surgical Education. 2018;75(4):993–1000. doi: 10.1016/j.jsurg.2017.10.010.
    1. Pelargos PE, Nagasawa DT, Lagman C, Tenn S, Demos JV, Lee SJ, et al. Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery. Journal of Clinical Neurosciences. 2017;35:1–4. doi: 10.1016/j.jocn.2016.09.002.
    1. Bernard F, Gallet C, Fournier H D, Laccoureye L, Roche P H, & Troude L. Toward the development of 3-dimensional virtual reality video tutorials in the French neurosurgical residency program. Example of the combined petrosal approach in the French College of Neurosurgery.Neurochirurgie. 2019;65(4):152–157.10.1016/j.neuchi.2019.04.004.
    1. Roh TH, Oh JW, Jang CK, Choi S, Kim EH, Hong CK, et al. Virtual dissection of the real brain: integration of photographic 3D models into virtual reality and its effect on neurosurgical resident education. Neurosurgery Focus. 2021;51(2):E16. doi: 10.3171/2021.5.focus21193.
    1. Sahyouni R, Moshtaghi O, Tran DK, Kaloostian S, Rajaii R, Bustillo D, et al. Assessment of Google Glass as an adjunct in neurological surgery. Surgical Neurology International. 2017;8:68. doi: 10.4103/sni.sni_277_16.
    1. Mitani S, Sato E, Kawaguchi N, Sawada S, Sakamoto K, Kitani T, et al. Case-specific three-dimensional hologram with a mixed reality technique for tumor resection in otolaryngology. Laryngoscope Investigative Otolaryngology. 2021;6(3):432–437. doi: 10.1002/lio2.581.
    1. Moshtaghi O, Kelley KS, Armstrong WB, Ghavami Y, Gu J, Djalilian HR. Using Google Glass to solve communication and surgical education challenges in the operating room. The Laryngoscope. 2015;125(10):2295–2297. doi: 10.1002/lary.25249.
    1. Dickey RM, Srikishen N, Lipshultz LI, Spiess PE, Carrion RE, Hakky TS. Augmented reality assisted surgery: a urologic training tool. Asian Journal of Andrology. 2016;18(5):732–734. doi: 10.4103/1008-682x.166436.
    1. Cecil J, Gupta A, Pirela-Cruz M, Ramanathan P. A network-based virtual reality simulation training approach for orthopedic surgery. ACM Transactions on Multimedia Computing, Communications, and Applications. 2018;14(3):1–12. doi: 10.1145/3232678.
    1. Lohre R, Bois AJ, Athwal GS, Goel DP. Improved complex skill acquisition by immersive virtual reality training: a randomized controlled trial. The Journal of Bone and Joint Surgery. 2020;102(6):e26. doi: 10.2106/jbjs.19.00982.
    1. Bakshi SK, Lin SR, Ting DSW, Chiang MF, Chodosh J. The era of artificial intelligence and virtual reality: transforming surgical education in ophthalmology. The British Journal of Ophthalmology. 2020;105:1325–1328. doi: 10.1136/bjophthalmol-2020-316845.
    1. Abbud N, Aydin A, Amin M, Scott C, Venenziano D, Van Cleynenbreugel B, et al. MP34–02 evaluation of the Microsoft Hololens in surgical training of urological laparoscopic skills.The Journal of urology. 2020;203.e503.10.1097/JU.0000000000000878.02.
    1. Huber T, Paschold M, Hansen C, Lang H, Kneist W. Artificial versus video-based immersive virtual surroundings: analysis of performance and user’s preference. Surgical Innovation. 2018;25(3):280–285. doi: 10.1177/1553350618761756.
    1. Huber T, Wunderling T, Paschold M, Lang H, Kneist W, Hansen C. Highly immersive virtual reality laparoscopy simulation: development and future aspects. International Journal of Computer Assisted Radiology and Surgery. 2018;13(2):281–290. doi: 10.1007/s11548-017-1686-2.
    1. Li M, Ganni S, Ponten J, Albayrak A, Rutkowski A, Jakimowicz J. Analysing usability and presence of a virtual reality operating room (VOR) simulator during laparoscopic surgery training. 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 2020;566–572. 10.1109/VR46266.2020.00078.
    1. Nikouline A, Jimenez MC, Okrainec A. Feasibility of remote administration of the fundamentals of laparoscopic surgery (FLS) skills test using Google wearable device. Surgical Endoscopy. 2020;34(1):443–449. doi: 10.1007/s00464-019-06788-w.
    1. Rewkowski N, State A, Fuchs H. Small marker tracking with low-cost, unsynchronized, movable consumer cameras for augmented reality surgical training. 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 2020;90–95. 10.1109/ISMAR-Adjunct51615.2020.0003.
    1. Mäkinen H, Haavisto E, Havola S, Koivisto JM. User experiences of virtual reality technologies for healthcare in learning: an integrative review. Behav Inform Technol. 2020 doi: 10.1080/0144929X.2020.1788162.

Source: PubMed

Sponsoren und Mitarbeiter

Krankheiten

Drogeninterventionen

3
Abonnieren