Systematic review on the effectiveness of augmented reality applications in medical training

E Z Barsom, M Graafland, M P Schijven, E Z Barsom, M Graafland, M P Schijven

Abstract

Background: Computer-based applications are increasingly used to support the training of medical professionals. Augmented reality applications (ARAs) render an interactive virtual layer on top of reality. The use of ARAs is of real interest to medical education because they blend digital elements with the physical learning environment. This will result in new educational opportunities. The aim of this systematic review is to investigate to which extent augmented reality applications are currently used to validly support medical professionals training.

Methods: PubMed, Embase, INSPEC and PsychInfo were searched using predefined inclusion criteria for relevant articles up to August 2015. All study types were considered eligible. Articles concerning AR applications used to train or educate medical professionals were evaluated.

Results: Twenty-seven studies were found relevant, describing a total of seven augmented reality applications. Applications were assigned to three different categories. The first category is directed toward laparoscopic surgical training, the second category toward mixed reality training of neurosurgical procedures and the third category toward training echocardiography. Statistical pooling of data could not be performed due to heterogeneity of study designs. Face-, construct- and concurrent validity was proven for two applications directed at laparoscopic training, face- and construct validity for neurosurgical procedures and face-, content- and construct validity in echocardiography training. In the literature, none of the ARAs completed a full validation process for the purpose of use.

Conclusion: Augmented reality applications that support blended learning in medical training have gained public and scientific interest. In order to be of value, applications must be able to transfer information to the user. Although promising, the literature to date is lacking to support such evidence.

Keywords: Augmented reality; Medical education; Medical specialist training; Surgery; Training.

Conflict of interest statement

Compliance with ethical standards Disclosures Authors E.Z. Barsom, M. Graafland and M.P. Schijven have no conflicts of interest or financial ties to disclose.

Figures

Fig. 1
Fig. 1
Search strategy on augmented reality applications to train or educate medical professionals
Fig. 2
Fig. 2
Overview of augmented reality applications (ARAs) and their methodological quality to train or educate medical professionals

References

    1. Vanderbilt AA, Grover AC, Pastis NJ, Feldman M, Granados DD, Murithi LK, Mainous AG., III Randomized controlled trials: a systematic review of laparoscopic surgery and simulation based training. Glob J Health Sci. 2014;7(2):310–327.
    1. Bharathan R, Vali S, Setchell T, Miskry T, Darzi A, Aggarwal R. Psychomotor skills and cognitive load training on a virtual reality laparoscopic simulator for tubal surgery is effective. Eur J Obstet Gynecol Reprod Biol. 2013;7(2):310–327.
    1. Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P. Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg. 2004;91(2):146–150.
    1. Schout BM, Ananias HJ, Bemelmans BL, d’Ancona FC, Muijtjens AM, Dolmans VE, et al. Transfer of cysto-urethroscopy skills from a virtual-reality simulator to the operating room: a randomized controlled trial. BJU Int. 2010;106(2):226–231.
    1. Schreuder HW, Oei G, Maas M, Borleffs JC, Schijven MP. Implementation of simulation in surgical practice: minimally invasive surgery has taken the lead: the Dutch experience. Med Teach. 2011;33(2):105–115.
    1. Graafland M, Schraagen JM, Schijven MP. Systematic review of serious games for medical education and surgical skills training. Br J Surg. 2012;99(10):1322–1330.
    1. Carmigniani J, Furht B, Anisetti M, Ceravolo P, Damiani E, Ivkovic M. Augmented reality technologies, systems and applications. Multimed Tools Appl. 2011;51(1):341–377.
    1. Berryman DR. Augmented reality: a review. Med Ref Serv Q. 2012;31(2):212–218.
    1. Guicherit OR. The European working time directive and surgical residents’ expertise: no effect on the number of operations. Ned Tijdschr Geneeskd. 2015;159:A9231.
    1. Hopmans CJ, den Hoed PT, van der Laan L, van der Harst E, van der Elst M, Mannaerts GH, Dawson I, Timmand R, Wijnhoven BP, IJzermans JN. Impact of the European working time directive (EWTD) on the operative experience of surgery residents. Surgery. 2015;157(4):634–641.
    1. Jamal MH, Wong S, Whalen TV. Effects of the reduction of surgical residents’ work hours and implications for surgical residency programs: a narrative review. BMC Med Educ. 2014;14(Suppl 1):S14.
    1. Koh GC, Khoo HE, Wong ML, Koh D. The effects of problem-based learning during medical school on physician competency: a systematic review. CMAJ. 2008;178(1):34–41.
    1. Khoiriyah U, Roberts C, Jorm C, van der Vleuten CP. Enhancing students’ learning in problem based learning: validation of a self-assessment scale for active learning and critical thinking. BMC Med Educ. 2015;26(15):140.
    1. Burgess AW, Ramsey-Stewart G, May J, Mellis C. Team-based learning methods in teaching topographical anatomy by dissection. ANZ J Surg. 2012;82(6):457–460.
    1. Burgess AW, McGregor DM, Mellis CM. Applying established guidelines to team-based learning programs in medical schools: a systematic review. Acad Med. 2014;89(4):678–688.
    1. Jayakumar N, Brunckhorst O, Dasgupta P, Khan MS, Ahmed K. e-Learning in Surgical Education: a Systematic Review. J Surg Educ. 2015;72(6):1145–1157.
    1. Pinto A, Brunese L, Pinto F, Acampora C, Romano L. E-learning and education in radiology. Eur J Radiol. 2011;78(3):368–371.
    1. Wang X, Dunston PS. Design, Strategies, and Issues Towards an Augmented Reality-based Construction Training Platform. ITcon. 2007;12:363–380.
    1. Wu H, Lee S, Chang H, Liang J. Current status, opportunities and challenges of augmented reality in education. Comput Educ. 2013;62:41–49.
    1. Kamphuis C, Barsom E, Schijven M, Christoph N. Augmented reality in medical education? Perspect Med Educ. 2014;3(4):300–311.
    1. Botden SM, Jakimowicz JJ. What is going on in augmented reality simulation in laparoscopic surgery? Surg Endosc. 2009;23(8):1693–1700.
    1. Chu MW, Moore J, Peters T, Bainbridge D, McCarty D, Guiraudon GM, et al. Augmented reality image guidance improves navigation for beating heart mitral valve repair. Innovations (Phila) 2012;7(4):274–281.
    1. Low D, Lee CK, Dip LL, Ng WH, Ang BT, Ng I. Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas. Br J Neurosurg. 2010;24(1):69–74.
    1. Szabo Z, Berg S, Sjokvist S, Gustafsson T, Carleberg P, Uppsall M, et al. Real-time intraoperative visualization of myocardial circulation using augmented reality temperature display. Int J Cardiovasc Imaging. 2013;29(2):521–528.
    1. Breton-Lopez J, Quero S, Botella C, Garcia-Palacios A, Banos RM, Alcaniz M. An augmented reality system validation for the treatment of cockroach phobia. Cyberpsychol Behav Soc Netw. 2010;13(6):705–710.
    1. Lamounier E, Lopes K, Cardoso A, Andrade A, Soares A. On the use of virtual and augmented reality for upper limb prostheses training and simulation. Conf Proc IEEE Eng Med Biol Soc. 2010;2010:2451–2454.
    1. Mousavi HH, Khademi M, Dodakian L, Cramer SC, Lopes CV. A Spatial Augmented Reality rehab system for post-stroke hand rehabilitation. Stud Health Technol Inform. 2013;184:279–285.
    1. Gallagher AG, Ritter EM, Satava RM. Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc. 2003;17(10):1525–1529.
    1. Schijven MP, Jakimowicz JJ. Validation of virtual reality simulators: key to the successful integration of a novel teaching technology into minimal access surgery. Minim Invasive Ther Allied Technol. 2005;14(4):244–246.
    1. Van Dongen KW, Tournoij E, van der Zee DC, Schijven MP, Broeders IA. Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts? Surg Endosc. 2007;21(8):1413–1417.
    1. Higgins JPT, Green S (ed) (2011) Cochrane Handbook for Systematic Reviews of Interventions, version 5.1.0 [updated March 2011]. The Cochrane Collaboration . Accessed 26 Jan 2016
    1. Slim K, Nini E, Forestier D, Kwiatkowski F, Panis Y, Chipponi J. Methodological index for non-randomized studies (minors): development and validation of a new instrument. ANZ J Surg. 2003;73:712–716.
    1. Botden SM, Berlage JT, Schijven MP, Jakimowicz JJ. Face validity study of the ProMIS augmented reality laparoscopic suturing simulator. Surg Technol Int. 2008;17:26–32.
    1. Broe D, Ridgway PF, Johnson S, Tierney S, Conlon KC. Construct validation of a novel hybrid surgical simulator. Surg Endosc. 2006;20(6):900–904.
    1. Gilliam AD. Construct validity of the ProMIS laparoscopic simulator. Surg Endosc. 2009;23(5):1150.
    1. Pellen MG, Horgan LF, Barton JR, Attwood SE. Construct validity of the ProMIS laparoscopic simulator. Surg Endosc. 2009;23(1):130–139.
    1. Van Sickle KR, McClusky DA, III, Gallagher AG, Smith CD. Construct validation of the ProMIS simulator using a novel laparoscopic suturing task. Surg Endosc. 2005;19(9):1227–1231.
    1. Nugent E, Shirilla N, Hafeez A, O’Riordain DS, Traynor O, Harrison AM, et al. Development and evaluation of a simulator-based laparoscopic training program for surgical novices. Surg Endosc. 2013;27(1):214–221.
    1. Ritter EM, Kindelan TW, Michael C, Pimentel EA, Bowyer MW. Concurrent validity of augmented reality metrics applied to the fundamentals of laparoscopic surgery (FLS) Surg Endosc. 2007;21(8):1441–1445.
    1. Lahanas V, Loukas C, Smailis N, Georgiou E. A novel augmented reality simulator for skills assessment in minimal invasive surgery. Surg Endosc. 2015;29(8):2224–2234.
    1. Moult E, Ungi T, Welch M, Lu J, McGraw RC, Fichtinger G. Ultrasound-guided facet joint injection training using Perk Tutor. Int J Comput Assist Radiol Surg. 2013;8(5):831–836.
    1. Keri Z, Sydor D, Ungi T, Holden MS, McGraw R, Mousavi P, et al. Computerized training system for ultrasound-guided lumbar puncture on abnormal spine models: a randomized controlled trial. Can J Anaesth. 2015;62(7):777–784.
    1. Yeo CT, Ungi T, Thainual P, Lasso A, McGraw RC, Fichtinger G. The effect of augmented reality training on percutaneous needle placement in spinal facet joint injections. IEEE Trans Biomed Eng. 2011;58(7):2031–2037.
    1. Luciano CJ, Banerjee PP, Bellotte B, Oh GM, Lemole M, Jr, Charbel FT, et al. Learning retention of thoracic pedicle screw placement using a high-resolution augmented reality simulator with haptic feedback. Neurosurgery. 2011;69 Suppl Operative(1):ons14–ons19.
    1. Alaraj A, Luciano CJ, Bailey DP, Elsenousi A, Roitberg BZ, Bernardo A, et al. Virtual reality cerebral aneurysm clipping simulation with real-time haptic feedback. Neurosurgery. 2015;11(Suppl 2):52–58.
    1. Shakur SF, Luciano CJ, Kania P, Roitberg BZ, Banerjee PP, Slavin KV, et al. Usefulness of a Virtual Reality Percutaneous Trigeminal Rhizotomy Simulator in Neurosurgical Training. Neurosurgery. 2015;11(Suppl 3):420–425.
    1. Hooten KG, Lister JR, Lombard G, Lizdas DE, Lampotang S, Rajon DA, Bova F, Murad GJ. Mixed reality ventriculostomy simulation: experience in neurosurgical residency. Neurosurgery. 2014;10(Suppl 4):576–581.
    1. Platts DG, Humphries J, Burstow DJ, Anderson B, Forshaw T, Scalia GM. The use of computerised simulators for training of transthoracic and transoesophageal echocardiography. The future of echocardiographic training? Heart Lung Circ. 2012;21(5):267–274.
    1. Weidenbach M, Razek V, Wild F, Khambadkone S, Berlage T, Janousek J, Marek J. Simulation of congenital heart defects: a novel way of training in echocardiography. Heart. 2009;95(8):636–641.
    1. Rouch JD, Wagner JP, Scott A, Chen DC, DeUgarte DA, Shew SB, Tilou A, Dunn JC, Lee SL. Innovation in pediatric surgical education for general surgery residents: a mobile web resource. J Surg Educ. 2015;72(6):1190–1194.
    1. Fernandez GL, Page DW, Coe NP, Lee PC, Patterson LA, Skylizard L, et al. Boot cAMP: educational outcomes after 4 successive years of preparatory simulation-based training at onset of internship. J Surg Educ. 2012;69(2):242–248.
    1. Peyre SE, Peyre CG, Sullivan ME, Towfigh S. A surgical skills elective can improve student confidence prior to internship. J Surg Res. 2006;133(1):11–15.
    1. Zeng W, Woodhouse J, Brunt LM. Do preclinical background and clerkship experiences impact skills performance in an accelerated internship preparation course for senior medical students? Surgery. 2010;148(4):768–776.
    1. Schreuder HW, Oei G, Maas M, Borleffs JC, Schijven MP. Implementation of simulation in surgical practice: minimally invasive surgery has taken the lead: the Dutch experience. Med Teach. 2011;33(2):105–115.
    1. Gartner . Accessed 26 Jan 2016
    1. Engadget . Accessed 26 Jan 2016
    1. Forbes . Accessed 26 Jan 2016
    1. . Accessed 26 Jan 2016
    1. Schreinemacher MH, Graafland M, Schijven MP. Google glass in surgery. Surg Innov. 2014;21(6):651–652.
    1. Guze AP. Using Technology to Meet the Challenges of Medical Education. Trans Am Clin Climatol Assoc. 2015;126:260–270.
    1. Graafland M, Schraagen JM, Boermeester MA, Bemelman WA, Schijven MP. Training situational awareness to reduce surgical errors in the operating room. Br J Surg. 2015;102(1):16–23.

Source: PubMed

3
订阅