A scoping review of augmented reality in nursing

Hanna Wüller, Jonathan Behrens, Marcus Garthaus, Sara Marquard, Hartmut Remmers, Hanna Wüller, Jonathan Behrens, Marcus Garthaus, Sara Marquard, Hartmut Remmers

Abstract

Background: Augmented reality (AR) has the potential to be utilized in various fields. Nursing fulfils the requirements of smart glass use cases, and technology may be one method of supporting nurses that face challenges such as demographic change. The development of AR to assist in nursing is now feasible. Attempts to develop applications have been made, but there has not been an overview regarding the existing research.

Objective: The aim of this scoping review is to provide an overview of the current research regarding AR in nursing to identify possible research gaps. This led to the following research question: "To date, what research has been performed regarding the use of AR in nursing?". A focus has been placed on the topics involving cases, evaluations, and devices used.

Methods: A scoping review was carried out with the methodological steps outlined by Arksey and O'Malley (2005) and further enhanced by Levac et al. (2010). A broad range of keywords were used systematically in eight databases including PubMed, Web of Science and ACM to search for topics in nursing.

Results: The search led to 23 publications that were included in the final analysis. The majority of the identified publications describe pilot studies. The methods used for identifying use cases and evaluating applications differ among the included studies. Furthermore, the devices used vary from study to study and may include smart glasses, tablets, and smart watches, among others. Previous studies predominantly evaluated the use of smart glasses. In addition, evaluations did not take framing conditions into account. Reviewed publications that evaluated the use of AR in nursing also identified technical challenges associated with AR.

Conclusions: These results show that the use of AR in nursing may have positive implications. While current studies focus on evaluating prototypes, future studies should focus on performing long-term evaluations to take framing conditions and the long-term consequences of AR into consideration. Our findings are important and informative for nurses and technicians who are involved in the development of new technologies. They can use our findings to reflect on their own design of case identification, requirements for elicitation and evaluation.

Keywords: Augmented reality; Evaluation methods; Nursing; Scoping review; Values.

Conflict of interest statement

Not applicableNot applicableThe authors declare that they have no competing interests.Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Figures

Fig. 1
Fig. 1
Flow diagram depicting the study selection process

References

    1. Milgram P, Kishino F. A taxonomy of mixed reality visual displays. IEICE Trans Inf Syst. 1994;77(12):1321–1329.
    1. Klinker K, Berkemeier L, Zobel B, Wüller H, Huck-Fries V, Wiesche M, Remmers H, Thomas O, Krcmar H. Multikonferenz Wirtschaftsinformatik Lüneburg. 2018. Structure for innovations: a use case taxonomy for smart glasses in service processes.
    1. Wang X, Kim MJ, Love PE, Kang S-C. Augmented reality in built environment: classification and implications for future research. Autom Constr. 2013;32:1–13. doi: 10.1016/j.autcon.2012.11.021.
    1. Bacca J, Baldiris S, Fabregat R, Graf S. Augmented reality trends in education: a systematic review of research and applications. J Educ Technol Soc. 2014;17(4):133.
    1. Diegmann P, Schmidt-Kraepelin M, Van den Eynden S, Basten D. Benefits of augmented reality in educational environments-a systematic literature review. In: Wirtschaftsinformatik: 2015, vol. 2015. p. 1542–56.
    1. Ong SK, Yuan ML, Nee AYC. Augmented reality applications in manufacturing: a survey. Int J Prod Res. 2008;46(10):2707–2742. doi: 10.1080/00207540601064773.
    1. Nee AY, Ong S, Chryssolouris G, Mourtzis D. Augmented reality applications in design and manufacturing. CIRP Ann. 2012;61(2):657–679. doi: 10.1016/j.cirp.2012.05.010.
    1. Bulearca M, Tamarjan D. Augmented reality: a sustainable marketing tool. Glob Bus Manag Res. 2010;2(2):237–252.
    1. Mitrasinovic S, Camacho E, Trivedi N, Logan J, Campbell C, Zilinyi R, Lieber B, Bruce E, Taylor B, Martineau D. Clinical and surgical applications of smart glasses. Technol Health Care. 2015;23(4):381–401. doi: 10.3233/THC-150910.
    1. Sultan N. Reflective thoughts on the potential and challenges of wearable technology for healthcare provision and medical education. Int J Inf Manag. 2015;35(5):521–526. doi: 10.1016/j.ijinfomgt.2015.04.010.
    1. Wei NJ, Dougherty B, Myers A, Badawy SM. Using Google glass in surgical settings: systematic review. JMIR mHealth uHealth. 2018;6(3):e54. doi: 10.2196/mhealth.9409.
    1. Dougherty B, Badawy SM. Using Google glass in nonsurgical medical settings: systematic review. JMIR mHealth uHealth. 2017;5(10):e159. doi: 10.2196/mhealth.8671.
    1. Zhu E, Hadadgar A, Masiello I, Zary N. Augmented reality in healthcare education: an integrative review. PeerJ. 2014;2:e469. doi: 10.7717/peerj.469.
    1. Liao H, Inomata T, Sakuma I, Dohi T. 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Biomed Eng. 2010;57(6):1476–1486. doi: 10.1109/TBME.2010.2040278.
    1. Ferguson C, Davidson PM, Scott PJ, Jackson D, Hickman LD. Augmented reality, virtual reality and gaming: an integral part of nursing. In: Taylor & Francis; 2015.
    1. Zhang X, Chen G, Liao H. High-quality see-through surgical guidance system using enhanced 3-D autostereoscopic augmented reality. IEEE Trans Biomed Eng. 2017;64(8):1815–1825. doi: 10.1109/TBME.2016.2624632.
    1. Bevölkerungsentwicklung und Altersstruktur. Bevölkerung in absoluten Zahlen, Anteile der Altersgruppen in Prozent, 1960 bis 2050 [].
    1. Evans M, Hielscher V, Voss D: Damit Arbeit 4.0 in der Pflege ankommt. Wie Technik die Pflege stärken kann. Policy-Brief der Hans-Böckler-Stiftung 2018, März 2018(Nr. 4).
    1. Hülsken-Giesler M, Krings B-J. Technik und Pflege in einer Gesellschaft des langen Lebens: Einführung in den Schwerpunkt. Technikfolgenabschätzung Theorie und Praxis. 2015;24:4–10.
    1. Hübner U, Liebe J, Hüsers J, Thye J, Egbert N, Hackl W, Ammenwerth E: IT-Report Gesundheitswesen–Schwerpunkt: Pflege im Informationszeitalter. In: Schriftenreihe der Hochschule Osnabrück. Hannover; 2015.
    1. Mays N, Roberts E, Popay J. Synthesising research evidence. Studying the organization and delivery of health services: research methods. London: Routledge; 2001. pp. 188–220.
    1. Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5(1):69. doi: 10.1186/1748-5908-5-69.
    1. Armstrong R, Hall BJ, Doyle J, Waters E. ‘Scoping the scope’of a cochrane review. J Public Health. 2011;33(1):147–150. doi: 10.1093/pubmed/fdr015.
    1. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32. doi: 10.1080/1364557032000119616.
    1. O’Brien KK, Colquhoun H, Levac D, Baxter L, Tricco AC, Straus S, Wickerson L, Nayar A, Moher D, O’Malley L. Advancing scoping study methodology: a web-based survey and consultation of perceptions on terminology, definition and methodological steps. BMC Health Serv Res. 2016;16(1):305. doi: 10.1186/s12913-016-1579-z.
    1. Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169:467–473. doi: 10.7326/M18-0850.
    1. Aldaz G, Shluzas LA, Pickham D, Eris O, Sadler J, Joshi S, Leifer L. Hands-free image capture, data tagging and transfer using Google glass: a pilot study for improved wound care management. PLoS One. 2015;10(4):e0121179. doi: 10.1371/journal.pone.0121179.
    1. Kopetz JP, Wessel D, Jochems N. Eignung von Datenbrillen zur Unterstützung von Pflegekräften in der Ausbildung. Zeitschrift für Arbeitswissenschaft. 2018;72(1):13–22. doi: 10.1007/s41449-017-0072-9.
    1. Mentler T, Berndt H, Herczeg M. Proceedings of the European Conference on Cognitive Ergonomics. Nottingham, United Kingdom: ACM; 2016. Optical head-mounted displays for medical professionals: cognition-supporting human-computer interaction design; pp. 1–8.
    1. Schneidereith T. Seeing through Google glass: using an innovative technology to improve medication safety behaviors in undergraduate nursing students. Nurs Educ Perspect. 2015;36(5):337–339. doi: 10.5480/15-1653.
    1. Vaughn J, Lister M, Shaw RJ. Piloting augmented reality technology to enhance realism in clinical simulation. Comput Inform Nurs. 2016;34(9):402–405. doi: 10.1097/CIN.0000000000000251.
    1. Grünerbl A, Pirkl G, Weal M, Gobbi M, Lukowicz P. Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers. Osaka, Japan: ACM; 2015. Monitoring and enhancing nurse emergency training with wearable devices; pp. 1261–1267.
    1. Byrne PJ, Senk PA. Google glass in nursing education: accessing knowledge at the point of care. Comput Inform Nurs. 2017;35(3):117–120. doi: 10.1097/CIN.0000000000000339.
    1. Garrett B, Jackson C, Wilson B. Augmented reality m-learning to enhance nursing skills acquisition in the clinical skills laboratory. Interactive Technol Smart Educ. 2015;12(4):298–314. doi: 10.1108/ITSE-05-2015-0013.
    1. Pugoy RAD, Ramos RC, Figueroa RB, Jr, Rivera MHC, Siritarungsri B, Cheevakasemsook A, Noimuenwai P, Kaewsarn P. Augmented reality in nursing education: addressing the limitations of developing a learning material for nurses in the Philippines and Thailand. Int J Open Distance e-Learning. 2016;2(1):11–24.
    1. Rahn A, Kjaergaard HW. Augmented reality as a visualizing facilitator in nursing education. Proceedings of the INTED. 2014;2014:6560–6568.
    1. Rochlen LR, Levine R, Tait AR. First-person point-of-view-augmented reality for central line insertion training: a usability and feasibility study. Simul Healthc. 2017;12(1):57–62.
    1. Samosky JT, Nelson DA, Wang B, Bregman R, Hosmer A, Mikulis B, Weaver R. Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction: 2012: ACM. 2012. BodyExplorerAR: enhancing a mannequin medical simulator with sensing and projective augmented reality for exploring dynamic anatomy and physiology; pp. 263–270.
    1. Klinker K, Fries V, Wiesche M, Krcmar H: CatCare: designing a serious game to foster hand hygiene compliance in health care facilities. In: Designing the digital transformation: DESRIST 2017 research in Progress proceedings of the 12th international conference on design science research in information systems and technology Karlsruhe, Germany 30 May-1 Jun: 2017: Karlsruher Institut für Technologie (KIT); 2017.
    1. Fumagalli S, Torricelli G, Massi M, Calvani S, Boni S, Roberts AT, Accarigi E, Manetti S, Marchionni N. Effects of a new device to guide venous puncture in elderly critically ill patients: results of a pilot randomized study. Aging Clin Exp Res. 2016.
    1. Nilsson S, Johansson B. Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces. Adelaide, Australia: ACM; 2007. Fun and usable: augmented reality instructions in a hospital setting; pp. 123–130.
    1. Nilsson S, Johansson BJE. CHI '08 Extended Abstracts on Human Factors in Computing Systems. Florence, Italy: ACM; 2008. Acceptance of augmented reality instructions in a real work setting; pp. 2025–2032.
    1. Yoshida S, Sasaki A, Sato C, Yamazaki M, Takayasu J, Tanaka N, Okabayashi N, Hirano H, Saito K, Fujii Y, et al. A novel approach to surgical instructions for scrub nurses by using see-through-type head-mounted display. CIN-Comput Inform Nurs. 2015;33(8):335–338. doi: 10.1097/CIN.0000000000000153.
    1. Ehrler F, Diener R, Lovis C. Opportunities and limitations in using google glass to assist drug dispensing. Stud Health Technol Inform. 2015;211:283–285.
    1. Ehrler F, Siebert J, Haddad K, Sahin A, Schrurs P, Diener R, Gervaix A, Manzano S, Lovis C. Adapting guidelines for Google glass: the case of pediatric CPR. Stud Health Technol Inform. 2016;224:141–145.
    1. Gonzalez FC, Villegas OO, Ramirez DE, Sanchez VG, Dominguez HO. Smart multi-level tool for remote patient monitoring based on a wireless sensor network and mobile augmented reality. Sensors (Basel) 2014;14(9):17212–17234. doi: 10.3390/s140917212.
    1. Wüller H, Behrens J, Klinker K, Wiesche M, Krcmar H, Remmers H. Smart glasses in nursing – situation change and further usages exemplified on a wound care application. Stud Health Technol Inform. 2018;253(German Medical Data Sciences: A Learning Healthcare System):191–195.
    1. Byrne MD. PACU go! Augmented and virtual realities in Perianesthesia care. J Perianesth Nurs. 2017;32(3):257–259. doi: 10.1016/j.jopan.2017.04.004.
    1. Frost J, Delaney L, Fitzgerald R. University of Canberra implementing augmented reality into nursing education. Aust Nurs Midwifery J. 2017;25(5):30.
    1. Friedman B, Kahn Jr PH, Borning A, Huldtgren A: Value sensitive design and information systems. In: Early engagement and new technologies: opening up the laboratory. Springer; 2013: 55–95.
    1. Detweiler C, Hindriks K. A survey of values, technologies and contexts in pervasive healthcare. Pervasive and Mobile Computing. 2016;27:1–13. doi: 10.1016/j.pmcj.2015.09.002.
    1. Remmers H. Natürlichkeit und Künstlichkeit - Zur Analyse und Bewertung von Technik in der Pflege des Menschen. Technikfolgenabschätzung Theorie und Praxis. 2015;24(2):11–20.
    1. Weinberger N, Decker M, Krings B-J. Pflege von Menschen mit Demenz–Bedarfsorientierte Technikgestaltung. Technische Unterstützung für Menschen mit Demenz KIT Scientific Publishing. 2013:61–74.
    1. Coeckelbergh Mark. Machine Medical Ethics. Cham: Springer International Publishing; 2014. Good Healthcare Is in the “How”: The Quality of Care, the Role of Machines, and the Need for New Skills; pp. 33–47.
    1. Bang M, Solnevik K, Eriksson H. The nurse watch: design and evaluation of a smart watch application with vital sign monitoring and checklist reminders. AMIA Annu Symp Proc. 2015;2015:314–319.

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera