Dashboards for visual display of patient safety data: a systematic review

Daniel R Murphy, April Savoy, Tyler Satterly, Dean F Sittig, Hardeep Singh, Daniel R Murphy, April Savoy, Tyler Satterly, Dean F Sittig, Hardeep Singh

Abstract

Background: Methods to visualise patient safety data can support effective monitoring of safety events and discovery of trends. While quality dashboards are common, use and impact of dashboards to visualise patient safety event data remains poorly understood.

Objectives: To understand development, use and direct or indirect impacts of patient safety dashboards.

Methods: We conducted a systematic review in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. We searched PubMed, EMBASE and CINAHL for publications between 1 January 1950 and 30 August 2018 involving use of dashboards to display data related to safety targets defined by the Agency for Healthcare Research and Quality's Patient Safety Net. Two reviewers independently reviewed search results for inclusion in analysis and resolved disagreements by consensus. We collected data on development, use and impact via standardised data collection forms and analysed data using descriptive statistics.

Results: Literature search identified 4624 results which were narrowed to 33 publications after applying inclusion and exclusion criteria and consensus across reviewers. Publications included only time series and case study designs and were inpatient focused and emergency department focused. Information on direct impact of dashboards was limited, and only four studies included informatics or human factors principles in development or postimplementation evaluation.

Discussion: Use of patient-safety dashboards has grown over the past 15 years, but impact remains poorly understood. Dashboard design processes rarely use informatics or human factors principles to ensure that the available content and navigation assists task completion, communication or decision making.

Conclusion: Design and usability evaluation of patient safety dashboards should incorporate informatics and human factors principles. Future assessments should also rigorously explore their potential to support patient safety monitoring including direct or indirect impact on patient safety.

Keywords: data visualization; informatics; safety management.

Conflict of interest statement

Competing interests: None declared.

© Author(s) (or their employer(s)) 2021. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Figures

Figure 1
Figure 1
Flow chart of literature search results and the selection process of accepted/excluded publications.
Figure 2
Figure 2
Number of publications identified by dashboard patient safety topic.

References

    1. Kohn LT, Corrigan JM, Donaldson MS, Committee on Quality of Health Care in America, Institute of Medicine . To err is human: building a safer health system. The National Academies Press, 2000.
    1. Quality payment program. United States Centers for Medicare & Medicaid Services. Available: [Accessed 6/6/2021].
    1. Hugo JV, S SG. Human factors principles in information Dashboard design. Idaho Falls, ID (United States: Idaho National Lab. (INL), 2016.
    1. Dowding D, Randell R, Gardner P, et al. . Dashboards for improving patient care: review of the literature. Int J Med Inform 2015;84:87–100. 10.1016/j.ijmedinf.2014.10.001
    1. Sarikaya A, Correll M, Bartram L, et al. . What do we talk about when we talk about Dashboards? IEEE Trans Vis Comput Graph 2019;25:682–92. 10.1109/TVCG.2018.2864903
    1. Dowding D, Merrill JA. The development of Heuristics for evaluation of Dashboard Visualizations. Appl Clin Inform 2018;9:511–8. 10.1055/s-0038-1666842
    1. Carayon P, Hoonakker P. Human factors and usability for health information technology: old and new challenges. Yearb Med Inform 2019;28:071–7. 10.1055/s-0039-1677907
    1. Norman DA, Draper SW. User centered system design: new perspectives on Human-Computer interaction. 1st ed. CRC Press, 1986.
    1. 20282-2 usability of consumer products and products for public use, 2013International Organization of Standards. Available:
    1. PSNet topics, 2021. Available: [Accessed 6/6/2021].
    1. Mazzella-Ebstein AM, Saddul R. Web-Based nurse executive dashboard. J Nurs Care Qual 2004;19:307–15. 10.1097/00001786-200410000-00004
    1. Donaldson N, Brown DS, Aydin CE, et al. . Leveraging nurse-related dashboard benchmarks to expedite performance improvement and document excellence. J Nurs Adm 2005;35:163–72. 10.1097/00005110-200504000-00005
    1. Johnson K, Hallsey D, Meredith RL, et al. . A nurse-driven system for improving patient quality outcomes. J Nurs Care Qual 2006;21:168–75. 10.1097/00001786-200604000-00013
    1. Anand V, Cave D, McCrady H, et al. . The development of a congenital heart programme quality dashboard to promote transparent reporting of outcomes. Cardiol Young 2015;25:1579–83. 10.1017/S1047951115002085
    1. Hebert C, Flaherty J, Smyer J, et al. . Development and validation of an automated ventilator-associated event electronic surveillance system: a report of a successful implementation. Am J Infect Control 2018;46:316–21. 10.1016/j.ajic.2017.09.006
    1. Mayfield J, Wood H, Russo AJ, et al. . Facility level dashboard utilized to decrease infection preventionists time disseminating data. Am J Infect Control 2013;41:S54. 10.1016/j.ajic.2013.03.112
    1. Chandraharan E. Clinical dashboards: do they actually work in practice? Three-year experience with the maternity Dashboard. Clin Risk 2010;16:176–82. 10.1258/cr.2010.010022
    1. Coleman JJ, Hodson J, Brooks HL, et al. . Missed medication doses in hospitalised patients: a descriptive account of quality improvement measures and time series analysis. Int J Qual Health Care 2013;25:564–72. 10.1093/intqhc/mzt044
    1. Lau S, Wehbi M, Varma V. Electronic tool for tracking patient care after positive colon biopsy. Am J Clin Pathol 2012;138:A122. 10.1093/ajcp/138.suppl2.191
    1. Mlaver E, Schnipper JL, Boxer RB, et al. . User-Centered collaborative design and development of an inpatient safety dashboard. Jt Comm J Qual Patient Saf 2017;43:676–85. 10.1016/j.jcjq.2017.05.010
    1. Waitman LR, Phillips IE, McCoy AB, et al. . Adopting real-time surveillance dashboards as a component of an enterprisewide medication safety strategy. Jt Comm J Qual Patient Saf 2011;37:326–AP4. 10.1016/S1553-7250(11)37041-9
    1. Collier M. Pressure Ulcer Incidence: The Development and Benefits of 10 Year’s-experience with an Electronic Monitoring Tool (PUNT) in a UK Hospital Trust. EWMA J 2015;15:15–20.
    1. Fong A, Harriott N, Walters DM, et al. . Integrating natural language processing expertise with patient safety event review committees to improve the analysis of medication events. Int J Med Inform 2017;104:120–5. 10.1016/j.ijmedinf.2017.05.005
    1. Bakos KK, Zimmermann D, Moriconi D. Implementing the clinical Dashboard at VCUHS. NI 2012 2012;2012:11.
    1. Conway WA, Hawkins S, Jordan J, et al. . The Henry Ford health system no harm campaign: a comprehensive model to reduce harm and save lives. Jt Comm J Qual Patient Saf 2012;38:318–AP1. 10.1016/S1553-7250(12)38042-2
    1. Mane KK, Rubenstein KB, Nassery N, et al. . Diagnostic performance dashboards: tracking diagnostic errors using big data. BMJ Qual Saf 2018;27:567–70. 10.1136/bmjqs-2018-007945
    1. Dharamshi R, Hillman T, Shaw R. Increasing engagement with clinical outcome data. Br J Healthc Manag 2011;17:585–9. 10.12968/bjhc.2011.17.12.585
    1. Rioux C, Grandbastien B, Astagneau P. Impact of a six-year control programme on surgical site infections in France: results of the INCISO surveillance. J Hosp Infect 2007;66:217–23. 10.1016/j.jhin.2007.04.005
    1. Frazier JA, Williams B. Successful implementation and evolution of Unit-Based nursing Dashboards. Nurse Leader 2012;10:44–6. 10.1016/j.mnl.2012.01.003
    1. Hendrickson C, Guelcher A, Guspiel AM, et al. . Results of increasing the frequency of healthcare associated infections (HAI) data reported to managers with an embedded quality improvement process. Am J Infect Control 2013;41:S114. 10.1016/j.ajic.2013.03.230
    1. Madison AS, Johnson D, Shepard J. Leveraging internal knowledge to create a central line associated bloodstream infection surveillance and reporting tool. Am J Infect Control 2013;41:S56. 10.1016/j.ajic.2013.03.116
    1. Rao R. Application of six sigma process to implement the infection control process and its impact on infection rates in a tertiary health care centre. BMC Proc 2011;5. 10.1186/1753-6561-5-S6-P228
    1. Lo Y-S, Lee W-S, Chen G-B, et al. . Improving the work efficiency of healthcare-associated infection surveillance using electronic medical records. Comput Methods Programs Biomed 2014;117:351–9. 10.1016/j.cmpb.2014.07.006
    1. Riley S, Cheema K. Quality Observatories: using information to create a culture of measurement for improvement. Clin Risk 2010;16:93–7. 10.1258/cr.2010.010002
    1. Mackie S, Baldie D, McKenna E, et al. . Using quality improvement science to reduce the risk of pressure ulcer occurrence – a case study in NHS Tayside. Clin Risk 2014;20:134–43. 10.1177/1356262214562916
    1. Gardner LA, Bray PJ, Finley E, et al. . Standardizing falls reporting: using data from adverse event reporting to drive quality improvement. J Patient Saf 2019;15:135–42. 10.1097/PTS.0000000000000204
    1. Hyman D, Neiman J, Rannie M, et al. . Innovative use of the electronic health record to support harm reduction efforts. Pediatrics 2017;139:e20153410–e10. 10.1542/peds.2015-3410
    1. Ratwani RM, Fong A. 'Connecting the dots': Leveraging visual analytics to make sense of patient safety event reports. J Am Med Inform Assoc 2015;22:312–7. 10.1136/amiajnl-2014-002963
    1. Skledar SJ, Niccolai CS, Schilling D, et al. . Quality-Improvement analytics for intravenous infusion pumps. Am J Health Syst Pharm 2013;70:680–6. 10.2146/ajhp120104
    1. Stone AB, Jones MR, Rao N, et al. . A Dashboard for monitoring Opioid-Related adverse drug events following surgery using a national administrative database. Am J Med Qual 2019;34:45-52. 10.1177/1062860618782646
    1. Milligan PE, Bocox MC, Pratt E, et al. . Multifaceted approach to reducing occurrence of severe hypoglycemia in a large healthcare system. Am J Health Syst Pharm 2015;72:1631–41. 10.2146/ajhp150077
    1. Shneiderman B. The eyes have it: a task by data type taxonomy for information Visualizations. Proceedings 1996 IEEE Symposium on Visual Languages 1996:336–43. 10.1109/VL.1996.545307
    1. Roskoski R. Guidelines for preparing color figures for everyone including the colorblind. Pharmacol Res 2017;119:240–1. 10.1016/j.phrs.2017.02.005
    1. Holden RJ, Carayon P. SEIPS 101 and seven simple SEIPS tools. BMJ Qual Saf 2021. 10.1136/bmjqs-2020-012538. [Epub ahead of print: 26 May 2021].
    1. Carayon P, Hoonakker P, Hundt AS, et al. . Application of human factors to improve usability of clinical decision support for diagnostic decision-making: a scenario-based simulation study. BMJ Qual Saf 2020;29:329–40. 10.1136/bmjqs-2019-009857
    1. Savoy A, Militello LG, Patel H, et al. . A cognitive systems engineering design approach to improve the usability of electronic order forms for medical consultation. J Biomed Inform 2018;85:138–48. 10.1016/j.jbi.2018.07.021
    1. Harte R, Glynn L, Rodríguez-Molinero A, et al. . A Human-Centered design methodology to enhance the usability, human factors, and user experience of connected health systems: a three-phase methodology. JMIR Hum Factors 2017;4:e8. 10.2196/humanfactors.5443
    1. Wilson J, Rosenberg D. Chapter 39 - Rapid Prototyping for User Interface Design. In: Helander M, ed. Handbook of Human-Computer Interaction. North. Holland, 1988: 859–75.
    1. McMullen CK, Ash JS, Sittig DF, et al. . Rapid assessment of clinical information systems in the healthcare setting: an efficient method for time-pressed evaluation. Methods Inf Med 2011;50:299–307. 10.3414/ME10-01-0042
    1. Nagelkerk J, Peterson T, Pawl BL, et al. . Patient safety culture transformation in a children's Hospital: an interprofessional approach. J Interprof Care 2014;28:358–64. 10.3109/13561820.2014.885935
    1. Pemberton MN, Ashley MP, Shaw A, et al. . Measuring patient safety in a UK dental Hospital: development of a dental clinical effectiveness dashboard. Br Dent J 2014;217:375–8. 10.1038/sj.bdj.2014.859

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera