Development and Usability Testing of the Agency for Healthcare Research and Quality Common Formats to Capture Diagnostic Safety Events

Andrea Bradford, Umber Shahid, Gordon D Schiff, Mark L Graber, Abigail Marinez, Paula DiStabile, Andrea Timashenka, Hamid Jalal, P Jeffrey Brady, Hardeep Singh, Andrea Bradford, Umber Shahid, Gordon D Schiff, Mark L Graber, Abigail Marinez, Paula DiStabile, Andrea Timashenka, Hamid Jalal, P Jeffrey Brady, Hardeep Singh

Abstract

Objectives: A lack of consensus around definitions and reporting standards for diagnostic errors limits the extent to which healthcare organizations can aggregate, analyze, share, and learn from these events. In response to this problem, the Agency for Healthcare Research and Quality (AHRQ) began the development of the Common Formats for Event Reporting for Diagnostic Safety Events (CFER-DS). We conducted a usability assessment of the draft CFER-DS to inform future revision and implementation.

Methods: We recruited a purposive sample of quality and safety personnel working in 8 U.S. healthcare organizations. Participants were invited to use the CFER-DS to simulate reporting for a minimum of 5 cases of diagnostic safety events and then provide written and verbal qualitative feedback. Analysis focused on participants' perceptions of content validity, ease of use, and potential for implementation.

Results: Estimated completion time was 30 to 90 minutes per event. Participants shared generally positive feedback about content coverage and item clarity but identified reporter burden as a potential concern. Participants also identified opportunities to clarify several conceptual definitions, ensure applicability across different care settings, and develop guidance to operationalize use of CFER-DS. Findings led to refinement of content and supplementary materials to facilitate implementation.

Conclusions: Standardized definitions of diagnostic safety events and reporting standards for contextual information and contributing factors can help capture and analyze diagnostic safety events. In addition to usability testing, additional feedback from the field will ensure that AHRQ's CFER-DS is useful to a broad range of users for learning and safety improvement.

Conflict of interest statement

The authors disclose no conflict of interest.

Copyright © 2022 The Author(s). Published by Wolters Kluwer Health, Inc.

Figures

FIGURE 1
FIGURE 1
Common Formats for Event Reporting—Diagnostic Safety, version 0.1.

References

    1. Institute of Medicine (U.S.). Committee on Diagnostic Error in Health Care . Improving diagnosis in health care. In: Balogh E, Miller BT, Ball J, eds. Quality Chasm Series. Washington, DC: The National Academies Press; 2015:xxvii, 444 pages.
    1. Zwaan L, Schiff GD, Singh H. Advancing the research agenda for diagnostic error reduction. BMJ Qual Saf. 2013;22(Suppl 2):ii52–ii57.
    1. Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med. 2005;165:1493–1499.
    1. Schiff G Kim S Abrams R, et al. . Diagnosing diagnosis errors: lessons from a multi-institutional collaborative project. In: Henriksen K Battles J Marks E, et al.., eds. Advances in Patient Safety: From Research to Implementation (Volume 2: Concepts and Methodology). Rockville, MD: Agency for Healthcare Research and Quality; 2005.
    1. Schiff GD Hasan O Kim S, et al. . Diagnostic error in medicine: analysis of 583 physician-reported errors. Arch Intern Med. 2009;169:1881–1887.
    1. Singh H Khanna A Spitzmueller C, et al. . Recommendations for using the Revised Safer Dx Instrument to help measure and improve diagnostic safety. Diagnosis (Berl). 2019;6:315–323.
    1. Betsy Lehman Center for Patient Safety . Improving diagnosis in primary care one case at a time. 2021. Betsy Lehman Center for Patient Safety. Available at: . Accessed August 1, 2021.
    1. Agency for Healthcare Research and Quality . Network of Patient Safety Databases (NPSD). 2021. Available at: . Accessed August 1, 2021.
    1. Clancy CM. Common formats allow uniform collection and reporting of patient safety data by patient safety organizations. Am J Med Qual. 2010;25:73–75.
    1. Collins S Couture B Dykes P, et al. . Implementation, evaluation, and recommendations for extension of AHRQ Common Formats to capture patient- and carepartner-generated safety data. JAMIA Open. 2018;1:20–25.
    1. Hua L, Gong Y. Usability Evaluation of a Voluntary Patient Safety Reporting System: Understanding the Difference between Predicted and Observed Time Values by Retrospective Think-Aloud Protocols. Berlin, Heidelberg: Springer; 2013:94–100.
    1. Hua L, Gong Y. Toward user-centered patient safety event reporting system: a trial of text prediction in clinical data entry. In: Sarkar I, Georgiou A, Mazzoncini de Azevedo Marques P, eds. MEDINFO 2015: eHealth-Enabled Health Proceedings of the 15th World Congress on Health and Biomedical Informatics. Amsterdam, the Netherlands: IOS Press; 2015.
    1. Williams T Szekendi M Pavkovic S, et al. . The reliability of AHRQ Common Format Harm Scales in rating patient safety events. J Patient Saf. 2015;11:52–59.
    1. Daniels JP King AD Cochrane DD, et al. . A human factors and survey methodology-based design of a web-based adverse event reporting system for families. Int J Med Inform. 2010;79:339–348.
    1. Schneider EC Ridgely MS Quigley DD, et al. . Developing and testing the health care safety hotline: a prototype consumer reporting system for patient safety events. Rand Health Q. 2017;6:1.
    1. Sun O, Chen J, Magrabi F. Using voice-activated conversational interfaces for reporting patient safety incidents: a technical feasibility and pilot usability study. In: Cummings E, Ryan A, Schaper L, eds. Enhance the Practitioner and Consumer Experience in Healthcare: Selected Papers from the 26th Australian National Health Informatics Conference (HIC 2018). Amsterdam, the Netherlands: IOS Press; 2018.
    1. Singh H, Sittig DF. Advancing the science of measurement of diagnostic errors in healthcare: the Safer Dx framework. BMJ Qual Saf. 2015;24:103–110.
    1. Singh H. Editorial: helping health care organizations to define diagnostic errors as missed opportunities in diagnosis. Jt Comm J Qual Patient Saf. 2014;40:99–101.
    1. Agency for Healthcare Research and Quality . Leadership to Improve Diagnosis: A Call to Action. 2021. Available at: . Accessed August 1, 2021.
    1. Padula WV Nagarajan M Davidson PM, et al. . Investing in skilled specialists to grow hospital infrastructure for quality improvement. J Patient Saf. 2021;17:51–55.
    1. Agency for Healthcare Research and Quality . NPSD Chartbook 2020. Available at: . Accessed August 1, 2021.

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera