Accuracy of emergency department triage using the Emergency Severity Index and independent predictors of under-triage and over-triage in Brazil: a retrospective cohort analysis

Jeremiah S Hinson, Diego A Martinez, Paulo S K Schmitz, Matthew Toerper, Danieli Radu, James Scheulen, Sarah A Stewart de Ramirez, Scott Levin, Jeremiah S Hinson, Diego A Martinez, Paulo S K Schmitz, Matthew Toerper, Danieli Radu, James Scheulen, Sarah A Stewart de Ramirez, Scott Levin

Abstract

Background: Emergency department (ED) triage is performed to prioritize care for patients with critical and time-sensitive illness. Triage errors create opportunity for increased morbidity and mortality. Here, we sought to measure the frequency of under- and over-triage of patients by nurses using the Emergency Severity Index (ESI) in Brazil and to identify factors independently associated with each.

Methods: This was a single-center retrospective cohort study. The accuracy of initial ESI score assignment was determined by comparison with a score entered at the close of each ED encounter by treating physicians with full knowledge of actual resource utilization, disposition, and acute outcomes. Chi-square analysis was used to validate this surrogate gold standard, via comparison of associations with disposition and clinical outcomes. Independent predictors of under- and over-triage were identified by multivariate logistic regression.

Results: Initial ESI-determined triage score was classified as inaccurate for 16,426 of 96,071 patient encounters. Under-triage was associated with a significantly higher rate of admission and critical outcome, while over-triage was associated with a lower rate of both. A number of factors identifiable at time of presentation including advanced age, bradycardia, tachycardia, hypoxia, hyperthermia, and several specific chief complaints (i.e., neurologic complaints, chest pain, shortness of breath) were identified as independent predictors of under-triage, while other chief complaints (i.e., hypertension and allergic complaints) were independent predictors of over-triage.

Conclusions: Despite rigorous and ongoing training of ESI users, a large number of patients in this cohort were under- or over-triaged. Advanced age, vital sign derangements, and specific chief complaints-all subject to limited guidance by the ESI algorithm-were particularly under-appreciated.

Keywords: Emergency department; Emergency severity index; Mistriage; Triage.

Conflict of interest statement

Ethics approval and consent to participate

This study was approved by the institutional review boards of all participating institutions.

Consent for publication

Not applicable.

Competing interests

SL is the founder and co-owner of a start-up company with a focus on data-driven improvement of emergency department and hospital operations. JH, DM, PS, MT, DR, JS, and SR have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Figures

Fig. 1
Fig. 1
Distribution of ED visits by initial ESI designation and classifications as accurate, over-triage, or under-triage. High acuity = ESI level 1 or 2; moderate acuity = ESI level 3; low acuity = ESI level 4 or 5. ED emergency department; ESI Emergency Severity Index
Fig. 2
Fig. 2
Associations between triage accuracy and clinical outcomes. a Under-triage to moderate- and low-acuity ESI triage levels is associated with a significantly increased prevalence of hospital admission and critical outcomes. b Over-triage to moderate- and high-acuity ESI triage levels is associated with a significantly decreased prevalence of hospital admission and critical outcomes

References

    1. Iserson KV, Moskop JC. Triage in medicine, part I: concept, history, and types. Ann Emerg Med. 2007;49(3):275–281. doi: 10.1016/j.annemergmed.2006.05.019.
    1. Committee on the Future of Emergency Care in the United States Health System . Hospital-based emergency care: at the breaking point. Washington, DC: Committee on the Future of Emergency Care in the United States Health System; 2006.
    1. Morrison JB, Wears RL. 29th International Conference of the System Dynamics Society. 2011. Emergency department crowding: vicious cycles in the ED; pp. 1–36.
    1. Pines JM, Hilton JA, Weber EJ, Alkemade AJ, Al Shabanah H, Anderson PD, et al. International perspectives on emergency department crowding. Acad Emerg Med. 2011;18(12):1358–1370. doi: 10.1111/j.1553-2712.2011.01235.x.
    1. Stead LG, Jain A, Decker WW. Emergency department over-crowding: a global perspective. Int J Emerg Med. 2009;2(3):133–134. doi: 10.1007/s12245-009-0131-x.
    1. Seiger N, van Veen M, Steyerberg EW, Ruige M, van Meurs AHJ, Moll HA. Undertriage in the Manchester triage system: an assessment of severity and options for improvement. Arch Dis Child. 2011;96(7):653–657. doi: 10.1136/adc.2010.206797.
    1. Hitchcock M, Gillespie B, Crilly J, Chaboyer W. Triage: an investigation of the process and potential vulnerabilities. J Adv Nurs. 2014;70(7):1532–1541. doi: 10.1111/jan.12304.
    1. Yurkova I, Wolf L. Under-triage as a significant factor affecting transfer time between the emergency department and the intensive care unit. J Emerg Nurs. 2011;37(5):491–496. doi: 10.1016/j.jen.2011.01.016.
    1. Haas B, Gomez D, Zagorski B, Stukel TA, Rubenfeld GD, Nathens AB. Survival of the fittest: the hidden cost of undertriage of major trauma. J Am Coll Surg. 2010;211(6):804–811. doi: 10.1016/j.jamcollsurg.2010.08.014.
    1. Schull MJ, Vermeulen M, Slaughter G, Morrison L, Daly P. Emergency department crowding and thrombolysis delays in acute myocardial infarction. Ann Emerg Med. 2004;44(6):577–585. doi: 10.1016/j.annemergmed.2004.05.004.
    1. Kulstad EB, Kelley KM. Overcrowding is associated with delays in percutaneous coronary intervention for acute myocardial infarction. Int J Emerg Med. 2009;2(3):149–154. doi: 10.1007/s12245-009-0107-x.
    1. Pines JM, Hollander JE, Localio AR, Metlay JP. The association between emergency department crowding and hospital performance on antibiotic timing for pneumonia and percutaneous intervention for myocardial infarction. Acad Emerg Med. 2006;13(8):873–878. doi: 10.1111/j.1553-2712.2006.tb01741.x.
    1. Sills MR, Fairclough D, Ranade D, Kahn MG. Emergency department crowding is associated with decreased quality of care for children with acute asthma. Ann Emerg Med. 2011;57(3):191–197. doi: 10.1016/j.annemergmed.2010.08.027.
    1. Mills AM, Shofer FS, Chen EH, Hollander JE, Pines JM. The association between emergency department crowding and analgesia administration in acute abdominal pain patients. Acad Emerg Med. 2009;16(7):603–608. doi: 10.1111/j.1553-2712.2009.00441.x.
    1. Oredsson S, Jonsson H, Rognes J, Lind L, Goransson KE, Ehrenberg A, et al. A systematic review of triage-related interventions to improve patient flow in emergency departments. Scand J Trauma Resusc Emerg Med. 2011;19:43. doi: 10.1186/1757-7241-19-43.
    1. Calder LA, Forster AJ, Stiell IG, Carr LK, Perry JJ, Vaillancourt C, et al. Mapping out the emergency department disposition decision for high-acuity patients. Ann Emerg Med. 2012;60(5):567–576.e4. doi: 10.1016/j.annemergmed.2012.04.013.
    1. Australasian College for Emergency Medicine. Guidelines on the implementation of the Australasian Triage Scale in Emergency Department. Doc No G24. 2013;1–8.
    1. Beveridge R, Clarke B, Janes L, Savage N, Thompson J, Dodd G, et al. Canadian Emergency Department Triage and Acuity Scale: implementation guidelines. Can J Emerg Med. 1999;1(3 suppl):S2–28.
    1. Mackway-Jones K, editor. Emergency triage. 1. Manchester: Manchester Triage Group; 1996. p. 168.
    1. Ahrq Q. In: Emergency Severity Index (ESI): a triage tool for emergency department care. 4. Gilboy N, Tanabe P, Travers D, Rosenau AM, editors. 2012. p. 114.
    1. McHugh M, Tanabe P, McClelland M, Khare RK. More patients are triaged using the Emergency Severity Index than any other triage acuity system in the United States. Acad Emerg Med. 2012;19(1):106–109. doi: 10.1111/j.1553-2712.2011.01240.x.
    1. Christ M, Grossmann F, Winter D, Bingisser R, Platz E. Modern triage in the emergency department. Dtsch Arztebl Int. 2010;107(50):892–898.
    1. Center for Disease Control and Prevention. Ambulatory Health Care Data. [Internet]. [cited 2014 Jan 1]. Available from:
    1. Dugas AF, Kirsch TD, Toerper M, Korley F, Yenokyan G, France D, et al. An electronic emergency triage system to improve patient distribution by critical outcomes. J Emerg Med. 2016;50(6):910–918. doi: 10.1016/j.jemermed.2016.02.026.
    1. Barfod C, Lauritzen MMP, Danker JK, Sölétormos G, Forberg JL, Berlac PA, et al. Abnormal vital signs are strong predictors for intensive care unit admission and in-hospital mortality in adults triaged in the emergency department—a prospective cohort study. Scand J Trauma Resusc Emerg Med. 2012;20:28. doi: 10.1186/1757-7241-20-28.
    1. Tortora GJ. Principles of Anatomy and Physiology. 6th ed. Boston: Addison-Wesley Educational Publishers; 1990. 956.
    1. Chobanian AV, Bakris GL, Black HR, et al. The seventh report of the joint national committee on prevention, detection, evaluation, and treatment of high blood pressure: the jnc 7 report. JAMA. 2003;289(19):2560–2571. doi: 10.1001/jama.289.19.2560.
    1. McGillicuddy DC, O’Connell FJ, Shapiro NI, Calder SA, Mottley LJ, Roberts JC, et al. Emergency department abnormal vital sign “triggers” program improves time to therapy. Acad Emerg Med. 2011;18(5):483–487. doi: 10.1111/j.1553-2712.2011.01056.x.
    1. Healthcare cost and utilization project: clinical classification software [Internet]. Agency for Healthcare Research in Quality. [cited 2016 Jan 1]. Available from:
    1. Centers for Disease Control and Prevention . National Hospital Ambulatory Medical Care Survey: 2010 emergency department summary tables. 2011.
    1. Platts-Mills TF, Travers D, Biese K, McCall B, Kizer S, LaMantia M, et al. Accuracy of the emergency severity index triage instrument for identifying elder emergency department patients receiving an immediate life-saving intervention. Acad Emerg Med. 2010;17(3):238–243. doi: 10.1111/j.1553-2712.2010.00670.x.
    1. van der Wulp I, Rullmann HA, Leenen LP, van Stel HF. Associations of the Emergency Severity Index triage categories with patients’ vital signs at triage: a prospective observational study. Emerg Med J. 2011;28(12):1032–1035. doi: 10.1136/emj.2010.096172.
    1. Devos E, Jacobson L. Approach to adult patients with acute dyspnea. Emerg Med Clin North Am. 2016;34(1):129–149. doi: 10.1016/j.emc.2015.08.008.
    1. Woo KC, Schneider JI. High-risk chief complaints I: chest pain—the big three. Emerg Med Clin North Am. 2009;27(4):685–712. doi: 10.1016/j.emc.2009.07.007.
    1. Eitel DR, Travers DA, Rosenau AM, Gilboy N, Wuerz RC. The emergency severity index triage algorithm version 2 is reliable and valid. Acad Emerg Med. 2003;10(10):1070–1080. doi: 10.1111/j.1553-2712.2003.tb00577.x.
    1. Wuerz RC, Milne LW, Eitel DR, Travers D, Gilboy N. Reliability and validity of a new five-level triage instrument. Acad Emerg Med. 2000;7(3):236–242. doi: 10.1111/j.1553-2712.2000.tb01066.x.

Source: PubMed

3
Abonneren