Performance of the quick Sequential (sepsis-related) Organ Failure Assessment score as a prognostic tool in infected patients outside the intensive care unit: a systematic review and meta-analysis

Jae-Uk Song, Cheol Kyung Sin, Hye Kyeong Park, Sung Ryul Shim, Jonghoo Lee, Jae-Uk Song, Cheol Kyung Sin, Hye Kyeong Park, Sung Ryul Shim, Jonghoo Lee

Abstract

Background: The usefulness of the quick Sequential (Sepsis-related) Organ Failure Assessment (qSOFA) score in providing bedside criteria for early prediction of poor outcomes in patients with suspected infection remains controversial. We investigated the prognostic performance of a positive qSOFA score outside the intensive care unit (ICU) compared with positive systemic inflammatory response syndrome (SIRS) criteria.

Methods: A systematic literature search was performed using MEDLINE, Embase, and the Cochrane Central Register of Controlled Trials. Data were pooled on the basis of sensitivity, specificity, and diagnostic OR. Overall test performance was summarized using a hierarchical summary ROC and the AUC. Meta-regression analysis was used to identify potential sources of bias.

Results: We identified 23 studies with a total of 146,551 patients. When predicting in-hospital mortality in our meta-analysis, we identified pooled sensitivities of 0.51 for a positive qSOFA score and 0.86 for positive SIRS criteria, as well as pooled specificities of 0.83 for a positive qSOFA score and 0.29 for positive SIRS criteria. Discrimination for in-hospital mortality had similar AUCs between the two tools (0.74 vs. 0.71; P = 0.816). Using meta-regression analysis, an overall mortality rate ≥ 10% and timing of qSOFA score measurement could be significant sources of heterogeneity. For predicting acute organ dysfunction, although the AUC for a positive qSOFA score was higher than that for positive SIRS criteria (0.87 vs. 0.76; P < 0.001), the pooled sensitivity of positive qSOFA score was very low (0.47). In addition, a positive qSOFA score tended to be inferior to positive SIRS criteria in predicting ICU admission (0.63 vs. 0.78; P = 0.121).

Conclusions: A positive qSOFA score had high specificity outside the ICU in early detection of in-hospital mortality, acute organ dysfunction, and ICU admission, but low sensitivity may have limitations as a predictive tool for adverse outcomes. Because between-study heterogeneity was highly represented among the studies, our results should be interpreted with caution.

Keywords: Emergency department; Intensive care unit; Mortality; Sepsis; qSOFA.

Conflict of interest statement

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Figures

Fig. 1
Fig. 1
Flow diagram for the identification of eligible studies. ICU Intensive care unit, qSOFA Quick Sequential (Sepsis-related) Organ Failure Assessment
Fig. 2
Fig. 2
Paired forest plots of sensitivity and specificity of positive quick Sequential (Sepsis-related) Organ Failure Assessment scores in predicting in-hospital mortality in patients with infection outside the intensive care unit
Fig. 3
Fig. 3
Hierarchical summary ROC (SROC) curves for (a) positive quick Sequential (Sepsis-related) Organ Failure Assessment (qSOFA) scores and (b) positive systemic inflammatory response syndrome (SIRS) criteria for predicting in-hospital mortality, and for (c) positive qSOFA scores and (d) positive SIRS criteria for early detection of acute organ dysfunction in patients with infection outside the intensive care unit. SENS Sensitivity; SPEC, Specificity

References

    1. Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche JD, Coopersmith CM, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3) JAMA. 2016;315:801–10. doi: 10.1001/jama.2016.0287.
    1. Liu V, Escobar GJ, Greene JD, Soule J, Whippy A, Angus DC, Iwashyna TJ. Hospital deaths in patients with sepsis from 2 independent cohorts. JAMA. 2014;312:90–2. doi: 10.1001/jama.2014.5804.
    1. Bhattacharjee P, Edelson DP, Churpek MM. Identifying patients with sepsis on the hospital wards. Chest. 2017;151:898–907. doi: 10.1016/j.chest.2016.06.020.
    1. Vincent JL, Opal SM, Marshall JC, Tracey KJ. Sepsis definitions: time for change. Lancet. 2013;381:774–5. doi: 10.1016/S0140-6736(12)61815-7.
    1. Kaukonen KM, Bailey M, Pilcher D, Cooper DJ, Bellomo R. Systemic inflammatory response syndrome criteria in defining severe sepsis. N Engl J Med. 2015;372:1629–38. doi: 10.1056/NEJMoa1415236.
    1. Seymour CW, Liu VX, Iwashyna TJ, Brunkhorst FM, Rea TD, Scherag A, Rubenfeld G, Kahn JM, Shankar-Hari M, Singer M, et al. Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3) JAMA. 2016;315:762–74. doi: 10.1001/jama.2016.0288.
    1. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151:264–9. doi: 10.7326/0003-4819-151-4-200908180-00135.
    1. Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, Cohen J, Opal SM, Vincent JL, Ramsay G, et al. 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Intensive Care Med. 2003;29:530–8. doi: 10.1007/s00134-003-1662-x.
    1. Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, Schein RM, Sibbald WJ, ACCP/SCCM Consensus Conference Committee Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. Chest. 1992;101:1644–55. doi: 10.1378/chest.101.6.1644.
    1. Borzecki AM, Christiansen CL, Chew P, Loveland S, Rosen AK. Comparison of in-hospital versus 30-day mortality assessments for selected medical conditions. Med Care. 2010;48:1117–21. doi: 10.1097/MLR.0b013e3181ef9d53.
    1. Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J. The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2003;3:25. doi: 10.1186/1471-2288-3-25.
    1. Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005;58:982–90. doi: 10.1016/j.jclinepi.2005.02.022.
    1. Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001;20:2865–84. doi: 10.1002/sim.942.
    1. Thompson SG. Why sources of heterogeneity in meta-analysis should be investigated. BMJ. 1994;309:1351–5. doi: 10.1136/bmj.309.6965.1351.
    1. Lijmer JG, Mol BW, Heisterkamp S, Bonsel GJ, Prins MH, van der Meulen JH, Bossuyt PM. Empirical evidence of design-related bias in studies of diagnostic tests. JAMA. 1999;282:1061–6. doi: 10.1001/jama.282.11.1061.
    1. Moses LE, Shapiro D, Littenberg B. Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med. 1993;12(14):1293–316. doi: 10.1002/sim.4780121403.
    1. Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol. 2005;58:882–93. doi: 10.1016/j.jclinepi.2005.01.016.
    1. April MD, Aguirre J, Tannenbaum LI, Moore T, Pingree A, Thaxton RE, Sessions DJ, Lantry JH. Sepsis clinical criteria in emergency department patients admitted to an intensive care unit: an external validation study of quick Sequential Organ Failure Assessment. J Emerg Med. 2017;52:622–31. doi: 10.1016/j.jemermed.2016.10.012.
    1. Askim Å, Moser F, Gustad LT, Stene H, Gundersen M, Åsvold BO, Dale J, Bjørnsen LP, Damås JK, Solligård E. Poor performance of quick-SOFA (qSOFA) score in predicting severe sepsis and mortality – a prospective study of patients admitted with infection to the emergency department. Scand J Trauma Resusc Emerg Med. 2017;25:56. doi: 10.1186/s13049-017-0399-4.
    1. Chen YX, Wang JY, Guo SB. Use of CRB-65 and quick Sepsis-related Organ Failure Assessment to predict site of care and mortality in pneumonia patients in the emergency department: a retrospective study. Crit Care. 2016;20:167. doi: 10.1186/s13054-016-1351-0.
    1. Churpek MM, Snyder A, Han X, Sokol S, Pettit N, Howell MD, Edelson DP. Quick Sepsis-related Organ Failure Assessment, systemic inflammatory response syndrome, and early warning scores for detecting clinical deterioration in infected patients outside the intensive care unit. Am J Respir Crit Care Med. 2017;195:906–11. doi: 10.1164/rccm.201604-0854OC.
    1. Donnelly JP, Safford MM, Shapiro NI, Baddley JW, Wang HE. Application of the Third International Consensus Definitions for Sepsis (Sepsis-3) classification: a retrospective population-based cohort study. Lancet Infect Dis. 2017;17:661–70. doi: 10.1016/S1473-3099(17)30117-2.
    1. Dorsett M, Kroll M, Smith CS, Asaro P, Liang SY, Moy HP. qSOFA has poor sensitivity for prehospital identification of severe sepsis and septic shock. Prehospital Emerg Care. 2017;21:489–97. doi: 10.1080/10903127.2016.1274348.
    1. Finkelsztein EJ, Jones DS, Ma KC, Pabon MA, Delgado T, Nakahira K, Arbo JE, Berlin DA, Schenck EJ, Choi AM, et al. Comparison of qSOFA and SIRS for predicting adverse outcomes of patients with suspicion of sepsis outside the intensive care unit. Crit Care. 2017;21:73. doi: 10.1186/s13054-017-1658-5.
    1. Forward E, Konecny P, Burston J, Adhikari S, Doolan H, Jensen T. Predictive validity of the qSOFA criteria for sepsis in non-ICU inpatients. Intensive Care Med. 2017;43:945–6. doi: 10.1007/s00134-017-4776-2.
    1. Freund Y, Lemachatti N, Krastinova E, Van Laer M, Claessens YE, Avondo A, Occelli C, Feral-Pierssens AL, Truchot J, Ortega M, et al. Prognostic accuracy of Sepsis-3 criteria for in-hospital mortality among patients with suspected infection presenting to the emergency department. JAMA. 2017;317:301–8. doi: 10.1001/jama.2016.20329.
    1. Giamarellos-Bourboulis EJ, Tsaganos T, Tsangaris I, Lada M, Routsi C, Sinapidis D, Koupetori M, Bristianou M, Adamis G, Mandragos K, et al. Validation of the new Sepsis-3 definitions: proposal for improvement in early risk identification. Clin Microbiol Infect. 2017;23:104–9. doi: 10.1016/j.cmi.2016.11.003.
    1. Henning DJ, Puskarich MA, Self WH, Howell MD, Donnino MW, Yealy DM, Jones AE, Shapiro NI. An emergency department validation of the SEP-3 sepsis and septic shock definitions and comparison with 1992 consensus definitions. Ann Emerg Med. 2017;70(4):544–52.e5. doi: 10.1016/j.annemergmed.2017.01.008.
    1. Huson MA, Kalkman R, Grobusch MP, van der Poll T. Predictive value of the qSOFA score in patients with suspected infection in a resource limited setting in Gabon. Travel Med Infect Dis. 2017;15:76–7. doi: 10.1016/j.tmaid.2016.10.014.
    1. Hwang SY, Jo IJ, Lee SU, Lee TR, Yoon H, Cha WC, Sim MS, Shin TG. Low accuracy of positive qSOFA criteria for predicting 28-day mortality in critically ill septic patients during the early period after emergency department presentation. Ann Emerg Med. 2018;71(1):1–9.e2. doi: 10.1016/j.annemergmed.2017.05.022.
    1. Kim M, Ahn S, Kim WY, Sohn CH, Seo DW, Lee YS, Lim KS. Predictive performance of the quick Sequential Organ Failure Assessment score as a screening tool for sepsis, mortality, and intensive care unit admission in patients with febrile neutropenia. Support Care Cancer. 2017;25:1557–62. doi: 10.1007/s00520-016-3567-6.
    1. Kolditz M, Scherag A, Rohde G, Ewig S, Welte T, Pletz M, CAPNETZ Study Group Comparison of the qSOFA and CRB-65 for risk prediction in patients with community-acquired pneumonia. Intensive Care Med. 2016;42:2108–10. doi: 10.1007/s00134-016-4517-y.
    1. Mellhammar L, Wullt S, Lindberg A, Lanbeck P, Christensson B, Linder A. Sepsis incidence: a population-based study. Open Forum Infect Dis. 2016;3:ofw207. doi: 10.1093/ofid/ofw207.
    1. Park HK, Kim WY, Kim MC, Jung W, Ko BS. Quick Sequential Organ Failure Assessment compared to systemic inflammatory response syndrome for predicting sepsis in emergency department. J Crit Care. 2017;42:12–7. doi: 10.1016/j.jcrc.2017.06.020.
    1. Peake SL, Delaney A, Bailey M, Bellomo R, ARISE Investigators. Potential impact of the 2016 Consensus Definitions of Sepsis and Septic Shock on future sepsis research. Ann Emerg Med. 2017;70(4):553–61.e1. 10.1016/j.annemergmed.2017.04.007.
    1. Quinten VM, van Meurs M, Wolffensperger AE, Ter Maaten JC, Ligtenberg JJM. Sepsis patients in the emergency department: stratification using the Clinical Impression Score, Predisposition, Infection, Response and Organ dysfunction score or quick Sequential Organ Failure Assessment score? Eur J Emerg Med. 2017. 10.1097/MEJ.0000000000000460.
    1. Ranzani OT, Prina E, Menéndez R, Ceccato A, Cilloniz C, Méndez R, Gabarrus A, Barbeta E, Li Bassi G, Ferrer M, et al. New sepsis definition (Sepsis-3) and community-acquired pneumonia mortality: a validation and clinical decision-making study. Am J Respir Crit Care Med. 2017;196(10):1287–97. doi: 10.1164/rccm.201611-2262OC.
    1. Wang JY, Chen YX, Guo SB, Mei X, Yang P. Predictive performance of quick Sepsis-related Organ Failure Assessment for mortality and ICU admission in patients with infection at the ED. Am J Emerg Med. 2016;34:1788–93. doi: 10.1016/j.ajem.2016.06.015.
    1. Williams JM, Greenslade JH, McKenzie JV, Chu K, Brown AFT, Lipman J. Systemic inflammatory response syndrome, quick Sequential Organ Function Assessment, and organ dysfunction: insights from a prospective database of ED patients with infection. Chest. 2017;151:586–96. doi: 10.1016/j.chest.2016.10.057.
    1. Churpek MM, Zadravecz FJ, Winslow C, Howell MD, Edelson DP. Incidence and prognostic value of the systemic inflammatory response syndrome and organ dysfunctions in ward patients. Am J Respir Crit Care Med. 2015;192:958–64. doi: 10.1164/rccm.201502-0275OC.
    1. Jaimes F, Garces J, Cuervo J, Ramirez F, Ramirez J, Vargas A, Quintero C, Ochoa J, Tandioy F, Zapata L, et al. The systemic inflammatory response syndrome (SIRS) to identify infected patients in the emergency room. Intensive Care Med. 2003;29:1368–71. doi: 10.1007/s00134-003-1874-0.
    1. Sprung CL, Sakr Y, Vincent JL, Le Gall JR, Reinhart K, Ranieri VM, Gerlach H, Fielden J, Groba CB, Payen D. An evaluation of systemic inflammatory response syndrome signs in the Sepsis Occurrence in Acutely Ill Patients (SOAP) study. Intensive Care Med. 2006;32:421–7. doi: 10.1007/s00134-005-0039-8.
    1. Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, Peterson E, Tomlanovich M, Early Goal-Directed Therapy Collaborative Group Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med. 2001;345:1368–77. doi: 10.1056/NEJMoa010307.
    1. Dinnes J, Deeks J, Kirby J, Roderick P. A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy. Health Technol Assess. 2005;9(12).

Source: PubMed

Szponzorok és közreműködők

Egészségi állapot

Kábítószer-beavatkozások

3
Iratkozz fel