Describing organ dysfunction in the intensive care unit: a cohort study of 20,000 patients

Andrea Soo, Danny J Zuege, Gordon H Fick, Daniel J Niven, Luc R Berthiaume, Henry T Stelfox, Christopher J Doig, Andrea Soo, Danny J Zuege, Gordon H Fick, Daniel J Niven, Luc R Berthiaume, Henry T Stelfox, Christopher J Doig

Abstract

Background: Multiple organ dysfunction is a common cause of morbidity and mortality in intensive care units (ICUs). Original development of the Sequential Organ Failure Assessment (SOFA) score was not to predict outcome, but to describe temporal changes in organ dysfunction in critically ill patients. Organ dysfunction scoring may be a reasonable surrogate outcome in clinical trials but further exploration of the impact of case mix on the temporal sequence of organ dysfunction is required. Our aim was to compare temporal changes in SOFA scores between hospital survivors and non-survivors.

Methods: We performed a population-based observational retrospective cohort study of critically ill patients admitted from January 1, 2004, to December 31, 2013, to 4 multisystem adult intensive care units (ICUs) in Calgary, Canada. The primary outcome was temporal changes in daily SOFA scores during the first 14 days of ICU admission. SOFA scores were modeled between hospital survivors and non-survivors using generalized estimating equations (GEE) and were also stratified by admission SOFA (≤ 11 versus > 11).

Results: The cohort consisted of 20,007 patients with at least one SOFA score and was mostly male (58.2%) with a median age of 59 (interquartile range [IQR] 44-72). Median ICU length of stay was 3.5 (IQR 1.7-7.5) days. ICU and hospital mortality were 18.5% and 25.5%, respectively. Temporal change in SOFA scores varied by survival and admission SOFA score in a complicated relationship. Area under the receiver operating characteristic (ROC) curve using admission SOFA as a predictor of hospital mortality was 0.77. The hospital mortality rate was 5.6% for patients with an admission SOFA of 0-2 and 94.4% with an admission SOFA of 20-24. There was an approximately linear increase in hospital mortality for SOFA scores of 3-19 (range 8.7-84.7%).

Conclusions: Examining the clinical course of organ dysfunction in a large non-selective cohort of patients provides insight into the utility of SOFA. We have demonstrated that hospital outcome is associated with both admission SOFA and the temporal rate of change in SOFA after admission. It is necessary to further explore the impact of additional clinical factors on the clinical course of SOFA with large datasets.

Keywords: Cohort studies; Critical illness; Intensive care units; Multiple organ failure; Natural history; Organ dysfunction scores.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Hospital mortality by a admission, b maximum, and c highest SOFA scores. SOFA, Sequential Organ Failure Assessment
Fig. 2
Fig. 2
Hospital mortality by a admission, b maximum, and c highest SOFA scores excluding CNS component. CNS, central nervous system; SOFA, Sequential Organ Failure Assessment
Fig. 3
Fig. 3
ad SOFA scores by hospital mortality overall and by subgroups (admission SOFA, period, and LOS). SOFA, Sequential Organ Failure Assessment; LOS, length of stay
Fig. 4
Fig. 4
ac SOFA scores by hospital mortality overall using a nonlinear, b spline, and c categorical GEE models. The points represent results from the piecewise linear GEE model. SOFA, Sequential Organ Failure Assessment
Fig. 5
Fig. 5
ad SOFA scores by ICU mortality overall and by subgroups (admission SOFA, period, and LOS). SOFA, Sequential Organ Failure Assessment; LOS, length of stay
Fig. 6
Fig. 6
Hospital mortality by early change in daily SOFA scores. SOFA, Sequential Organ Failure Assessment
Fig. 7
Fig. 7
ICU mortality by early change in daily SOFA scores. SOFA, Sequential Organ Failure Assessment
Fig. 8
Fig. 8
ROC and PR curves for predictors of hospital and ICU mortality. ROC, receiver operating characteristic; PR, precision-recall

References

    1. Brealey D, Singer M. Multi-organ dysfunction in the critically ill: epidemiology, pathophysiology and management. J R Coll Physicians Lond. 2000;34(5):424–427.
    1. Baue AE. Multiple, progressive, or sequential systems failure: a syndrome of the 1970s. Arch Surg. 1975;110:779–781. doi: 10.1001/archsurg.1975.01360130011001.
    1. Baue AE. Multiple organ failure, multiple organ dysfunction syndrome, and systemic inflammatory response syndrome: why no magic bullets? Arch Surg. 1997;132:703–707. doi: 10.1001/archsurg.1997.01430310017002.
    1. Heard S, Fink M. Multiple organ failure syndrome. Part 1: epidemiology, prognosis, and pathophysiology. J Int Care Med. 1991;6:279–294. doi: 10.1177/088506669100600604.
    1. Deitch EA. Multiple organ failure: pathophysiology and potential future therapy. Ann Surg. 1992;216:117–134. doi: 10.1097/00000658-199208000-00002.
    1. Seely AJE, Christou NV. Multiple organ dysfunction syndrome: exploring the paradigm of complex nonlinear systems. Crit Care Med. 2000;28:2193–2000. doi: 10.1097/00003246-200007000-00003.
    1. Marshal JC. Critical illness is an iatrogenic disorder. Crit Care Med. 2010;38:S582–S589. doi: 10.1097/CCM.0b013e3181f2002a.
    1. Matsuda N, Hattori Y. Systemic inflammatory response syndrome (SIRS): molecular pathophysiology and gene therapy. J Pharmacol Sci. 2006;101:189–198. doi: 10.1254/jphs.CRJ06010X.
    1. Baue AE. MOF, MODS, and SIRS: what is in a name or an acronym? Shock. 2006;26:438–449. doi: 10.1097/01.shk.0000228172.32587.7a.
    1. Vincent J-L, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, et al. The SOFA (sepsis-related organ failure assessment) score to describe organ dysfunction/failure. Intensive Care Med. 1996;22:707–710. doi: 10.1007/BF01709751.
    1. Marshall JC, Cook DJ, Christou NV, Bernard GR, Sprung CL, Sibbald WJ. Multiple organ dysfunction score: a reliable descriptor of a complex clinical outcome. Crit Care Med. 1995;23:1638–1652. doi: 10.1097/00003246-199510000-00007.
    1. Le Gall JR, Lkar J, Lemeshow S, Saulnier F, Alberti C, Artigas A, et al. The logistic organ dysfunction system: a new way to assess organ dysfunction in the intensive care unit. ICU scoring group. JAMA. 1996;276:802–810. doi: 10.1001/jama.1996.03540100046027.
    1. Zygun DA, Doig CJ. Measuring organ dysfunction. In: Vincent J-L, editor. Yearbook of intensive care and emergency medicine. Berlin: Springer-Verlag; 2002.
    1. Lee KS, Sheen SS, Jung YJ, Park RW, Lee YJ, Chung WY, et al. Consideration of additional factors in sequential organ failure assessment score. J Crit Care. 2014;29(1):185.e9–185.e12. doi: 10.1016/j.jcrc.2013.10.006.
    1. de Grooth HJ, Geenen IL, Girbes AR, Vincent JL, Parienti JJ, Oudemans-van Straaten HM. SOFA and mortality endpoints in randomized controlled trials: a systematic review and meta-regression analysis. Crit Care. 2017;21:38. doi: 10.1186/s13054-017-1609-1.
    1. Marshall J. Organ dysfunction as an outcome measure in clinical trials. Eur J Surg Suppl. 1999;584:62–67. doi: 10.1080/11024159950188583.
    1. Minne L, Abu-Hanna A, de Jonge E. Evaluation of SOFA-based models for predicting mortality in the ICU: a systematic review. Crit Care. 2008;12(6):R161. doi: 10.1186/cc7160.
    1. Ferreira FL, Bota DP, Bross A, Mélot C, Vincent JL. Serial evaluation of the SOFA score to predict outcome in critically ill patients. JAMA. 2001;286(14):1754–1758. doi: 10.1001/jama.286.14.1754.
    1. Moreno R, Vincent JL, Matos R, Mendonça A, Cantraine F, Thijs L, et al. The use of maximum SOFA score to quantify organ dysfunction/failure in intensive care. Results of a prospective, multicenter study. Int Care Med. 1999;25:686–696. doi: 10.1007/s001340050931.
    1. Bingold TM, Lefering R, Zacharowski K, Meybohm P, Waydhas C, Rosenberger P, et al. Individual organ failure and concomitant risk of mortality differs according to the type of ICU admission to ICU, a retrospective study of SOFA score of 23,795 patients. PLoS One. 2015;10(8):e0134329. doi: 10.1371/journal.pone.0134329.
    1. Zygun DA, Laupland KB, Fick GH, Sandham JD, Doig CJ. Limited ability of SOFA and MOD scores to discriminate outcome: a prospective evaluation in 1,436 patients. Can J Anaesth. 2005;52(3):302–308. doi: 10.1007/BF03016068.
    1. Christian MD, Hawryluck L, Wax RS, Cook T, Lazar NM, Herridge MS, et al. Development of a triage protocol for critical care during an influenza pandemic. CMAJ. 2006;175:1377–1381. doi: 10.1503/cmaj.060911.
    1. Khan Z, Hulme J, Sherwood N. An assessment of the validity of SOFA score based triage in H1N1 critically ill patients during an influenza pandemic. Anaesthesia. 2009;64:1283–1288. doi: 10.1111/j.1365-2044.2009.06135.x.
    1. Sprung CL, Zimmerman JL, Christian MD, Joynt GM, Hick JL, Taylor B, et al. Recommendations for intensive care unit and hospital preparations for an influenza epidemic or mass disaster. Summary report of the European Society of Intensive Care Medicine’s Task Force for intensive care unit triage during an influenza epidemic or mass disaster. Int Care Med. 2010;36:428–443. doi: 10.1007/s00134-010-1759-y.
    1. Shahpori R, Stelfox HT, Doig CJ, Boiteau PJ, Zygun DA. Sequential organ failure assessment in H1N1 pandemic planning. Crit Care Med. 2011;39(4):827–832. doi: 10.1097/CCM.0b013e318206d548.
    1. Kanter RK. Would triage predictors perform better than first-come, first-served in pandemic ventilator allocation? Chest. 2015;147(1):102–108. doi: 10.1378/chest.14-0564.
    1. Hutchings L, Watkinson P, Young JD, Willett K. Defining multiple organ failure after major trauma: a comparison of the Denver, Sequential Organ Failure Assessment, and Marshal scoring systems. J Trauma and Acute Care Surg. 2017;82(3):534–541. doi: 10.1097/TA.0000000000001328.
    1. Zygun D, Berthiaume L, Laupland K, Kortbeek J, Doig C. SOFA is superior to MOD score for the determination of non-neurologic organ dysfunction in patients with severe traumatic brain injury: a cohort study. Crit Care. 2006;10(4):R115. doi: 10.1186/cc5007.
    1. Zygun DA, Kortbeek JB, Fick GH, Laupland KB, Doig CJ. Non-neurologic organ dysfunction in severe traumatic brain injury. Crit Care Med. 2005;33(3):654–60.
    1. Zygun DA, Doig CJ, Gupta AK, Whiting G, Nicholas C, Shepherd E, et al. Non-neurological organ dysfunction in neurocritical care. J Crit Care. 2003;18(4):238–244. doi: 10.1016/j.jcrc.2003.10.007.
    1. Doig CJ, Zygun DA, Fick GH, Laupland KB, Boiteau PJ, Shahpori R, et al. Study of clinical course of organ dysfunction in intensive care. Crit Care Med. 2004;32(2):384–390. doi: 10.1097/01.CCM.0000108881.14082.10.
    1. Badreldin A, Elsobky S, Lehmann T, Brehm BB, Doenst T, Hekmat K. Daily-mean-SOFA, a new derivative to increase accuracy of mortality prediction in cardiac surgical intensive care units. Thor Cardiovasc Surg. 2012;60(1):43–50.
    1. Holder AL, Overton E, Lyu P, Kempker JA, Nemati S, Razmi F, et al. Serial daily organ failure assessment beyond ICU day 5 does not independently add precision to ICU risk-of-death prediction. Crit Care Med. 2017;45(12):2014–2022. doi: 10.1097/CCM.0000000000002708.
    1. Badawi O, Liu X, Hassan E, Amelung PJ, Swami S. Evaluation of ICU risk models adapted for use as continuous markers of severity of illness throughout the ICU stay. Crit Care Med. 2018;46(3):361–367. doi: 10.1097/CCM.0000000000002904.
    1. Kramer AH, Zygun DA, Doig CJ, Zuege DJ. Incidence of neurologic death among patients with brain injury: a cohort study in a Canadian health region. CMAJ. 2013;185(18):E838–E845. doi: 10.1503/cmaj.130271.
    1. Brundin-Mather R, Soo A, Zuege D, Niven DJ, Fiest K, Doig CJ, et al. Secondary EMR data for quality improvement and research: a comparison of manual and electronic data collection from an integrated critical care electronic medical record system. J Crit Care. 2018;47:295–301. doi: 10.1016/j.jcrc.2018.07.021.
    1. Anami EH, Grion CM, Cardoso LT, Kauss IA, Thomazini MC, Zampa HB, Bonametti AM, Matsuo T. Serial evaluation of SOFA score in a Brazilian teaching hospital. Intensive Crit Care Nurs. 2010;26(20):75–82. doi: 10.1016/j.iccn.2009.10.005.
    1. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1998;44(3):837–845. doi: 10.2307/2531595.
    1. R Core Team . R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2018.
    1. Højsgaard S, Halekoh U, Yan J. The R package geepack for generalized estimating equations. J Stat Softw. 2005;15(2):1–11.
    1. Højsgaard S, Halekoh U (2018). doBy: Groupwise statistics, LSmeans, linear contrasts, utilities. R package version 4.6-2.
    1. Sing T, Sander O, Beerenwinkel N, Lengauer T. ROCR: visualizing classifier performance in R. Bioinformatics. 2005;21(20):3940–3941. doi: 10.1093/bioinformatics/bti623.
    1. Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez JC, Müller M. pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics. 2011;12:77. doi: 10.1186/1471-2105-12-77.
    1. Knox DB, Lanspa MJ, Pratt CM, Kuttler KG, Jones JP, Brown SM. Glasgow coma scale dominates the association between admission sequential organ failure assessment score and 30-day mortality in a mixed intensive care unit population. J Crit Care. 2014;29(5):780–785. doi: 10.1016/j.jcrc.2014.05.009.
    1. Keilwagen J, Grosse I, Grau J. Area under precision-recall curves for weighted and unweighted data. PLoS One. 2014;9(3):e92209. doi: 10.1371/journal.pone.0092209.
    1. Grau J, Grosse I, Keilwagen J. PRROC: computing and visualizing precision-recall and receiver operating characteristic curves in R. Bioinformatics. 2015;31(15):2595–2597. doi: 10.1093/bioinformatics/btv153.
    1. Russell J, Singer J, Bernard G, Wheeler A, Fulkerson W, Hudson L, et al. Changing patterns of organ dysfunction in early human sepsis is related to morbidity. Crit Care Med. 2000;28:3405–3411. doi: 10.1097/00003246-200010000-00005.
    1. Prentice R. Surrogate endpoints in clinical trials: definitions and operational criteria. Stat Med. 1989;8:831–840. doi: 10.1002/sim.4780080407.
    1. Rubenfeld GD. Surrogate measures of patient-centered outcomes in critical care. In: Angus DC, Carlet J, editors. Surviving intensive care. Berlin: Springer; 2003. pp. 169–180.
    1. Vincent JL. Endpoints in sepsis trials: more than just 28-day mortality? Crit Care Med. 2004;32:S209–S213. doi: 10.1097/01.CCM.0000126124.41743.86.
    1. Kleiman DA, Barie PS. Survival in fully manifest multiple organ dysfunction syndrome. Surg Infect. 2014;15(4):445–449. doi: 10.1089/sur.2012.071.
    1. Cabre L, Mancebo J, Solsona JF, Saura P, Gich I, Blanch L, et al. Multicenter study of the multiple organ dysfunction syndrome in intensive care units: the usefulness of sequential organ failure assessment scores in decision making. Int Care Med. 2005;31:927–933. doi: 10.1007/s00134-005-2640-2.
    1. Houthooft R, Ruyssinck J, van der Herten J, Stijven S, Couckuyt I, Gadeyne B, et al. Predictive modelling of survival and length of stay in critically ill patients using sequential organ failure scores. Artif Intell Med. 2015;63(3):191–207. doi: 10.1016/j.artmed.2014.12.009.
    1. Rehman MF, Siddiqui MS. Predicting death and disability, is it really possible? A medical ICU prognostication model study. Crit Care Med. 2014;42:2449–2450. doi: 10.1097/CCM.0000000000000577.
    1. Meadow W, Pohlman A, Reynolds D, Rand L, Correia C, Christoph E, et al. Power and limitations of daily prognostication of death in the medical ICU for outcomes in the following 6 months. Crit Care Med. 2014;42:2387–2392. doi: 10.1097/CCM.0000000000000521.
    1. Hsieh YZ, Su MC, Wang CH, Wang PC. Prediction of survival of ICU patients using computational intelligence. Comp Biol Med. 2014;47:13–19. doi: 10.1016/j.compbiomed.2013.12.012.
    1. Sandri M, Berchialla P, Baldi I, Gregori D, De Blasi RA. Dynamic Bayesian networks to predict sequences of organ failures in patients admitted to ICU. J Biomed Informatics. 2014;48:106–113. doi: 10.1016/j.jbi.2013.12.008.
    1. Sekulic AD, Trpkovic SV, Pavlovic AP, Marinkovic OM, Ilic AN. Scoring systems in assessing survival of critically ill patients. Med Sci Monit. 2015;21:2621–2629. doi: 10.12659/MSM.894153.

Source: PubMed

3
Subscribe