Comparison of Charlson comorbidity index with SAPS and APACHE scores for prediction of mortality following intensive care

Steffen Christensen, Martin Berg Johansen, Christian Fynbo Christiansen, Reinhold Jensen, Stanley Lemeshow, Steffen Christensen, Martin Berg Johansen, Christian Fynbo Christiansen, Reinhold Jensen, Stanley Lemeshow

Abstract

Background: Physiology-based severity of illness scores are often used for risk adjustment in observational studies of intensive care unit (ICU) outcome. However, the complexity and time constraints of these scoring systems may limit their use in administrative databases. Comorbidity is a main determinant of ICU outcome, and comorbidity scores can be computed based on data from most administrative databases. However, limited data exist on the performance of comorbidity scores in predicting mortality of ICU patients.

Objectives: To examine the performance of the Charlson comorbidity index (CCI) alone and in combination with other readily available administrative data and three physiology-based scores (acute physiology and chronic health evaluations [APACHE] II, simplified acute physiology score [SAPS] II, and SAPS III) in predicting short- and long-term mortality following intensive care.

Methods: For all adult patients (n = 469) admitted to a tertiary university-affiliated ICU in 2007, we computed APACHE II, SAPS II, and SAPS III scores based on data from medical records. Data on CCI score age and gender, surgical/medical status, social factors, mechanical ventilation and renal replacement therapy, primary diagnosis, and complete follow-up for 1-year mortality was obtained from administrative databases. We computed goodness-of-fit statistics and c-statistics (area under ROC [receiver operating characteristic] curve) as measures of model calibration (ability to predict mortality proportions over classes of risk) and discrimination (ability to discriminate among the patients who will die or survive), respectively.

Results: Goodness-of-fit statistics supported model fit for in-hospital, 30-day, and 1-year mortality of all combinations of the CCI score. Combining the CCI score with other administrative data revealed c-statistics of 0.75 (95% confidence interval [CI] 0.69-0.81) for in-hospital mortality, 0.75 (95% CI 0.70-0.80) for 30-day mortality, and 0.72 (95% CI 0.68-0.77) for 1-year mortality. There were no major differences in c-statistics between physiology-based systems and the CCI combined with other administrative data.

Conclusion: The CCI combined with administrative data predict short- and long-term mortality for ICU patients as well as physiology-based scores.

Keywords: CCI; ICU; epidemiology; physiology-based scores.

References

    1. Vincent JL. Evidence-based medicine in the ICU: important advances and limitations. Chest. 2004;126(2):592–600.
    1. Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001;29(7):1303–1310.
    1. Barnato AE, Alexander SL, Linde-Zwirble WT, Angus DC. Racial variation in the incidence, care, and outcomes of severe sepsis: analysis of population, patient, and hospital characteristics. Am J Respir Crit Care Med. 2008;177(3):279–284.
    1. Vincent JL, Sakr Y, Sprung C, Harboe S, Damas P. Are blood transfusions associated with greater mortality rates? Results of the Sepsis Occurrence in Acutely Ill Patients study. Anesthesiology. 2008;108(1):31–39.
    1. Vincent JL, Baron JF, Reinhart K, et al. Anemia and blood transfusion in critically ill patients. JAMA. 2002;288(12):1499–1507.
    1. Padkin A, Rowan K, Black N. Using high quality clinical databases to complement the results of randomised controlled trials: the case of recombinant human activated protein C. BMJ. 2001;323(7318):923–926.
    1. Le G, Jr, Lemeshow S, Saulnier F. A new simplified acute physiology score (SAPS II) based on a European/North American multicenter study. JAMA. 1993;270(24):2957–2963.
    1. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med. 1985;13(10):818–829.
    1. Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J. Mortality probability models (MPM II) based on an international cohort of intensive care unit patients. JAMA. 1993;270(20):2478–2486.
    1. Pittet D, Thievent B, Wenzel RP, Li N, Gurman G, Suter PM. Importance of pre-existing co-morbidities for prognosis of septicemia in critically ill patients. Intensive Care Med. 1993;19(5):265–272.
    1. Johnston JA, Wagner DP, Timmons S, Welsh D, Tsevat J, Render ML. Impact of different measures of comorbid disease on predicted mortality of intensive care unit patients. Med Care. 2002;40(10):929–940.
    1. Ho KM, Knuiman M, Finn J, Webb SA. Estimating long-term survival of critically ill patients: the PREDICT model. PLoS ONE. 2008;3(9):e3226.
    1. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–383.
    1. Needham DM, Scales DC, Laupacis A, Pronovost PJ. A systematic review of the Charlson comorbidity index using Canadian administrative databases: a perspective on risk adjustment in critical care research. J Crit Care. 2005;20(1):12–19.
    1. Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45(6):613–619.
    1. Ho KM, Finn J, Knuiman M, Webb SA. Combining multiple comorbidities with Acute Physiology Score to predict hospital mortality of critically ill patients: a linked data cohort study. Anaesthesia. 2007;62(11):1095–1100.
    1. Norena M, Wong H, Thompson WD, Keenan SP, Dodek PM. Adjustment of intensive care unit outcomes for severity of illness and comorbidity scores. J Crit Care. 2006;21(2):142–150.
    1. Poses RM, McClish DK, Smith WR, Bekes C, Scott WE. Prediction of survival of critically ill patients by admission comorbidity. J Clin Epidemiol. 1996;49(7):743–747.
    1. Knaus W, Wagner D, Draper E. APACHE III study design: analytic plan for evaluation of severity and outcome in intensive care unit patients. Implications. Crit Care Med. 1989;17(12 Pt 2):S219–S221.
    1. Andersen TF, Madsen M, Jorgensen J, Mellemkjoer L, Olsen JH. The Danish National Hospital Register. A valuable source of data for modern health sciences. Dan Med Bull. 1999;46(3):263–268.
    1. Frank L. Epidemiology. When an entire country is a cohort. Science. 2000;287(5462):2398–2399.
    1. Afessa B, Keegan MT, Gajic O, Hubmayr RD, Peters SG. The influence of missing components of the Acute Physiology Score of APACHE III on the measurement of ICU performance. Intensive Care Med. 2005;31(11):1537–1543.
    1. Schneeweiss S, Seeger JD, Maclure M, Wang PS, Avorn J, Glynn RJ. Performance of comorbidity scores to control for confounding in epidemiologic studies using claims data. Am J Epidemiol. 2001;154(9):854–864.
    1. Knaus WA, Harrell FE, Jr, Lynn J, et al. The SUPPORT prognostic model. Objective estimates of survival for seriously ill hospitalized adults. Study to understand prognoses and preferences for outcomes and risks of treatments. Ann Intern Med. 1995;122:191–203.
    1. Strand K, Flaatten H. Severity scoring in the ICU: a review. Acta Anaesthesiol Scand. 2008;52:467–478.
    1. Livingston BM, MacKirdy FN, Howie JC, Jones R, Norrie JD. Assessment of the performance of five intensive care scoring models within a large Scottish database. Crit Care Med. 2000;28:1820–1827.

Source: PubMed

Подписаться