LACE+ index: extension of a validated index to predict early death or urgent readmission after hospital discharge using administrative data

Carl van Walraven, Jenna Wong, Alan J Forster, Carl van Walraven, Jenna Wong, Alan J Forster

Abstract

Background: Death or urgent readmission after hospital discharge is a common adverse event that can be used to compare outcomes of care between institutions. To accurately adjust for risk and to allow for interhospital comparisons of readmission rates, we used administrative data to derive and internally validate an extension of the LACE index, a previously validated index for 30-day death or urgent readmission.

Methods: We randomly selected 500 000 medical and surgical patients discharged to the community from any Ontario hospital between 1 April 2003 and 31 March 2009. We derived a logistic regression model on 250 000 randomly selected patients from this group and modified the final model into an index scoring system, the LACE+ index. We internally validated the LACE+ index using data from the remaining 250 000 patients and compared its performance with that of the original LACE index.

Results: Within 30 days of discharge to the community, 33 825 (6.8%) of the patients had died or had been urgently readmitted. In addition to the variables included in the LACE index (length of stay in hospital [L], acuity of admission [A], comorbidity [C] and emergency department utilization in the 6 months before admission [E]), the LACE+ index incorporated patient age and sex, teaching status of the discharge hospital, acute diagnoses and procedures performed during the index admission, number of days on alternative level of care during the index admission, and number of elective and urgent admissions to hospital in the year before the index admission. The LACE+ index was highly discriminative (C statistic 0.771, 95% confidence interval 0.767-0.775), was well calibrated across most of its range of scores and had a model performance that exceeded that of the LACE index.

Interpretation: The LACE+ index can be used to predict the risk of postdischarge death or urgent readmission on the basis of administrative data for the Ontario population. Its performance exceeds that of the LACE index, and it allows analysts to accurately estimate the risk of important postdischarge outcomes.

Conflict of interest statement

Competing interests: None declared.

Figures

Figure 1
Figure 1
Outline for creation of study cohort
Figure 2
Figure 2
Association of transformed continuous covariates and interaction terms in the final logistic regression model with predicted risk of 30-day death or urgent readmission
Figure 3
Figure 3
Distribution and calibration of the LACE+ index by 10-point strata
Table 1
Table 1
Description of study cohort
Table 2
Table 2
Final risk prediction model
Table 3
Table 3
LACE+ scoring system to predict risk of 30-day death or urgent readmission
Table 4
Table 4
Expected and observed probability of 30-day death or urgent readmission in the validation population, by 10-point strata of the LACE+ index
Table 5
Table 5
Performance of the LACE+ index with and without the CMG score
Textbox 1
Textbox 1
Components in the LACE and LACE+ indices

References

    1. Bottle Alex, Aylin Paul, Majeed Azeem. Identifying patients at high risk of emergency hospital admissions: a logistic regression analysis. J R Soc Med. 2006;99(8):406–414. doi: 10.1258/jrsm.99.8.406. .
    1. Billings John, Dixon Jennifer, Mijanovich Tod, Wennberg David. Case finding for patients at risk of readmission to hospital: development of algorithm to identify high risk patients. BMJ. 2006;333(7563):327. doi: 10.1136/. .
    1. Hasan Omar, Meltzer David O, Shaykevich Shimon A, Bell Chaim M, Kaboli Peter J, Auerbach Andrew D, Wetterneck Tosha B, Arora Vineet M, Zhang James, Schnipper Jeffrey L. Hospital readmission in general medicine patients: a prediction model. J Gen Intern Med. 2010;25(3):211–219. doi: 10.1007/s11606-009-1196-1. .
    1. van Carl, Walraven, Dhalla Irfan A, Bell Chaim, Etchells Edward, Stiell Ian G, Zarnke Kelly, Austin Peter C, Forster Alan J. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ. 2010 Mar 1;182(6):551–557. doi: 10.1503/cmaj.091117. .
    1. Quan Hude, Sundararajan Vijaya, Halfon Patricia, Fong Andrew, Burnand Bernard, Luthi Jean-Christophe, Saunders L D, Beck Cynthia A, Feasby Thomas E, Ghali William A. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43(11):1130–1139. doi: 10.1097/01.mlr.0000182534.19832.83. .
    1. van Walraven C, Wong J, Forster A J. Derivation and validation of a diagnostic score based on case-mix groups to predict 30-day death or urgent readmission. Open Med. 2012;6(3):e80–e89.
    1. Scales Damon C, Guan Jun, Martin Claudio M, Redelmeier Donald A. Administrative data accurately identified intensive care unit admissions in Ontario. J Clin Epidemiol. 2006;59(8):802–807. doi: 10.1016/j.jclinepi.2005.11.015. .
    1. Sauerbrei W, Royston P. Building multivariable prognostic and diagnostic models: transformation of the predictors by using fractional polynomials. J R Stat Soc Ser A. 1999;162(1):71–94. doi: 10.1111/1467-985X.00122. .
    1. Sullivan Lisa M, Massaro Joseph M, D'Agostino Ralph B., Sr Presentation of multivariate data for clinical use: The Framingham Study risk score functions. Stat Med. 2004 May 30;23(10):1631–1660. doi: 10.1002/sim.1742. .
    1. Gonen M. Analyzing receiver operating characteristic curves with SAS. Cary (NC): SAS Institute Inc; 2007. Single continuous predictor; pp. 15–36.
    1. Hosmer D W, Hosmer T, Le Cessie S, Lemeshow S. A comparison of goodness-of-fit tests for the logistic regression model. Stat Med. 1997 May 15;16(9):965–980. doi: 10.1002/(SICI)1097-0258(19970515)16:9<965::AID-SIM509>;2-O.
    1. Daly Leslie. Simple SAS macros for the calculation of exact binomial and Poisson confidence limits. Comput Biol Med. 1992;22(5):351–361. doi: 10.1016/0010-4825(92)90023-G. .
    1. Pencina Michael J, D'Agostino Ralph B, Sr, D'Agostino Ralph B, Jr, Vasan Ramachandran S. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008 Jan 30;27(2):157–172. doi: 10.1002/sim.2929. .
    1. Pencina Michael J, D'Agostino Ralph B, Sr, Steyerberg Ewout W. Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med. 2010 Nov 5;30(1):11–21. doi: 10.1002/sim.4085. .
    1. Kramer Andrew A, Zimmerman Jack E. Assessing the calibration of mortality benchmarks in critical care: The Hosmer-Lemeshow test revisited*. Crit Care Med. 2007;35(9):2052–2056. doi: 10.1097/01.CCM.0000275267.64078.B0. .

Source: PubMed

3
구독하다