Development and validation of a prognostic 40-day mortality risk model among hospitalized patients with COVID-19

Donald A Berry, Andrew Ip, Brett E Lewis, Scott M Berry, Nicholas S Berry, Mary MrKulic, Virginia Gadalla, Burcu Sat, Kristen Wright, Michelle Serna, Rashmi Unawane, Katerina Trpeski, Michael Koropsak, Puneet Kaur, Zachary Sica, Andrew McConnell, Urszula Bednarz, Michael Marafelias, Andre H Goy, Andrew L Pecora, Ihor S Sawczuk, Stuart L Goldberg, Donald A Berry, Andrew Ip, Brett E Lewis, Scott M Berry, Nicholas S Berry, Mary MrKulic, Virginia Gadalla, Burcu Sat, Kristen Wright, Michelle Serna, Rashmi Unawane, Katerina Trpeski, Michael Koropsak, Puneet Kaur, Zachary Sica, Andrew McConnell, Urszula Bednarz, Michael Marafelias, Andre H Goy, Andrew L Pecora, Ihor S Sawczuk, Stuart L Goldberg

Abstract

Objectives: The development of a prognostic mortality risk model for hospitalized COVID-19 patients may facilitate patient treatment planning, comparisons of therapeutic strategies, and public health preparations.

Methods: We retrospectively reviewed the electronic health records of patients hospitalized within a 13-hospital New Jersey USA network between March 1, 2020 and April 22, 2020 with positive polymerase chain reaction results for SARS-CoV-2, with follow-up through May 29, 2020. With death or hospital discharge by day 40 as the primary endpoint, we used univariate followed by stepwise multivariate proportional hazard models to develop a risk score on one-half the data set, validated on the remainder, and converted the risk score into a patient-level predictive probability of 40-day mortality based on the combined dataset.

Results: The study population consisted of 3123 hospitalized COVID-19 patients; median age 63 years; 60% were men; 42% had >3 coexisting conditions. 713 (23%) patients died within 40 days of hospitalization for COVID-19. From 22 potential candidate factors 6 were found to be independent predictors of mortality and were included in the risk score model: age, respiratory rate ≥25/minute upon hospital presentation, oxygenation <94% on hospital presentation, and pre-hospital comorbidities of hypertension, coronary artery disease, or chronic renal disease. The risk score was highly prognostic of mortality in a training set and confirmatory set yielding in the combined dataset a hazard ratio of 1.80 (95% CI, 1.72, 1.87) for one unit increases. Using observed mortality within 20 equally sized bins of risk scores, a predictive model for an individual's 40-day risk of mortality was generated as -14.258 + 13.460*RS + 1.585*(RS-2.524)^2-0.403*(RS-2.524)^3. An online calculator of this 40-day COVID-19 mortality risk score is available at www.HackensackMeridianHealth.org/CovidRS.

Conclusions: A risk score using six variables is able to prognosticate mortality within 40-days of hospitalization for COVID-19.

Trial registration: Clinicaltrials.gov Identifier: NCT04347993.

Conflict of interest statement

The authors declare no conflicts of interest. Authors DAB and SMB are co-owners and NSB is an employee of Berry Consultants, LLC, a company that designs and analyses clinical trials for pharmaceutical and medical device companies, NIH cooperative groups, patient advocacy groups, and international consortia. Berry Consultants received no funding related to this project. This does not alter our adherence to PLOS ONE policies on sharing data and materials.

Figures

Fig 1. Relationship between age cubed and…
Fig 1. Relationship between age cubed and 40-day mortality.
Fig 2. 40-day mortality based on risk…
Fig 2. 40-day mortality based on risk score.
40-day mortality among COVID-19 patients in the training and confirmatory sets as divided into bins of 20 patients of ascending mean Risk Scores. Bins 6, 11, and 16 contain 157 patients each and all other bins have 156 patients.
Fig 3. Patient mortality risk by day…
Fig 3. Patient mortality risk by day 40 using a proportional hazards model.
Fig 4. Patient-specific risk of mortality by…
Fig 4. Patient-specific risk of mortality by day 40 using actual mortality in datasets.

References

    1. Petrilli CM, Jones SA, Yang J, et al.. Factors associated with hospitalization and critical illness among 4,103 patients with COVID-19 disease in New York City. BMJ 369: m1966 (2020) doi: 10.1136/bmj.m1966
    1. Richardson S, Hirsch JS, Narasimhan M, et al.. Presenting Characteristics, Comorbidities, and Outcomes Among 5700 Patients Hospitalized With COVID-19 in the New York City Area. JAMA. 323:2052–2059. (2020) doi: 10.1001/jama.2020.6775
    1. Garg S, Kim L, Whitaker M, et al.. Hospitalization Rates and Characteristics of Patients Hospitalized with Laboratory-Confirmed Coronavirus Disease 2019—COVID-NET, 14 States, March 1–30, 2020. MMWR Morb Mortal Wkly Rep 69:458–464. (2020) doi: 10.15585/mmwr.mm6915e3
    1. New York State Department of Health. COVID-19 Tracker. (June 3, 2021
    1. Knaus WA, Draper EA, Wagner DP. APACHE II: a severity of disease classification system. Crit Care Med. 13:818–29. (1985)
    1. Le Gall JR, Lemeshow S, Saulnier F. A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA. 270:2957–63. (1993) doi: 10.1001/jama.270.24.2957
    1. Vincent JL, de Mendonça A, Cantraine F, et al.. Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units: results of a multicenter, prospective study. Working group on "sepsis-related problems" of the European Society of Intensive Care Medicine. Crit Care Med. 26:1793–800 (1998) doi: 10.1097/00003246-199811000-00016
    1. Wynants L, Van Calster B, Bonten M, et al.. Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal BMJ 369:m1328 (2020) doi: 10.1136/bmj.m1328
    1. Liang W, Liang H, Ou L, et al.. Development and Validation of a Clinical Risk Score to Predict the Occurrence of Critical Illness in Hospitalized Patients With COVID-19. JAMA Intern Med. 180:1081–1089. (2020) doi: 10.1001/jamainternmed.2020.2033
    1. Knight SR, Ho A, Pius R, et al.. Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: development and validation of the 4C Mortality Score BMJ 370:m3339. (2020) doi: 10.1136/bmj.m3339
    1. Salto-Alejandre S, Roca-Oporto C, Martín-Gutiérrez G, et al.. A quick prediction tool for unfavourable outcome in COVID-19 inpatients: development and internal validation. J Infection September 24, 2020. (2020) doi: 10.1016/j.jinf.2020.09.023
    1. Brurberg KG, Fretheim A. COVID-19: The relationship between age, comorbidity and disease severity—a rapid review, 1st update. [COVID-19: Sammenheng mellom alder, komorbiditet ogsykdomsalvorlighet—en hurtigoversikt, første oppdatering. Hurtigoversikt 2020.] Oslo: Norwegian Institute of Public Health, 2020.
    1. Di Castelnuovo A, Bonaccio M, Costanzo S et al.. COvid-19 RISk and Treatments (CORIST) collaboration. Common cardiovascular risk factors and in-hospital mortality in 3,894 patients with COVID-19: survival analysis and machine learning-based findings from the multicentre Italian CORIST Study. Nutr Metab Cardiovasc Dis. 30(11):1899–1913. (2020) doi: 10.1016/j.numecd.2020.07.031
    1. Moons KG, Altman DG, Reitsma JB, et al.. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 162:W1–73. (2015) doi: 10.7326/M14-0698
    1. Ip A, Berry DA, Hansen E, et al.. Hydroxychloroquine and tocilizumab therapy in COVID-19 patients—An observational study. PLoS ONE 15: e0237693. (2020) doi: 10.1371/journal.pone.0237693
    1. Biran N, Ip A, Ahn J, et al.. Tocilizumab among patients with COVID-19 in the intensive care unit: a multicentre observational study. Lancet Rheumatol. 2: e603–e612. (2020) doi: 10.1016/S2665-9913(20)30277-0

Source: PubMed

3
Abonnere