Combining Biomarkers with EMR Data to Identify Patients in Different Phases of Sepsis
Ishan Taneja, Bobby Reddy, Gregory Damhorst, Sihai Dave Zhao, Umer Hassan, Zachary Price, Tor Jensen, Tanmay Ghonge, Manish Patel, Samuel Wachspress, Jackson Winter, Michael Rappleye, Gillian Smith, Ryan Healey, Muhammad Ajmal, Muhammad Khan, Jay Patel, Harsh Rawal, Raiya Sarwar, Sumeet Soni, Syed Anwaruddin, Benjamin Davis, James Kumar, Karen White, Rashid Bashir, Ruoqing Zhu, Ishan Taneja, Bobby Reddy, Gregory Damhorst, Sihai Dave Zhao, Umer Hassan, Zachary Price, Tor Jensen, Tanmay Ghonge, Manish Patel, Samuel Wachspress, Jackson Winter, Michael Rappleye, Gillian Smith, Ryan Healey, Muhammad Ajmal, Muhammad Khan, Jay Patel, Harsh Rawal, Raiya Sarwar, Sumeet Soni, Syed Anwaruddin, Benjamin Davis, James Kumar, Karen White, Rashid Bashir, Ruoqing Zhu
Abstract
Sepsis is a leading cause of death and is the most expensive condition to treat in U.S. hospitals. Despite targeted efforts to automate earlier detection of sepsis, current techniques rely exclusively on using either standard clinical data or novel biomarker measurements. In this study, we apply machine learning techniques to assess the predictive power of combining multiple biomarker measurements from a single blood sample with electronic medical record data (EMR) for the identification of patients in the early to peak phase of sepsis in a large community hospital setting. Combining biomarkers and EMR data achieved an area under the receiver operating characteristic (ROC) curve (AUC) of 0.81, while EMR data alone achieved an AUC of 0.75. Furthermore, a single measurement of six biomarkers (IL-6, nCD64, IL-1ra, PCT, MCP1, and G-CSF) yielded the same predictive power as collecting an additional 16 hours of EMR data(AUC of 0.80), suggesting that the biomarkers may be useful for identifying these patients earlier. Ultimately, supervised learning using a subset of biomarker and EMR data as features may be capable of identifying patients in the early to peak phase of sepsis in a diverse population and may provide a tool for more timely identification and intervention.
Conflict of interest statement
Ishan Taneja, Bobby Reddy Jr. and Samuel Waschpress work for Prenosis Inc.. Jackson Winter worked at Prenosis at the time of submission but has since left and is now a graduate student at the University of Illinois at Urbana-Champaign. All other authors report no competing interests.
Figures
References
- Vincent J-L, et al. Assessment of the worldwide burden of critical illness: the Intensive Care Over Nations (ICON) audit. Lancet Respir. Med. 2014;2:380–386. doi: 10.1016/S2213-2600(14)70061-X.
- Cohen J, et al. Sepsis: a roadmap for future research. Lancet Infect. Dis. 2015;15:581–614. doi: 10.1016/S1473-3099(15)70112-X.
- Singer M, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3) JAMA. 2016;315:801. doi: 10.1001/jama.2016.0287.
- Lagu T, et al. Hospitalizations, costs, and outcomes of severe sepsis in the United States 2003 to 2007. Criti. Care Med. 2012;40:754–761. doi: 10.1097/CCM.0b013e318232db65.
- Rivers E, et al. Early goal-directed therapy in the treatment of severe sepsis and septic shock. N. Engl. J. Med. 2001;345:1368–77. doi: 10.1056/NEJMoa010307.
- Dellinger RP, et al. Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Crit. Care Med. 2013;41:580–637. doi: 10.1097/CCM.0b013e31827e83af.
- Novosad SA, et al. Vital Signs: Epidemiology of Sepsis: Prevalence of Health Care Factors and Opportunities for Prevention. MMWR. Morb. Mortal. Wkly. Rep. 2016;65:864–869. doi: 10.15585/mmwr.mm6533e1.
- Mouncey PR, et al. Trial of Early, Goal-Directed Resuscitation for Septic Shock. N. Engl. J. Med. 2015;372:1301–1311. doi: 10.1056/NEJMoa1500896.
- Nguyen SQ, et al. Automated electronic medical record sepsis detection in the emergency department. PeerJ. 2014;2:e343. doi: 10.7717/peerj.343.
- Hooper MH, et al. Randomized trial of automated, electronic monitoring to facilitate early detection of sepsis in the intensive care unit*. Crit. Care Med. 2012;40:2096–2101. doi: 10.1097/CCM.0b013e318250a887.
- Alsolamy S, et al. Diagnostic accuracy of a screening electronic alert tool for severe sepsis and septic shock in the emergency department. BMC Med. Inform. Decis. Mak. 2014;14:105. doi: 10.1186/s12911-014-0105-7.
- Henry, K., Hager, D., Pronovost, P. & Saria, S. A targeted real-time early warning score (TREWScore) for septic shock. Sci. Transl. Med. 7, (2015).
- Tsoukalas A, Albertson T, Tagkopoulos I. From Data to Optimal Decision Making: A Data-Driven, Probabilistic Machine Learning Approach to Decision Support for Patients With Sepsis. JMIR Med. Informatics. 2015;3:e11. doi: 10.2196/medinform.3445.
- Marlin, B. M., Kale, D. C., Khemani, R. G. & Wetzel, R. C. Unsupervised pattern discovery in electronic health care data using probabilistic clustering models. in Proceedings of the 2nd ACM SIGHIT symposium on International health informatics - IHI ’12 DOI:10.1145/2110363.2110408 (2012).
- Gultepe E, et al. From vital signs to clinical outcomes for patients with sepsis: a machine learning basis for a clinical decision support system. J. Am. Med. Informatics Assoc. 2014;21:315–325. doi: 10.1136/amiajnl-2013-001815.
- Pierrakos C, Vincent J-L. Sepsis biomarkers: a review. Crit. Care. 2010;14:R15. doi: 10.1186/cc8872.
- Li S, et al. Neutrophil CD64 expression as a biomarker in the early diagnosis of bacterial infection: a meta-analysis. Int. J. Infect. Dis. 2013;17:e12–e23. doi: 10.1016/j.ijid.2012.07.017.
- Shahkar L, Keshtkar A, Mirfazeli A, Ahani A, Roshandel G. The Role of IL-6 for Predicting Neonatal Sepsis: A Systematic Review and Meta-Analysis. Iranian Journal of Pediatrics. 2011;21:411–417.
- Wacker C, Prkno A, Brunkhorst FM, Schlattmann P. Procalcitonin as a diagnostic marker for sepsis: a systematic review and meta-analysis. Lancet Infect. Dis. 2013;13:426–435. doi: 10.1016/S1473-3099(12)70323-7.
- Docke W-D. Monitoring Temporary Immunodepression by Flow Cytometric Measurement of Monocytic HLA-DR Expression: A Multicenter Standardized Study. Clin. Chem. 2005;51:2341–2347. doi: 10.1373/clinchem.2005.052639.
- Wong HR, et al. A multibiomarker-based outcome risk stratification model for adult septic shock*. Crit. Care Med. 2014;42:781–9. doi: 10.1097/CCM.0000000000000106.
- Oved K, et al. A Novel Host-Proteome Signature for Distinguishing between Acute Bacterial and Viral Infections. PLoS One. 2015;10:e0120012. doi: 10.1371/journal.pone.0120012.
- Gibot S, et al. Combination Biomarkers to Diagnose Sepsis in the Critically Ill Patient. Am. J. Respir. Crit. Care Med. 2012;186:65–71. doi: 10.1164/rccm.201201-0037OC.
- Wong HR, et al. The Temporal Version of the Pediatric Sepsis Biomarker Risk Model. PLoS One. 2014;9:e92121. doi: 10.1371/journal.pone.0092121.
- Shapiro, N. I. et al. A prospective, multicenter derivation of a biomarker panel to assess risk of organ dysfunction, shock, and death in emergency department patients with suspected sepsis. Crit. Care Med. 37 (2009).
- Tsalik EL, et al. Host gene expression classifiers diagnose acute respiratory illness etiology. Sci. Transl. Med. 2016;8:322ra11–322ra11. doi: 10.1126/scitranslmed.aad6873.
- Langley RJ, et al. An Integrated Clinico-Metabolomic Model Improves Prediction of Death in Sepsis. Sci. Transl. Med. 2013;5:195ra95–195ra95. doi: 10.1126/scitranslmed.3005893.
- Samraj RS, Zingarelli B, Wong HR. Role of Biomarkers in Sepsis Care. Shock. 2013;40:358–365. doi: 10.1097/SHK.0b013e3182a66bd6.
- Kobeissi Za, Zanotti-Cavazzoni SL. Biomarkers of sepsis. Yearb. Crit. Care Med. 2010;2010:227–228. doi: 10.1016/S0734-3299(10)79402-8.
- Hastie, T., Tibshirani, R. & Friedman, J. The Elements of Statistical Learning. Elements1, (Springer New York, 2009).
- Chang, Y.-W. & Lin, C.-J. Feature ranking using linear svm. Causation Predict. Challenge, Challenges Mach. Learn. 53–64 (2008).
- Louppe, G., Wehenkel, L., Sutera, A. & Geurts, P. Understanding variable importances in forests of randomized trees. Adv. Neural Inf. Process. Syst. 26, 431–439 doi:NIPS2013_4928 (2013).
- Rhee C, et al. Diagnosing sepsis is subjective and highly variable: a survey of intensivists using case vignettes. Crit. Care. 2016;20:89. doi: 10.1186/s13054-016-1266-9.
- Oda S, et al. Sequential measurement of IL-6 blood levels in patients with systemic inflammatory response syndrome (SIRS)/sepsis. Cytokine. 2005;29:169–175. doi: 10.1016/j.cyto.2004.10.010.
- Otto, G. P. et al. The late phase of sepsis is characterized by an increased microbiological burden and death rate. Crit. Care Doi 10.1186/cc10332 (2013).
- Friedman, J., Hastie, T. & Tibshirani, R. Regularization Paths for Generalized Linear Models via Coordinate Descent. J. Stat. Softw. 33, (2010).
Source: PubMed