Manual and automated methods for identifying potentially preventable readmissions: a comparison in a large healthcare system
Ana H Jackson, Emily Fireman, Paul Feigenbaum, Estee Neuwirth, Patricia Kipnis, Jim Bellows, Ana H Jackson, Emily Fireman, Paul Feigenbaum, Estee Neuwirth, Patricia Kipnis, Jim Bellows
Abstract
Background: Identification of potentially preventable readmissions is typically accomplished through manual review or automated classification. Little is known about the concordance of these methods.
Methods: We manually reviewed 459 30-day, all-cause readmissions at 18 Kaiser Permanente Northern California hospitals, determining potential preventability through a four-step manual review process that included a chart review tool, interviews with patients, their families, and treating providers, and nurse reviewer and physician evaluation of findings and determination of preventability on a five-point scale. We reassessed the same readmissions with 3 M's Potentially Preventable Readmission (PPR) software. We examined between-method agreement and the specificity and sensitivity of the PPR software using manual review as the reference.
Results: Automated classification and manual review respectively identified 78% (358) and 47% (227) of readmissions as potentially preventable. Overall, the methods agreed about the preventability of 56% (258) of readmissions. Using manual review as the reference, the sensitivity of PPR was 85% and specificity was 28%.
Conclusions: Concordance between methods was not high enough to replace manual review with automated classification as the primary method of identifying preventable 30-day, all-cause readmission for quality improvement purposes.
References
- Readmissions reduction program. .
- van Walraven C, Jennings A, Forster AJ. A meta-analysis of hospital 30-day avoidable readmission rates. J Eval Clin Pract. 2012;18:1211–1218. doi: 10.1111/j.1365-2753.2011.01773.x.
- Levy A, Alsop K, Hehir M, Lock V, Greenwood R, Tobin G. Hospital readmissions. We'll meet again. Health Serv J. 2000;110:30–31.
- Williams EI, Fitton F. Factors affecting early unplanned readmission of elderly patients to hospital. BMJ. 1988;297:784–787. doi: 10.1136/bmj.297.6651.784.
- van Walraven C, Bennett C, Jennings A, Austin PC, Forster AJ. Proportion of hospital readmissions deemed avoidable: a systematic review. CMAJ. 2011;183:E391–402. doi: 10.1503/cmaj.101860.
- Goldfield N. How important is it to identify avoidable hospital readmissions with certainty? CMAJ. 2011;183:E368–369. doi: 10.1503/cmaj.110448.
- van Walraven C, Jennings A, Taljaard M, Dhalla I, English S, Mulpuru S, Blecker S, Forster AJ. Incidence of potentially avoidable urgent readmissions and their relation to all-cause urgent readmissions. CMAJ. 2011;183:E1067–1072. doi: 10.1503/cmaj.110400.
- Feigenbaum P, Neuwirth E, Trowbridge L, Teplitsky S, Barnes CA, Fireman E, Dorman J, Bellows J. Factors contributing to all-cause 30-day readmissions: a structured case series across 18 hospitals. Med Care. 2012;50:599–605. doi: 10.1097/MLR.0b013e318249ce72.
- STAAR. STate Action on Avoidable Rehospitalizations. .
- Averill RF, Goldfield NI, Muldoon J, Steinbeck BA, Grant TM. A closer look at all-patient refined DRGs. J AHIMA. 2002;73:46–50.
- Goldfield NI, McCullough EC, Hughes JS, Tang AM, Eastman B, Rawlins LK, Averill RF. Identifying potentially preventable readmissions. Health Care Financ Rev. 2008;30:75–91.
- Jencks SF, Williams MV, Coleman EA. Rehospitalizations among patients in the Medicare fee-for-service program. N Engl J Med. 2009;360:1418–1428. doi: 10.1056/NEJMsa0803563.
- America's Health Insurance Plans. Reductions in hospital days, re-admissions, and potentially avoidable admissions among Medicare Advantage enrollees in California and Nevada. Washington, DC: AHIP Center for Policy and Research; 2009.
- Krumholz HM. Post-hospital syndrome–an acquired, transient condition of generalized risk. N Engl J Med. 2013;368:100–102. doi: 10.1056/NEJMp1212324.
- Yam CH, Wong EL, Chan FW, Wong FY, Leung MC, Yeoh EK. Measuring and preventing potentially avoidable hospital readmissions: a review of the literature. Hong Kong Med J. 2010;16:383–389.
- Gay J, Agrawal R, Del Beccaro M, Eghtesady P, Feildston ES, Golias J, Hain P, McClead RE, Morse RB, Neuman MI, Harris JM, Simon H, Tejedor-Soto J, Teufel R, Shah S. Rates and impact of potentially preventable readmissions at children's hospitals [abstract] Am Acad Pediatr. 2013. .
- Validating and classifying VA readmissions for quality assessment and improvement. .
- Mull HJ, Chen Q, O'Brien WJ, Shwartz M, Borzecki AM, Hanchate A, Rosen AK. Comparing 2 methods of assessing 30-Day readmissions: what is the impact on hospital profiling in the veterans health administration? Med Care. 2013;51:589–596. doi: 10.1097/MLR.0b013e31829019a4.
Source: PubMed