The ICE-AKI study: Impact analysis of a Clinical prediction rule and Electronic AKI alert in general medical patients

Luke E Hodgson, Paul J Roderick, Richard M Venn, Guiqing L Yao, Borislav D Dimitrov, Lui G Forni, Luke E Hodgson, Paul J Roderick, Richard M Venn, Guiqing L Yao, Borislav D Dimitrov, Lui G Forni

Abstract

Background: Acute kidney injury (AKI) is assoicated with high mortality and measures to improve risk stratification and early identification have been urgently called for. This study investigated whether an electronic clinical prediction rule (CPR) combined with an AKI e-alert could reduce hospital-acquired AKI (HA-AKI) and improve associated outcomes.

Methods and findings: A controlled before-and-after study included 30,295 acute medical admissions to two adult non-specialist hospital sites in the South of England (two ten-month time periods, 2014-16); all included patients stayed at least one night and had at least two serum creatinine tests. In the second period at the intervention site a CPR flagged those at risk of AKI and an alert was generated for those with AKI; both alerts incorporated care bundles. Patients were followed-up until death or hospital discharge. Primary outcome was change in incident HA-AKI. Secondary outcomes in those developing HA-AKI included: in-hospital mortality, AKI progression and escalation of care. On difference-in-differences analysis incidence of HA-AKI reduced (odds ratio [OR] 0.990, 95% CI 0.981-1.000, P = 0.049). In-hospital mortality in HA-AKI cases reduced on difference-in-differences analysis (OR 0.924, 95% CI 0.858-0.996, P = 0.038) and unadjusted analysis (27.46% pre vs 21.67% post, OR 0.731, 95% CI 0.560-0.954, P = 0.021). Mortality in those flagged by the CPR significantly reduced (14% pre vs 11% post intervention, P = 0.008). Outcomes for community-acquired AKI (CA-AKI) cases did not change. A number of process measures significantly improved at the intervention site. Limitations include lack of randomization, and generalizability will require future investigation.

Conclusions: In acute medical admissions a multi-modal intervention, including an electronically integrated CPR alongside an e-alert for those developing HA-AKI improved in-hospital outcomes. CA-AKI outcomes were not affected. The study provides a template for investigations utilising electronically generated prediction modelling. Further studies should assess generalisability and cost effectiveness.

Trial registration: Clinicaltrials.org NCT03047382.

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1. Consort diagram inclusion and exclusions.
Fig 1. Consort diagram inclusion and exclusions.
CA-AKI–Community-acquired AKI, HA-AKI–Hospital-acquired AKI, SCr–serum Creatinine.
Fig 2
Fig 2
Summary of intervention. At the control site no alerts were generated. RED boxes = AKI (community or hospital-acquired), AMBER = APS ≥5 points–cut-off for flagging patient at risk of AKI, GREEN box–all other patients (APS <5 points). HA-AKI–Hospital-acquired AKI, PAS–Patient administration system, SCr–serum creatinine. Patientrack AKI ALERT* ^AKI Prediction Score (APS)–clinical prediction rule.
Fig 3
Fig 3
Top left (A): Patient tile indicating presence and stage of AKI, baseline SCr and care bundle task status; top right (B): electronic observation chart with AKI status (present or at risk) in top right of screen with link to SCr results; bottom left (C): graph of SCr; bottom right (D): AKI care bundle. SCr–serum creatinine. Note that details for illustration only and are not of a real patient.
Fig 4. In-patient mortality in cases who…
Fig 4. In-patient mortality in cases who developed HA-AKI before and after the intervention.
HA-AKI–hospital-acquired AKI, OR–odds ratio (95% CI).
Fig 5. The learning health system–AKI as…
Fig 5. The learning health system–AKI as a case study.
AI–artificial intelligence.

References

    1. KDIGO Clinical Practice Guideline for Acute Kidney Injury. Kidney Int 2012;Suppl 2(1):1–136. Epub 2012/03/01. 10.1038/kisup.2012.6 ; PubMed Central PMCID: PMCPMC4089619.
    1. Susantitaphong P, Cruz DN, Cerda J, Abulfaraj M, Alqahtani F, Koulouridis I, et al. World incidence of AKI: a meta-analysis. Clin J Am Soc Nephrol. 2013;8(9):1482–93. Epub 2013/06/08. 10.2215/CJN.00710113 ; PubMed Central PMCID: PMCPMC3805065.
    1. Joannidis M, Druml W, Forni LG, Groeneveld ABJ, Honore PM, Hoste E, et al. Prevention of acute kidney injury and protection of renal function in the intensive care unit: update 2017: Expert opinion of the Working Group on Prevention, AKI section, European Society of Intensive Care Medicine. Intensive Care Med. 2017;43(6):730–49. Epub 2017/06/04. 10.1007/s00134-017-4832-y ; PubMed Central PMCID: PMCPMC5487598.
    1. Harel Z, Wald R, Bargman JM, Mamdani M, Etchells E, Garg AX, et al. Nephrologist follow-up improves all-cause mortality of severe acute kidney injury survivors. Kidney Int. 2013;83(5):901–8. Epub 2013/01/18. 10.1038/ki.2012.451 .
    1. Mehta RL, Cerda J, Burdmann EA, Tonelli M, Garcia-Garcia G, Jha V, et al. International Society of Nephrology's 0by25 initiative for acute kidney injury (zero preventable deaths by 2025): a human rights case for nephrology. Lancet. 2015;385(9987):2616–43. Epub 2015/03/18. 10.1016/S0140-6736(15)60126-X .
    1. James MT, Hobson CE, Darmon M, Mohan S, Hudson D, Goldstein SL, et al. Applications for detection of acute kidney injury using electronic medical records and clinical information systems: workgroup statements from the 15(th) ADQI Consensus Conference. Can J Kidney Health Dis. 2016;3:9 Epub 2016/03/01. 10.1186/s40697-016-0100-2 ; PubMed Central PMCID: PMCPMC4768328.
    1. Hoste EA, Kashani K, Gibney N, Wilson FP, Ronco C, Goldstein SL, et al. Impact of electronic-alerting of acute kidney injury: workgroup statements from the 15(th) ADQI Consensus Conference. Can J Kidney Health Dis. 2016;3:10 Epub 2016/03/01. 10.1186/s40697-016-0101-1 ; PubMed Central PMCID: PMCPMC4768416.
    1. Royston P, Moons KG, Altman DG, Vergouwe Y. Prognosis and prognostic research: Developing a prognostic model. BMJ. 2009;338:b604 Epub 2009/04/02. 10.1136/bmj.b604 .
    1. Kolhe NV, Staples D, Reilly T, Merrison D, McIntyre CW, Fluck RJ, et al. Impact of Compliance with a Care Bundle on Acute Kidney Injury Outcomes: A Prospective Observational Study. PLoS One. 2015;10(7):e0132279 Epub 2015/07/15. 10.1371/journal.pone.0132279 ; PubMed Central PMCID: PMCPMC4498890.
    1. Kolhe NV, Reilly T, Leung J, Fluck RJ, Swinscoe KE, Selby NM, et al. A simple care bundle for use in acute kidney injury: a propensity score-matched cohort study. Nephrol Dial Transplant. 2016;31(11):1846–54. Epub 2016/11/04. 10.1093/ndt/gfw087 .
    1. Al-Jaghbeer M, Dealmeida D, Bilderback A, Ambrosino R, Kellum JA. Clinical Decision Support for In-Hospital AKI. J Am Soc Nephrol. 2017. Epub 2017/11/04. 10.1681/asn.2017070765 29097621
    1. Wilson FP, Shashaty M, Testani J, Aqeel I, Borovskiy Y, Ellenberg SS, et al. Automated, electronic alerts for acute kidney injury: a single-blind, parallel-group, randomised controlled trial. Lancet. 2015. Epub 2015/03/03. 10.1016/s0140-6736(15)60266-5 .
    1. Stage 3 ‘Directive’ Patient Safety Alert: ‘Standardising the early identification of Acute Kidney Injury’. [Internet]. ; 2014; June [cited 25/11/2015]. Available from:
    1. Lachance P, Villeneuve P-M, Wilson FP, Selby NM, Featherstone R, Rewa O, et al. Impact of e-alert for detection of acute kidney injury on processes of care and outcomes: protocol for a systematic review and meta-analysis. BMJ Open. 2016;6(5):e011152 10.1136/bmjopen-2016-011152 PMC4861089.
    1. Forni LG, Dawes T, Sinclair H, Cheek E, Bewick V, Dennis M, et al. Identifying the patient at risk of acute kidney injury: a predictive scoring system for the development of acute kidney injury in acute medical patients. Nephron Clin Pract. 2013;123(3–4):143–50. Epub 2013/07/28. 10.1159/000351509 .
    1. Hodgson LE, Dimitrov BD, Roderick PJ, Venn R, Forni LG. Predicting AKI in emergency admissions: an external validation study of the acute kidney injury prediction score (APS). BMJ Open. 2017;7(3):e013511 Epub 2017/03/10. 10.1136/bmjopen-2016-013511 ; PubMed Central PMCID: PMCPMC5353262.
    1. Des Jarlais DC, Lyles C, Crepaz N, the TG. Improving the Reporting Quality of Nonrandomized Evaluations of Behavioral and Public Health Interventions: The TREND Statement. American Journal of Public Health. 2004;94(3):361–6. PMC1448256.
    1. Statistics OfN. 2011 Census General Report for England and Wales ONS Statistics OfN; 2011.
    1. Sawhney S, Fluck N, Marks A, Prescott G, Simpson W, Tomlinson L, et al. Acute kidney injury-how does automated detection perform? Nephrol Dial Transplant. 2015;30(11):1853–61. Epub 2015/05/01. 10.1093/ndt/gfv094 ; PubMed Central PMCID: PMCPMC4617372.
    1. Wallace E, Smith SM, Perera-Salazar R, Vaucher P, McCowan C, Collins G, et al. Framework for the impact analysis and implementation of Clinical Prediction Rules (CPRs). BMC Med Inform Decis Mak. 2011;11:62 Epub 2011/10/18. 10.1186/1472-6947-11-62 ; PubMed Central PMCID: PMCPMC3216240.
    1. Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765 Epub 2005/03/16. 10.1136/bmj.38398.500764.8F ; PubMed Central PMCID: PMCPMC555881.
    1. Stiell IG, McKnight RD, Greenberg GH, McDowell I, Nair RC, Wells GA, et al. Implementation of the Ottawa ankle rules. JAMA. 1994;271(11):827–32. Epub 1994/03/16. .
    1. Stiell IG, Wells GA, Hoag RH, Sivilotti ML, Cacciotti TF, Verbeek PR, et al. Implementation of the Ottawa Knee Rule for the use of radiography in acute knee injuries. JAMA. 1997;278(23):2075–9. Epub 1997/12/24. .
    1. Card D, Krueger AB. Minimum wages and employment: A case study of the fast food industry in New Jersey and Pennsylvania National Bureau of Economic Research, 1993.
    1. Ashenfelter OC, Card D. Using the longitudinal structure of earnings to estimate the effect of training programs National Bureau of Economic Research Cambridge, Mass., USA; 1984.
    1. Dimick JB, Ryan AM. Methods for evaluating changes in health care policy: the difference-in-differences approach. JAMA. 2014;312(22):2401–2. Epub 2014/12/10. 10.1001/jama.2014.16153 .
    1. Morris S, Hunter RM, Ramsay AIG, Boaden R, McKevitt C, Perry C, et al. Impact of centralising acute stroke services in English metropolitan areas on mortality and length of hospital stay: difference-in-differences analysis. BMJ: British Medical Journal. 2014;349 10.1136/bmj.g4757
    1. Patel MS, Volpp KG, Small DS, Hill AS, Even-Shoshan O, Rosenbaum L, et al. Association of the 2011 ACGME resident duty hour reforms with mortality and readmissions among hospitalized Medicare patients. JAMA. 2014;312(22):2364–73. Epub 2014/12/10. 10.1001/jama.2014.15273 .
    1. Rajaram R, Chung JW, Jones AT, Cohen ME, Dahlke AR, Ko CY, et al. Association of the 2011 ACGME resident duty hour reform with general surgery patient outcomes and with resident examination performance. JAMA. 2014;312(22):2374–84. Epub 2014/12/10. 10.1001/jama.2014.15277 .
    1. Liang K-Y, Zeger SL. Longitudinal data analysis using generalized linear models. Biometrika. 1986:13–22.
    1. Uchino S. Creatinine. Curr Opin Crit Care. 2010;16(6):562–7. Epub 2010/08/26. 10.1097/MCC.0b013e32833ea7f3 .
    1. Park S, Baek SH, Ahn S, Lee KH, Hwang H, Ryu J, et al. Impact of Electronic Acute Kidney Injury (AKI) Alerts With Automated Nephrologist Consultation on Detection and Severity of AKI: A Quality Improvement Study. Am J Kidney Dis. 2018;71(1):9–19. Epub 2017/07/30. 10.1053/j.ajkd.2017.06.008 .
    1. Awdishu L, Coates CR, Lyddane A, Tran K, Daniels CE, Lee J, et al. The impact of real-time alerting on appropriate prescribing in kidney disease: a cluster randomized controlled trial. J Am Med Inform Assoc. 2016;23(3):609–16. Epub 2015/11/29. 10.1093/jamia/ocv159 .
    1. Boutis K, Grootendorst P, Willan A, Plint AC, Babyn P, Brison RJ, et al. Effect of the Low Risk Ankle Rule on the frequency of radiography in children with ankle injuries. CMAJ. 2013;185(15):E731–8. Epub 2013/08/14. 10.1503/cmaj.122050 ; PubMed Central PMCID: PMCPMC3796622.
    1. McGinn TG, McCullagh L, Kannry J, Knaus M, Sofianou A, Wisnivesky JP, et al. Efficacy of an evidence-based clinical decision support in primary care practices: a randomized clinical trial. JAMA Intern Med. 2013;173(17):1584–91. Epub 2013/07/31. 10.1001/jamainternmed.2013.8980 .
    1. Phansalkar S, Edworthy J, Hellier E, Seger DL, Schedlbauer A, Avery AJ, et al. A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems. Journal of the American Medical Informatics Association: JAMIA. 2010;17(5):493–501. 10.1136/jamia.2010.005264 PMC2995688.
    1. Nightingale PG, Adu D, Richards NT, Peters M. Implementation of rules based computerised bedside prescribing and administration: intervention study. BMJ: British Medical Journal. 2000;320(7237):750–3. PMC27317.
    1. van der Sijs H, Aarts J, Vulto A, Berg M. Overriding of Drug Safety Alerts in Computerized Physician Order Entry. Journal of the American Medical Informatics Association: JAMIA. 2006;13(2):138–47. 10.1197/jamia.M1809 PMC1447540.
    1. Weingart SN, Toth M, Sands DZ, Aronson MD, Davis RB, Phillips RS. Physicians' decisions to override computerized drug alerts in primary care. Arch Intern Med. 2003;163(21):2625–31. Epub 2003/11/26. 10.1001/archinte.163.21.2625 .
    1. Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998;280(15):1339–46. Epub 1998/10/30. .
    1. Kanouse DE, Kallich JD, Kahan JP. Dissemination of effectiveness and outcomes research. Health Policy. 1995;34(3):167–92. Epub 1995/11/04. .
    1. Jaspers MW, Smeulers M, Vermeulen H, Peute LW. Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings. J Am Med Inform Assoc. 2011;18(3):327–34. Epub 2011/03/23. 10.1136/amiajnl-2011-000094 ; PubMed Central PMCID: PMCPMC3078663.
    1. Moxey A, Robertson J, Newby D, Hains I, Williamson M, Pearson S-A. Computerized clinical decision support for prescribing: provision does not guarantee uptake. Journal of the American Medical Informatics Association: JAMIA. 2010;17(1):25–33. 10.1197/jamia.M3170 PMC2995634.
    1. Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L, et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc. 2003;10(6):523–30. Epub 2003/08/20. 10.1197/jamia.M1370 ; PubMed Central PMCID: PMCPMC264429.
    1. Ash JS, Berg M, Coiera E. Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors. Journal of the American Medical Informatics Association: JAMIA. 2004;11(2):104–12. 10.1197/jamia.M1471 PMC353015.
    1. Bliss JP, Dunn MC. Behavioural implications of alarm mistrust as a function of task workload. Ergonomics. 2000;43(9):1283–300. Epub 2000/10/03. 10.1080/001401300421743 .
    1. Wickens CD, Carswell CM. The Proximity Compatibility Principle: Its Psychological Foundation and Relevance to Display Design. Human Factors: The Journal of the Human Factors and Ergonomics Society. 1995;37(3):473–94. 10.1518/001872095779049408
    1. Sanders AF. Some aspects of the selective process in the functional visual field. Ergonomics. 1970;13(1):101–17. Epub 1970/01/01. 10.1080/00140137008931124 .
    1. Poulton EC. Searching for newspaper headlines printed in capitals or lower-case letters. J Appl Psychol. 1967;51(5):417–25. Epub 1967/10/01. .
    1. Braun CC, Silver NC. Interaction of signal word and colour on warning labels: differences in perceived hazard and behavioural compliance. Ergonomics. 1995;38(11):2207–20. Epub 1995/11/01. 10.1080/00140139508925263 .
    1. Kanagasundaram NS, Bevan MT, Sims AJ, Heed A, Price DA, Sheerin NS. Computerized clinical decision support for the early recognition and management of acute kidney injury: a qualitative evaluation of end-user experience. Clinical Kidney Journal. 2016;9(1):57–62. 10.1093/ckj/sfv130 PMC4720208.
    1. McCoy AB, Waitman LR, Gadd CS, Danciu I, Smith JP, Lewis JB, et al. A computerized provider order entry intervention for medication safety during acute kidney injury: a quality improvement report. Am J Kidney Dis. 2010;56(5):832–41. Epub 2010/08/17. 10.1053/j.ajkd.2010.05.024 ; PubMed Central PMCID: PMCPMC2963668.
    1. Isaac T, Weissman JS, Davis RB, Massagli M, Cyrulik A, Sands DZ, et al. Overrides of medication alerts in ambulatory care. Arch Intern Med. 2009;169(3):305–11. Epub 2009/02/11. 10.1001/archinternmed.2008.551 .
    1. Roshanov PS, Fernandes N, Wilczynski JM, Hemens BJ, You JJ, Handler SM, et al. Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials. BMJ. 2013;346:f657 Epub 2013/02/16. 10.1136/bmj.f657 .
    1. Benning A, Dixon-Woods M, Nwulu U, Ghaleb M, Dawson J, Barber N, et al. Multiple component patient safety intervention in English hospitals: controlled evaluation of second phase. BMJ. 2011;342 10.1136/bmj.d199
    1. Brown C, Hofer T, Johal A, Thomson R, Nicholl J, Franklin BD, et al. An epistemology of patient safety research: a framework for study design and interpretation. Part 2. Study design. Quality and Safety in Health Care. 2008;17(3):163–9. 10.1136/qshc.2007.023648
    1. Craig P, Cooper C, Gunnell D, Haw S, Lawson K, Macintyre S, et al. Using natural experiments to evaluate population health interventions: new MRC guidance. Journal of epidemiology and community health. 2012;66(12):1182–6. 10.1136/jech-2011-200375 PMC3796763.
    1. Hospital Episode Statistics, Admitted Patient Care, England—2012–13, . 2013.
    1. Friedman C, Rubin J, Brown J, Buntin M, Corn M, Etheredge L, et al. Toward a science of learning systems: a research agenda for the high-functioning Learning Health System. J Am Med Inform Assoc. 2015;22(1):43–50. Epub 2014/10/25. 10.1136/amiajnl-2014-002977 ; PubMed Central PMCID: PMCPMC4433378.
    1. Digital Infrastructure for the Learning Health System: The Foundation for Continuous Improvement in Health and Health Care: Workshop Series Summary. Grossmann C, Powers B, McGinnis JM, editors. Washington DC: National Academy of Sciences.; 2011.
    1. Greene SM, Reid RJ, Larson EB. Implementing the learning health system: from concept to action. Ann Intern Med. 2012;157(3):207–10. Epub 2012/08/08. 10.7326/0003-4819-157-3-201208070-00012 .

Source: PubMed

Подписаться