Development and validation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for intensive care patients: observational multicentre study

M van den Boogaard, P Pickkers, A J C Slooter, M A Kuiper, P E Spronk, P H J van der Voort, J G van der Hoeven, R Donders, T van Achterberg, L Schoonhoven, M van den Boogaard, P Pickkers, A J C Slooter, M A Kuiper, P E Spronk, P H J van der Voort, J G van der Hoeven, R Donders, T van Achterberg, L Schoonhoven

Abstract

Objectives: To develop and validate a delirium prediction model for adult intensive care patients and determine its additional value compared with prediction by caregivers.

Design: Observational multicentre study.

Setting: Five intensive care units in the Netherlands (two university hospitals and three university affiliated teaching hospitals).

Participants: 3056 intensive care patients aged 18 years or over.

Main outcome measure: Development of delirium (defined as at least one positive delirium screening) during patients' stay in intensive care.

Results: The model was developed using 1613 consecutive intensive care patients in one hospital and temporally validated using 549 patients from the same hospital. For external validation, data were collected from 894 patients in four other hospitals. The prediction (PRE-DELIRIC) model contains 10 risk factors-age, APACHE-II score, admission group, coma, infection, metabolic acidosis, use of sedatives and morphine, urea concentration, and urgent admission. The model had an area under the receiver operating characteristics curve of 0.87 (95% confidence interval 0.85 to 0.89) and 0.86 after bootstrapping. Temporal validation and external validation resulted in areas under the curve of 0.89 (0.86 to 0.92) and 0.84 (0.82 to 0.87). The pooled area under the receiver operating characteristics curve (n=3056) was 0.85 (0.84 to 0.87). The area under the curve for nurses' and physicians' predictions (n=124) was significantly lower at 0.59 (0.49 to 0.70) for both.

Conclusion: The PRE-DELIRIC model for intensive care patients consists of 10 risk factors that are readily available within 24 hours after intensive care admission and has a high predictive value. Clinical prediction by nurses and physicians performed significantly worse. The model allows for early prediction of delirium and initiation of preventive measures. Trial registration Clinical trials NCT00604773 (development study) and NCT00961389 (validation study).

Conflict of interest statement

Competing interests: All authors have completed the Unified Competing Interest form at http://www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.

Figures

https://www.ncbi.nlm.nih.gov/pmc/articles/instance/4789962/bin/vanm834275.f1_default.jpg
Fig 1 Flow chart of development and temporal validation study
https://www.ncbi.nlm.nih.gov/pmc/articles/instance/4789962/bin/vanm834275.f2_default.jpg
Fig 2 Area under receiver operating characteristics curve (AUROC) of pooled data for development (AUROC=0.86), temporal validation (AUROC=0.89), and external validation (AUROC=0.84), resulting in AUROC of 0.85. AUROC was 0.59 (95% CI 0.49 to 0.70) for prediction by nurses and 0.59 (0.49 to 0.70) for prediction by physicians
https://www.ncbi.nlm.nih.gov/pmc/articles/instance/4789962/bin/vanm834275.f3_default.jpg
Fig 3 Calibration plot of pooled data, with calibration slope of 0.93 and intercept of −0.29

References

    1. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-IV). 4th ed. APA, 1994.
    1. Dubois MJ, Bergeron N, Dumont M, Dial S, Skrobik Y. Delirium in an intensive care unit: a study of risk factors. Intensive Care Med 2001;27:1297-304.
    1. Ely EW, Gautam S, Margolin R, Francis J, May L, Speroff T, et al. The impact of delirium in the intensive care unit on hospital length of stay. Intensive Care Med 2001;27:1892-900.
    1. Ouimet S, Kavanagh BP, Gottfried SB, Skrobik Y. Incidence, risk factors and consequences of ICU delirium. Intensive Care Med 2007;33:66-73.
    1. Milbrandt EB, Deppen S, Harrison PL, Shintani AK, Speroff T, Stiles RA, et al. Costs associated with delirium in mechanically ventilated patients. Crit Care Med 2004;32:955-62.
    1. Luetz A, Heymann A, Radtke FM, Chenitir C, Neuhaus U, Nachtigall I, et al. Different assessment tools for intensive care unit delirium: which score to use? Crit Care Med 2010;38:409-18.
    1. Van Eijk MJ, van Marum RJ, Klijn I, de Wit N, Kesecioglu J, Slooter AJC. Comparison of delirium assessment tools in a mixed intensive care unit. Crit Care Med 2009;37:1881-5.
    1. Koster S, Hensens AG, Oosterveld FG, Wijma A, van der Palen J. The delirium observation screening scale recognizes delirium early after cardiac surgery. Eur J Cardiovasc Nurs 2009;8:309-14.
    1. Spronk PE, Riekerk B, Hofhuis J, Rommes JH. Occurrence of delirium is severely underestimated in the ICU during daily care. Intensive Care Med 2009;35:1276-80.
    1. Van den Boogaard M, Pickkers P, van der Hoeven H, Roodbol G, van Achterberg T, Schoonhoven L. Implementation of a delirium assessment tool in the ICU can influence haloperidol use. Crit Care 2009;13:R131.
    1. Inouye SK, Bogardus ST Jr, Charpentier PA, Leo-Summers L, Acampora D, Holford TR, et al. A multicomponent intervention to prevent delirium in hospitalized older patients. N Engl J Med 1999;340:669-76.
    1. Kalisvaart KJ, de Jonghe JF, Bogaards MJ, Vreeswijk R, Egberts TC, Burger BJ, et al. Haloperidol prophylaxis for elderly hip-surgery patients at risk for delirium: a randomized placebo-controlled study. J Am Geriatr Soc 2005;53:1658-66.
    1. Inouye SK, Viscoli CM, Horwitz RI, Hurst LD, Tinetti ME. A predictive model for delirium in hospitalized elderly medical patients based on admission characteristics. Ann Intern Med 1993;119:474-81.
    1. Inouye SK, Zhang Y, Jones RN, Kiely DK, Yang F, Marcantonio ER. Risk factors for delirium at discharge: development and validation of a predictive model. Arch Intern Med 2007;167:1406-13.
    1. Pisani MA, Murphy TE, Van Ness PH, Araujo KL, Inouye SK. Characteristics associated with delirium in older patients in a medical intensive care unit. Arch Intern Med 2007;167:1629-34.
    1. Altman DG, Royston P. What do we mean by validating a prognostic model? Stat Med 2000;19:453-73.
    1. Vreeswijk R, Toornvliet A, Honing M, Bakker K, de Man T, Daas G, et al. Validation of the Dutch version of the confusion assessment method (CAM-ICU) for delirium screening in the intensive care unit. Netherlands Journal of Critical Care 2009;13:73-8.
    1. Van Rompaey B, Schuurmans MJ, Shortridge-Baggett LM, Truijen S, Bossaert L. Risk factors for intensive care delirium: a systematic review. Intensive Crit Care Nurs 2008;24:98-107.
    1. Arts D, de Keizer NF, Scheffer GJ, de Jonge E. Quality of data collected for severity of illness scores in the Dutch National Intensive Care Evaluation (NICE) registry. Intensive Care Med 2002;28:656-9.
    1. Inouye SK, Leo-Summers L, Zhang Y, Bogardus ST Jr, Leslie DL, Agostini JV. A chart-based method for identification of delirium: validation compared with interviewer ratings using the confusion assessment method. J Am Geriatr Soc 2005;53:312-8.
    1. Steyerberg EW. Clinical prediction models: a practical approach to development, validation, and updating. Springer Science+Business Media, 2009.
    1. R Development Core Team. R: a language and environment for statistical computing. R Foundation for Statistical Computing, 2009.
    1. Harrell FE Jr, with contributions from many other users. The Hmisc package. Harrell Miscellaneous, 2009.
    1. McCaffrey R, Locsin R. The effect of music on pain and acute confusion in older adults undergoing hip and knee surgery. Holist Nurs Pract 2006;20:218-24.
    1. Devlin JW, Skrobik Y. Antipsychotics for the prevention and treatment of delirium in the intensive care unit: what is their role? Harv Rev Psychiatry 2011;19:59-67.
    1. Schweickert WD, Pohlman MC, Pohlman AS, Nigos C, Pawlik AJ, Esbrook CL, et al. Early physical and occupational therapy in mechanically ventilated, critically ill patients: a randomised controlled trial. Lancet 2009;373:1874-82.
    1. Ely EW, Inouye SK, Bernard GR, Gordon S, Francis J, May L, et al. Delirium in mechanically ventilated patients: validity and reliability of the confusion assessment method for the intensive care unit (CAM-ICU). JAMA 2001;286:2703-10.
    1. Ely EW, Margolin R, Francis J, May L, Truman B, Dittus R, et al. Evaluation of delirium in critically ill patients: validation of the confusion assessment method for the intensive care unit (CAM-ICU). Crit Care Med 2001;29:1370-9.
    1. Van Eijk MM, van den Boogaard M, van Marum RJ, Benner P, Eikelenboom P, Honing ML, et al. Routine use of the confusion assessment method for the intensive care unit: a multicenter study. Am J Respir Crit Care Med 2011;184:340-4.
    1. Aldemir M, Ozen S, Kara IH, Sir A, Bac B. Predisposing factors for delirium in the surgical intensive care unit. Crit Care 2001;5:265-70.
    1. Oldenbeuving AW, de Kort PL, Jansen BP, Roks G, Kappelle LJ. Delirium in acute stroke: a review. Int J Stroke 2007;2:270-5.
    1. McNicoll L, Pisani MA, Zhang Y, Ely EW, Siegel MD, Inouye SK. Delirium in the intensive care unit: occurrence and clinical course in older patients. J Am Geriatr Soc 2003;51:591-8.

Source: PubMed

Patrocinadores y Colaboradores

Condiciones médicas

Intervenciones de drogas

3
Suscribir