Diagnostic accuracy of the 4AT for delirium detection in older adults: systematic review and meta-analysis

Zoë Tieges, Alasdair M J Maclullich, Atul Anand, Claire Brookes, Marica Cassarino, Margaret O'connor, Damien Ryan, Thomas Saller, Rakesh C Arora, Yue Chang, Kathryn Agarwal, George Taffet, Terence Quinn, Susan D Shenkin, Rose Galvin, Zoë Tieges, Alasdair M J Maclullich, Atul Anand, Claire Brookes, Marica Cassarino, Margaret O'connor, Damien Ryan, Thomas Saller, Rakesh C Arora, Yue Chang, Kathryn Agarwal, George Taffet, Terence Quinn, Susan D Shenkin, Rose Galvin

Abstract

Objective: Detection of delirium in hospitalised older adults is recommended in national and international guidelines. The 4 'A's Test (4AT) is a short (<2 minutes) instrument for delirium detection that is used internationally as a standard tool in clinical practice. We performed a systematic review and meta-analysis of diagnostic test accuracy of the 4AT for delirium detection.

Methods: We searched MEDLINE, EMBASE, PsycINFO, CINAHL, clinicaltrials.gov and the Cochrane Central Register of Controlled Trials, from 2011 (year of 4AT release on the website www.the4AT.com) until 21 December 2019. Inclusion criteria were: older adults (≥65 years); diagnostic accuracy study of the 4AT index test when compared to delirium reference standard (standard diagnostic criteria or validated tool). Methodological quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. Pooled estimates of sensitivity and specificity were generated from a bivariate random effects model.

Results: Seventeen studies (3,702 observations) were included. Settings were acute medicine, surgery, a care home and the emergency department. Three studies assessed performance of the 4AT in stroke. The overall prevalence of delirium was 24.2% (95% CI 17.8-32.1%; range 10.5-61.9%). The pooled sensitivity was 0.88 (95% CI 0.80-0.93) and the pooled specificity was 0.88 (95% CI 0.82-0.92). Excluding the stroke studies, the pooled sensitivity was 0.86 (95% CI 0.77-0.92) and the pooled specificity was 0.89 (95% CI 0.83-0.93). The methodological quality of studies varied but was moderate to good overall.

Conclusions: The 4AT shows good diagnostic test accuracy for delirium in the 17 available studies. These findings support its use in routine clinical practice in delirium detection.

Prospero registration number: CRD42019133702.

Keywords: 4AT; delirium; dementia; older patients; screening tool; systematic review.

© The Author(s) 2020. Published by Oxford University Press on behalf of the British Geriatrics Society.

Figures

Figure 1
Figure 1
PRISMA flow chart diagram for the search and study selection process.
Figure 2
Figure 2
Risk of bias and applicability concerns summary (see Appendix S3 for QUADAS-2 assessment criteria).
Figure 3
Figure 3
Hierarchical Summary Receiver Operating Characteristic (HSROC) curve of the 4AT for identifying individuals with delirium.

References

    1. Rieck KM, Pagali S, Miller DM. Delirium in hospitalized older adults. Hosp Pract (1995) 2020; 48: 3–16.
    1. Gibb K, Seeley A, Quinn Tet al. . The consistent burden in published estimates of delirium occurrence in medical inpatients over four decades: a systematic review and meta-analysis study. Age Ageing 2020; 49: 352–60.
    1. Koirala B, Hansen BR, Hosie Aet al. . Delirium point prevalence studies in inpatient settings: a systematic review and meta-analysis. J Clin Nurs 2020; 9: 2083–92.
    1. Wilson JE, Mart MD, Cunningham C, Shehabi Y, Girard T, MacLullich AMJ, Slooter AJC, Ely EW. (In press). Delirium. Nature Reviews Disease Primers.
    1. Scottish Intercollegiate Guidelins Network (SIGN) . Risk reduction and management of delirium. Edinburgh: 2019. . (accessed 10 June 2020).
    1. De J, Wand AP. Delirium screening: a systematic review of delirium screening tools in hospitalized patients. Gerontologist 2015; 55: 1079–99.
    1. Velthuijsen EL, Zwakhalen SM, Warnier RM, Mulder WJ, Verhey FR, Kempen GI. Psychometric properties and feasibility of instruments for the detection of delirium in older hospitalized patients: a systematic review. Int J Geriatr Psychiatry 2016; 31: 974–89.
    1. The 4 “A”s Test. . (accessed 10 June 2020).
    1. Bellelli G, Morandi A, Davis DHet al. . Validation of the 4AT, a new instrument for rapid delirium screening: a study in 234 hospitalised older people. Age Ageing 2014; 43: 496–502.
    1. Shenkin SD, Fox C, Godfrey Met al. . Delirium detection in older acute medical inpatients: a multicentre prospective comparative diagnostic test accuracy study of the 4AT and the confusion assessment method. BMC Med 2019; 17: 138.
    1. National Hip Fracture Database (NHFD). Annual Report 2019. . (accessed 10 June 2020).
    1. Vardy E, Collins N, Grover Uet al. . Use of a digital delirium pathway and quality improvement to improve delirium detection in the emergency department and outcomes in an acute hospital. Age Ageing 2020; 49: 672–8.
    1. Royal College of Physicians . NEWS2: Additional implementation guidance2020. . (accessed 10 June 2020).
    1. Inouye SK, van Dyck CH, Alessi CA, Balkin S, Siegal AP, Horwitz RI. Clarifying confusion: the confusion assessment method. A new method for detection of delirium. Ann Intern Med 1990; 113: 941–8.
    1. Rutjes AW, Reitsma JB, Di Nisio M, Smidt N, Rijn JC, Bossuyt PM. Evidence of bias and variation in diagnostic accuracy studies. CMAJ 2006; 174: 469–76.
    1. Asadollahi A, Saberi M, Entezari M, Hoseini Z, Hasani SA, Saberi LF. Iranian version of 4AT, an instrument for rapid delirium screening for later life. Int J Adv Appl Sci 2016; 3: 33–8.
    1. Chang Y, Oravec N, Kent D, Nugent K, Cornick A, Hiebert B, et al., editors. Validation of the “4AT” delirium screening tool in a cardiac surgery patient population. 9th Annual Meeting of the American Delirium Society; 2019; Boston, Massachusetts, USA.
    1. Gagné A-J, Voyer P, Boucher Vet al. . Performance of the French version of the 4AT for screening the elderly for delirium in the emergency department. CJEM 2018; 20: 903–10.
    1. Kazim R, MacLullich AMJ, Taffet GE, Agarwal KS, editors. 4AT screening tool used by nurses is both sensitive and specific for detection of delirium in hospitalized elders. 7th Annual Meeting of the American Delirium Society; 2016; Nashville, Tennessee, USA.
    1. Myrstad M, Watne LO, Johnsen NT, Bors-Lind E, Neerland BE. Delirium screening in an acute geriatric ward by nurses using 4AT: results from a quality improvement project. Eur Geriatr Med 2019; 10: 667–71.
    1. Saller T, MacLullich AMJ, Schäfer STet al. . Screening for delirium after surgery: validation of the 4 A's test (4AT) in the post-anaesthesia care unit. Anaesthesia 2019; 74: 1260–6.
    1. De J, Wand APF, Smerdely PI, Hunt GE. Validating the 4A's test in screening for delirium in a culturally diverse geriatric inpatient population. Int J Geriatr Psychiatry 2017; 32: 1322–9.
    1. Kuladee S, Prachason T. Development and validation of the Thai version of the 4 'A's test for delirium screening in hospitalized elderly patients with acute medical illnesses. Neuropsychiatr Dis Treat 2016; 12: 437–43.
    1. Al-Jumayli M, Hiner JA, Taffet GE, Agarwal KS. Use of the 4AT to detect delirium in older hospitalized cancer patients. J Am Geriatr Soc 2018; 66: S33.
    1. Saller T, MacLullich AMJ, Perneczky R. The 4AT - an instrument for delirium detection for older patients in the post-anaesthesia care unit. Anaesthesia 2020; 75: 410.
    1. Geriatric Medicine Research Collaborative . Delirium is prevalent in older hospital inpatients and associated with adverse outcomes: results of a prospective multi-centre study on World Delirium Awareness Day. BMC Med 2019; 17: 229.
    1. Mansutti I, Saiani L, Palese A. Detecting delirium in patients with acute stroke: a systematic review of test accuracy. BMC Neurol 2019; 19: 310.
    1. Heinrich TW, Kato H, Emanuel C, Denson S. Improving the validity of nurse-based delirium screening: a head-to-head comparison of Nursing Delirium-Screening Scale and short Confusion Assessment Method. Psychosomatics 2019; 60: 172–8.
    1. Rohatgi N, Weng Y, Bentley Jet al. . Initiative for prevention and early identification of delirium in medical-surgical units: lessons learned in the past five years. Am J Med 2019; 132: 1421–30.
    1. Marcantonio ER, Ngo LH, O'Connor Met al. . 3D-CAM: derivation and validation of a 3-minute diagnostic interview for CAM-defined delirium: a cross-sectional diagnostic test study. Ann Intern Med 2014; 161: 554–61.
    1. Han JH, Wilson A, Graves AJ, Shintani A, Schnelle JF, Ely EW. A quick and easy delirium assessment for nonphysician research personnel. Am J Emerg Med 2016; 34: 1031–6.

Source: PubMed

3
Abonner