A Rapid, Mobile Neurocognitive Screening Test to Aid in Identifying Cognitive Impairment and Dementia (BrainCheck): Cohort Study

Samantha Groppell, Karina M Soto-Ruiz, Benjamin Flores, William Dawkins, Isabella Smith, David M Eagleman, Yael Katz, Samantha Groppell, Karina M Soto-Ruiz, Benjamin Flores, William Dawkins, Isabella Smith, David M Eagleman, Yael Katz

Abstract

Background: The US population over the age of 65 is expected to double by the year 2050. Concordantly, the incidence of dementia is projected to increase. The subclinical stage of dementia begins years before signs and symptoms appear. Early detection of cognitive impairment and/or cognitive decline may allow for interventions to slow its progression. Furthermore, early detection may allow for implementation of care plans that may affect the quality of life of those affected and their caregivers.

Objective: We sought to determine the accuracy and validity of BrainCheck Memory as a diagnostic aid for age-related cognitive impairment, as compared against physician diagnosis and other commonly used neurocognitive screening tests, including the Saint Louis University Mental Status (SLUMS) exam, the Mini-Mental State Examination (MMSE), and the Montreal Cognitive Assessment (MoCA).

Methods: We tested 583 volunteers over the age of 49 from various community centers and living facilities in Houston, Texas. The volunteers were divided into five cohorts: a normative population and four comparison groups for the SLUMS exam, the MMSE, the MoCA, and physician diagnosis. Each comparison group completed their respective assessment and BrainCheck Memory.

Results: A total of 398 subjects were included in the normative population. A total of 84 participants were in the SLUMS exam cohort, 51 in the MMSE cohort, 35 in the MoCA cohort, and 18 in the physician cohort. BrainCheck Memory assessments were significantly correlated to the SLUMS exam, with coefficients ranging from .5 to .7. Correlation coefficients for the MMSE and BrainCheck and the MoCA and BrainCheck were also significant. Of the 18 subjects evaluated by a physician, 9 (50%) were healthy, 6 (33%) were moderately impaired, and 3 (17%) were severely impaired. A significant difference was found between the severely and moderately impaired subjects and the healthy subjects (P=.02). We derived a BrainCheck Memory composite score that showed stronger correlations with the standard assessments as compared to the individual BrainCheck assessments. Receiver operating characteristic (ROC) curve analysis of this composite score found a sensitivity of 81% and a specificity of 94%.

Conclusions: BrainCheck Memory provides a sensitive and specific metric for age-related cognitive impairment in older adults, with the advantages of a mobile, digital, and easy-to-use test.

Trial registration: ClinicalTrials.gov NCT03608722; https://ichgcp.net/clinical-trials-registry/NCT03608722 (Archived by WebCite at http://www.webcitation.org/76JLoYUGf).

Keywords: Alzheimer’s disease; BrainCheck; computerized cognitive assessment; dementia; digital cognitive assessment; digital testing; electronic neurocognitive tools; mild cognitive impairment (MCI); neurocognitive computerized assessment tools (NCAT); neurocognitive tests.

Conflict of interest statement

Conflicts of Interest: BrainCheck Inc provided personal fees in the form of annual salaries for the authors BF, WD, KMSR, YK, and DME; fees for consulting were provided to SG.

©Samantha Groppell, Karina M Soto-Ruiz, Benjamin Flores, William Dawkins, Isabella Smith, David M Eagleman, Yael Katz. Originally published in JMIR Aging (http://aging.jmir.org), 21.03.2019.

Figures

Figure 1
Figure 1
Normative distribution. Distributions of scores for individuals in the normative population are shown for each assessment. The number of normative data points in each distribution is indicated above each panel.
Figure 2
Figure 2
Comparison of BrainCheck assessments with the Saint Louis University Mental Status (SLUMS) exam. Shown are comparisons between SLUMS scores and the scores for each assessment. Each data point represents one participant who took both assessments. Pearson correlation coefficients are indicated above each panel.
Figure 3
Figure 3
Comparison of BrainCheck assessments with the Mini-Mental State Examination (MMSE). Shown are comparisons between MMSE scores and the scores for each assessment. Each data point represents one participant who took both assessments. Pearson correlation coefficients are indicated above each panel.
Figure 4
Figure 4
Comparison of BrainCheck assessments with the Montreal Cognitive Assessment (MoCA). Shown are comparisons between MoCA scores and the scores for each assessment. Each data point represents one participant who took both assessments. Pearson correlation coefficients are indicated above each panel.
Figure 5
Figure 5
Comparison of BrainCheck assessments with physician diagnosis. Shown are mean scores on each assessment for patients classified as healthy or impaired by a physician. P values determined by a two-sided t test are given above each panel.
Figure 6
Figure 6
Comparison between BrainCheck composite score and the Saint Louis University Mental Status (SLUMS) exam.
Figure 7
Figure 7
Comparison between BrainCheck composite score and the Mini-Mental State Examination (MMSE).
Figure 8
Figure 8
Comparison between BrainCheck composite score and the Montreal Cognitive Assessment (MoCA).
Figure 9
Figure 9
Receiver operating characteristic (ROC) curve for comparison between the physician diagnosis and the BrainCheck composite score.
Figure 10
Figure 10
Receiver operating characteristic (ROC) curve for comparison between the Saint Louis University Mental Status (SLUMS) test (cutoff 21) and the BrainCheck composite score.

References

    1. West LA, Cole S, Goodkind D, He W, US Census Bureau . 65+ in the United States: 2010. Washington, DC: US Government Printing Office; 2014. Jun, [2019-03-04]. .
    1. Plassman BL, Langa KM, Fisher GG, Heeringa SG, Weir DR, Ofstedal MB, Burke JR, Hurd MD, Potter GG, Rodgers WL, Steffens DC, Willis RJ, Wallace RB. Prevalence of dementia in the United States: The aging, demographics, and memory study. Neuroepidemiology. 2007;29(1-2):125–132. doi: 10.1159/000109998.
    1. Institute Of Medicine . In: Cognitive Aging: Progress in Understanding and Opportunities for Action. Blazer DG, Yaffe K, Liverman CT, editors. Washington, DC: The National Academies Press; 2015.
    1. Petersen RC, Lopez O, Armstrong MJ, Getchius TSD, Ganguli M, Gloss D, Gronseth GS, Marson D, Pringsheim T, Day GS, Sager M, Stevens J, Rae-Grant A. Practice guideline update summary: Mild cognitive impairment: Report of the Guideline Development, Dissemination, and Implementation Subcommittee of the American Academy of Neurology. Neurology. 2018 Jan 16;90(3):126–135. doi: 10.1212/WNL.0000000000004826.
    1. Mortimer JA, Borenstein AR, Gosche KM, Snowdon DA. Very early detection of Alzheimer neuropathology and the role of brain reserve in modifying its clinical expression. J Geriatr Psychiatry Neurol. 2005 Dec;18(4):218–223. doi: 10.1177/0891988705281869.
    1. Yiannopoulou KG, Papageorgiou SG. Current and future treatments for Alzheimer's disease. Ther Adv Neurol Disord. 2013 Jan;6(1):19–33. doi: 10.1177/1756285612461679.
    1. Petersen RC. Early diagnosis of Alzheimer's disease: Is MCI too late? Curr Alzheimer Res. 2009 Aug;6(4):324–330.
    1. Tariq SH, Tumosa N, Chibnall JT, Perry MH, Morley JE. Comparison of the Saint Louis University mental status examination and the mini-mental state examination for detecting dementia and mild neurocognitive disorder: A pilot study. Am J Geriatr Psychiatry. 2006 Nov;14(11):900–910. doi: 10.1097/01.JGP.0000221510.33817.86.
    1. Folstein MF, Folstein SE, McHugh PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975 Nov;12(3):189–198.
    1. Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, Cummings JL, Chertkow H. The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005 Apr;53(4):695–699. doi: 10.1111/j.1532-5415.2005.53221.x.
    1. Tsoi KKF, Chan JYC, Hirai HW, Wong SYS, Kwok TCY. Cognitive tests to detect dementia: A systematic review and meta-analysis. JAMA Intern Med. 2015 Sep;175(9):1450–1458. doi: 10.1001/jamainternmed.2015.2152.
    1. Szcześniak D, Rymaszewska J. The usfulness of the SLUMS test for diagnosis of mild cognitive impairment and dementia. Psychiatr Pol. 2016;50(2):457–472. doi: 10.12740/PP/OnlineFirst/43141. doi: 10.12740/PP/OnlineFirst/43141.
    1. Cordell CB, Borson S, Boustani M, Chodosh J, Reuben D, Verghese J, Thies W, Fried LB, Medicare Detection of Cognitive Impairment Workgroup Alzheimer's Association recommendations for operationalizing the detection of cognitive impairment during the Medicare Annual Wellness Visit in a primary care setting. Alzheimers Dement. 2013 Mar;9(2):141–150. doi: 10.1016/j.jalz.2012.09.011.
    1. Kaufer DI, Williams CS, Braaten AJ, Gill K, Zimmerman S, Sloane PD. Cognitive screening for dementia and mild cognitive impairment in assisted living: Comparison of 3 tests. J Am Med Dir Assoc. 2008 Oct;9(8):586–593. doi: 10.1016/j.jamda.2008.05.006.
    1. Howland M, Tatsuoka C, Smyth KA, Sajatovic M. Detecting change over time: A comparison of the SLUMS examination and the MMSE in older adults at risk for cognitive decline. CNS Neurosci Ther. 2016 May;22(5):413–419. doi: 10.1111/cns.12515.
    1. Olson RA, Chhanabhai T, McKenzie M. Feasibility study of the Montreal Cognitive Assessment (MoCA) in patients with brain metastases. Support Care Cancer. 2008 Nov;16(11):1273–1278. doi: 10.1007/s00520-008-0431-3.
    1. Harmon KG, Drezner JA, Gammons M, Guskiewicz KM, Halstead M, Herring SA, Kutcher JS, Pana A, Putukian M, Roberts WO. American Medical Society for Sports Medicine position statement: Concussion in sport. Br J Sports Med. 2013 Jan;47(1):15–26. doi: 10.1136/bjsports-2012-091941.
    1. Pezzotti P, Scalmana S, Mastromattei A, Di Lallo D, Progetto Alzheimer Working Group The accuracy of the MMSE in detecting cognitive impairment when administered by general practitioners: A prospective observational study. BMC Fam Pract. 2008 May 13;9:29. doi: 10.1186/1471-2296-9-29.
    1. Ellemberg D, Henry LC, Macciocchi SN, Guskiewicz KM, Broglio SP. Advances in sport concussion assessment: From behavioral to brain imaging measures. J Neurotrauma. 2009 Dec;26(12):2365–2382. doi: 10.1089/neu.2009.0906.
    1. Collie A, Maruff P, Makdissi M, McStephen M, Darby DG, McCrory P. Statistical procedures for determining the extent of cognitive change following concussion. Br J Sports Med. 2004 Jun;38(3):273–278.
    1. Behrens A, Eklund A, Elgh E, Smith C, Williams MA, Malm J. A computerized neuropsychological test battery designed for idiopathic normal pressure hydrocephalus. Fluids Barriers CNS. 2014;11:22. doi: 10.1186/2045-8118-11-22.
    1. Yang S, Flores B, Magal R, Harris K, Gross J, Ewbank A, Davenport S, Ormachea P, Nasser W, Le W, Peacock WF, Katz Y, Eagleman DM. Diagnostic accuracy of tablet-based software for the detection of concussion. PLoS One. 2017;12(7):e0179352. doi: 10.1371/journal.pone.0179352.
    1. Chertkow H, Feldman HH, Jacova C, Massoud F. Definitions of dementia and predementia states in Alzheimer's disease and vascular cognitive impairment: Consensus from the Canadian conference on diagnosis of dementia. Alzheimers Res Ther. 2013 Jul 08;5(Suppl 1):S2. doi: 10.1186/alzrt198.
    1. Bugg JM, Zook NA, DeLosh EL, Davalos DB, Davis HP. Age differences in fluid intelligence: Contributions of general slowing and frontal decline. Brain Cogn. 2006 Oct;62(1):9–16. doi: 10.1016/j.bandc.2006.02.006.
    1. Waltz JA, Knowlton BJ, Holyoak KJ, Boone KB, Back-Madruga C, McPherson S, Masterman D, Chow T, Cummings JL, Miller BL. Relational integration and executive function in Alzheimer's disease. Neuropsychology. 2004 Apr;18(2):296–305. doi: 10.1037/0894-4105.18.2.296.
    1. He W, Goodkind D, Kowal P, US Census Bureau . An Aging World: 2015. Washington, DC: US Government Publishing Office; 2016. Mar, [2019-03-04]. .
    1. Howden LM, Meyer JA. Age and Sex Composition: 2010. Washington, DC: US Census Bureau; 2011. May, [2019-03-04]. .

Source: PubMed

3
Abonner