Digital biomarker-based individualized prognosis for people at risk of dementia

Maximilian Buegler, Robbert Harms, Mircea Balasa, Irene B Meier, Themis Exarchos, Laura Rai, Rory Boyle, Adria Tort, Maha Kozori, Eutuxia Lazarou, Michaela Rampini, Carlo Cavaliere, Panagiotis Vlamos, Magda Tsolaki, Claudio Babiloni, Andrea Soricelli, Giovanni Frisoni, Raquel Sanchez-Valle, Robert Whelan, Emilio Merlo-Pich, Ioannis Tarnanas, Maximilian Buegler, Robbert Harms, Mircea Balasa, Irene B Meier, Themis Exarchos, Laura Rai, Rory Boyle, Adria Tort, Maha Kozori, Eutuxia Lazarou, Michaela Rampini, Carlo Cavaliere, Panagiotis Vlamos, Magda Tsolaki, Claudio Babiloni, Andrea Soricelli, Giovanni Frisoni, Raquel Sanchez-Valle, Robert Whelan, Emilio Merlo-Pich, Ioannis Tarnanas

Abstract

Background: Research investigating treatments and interventions for cognitive decline fail due to difficulties in accurately recognizing behavioral signatures in the presymptomatic stages of the disease. For this validation study, we took our previously constructed digital biomarker-based prognostic models and focused on generalizability and robustness of the models.

Method: We validated prognostic models characterizing subjects using digital biomarkers in a longitudinal, multi-site, 40-month prospective study collecting data in memory clinics, general practitioner offices, and home environments.

Results: Our models were able to accurately discriminate between healthy subjects and individuals at risk to progress to dementia within 3 years. The model was also able to differentiate between people with or without amyloid neuropathology and classify fast and slow cognitive decliners with a very good diagnostic performance.

Conclusion: Digital biomarker prognostic models can be a useful tool to assist large-scale population screening for the early detection of cognitive impairment and patient monitoring over time.

Keywords: Altoida Neuro Motor Index; Alzheimer's disease; artificial intelligence; augmented reality; cognitive aging; digital biomarker; machine learning; risk prediction.

Conflict of interest statement

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this article.The authors declare the following financial interests/personal relationships which may be considered potential competing interests:

© 2020 The Authors. Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring published by Wiley Periodicals, Inc. on behalf of the Alzheimer's Association.

Figures

FIGURE 1
FIGURE 1
Visual representation of three motor features during augmented reality task. Visual representation of three features (out of 109 key functional motor behaviors) corresponding to the “distribution of the path complexity when finding the augmented reality objects” (see Table S1). LEFT PANEL, Typical digital phenotype of mild cognitive impairment (MCI) subjects that will remain stable over time (n = 113). RIGHT PANEL, Typical digital phenotype of MCI that would progress to dementia over time for a period of 3 years
FIGURE 2
FIGURE 2
Flowchart showing methodology for training and evaluating machine learning models
FIGURE 3
FIGURE 3
Receiver operating characteristic (ROC) curves for internal cross‐validated results of predicting mild cognitive impairment (MCI) to dementia. Internally five‐fold cross‐validated ROC‐area under the curve (AUC) curves AUC‐ROC analysis, in identifying MCI subjects that progress to dementia in a 3‐year period. LEFT PANEL, Assessment versus MCI subjects that will remain stable over time (n = 113). RIGHT PANEL, Assessment versus the combined population of MCI and healthy control subjects that will remain stable over time for a period of 3 years
FIGURE 4
FIGURE 4
Receiver operating characteristic (ROC) curves for internal cross‐validated results of predicting amnestic mild cognitive impairment (aMCI) to Alzheimer's disease (AD) dementia. Internally five‐fold cross‐validated ROC curves predicting the conversion of subjects with aMCI to dementia due to AD versus a stable pooled population of non‐converters (LEFT PANEL) and predicting aMCI subject undergoing rapid conversion (

FIGURE 5

Individual performance of cognitive domains.…

FIGURE 5

Individual performance of cognitive domains. Individual performance in each cognitive domain engaged by…

FIGURE 5
Individual performance of cognitive domains. Individual performance in each cognitive domain engaged by the Neuro Motor Index neuro‐motor parameters most critically involved in the Altoida iADL task performance that predict the conversion into either dementia (LEFT PANEL) or Alzheimer's disease dementia (RIGHT PANEL). The standard deviation is computed over five cross‐validation folds
FIGURE 5
FIGURE 5
Individual performance of cognitive domains. Individual performance in each cognitive domain engaged by the Neuro Motor Index neuro‐motor parameters most critically involved in the Altoida iADL task performance that predict the conversion into either dementia (LEFT PANEL) or Alzheimer's disease dementia (RIGHT PANEL). The standard deviation is computed over five cross‐validation folds

References

    1. Vos SJB, Verhey F, Frölic L, et al. Prevalence and prognosis of Alzheimer's disease at the mild cognitive impairment stage. Brain. 2015;138(Pt 5):1327‐1338.
    1. Michaud TL, Su D, Siahpush M, Murman DL. The risk of incident mild cognitive impairment and progression to dementia considering mild cognitive impairment subtypes. Dement Geriatr Cogn Dis Extra. 2017;7(1):15‐29.
    1. Fleisher AS, Sowell BB, Taylor C, et al. Clinical predictors of progression to Alzheimer disease in amnestic mild cognitive impairment. Neurology. 2007;68(19):1588‐1595.
    1. van Maurik IS, Zwan MD, Tijms BM, et al. Interpreting biomarker results in individual patients with mild cognitive impairment in the Alzheimer's biomarkers in daily practice (ABIDE) project. JAMA Neurol. 2017;74(12):1481‐1491.
    1. Petersen RC, Lopez O, Armstrong MJ, et al. Practice guideline update summary: mild cognitive impairment. Report of the Guideline Development, Dissemination, and Implementation Subcommittee of the American Academy of Neurology. Neurology. 2018;90(3):126‐135.
    1. Bhagwat N, Viviano JD, Voineskos AN, Chakravarty MM, Alzheimer's Disease Neuroimaging Initiative . Modeling and prediction of clinical symptom trajectories in Alzheimer's disease using longitudinal data. PLoS Comput Biol. 2018;14(9):e1006376.
    1. Lorenzi M, Filippone M, Frisoni GB, Alexander DC, Ourselin S, Alzheimer's Disease Neuroimaging Initiative . Probabilistic disease progression modeling to characterize diagnostic uncertainty: application to staging and prediction in Alzheimer's disease. Neuroimage. 2019;190:56‐68.
    1. Davatzikos C, Bhatt P, Shaw LM, Batmanghelich KN, Trojanowski JQ. Prediction of MCI to AD conversion, via MRI, CSF biomarkers, and pattern classification. Neurobiol Aging. 2011;32(12):2322 e19‐27.
    1. Moradi E, Pepe A, Gaser C, Huttunen H, Tohka J, Alzheimer's Disease Neuroimaging Initiative . Machine learning framework for early MRI‐based Alzheimer's conversion prediction in MCI subjects. Neuroimage. 2015;104:398‐412.
    1. Wang T, Qiu RG, Yu M. Predictive modeling of the progression of Alzheimer's disease with recurrent neural networks. Sci Rep. 2018;8(1):9161.
    1. Mathotaarachchi S, Pascoal TA, Shin M, et al. Identifying incipient dementia individuals using machine learning and amyloid imaging. Neurobiol Aging. 2017;59:80‐90.
    1. Fisher CK, Smith AM, Walsh JR. Machine learning for comprehensive forecasting of Alzheimer's disease progression. Sci Rep. 2019;9(1):13622.
    1. Frisoni GB, Boccardi M, Barkhof F, et al. Strategic roadmap for an early diagnosis of Alzheimer's disease based on biomarkers. Lancet Neurol. 2017;16(8):661‐676.
    1. van Maurik IS, Vos SJ, Bos I, et al. Biomarker‐based prognosis for people with mild cognitive impairment (ABIDE): a modelling study. Lancet Neurol. 2019;18(11):1034‐1044.
    1. Frölich L, Peters O, Lewczuk P, et al. Incremental value of biomarker combinations to predict progression of mild cognitive impairment to Alzheimer's dementia. Alzheimers Res Ther. 2017;9(1):84.
    1. De Carli F, Nobili F, Pagani M, et al. Accuracy and generalization capability of an automatic method for the detection of typical brain hypometabolism in prodromal Alzheimer disease. Eur J Nucl Med Mol Imaging. 2019;46(2):334‐347.
    1. Chen Y, Denny KG, Harvey D, et al. Progression from normal cognition to mild cognitive impairment in a diverse clinic‐based and community‐based elderly cohort. Alzheimers Dement. 2017;13(4):399‐405.
    1. Tarnanas I, Tsolaki M, Nef T, Müri RM, Mosimann UP. Can a novel computerized cognitive screening test provide additional information for early detection of Alzheimer's disease?. Alzheimers Dement. 2014;10(6):790‐798.
    1. Tarnanas I, Papagiannopoulos S, Kazis D, Wiederhold M, Widerhold B, Tsolaki M. Reliability of a novel serious game using dual‐task gait profiles to early characterize aMCI. Front Aging Neurosci. 2015;7:50.
    1. Tarnanas I, Tsolaki A, Wiederhold M, Wiederhold B, Tsolaki M. Five‐year biomarker progression variability for Alzheimer's disease dementia prediction: can a complex instrumental activities of daily living marker fill in the gaps?. Alzheimers Dement (Amst). 2015;1(4):521‐532.
    1. , Evaluation of a Computerized Complex Instrumental Activities of Daily Living Marker (Altoida™) (AltoidaML). Bethesda (MD): National Library of Medicine (US), 2016.
    1. Jack CR, Jr , Albert MS, Knopman DS, et al. Introduction to the recommendations from the National Institute on Aging‐Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. 2011;7(3):257‐262.
    1. Collins GS, Reitsma JB, Altman DG, Moons KGM, members of the TRIPOD group . Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Eur Urol. 2015;67(6):1142‐1151.
    1. Chen TG, Carlos XG, Boost: A Scalable Tree Boosting System. 2016:785‐794.
    1. Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: synthetic minority over‐sampling technique. J Artificial Intelligence Res. 2002:321‐357.
    1. Cawley GCT, Talbot NLC. On over‐fitting in model selection and subsequent selection bias in performance evaluation. J Mach Learn Res. 2010;11:2079‐2107.
    1. Steyerberg EW, Harrell FE, Jr . Prediction models need appropriate internal, internal‐external, and external validation. J Clin Epidemiol. 2016;69:245‐247.
    1. Grill JD, Nuño MM, Gillen DL, Alzheimer's Disease Neuroimaging Initiative . Which MCI patients should be included in prodromal Alzheimer disease clinical trials?. Alzheimer Dis Assoc Disord. 2019;33(2):104‐112.
    1. Mosconi L, Tsui WH, Herholz K, et al. Multicenter standardized 18F‐FDG PET diagnosis of mild cognitive impairment, Alzheimer's disease, and other dementias. J Nucl Med. 2008;49(3):390‐398.
    1. Greene SJ, Killiany RJ, Alzheimer's Disease Neuroimaging Initiative . Subregions of the inferior parietal lobule are affected in the progression to Alzheimer's disease. Neurobiol Aging. 2010;31(8):1304‐1311.
    1. Verghese J, Annweiler C, Ayers E, et al. Motoric cognitive risk syndrome: multicountry prevalence and dementia risk. Neurology. 2014;83(8):718‐726.
    1. Montero‐Odasso M, Speechley M, Muir‐Hunter SW, et al. Motor and cognitive trajectories before dementia: results from gait and brain study. J Am Geriatr Soc. 2018;66(9):1676‐1683.
    1. Howett D, Castegnaro A, Krzywicka K, et al. Differentiation of mild cognitive impairment using an entorhinal cortex‐based test of virtual reality navigation. Brain. 2019;142(6):1751‐1766.
    1. Yaffe K, Falvey CM, Hoang T. Connections between sleep and cognition in older adults. Lancet Neurol. 2014;13(10):1017‐1028.
    1. André C, Tomadesso C, de Flores R, et al. Brain and cognitive correlates of sleep fragmentation in elderly subjects with and without cognitive deficits. Alzheimers Dement (Amst). 2019;11:142‐150.
    1. Chen R, Jankovic F, Marinsek N, et al. “Developing measures of cognitive impairment in the real world from consumergrade multimodal sensor streams”, presented at Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2019.

Source: PubMed

3
구독하다