Using a Digital Neuro Signature to measure longitudinal individual-level change in Alzheimer's disease: the Altoida large cohort study

Irene B Meier, Max Buegler, Robbert Harms, Azizi Seixas, Arzu Çöltekin, Ioannis Tarnanas, Irene B Meier, Max Buegler, Robbert Harms, Azizi Seixas, Arzu Çöltekin, Ioannis Tarnanas

Abstract

Conventional neuropsychological assessments for Alzheimer's disease are burdensome and inaccurate at detecting mild cognitive impairment and predicting Alzheimer's disease risk. Altoida's Digital Neuro Signature (DNS), a longitudinal cognitive test consisting of two active digital biomarker metrics, alleviates these limitations. By comparison to conventional neuropsychological assessments, DNS results in faster evaluations (10 min vs 45-120 min), and generates higher test-retest in intraindividual assessment, as well as higher accuracy at detecting abnormal cognition. This study comparatively evaluates the performance of Altoida's DNS and conventional neuropsychological assessments in intraindividual assessments of cognition and function by means of two semi-naturalistic observational experiments with 525 participants in laboratory and clinical settings. The results show that DNS is consistently more sensitive than conventional neuropsychological assessments at capturing longitudinal individual-level change, both with respect to intraindividual variability and dispersion (intraindividual variability across multiple tests), across three participant groups: healthy controls, mild cognitive impairment, and Alzheimer's disease. Dispersion differences between DNS and conventional neuropsychological assessments were more pronounced with more advanced disease stages, and DNS-intraindividual variability was able to predict conversion from mild cognitive impairment to Alzheimer's disease. These findings are instrumental for patient monitoring and management, remote clinical trial assessment, and timely interventions, and will hopefully contribute to a better understanding of Alzheimer's disease.

Conflict of interest statement

A.S. and A.Ç. declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this article. The remaining authors declare the following financial interests/personal relationships, which may be considered potential competing interests: M.B. and I.T. are employees and shareholders of Altodia, Inc. M.B., I.B.M., R.H., and I.T. report personal fees from Altoida, Inc., outside the submitted work. Finally, I.T., R.H., and M.B. have issued and pending patents with respect to Altoida DNS.

Figures

Fig. 1. Day-to-day variability in testing can…
Fig. 1. Day-to-day variability in testing can overshadow true performance due to external factors (environment) and internal factors (anxiety, motivation, etc.).
Reprint courtesy of Martin Sliwinsk, permission granted.
Fig. 2
Fig. 2
Dispersion index based on LTRS and NP plotted for for the HC (A), MCI (B), and AD (C) groups translated into standard deviation. The AC graphs show a nonlinear increase in standard deviation as a function of disease trajectories. Comparing the overall mean of LTRS vs NP per group yields the following values: HC: t = 10.00106, p < 0.00001; MCI: t = 7.02195, p < 0.00001; AD: t = 6.65272, p = 0.000011, the results are statistically significant at p < 0.001. Details of the individual time points are shown in Table 1.
Fig. 3
Fig. 3
Dispersion index plotted across tasks, showing group intraindividual standard deviation (iSD) for the HC (A), MCI (B), and AD (C) groups. The AC graphs show a nonlinear increase in SD as a function of disease trajectories. IIV is consistently and significantly more sensitive for the disease trajectory trends than conventional NP assessments, especially at the pre-conversion events (spikes in B predict a likely conversion by next assessment). LIIV longitudinal IIV.
Fig. 4
Fig. 4
An overview of the procedure used in both studies, except for the unsupervised Altoida DNS use, which was conducted only in Study B in HCs and participants with MCI.
Fig. 5. An illustration of dispersion.
Fig. 5. An illustration of dispersion.
Left: Individual patient data over time. Right: patient performance dispersion (dots) at different time points (A, B, and C) represented in population mean (line) picked up using Altoida (blue, top curve) and conventional NP (red, bottom curve). SD is related to the dispersion of a given subject over time (LTRS). Black (dashed line): true dispersion.
Fig. 6. Illustrations of the LTRS (top)…
Fig. 6. Illustrations of the LTRS (top) and LDVS (bottom) on the left (numbers 17.3 and 41.5 are random examples).
The two measures can be used in a matrix to obtain a combined longitudinal risk matrix (right). Green indicates low risk, yellow medium, and red high risk. In the risk matrix (right), the overlapping areas allow for a more nuanced interpretation.
Fig. 7. The IIV quantifies the variability…
Fig. 7. The IIV quantifies the variability of cognitive domain percentiles over time.
The value corresponds to the average variability of the subject’s test in multiples of the variability of healthy subjects for each domain. The value is only reliable for at least five tests done by the same participant.

References

    1. Mungas D, et al. Heterogeneity of cognitive trajectories in diverse older persons. Psychol. Aging. 2010;25:606–619. doi: 10.1037/a0019502.
    1. Mitchell RL, Phillips LH. The psychological, neurochemical and functional neuroanatomical mediators of the effects of positive and negative mood on executive functions. Neuropsychologia. 2007;2:617–629. doi: 10.1016/j.neuropsychologia.2006.06.030.
    1. Bilgel M, et al. Trajectories of Alzheimer disease-related cognitive measures in a longitudinal sample. Alzheimers Dement. 2014;10:735–742. doi: 10.1016/j.jalz.2014.04.520.
    1. Snyder PJ, et al. Assessing cognition and function in Alzheimer’s disease clinical trials: do we have the right tools? Alzheimer’s Dement. J. Alzheimer’s Assoc. 2014;10:853–860. doi: 10.1016/j.jalz.2014.07.158.
    1. Ye BS, et al. Effects of education on the progression of early- versus late-stage mild cognitive impairment. Int. Psychogeriatr. 2013;25:597–606. doi: 10.1017/S1041610212002001.
    1. Ye BS, et al. The heterogeneity and natural history of mild cognitive impairment of visual memory predominant type. J. Alzheimer’s Dis. 2015;43:143–152. doi: 10.3233/JAD-140318.
    1. Bielak A, Hultsch D, Strauss E, MacDonald S, Hunter M. Intraindividual variability in reaction time predicts cognitive outcomes 5 years later. Neuropsychology. 2010;24:731–741. doi: 10.1037/a0019802.
    1. Yao C, Rich JB, Tirona K, Bernstein LJ, et al. Intraindividual variability in reaction time before and after neoadjuvant chemotherapy in women diagnosed with breast cancer. Psycho-Oncology. 2017;6:50–54.
    1. Salthouse T. Consequences of age-related cognitive declines. Annu. Rev. Psychol. 2012;63:201–226. doi: 10.1146/annurev-psych-120710-100328.
    1. Murphy KJ, West R, Armilio ML, Craik FIM, Stuss DT. Word-list-learning performance in younger and older adults: intra-individual performance variability and false memory. Aging Neuropsychol. Cogn. 2007;14:70–94. doi: 10.1080/138255890969726.
    1. K„lin AM, et al. Intraindividual variability across cognitive tasks as a potential marker for prodromal Alzheimeras disease. Front. Aging Neurosci. 2014;6:23–29.
    1. Tractenberg RE, Pietrzak RH, et al. Intra-individual variability in alzheimeras disease and cognitive aging: definitions, context, and effect sizes. PLoS ONE. 2011;32:45–47.
    1. Salthouse TA, Nesselroade JR, Berish DE. Short-term variability in cognitive performance and the calibration of longitudinal change. J. Gerontol. Ser. B Psychol. Sci. Soc. Sci. 2006;61:P144–P151.
    1. Hilborn JV, Strauss E, Hultsch DF, Hunter MA. Intraindividual variability across cognitive domains: Investigation of dispersion levels and performance profiles in older adults. J. Clin. Exp. Neuropsychol. 2009;31:412–424. doi: 10.1080/13803390802232659.
    1. Mella N, et al. Individual differences in developmental change: quantifying the amplitude and heterogeneity in cognitive change across old age. J. Intell. 2018;6:10. doi: 10.3390/jintelligence6010010.
    1. Jeff Cummings Early Alzheimer’s disease: developing drugs for treatment guidance for industry. (2018).
    1. Chen, R. et al. Developing measures of cognitive impairment in the real world from consumer-grade multimodal sensor streams. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2019).
    1. Low DM, et al. Natural language processing reveals vulnerable mental health support groups and heightened health anxiety on reddit during COVID-19: observational study. J. Med. Internet Res. 2020;20:89–102.
    1. Buegler M, et al. Digital biomarker-based individualized prognosis for people at risk of dementia. Alzheimers Dement. 2020;12:12–14.
    1. Mesulam MM. Large-scale neurocognitive networks and distributed processing for attention, language, and memory. Ann. Neurol. 1990;28:597–613. doi: 10.1002/ana.410280502.
    1. Livingston G, et al. Dementia prevention, intervention, and care. Lancet. 2017;42:78–82.
    1. Ritchie CW, et al. Development of interventions for the secondary prevention of Alzheimeras dementia: the European Prevention of Alzheimeras Dementia (EPAD) project. Lancet Psychiatry. 2016;3(2):86–179. doi: 10.1016/S2215-0366(15)00454-X.
    1. Hultsch, D. F., Strauss, E., Hunter, M. A., & MacDonald, S. W. S. In The Handbook of Aging and Cognition (eds Craik, F. I. M. & Salthouse T. A.) 491–556 (Psychology Press, 2008).
    1. Wojtowicz M, Berrigan LI, Fisk JD. Intra-individual variability as a measure of information processing difficulties in multiple sclerosis. Int. J. MS Care. 2012;14:77–83. doi: 10.7224/1537-2073-14.2.77.
    1. Kim YJ, Cho S-K, Lee JS, et al. Data-driven prognostic features of cognitive trajectories in patients with amnestic mild cognitive impairments. Alzheimers Res. Ther. 2019;23:77–90.
    1. Murray AL, et al. Assessing individual-level change in dementia research: a review of methodologies. Alzheimers Res. Ther. 2021;13:26. doi: 10.1186/s13195-021-00768-w.
    1. Kivipelto M, et al. The Finnish geriatric intervention study to prevent cognitive impairment and disability (FINGER): study design and progress. Alzheimer’s Dement. 2013;9:657–665. doi: 10.1016/j.jalz.2012.09.012.
    1. Jack CR, Jr, et al. Contributors. NIA-AA Research Framework: toward a biological definition of Alzheimer’s disease. Alzheimers Dement. 2018;14:535–562. doi: 10.1016/j.jalz.2018.02.018.
    1. Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 1975;12:189–198. doi: 10.1016/0022-3956(75)90026-6.
    1. Nasreddine ZS, et al. The Montreal cognitive assessment, MoCA: A brief screening tool for mild cognitive impairment. J. Am. Geriatrics Soc. 2005;53:695–699. doi: 10.1111/j.1532-5415.2005.53221.x.
    1. Chlebowski, C. in Encyclopedia of Clinical Neuropsychology (eds Kreutzer, J. S., DeLuca, J. & Caplan, B) (Springer, 2011).
    1. Morris JC. The Clinical Dementia Rating (CDR): current version and scoring rules. Neurology. 1993;43:2412–2412. doi: 10.1212/WNL.43.1_Part_1.241-a.
    1. Butler M, Retzlaff P, Vanderploeg R. Neuropsychological test usage. Prof. Psychol. Res. Pract. 1991;22:510–512. doi: 10.1037/0735-7028.22.6.510.
    1. Bean J. in Encyclopedia of Clinical Neuropsychology (eds Kreutzer, J. S., DeLuca, J. & Caplan, B.) (Springer, 2011).
    1. Benton A. The visual retention test as a constructional praxis task. Stereotact. Funct. Neurosurg. 1962;22:141–155. doi: 10.1159/000104348.
    1. Kaufman AS. Test Review: Wechsler, D. Manual for the Wechsler adult intelligence scale, revised. New York: Psychological Corporation, 1981. J. Psychoeduc. Assess. 1983;1:309–313. doi: 10.1177/073428298300100310.
    1. Hutt ML, et al. The Kohs block-design tests. A revision for clinical practice. J. Appl. Psychol. 1932;27:31–40.
    1. Drozdick, L. W., Raiford, S. E., Wahlstrom, D., & Weiss, L. G. in Contemporary Intellectual Assessment: Theories, Tests, and Issues 4th edn, 486–511 (The Guilford Press, 2018).
    1. Benton A. Differential behavioral effects in frontal lobe disease. Neuropsychologia. 1968;6:53–60. doi: 10.1016/0028-3932(68)90038-9.
    1. Christensen H, et al. Dispersion in cognitive ability as a function of age: a longitudinal study of an elderly community sample. Aging Neuropsychol. Cogn. 1999;6:214–228. doi: 10.1076/anec.6.3.214.779.
    1. Cole, M. S., Bedeian, A. G., & Hirschfeld, R. R. Dispersion-composition models in multilevel research: a data-analytic framework (2010).
    1. Halliday DWR, et al. Intraindividual variability across neuropsychological tests: dispersion and disengaged lifestyle increase risk for Alzheimeras disease. J. Intell. 2018;28:13–15.
    1. Hochberg Y, Benjamini Y. More powerful procedures for multiple significance testing. Stat. Med. 1990;9:811–818. doi: 10.1002/sim.4780090710.
    1. ALZFORUM. Cognitive testing is getting faster and better (2017).

Source: PubMed

3
Prenumerera