Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study

Ioannis Tarnanas, Winfried Schlee, Magda Tsolaki, René Müri, Urs Mosimann, Tobias Nef, Ioannis Tarnanas, Winfried Schlee, Magda Tsolaki, René Müri, Urs Mosimann, Tobias Nef

Abstract

Background: Dementia is a multifaceted disorder that impairs cognitive functions, such as memory, language, and executive functions necessary to plan, organize, and prioritize tasks required for goal-directed behaviors. In most cases, individuals with dementia experience difficulties interacting with physical and social environments. The purpose of this study was to establish ecological validity and initial construct validity of a fire evacuation Virtual Reality Day-Out Task (VR-DOT) environment based on performance profiles as a screening tool for early dementia.

Objective: The objectives were (1) to examine the relationships among the performances of 3 groups of participants in the VR-DOT and traditional neuropsychological tests employed to assess executive functions, and (2) to compare the performance of participants with mild Alzheimer's-type dementia (AD) to those with amnestic single-domain mild cognitive impairment (MCI) and healthy controls in the VR-DOT and traditional neuropsychological tests used to assess executive functions. We hypothesized that the 2 cognitively impaired groups would have distinct performance profiles and show significantly impaired independent functioning in ADL compared to the healthy controls.

Methods: The study population included 3 groups: 72 healthy control elderly participants, 65 amnestic MCI participants, and 68 mild AD participants. A natural user interface framework based on a fire evacuation VR-DOT environment was used for assessing physical and cognitive abilities of seniors over 3 years. VR-DOT focuses on the subtle errors and patterns in performing everyday activities and has the advantage of not depending on a subjective rating of an individual person. We further assessed functional capacity by both neuropsychological tests (including measures of attention, memory, working memory, executive functions, language, and depression). We also evaluated performance in finger tapping, grip strength, stride length, gait speed, and chair stands separately and while performing VR-DOTs in order to correlate performance in these measures with VR-DOTs because performance while navigating a virtual environment is a valid and reliable indicator of cognitive decline in elderly persons.

Results: The mild AD group was more impaired than the amnestic MCI group, and both were more impaired than healthy controls. The novel VR-DOT functional index correlated strongly with standard cognitive and functional measurements, such as mini-mental state examination (MMSE; rho=0.26, P=.01) and Bristol Activities of Daily Living (ADL) scale scores (rho=0.32, P=.001).

Conclusions: Functional impairment is a defining characteristic of predementia and is partly dependent on the degree of cognitive impairment. The novel virtual reality measures of functional ability seem more sensitive to functional impairment than qualitative measures in predementia, thus accurately differentiating from healthy controls. We conclude that VR-DOT is an effective tool for discriminating predementia and mild AD from controls by detecting differences in terms of errors, omissions, and perseverations while measuring ADL functional ability.

Conflict of interest statement

Conflicts of Interest: None declared.

Figures

Figure 1
Figure 1
Virtual reality day-out task (VR-DOT) participant setup.
Figure 2
Figure 2
Sample sequential virtual reality day-out task (VR-DOT) screenshots, showing different tasks and viewpoints.
Figure 3
Figure 3
Receiver-operating curve (ROC) for the Virtual Reality Day-Out Task (VR-DOT) total score when discriminating among nondemented (healthy controls), amnestic mild cognitive impairment (aMCI), and patients with mild Alzheimer-type dementia (mild AD).
Figure 4
Figure 4
Odds ratios from exploratory individual regression analyses using VR-DOT, Bristol, and Blessed ADL scale scores rate of change as predictors for conversion from mild cognitive impairment to Alzheimer disease (bars represent 95% CI).

References

    1. Chaytor N, Schmitter-Edgecombe M. The ecological validity of neuropsychological tests: a review of the literature on everyday cognitive skills. Neuropsychol Rev. 2003 Dec;13(4):181–97.
    1. Franzen MD, Wilhelm KL. Conceptual foundations of ecological validity in neuropsychological assessment. In: Sbordone RJ, Long CJ, editors. Ecological Validity of Neuropsychological Testing. Boca Raton, FL: St Lucie Press; 1996.
    1. Thompson CL, Henry JD, Withall A, Rendell PG, Brodaty H. A naturalistic study of prospective memory function in MCI and dementia. Br J Clin Psychol. 2011 Nov;50(4):425–34. doi: 10.1111/j.2044-8260.2010.02004.x.
    1. Cesa GL, Manzoni GM, Bacchetta M, Castelnuovo G, Conti S, Gaggioli A, Mantovani F, Molinari E, Cárdenas-López G, Riva G. Virtual Reality for Enhancing the Cognitive Behavioral Treatment of Obesity With Binge Eating Disorder: Randomized Controlled Study With One-Year Follow-up. J Med Internet Res. 2013;15(6):e113. doi: 10.2196/jmir.2441.
    1. Rizzo AA, Buckwalter JG. Virtual reality and cognitive assessment and rehabilitation: the state of the art. Stud Health Technol Inform. 1997;44:123–45.
    1. Hall V, Conboy-Hill S, Taylor D. Using Virtual Reality to Provide Health Care Information to People With Intellectual Disabilities: Acceptability, Usability, and Potential Utility. J Med Internet Res. 2011;13(4):e91. doi: 10.2196/jmir.1917.
    1. Klinger E, Chemin I, Lebreton S, Marié RM. Virtual action planning in Parkinson's disease: a control study. Cyberpsychol Behav. 2006 Jun;9(3):342–7. doi: 10.1089/cpb.2006.9.342.
    1. Zhang L, Abreu BC, Masel B, Scheibel RS, Christiansen CH, Huddleston N, Ottenbacher KJ. Virtual reality in the assessment of selected cognitive function after brain injury. Am J Phys Med Rehabil. 2001 Aug;80(8):597–604; quiz 605.
    1. Campbell Z, Zakzanis KK, Jovanovski D, Joordens S, Mraz R, Graham SJ. Utilizing virtual reality to improve the ecological validity of clinical neuropsychology: an FMRI case study elucidating the neural basis of planning by comparing the Tower of London with a three-dimensional navigation task. Appl Neuropsychol. 2009 Oct;16(4):295–306. doi: 10.1080/09084280903297891.
    1. Zakzanis KK, Quintin G, Graham SJ, Mraz R. Age and dementia related differences in spatial navigation within an immersive virtual environment. Med Sci Monit. 2009 Apr;15(4):CR140–50.
    1. Rizzo AA, Buckwalter JG, van der Zaag C. Virtual environment applications in clinical neuropsychology. In: Stanney K, editor. The Handbook of Virtual Environments. New York: Lawrence Erlbaum Associates; 2002. pp. 1027–1064.
    1. Lo Priore C, Castelnuovo G, Liccione D, Liccione D. Experience with V-STORE: considerations on presence in virtual environments for effective neuropsychological rehabilitation of executive functions. Cyberpsychol Behav. 2003 Jun;6(3):281–7. doi: 10.1089/109493103322011579.
    1. Koenig S, Crucian G, Dalrymple-Alford J, Dünser A. Assessing navigation in real and virtual environments: A validation study. 8th International Conference on Disability, Virtual Reality and Associated Technologies; Aug 31-Sep 2, 2010; Viña del Mar/Valparaíso, Chile. 2010. pp. 7–16.
    1. Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969;9(3):179–86.
    1. Souder E, Chastain JR, Williams RD. Dementia in the new millennium. Medsurg Nurs. 2002 Apr;11(2):61–9; quiz 70.
    1. Petersen RC. Mild cognitive impairment as a diagnostic entity. J Intern Med. 2004 Sep;256(3):183–94. doi: 10.1111/j.1365-2796.2004.01388.x.
    1. Winblad B, Palmer K, Kivipelto M, Jelic V, Fratiglioni L, Wahlund LO, Nordberg A, Bäckman L, Albert M, Almkvist O, Arai H, Basun H, Blennow K, de Leon M, DeCarli C, Erkinjuntti T, Giacobini E, Graff C, Hardy J, Jack C, Jorm A, Ritchie K, van Duijn C, Visser P, Petersen RC. Mild cognitive impairment--beyond controversies, towards a consensus: report of the International Working Group on Mild Cognitive Impairment. J Intern Med. 2004 Sep;256(3):240–6. doi: 10.1111/j.1365-2796.2004.01380.x.
    1. Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Arch Neurol. 1999 Mar;56(3):303–8.
    1. Nelson AP, O'Connor MG. Mild cognitive impairment: a neuropsychological perspective. CNS Spectr. 2008 Jan;13(1):56–64.
    1. Binegar DL, Hynan LS, Lacritz LH, Weiner MF, Cullum CM. Can a direct IADL measure detect deficits in persons with MCI? Curr Alzheimer Res. 2009 Feb;6(1):48–51.
    1. Amieva H, Letenneur L, Dartigues JF, Rouch-Leroyer I, Sourgen C, D'Alchée-Birée F, Dib M, Barberger-Gateau P, Orgogozo JM, Fabrigoule C. Annual rate and predictors of conversion to dementia in subjects presenting mild cognitive impairment criteria defined according to a population-based study. Dement Geriatr Cogn Disord. 2004;18(1):87–93. doi: 10.1159/000077815.
    1. Gauthier S, Reisberg B, Zaudig M, Petersen RC, Ritchie K, Broich K, Belleville S, Brodaty H, Bennett D, Chertkow H, Cummings JL, de Leon M, Feldman H, Ganguli M, Hampel H, Scheltens P, Tierney MC, Whitehouse P, Winblad B, International Psychogeriatric Association Expert Conference on mild cognitive impairment Mild cognitive impairment. Lancet. 2006 Apr 15;367(9518):1262–70. doi: 10.1016/S0140-6736(06)68542-5.
    1. Petersen RC, Roberts RO, Knopman DS, Geda YE, Cha RH, Pankratz VS, Boeve BF, Tangalos EG, Ivnik RJ, Rocca WA. Prevalence of mild cognitive impairment is higher in men: The Mayo Clinic Study of Aging. Neurology. 2010 Sep 06;75(10):889–897. doi: 10.1212/WNL.0b013e3181f11d85.
    1. Yesavage JA, O'Hara R, Kraemer H, Noda A, Taylor JL, Ferris S, Gély-Nargeot MC, Rosen A, Friedman L, Sheikh J, Derouesné C. Modeling the prevalence and incidence of Alzheimer's disease and mild cognitive impairment. J Psychiatr Res. 2002 Oct;36(5):281–6.
    1. Bangen KJ. Complex activities of daily living vary by mild cognitive impairment subtype. Journal of the International Neuropsychological Society. 2010;16:630–639. doi: 10.1017/S1355617710000330.
    1. Goldberg TE. Performance-based measures of everyday function in mild cognitive impairment. American Journal of Psychiatry. 2010;167:845–853. doi: 10.1176/appi.ajp.2010.09050692.
    1. Burton CL, Strauss E, Bunce D, Hunter MA, Hultsch DF. Functional abilities in older adults with mild cognitive impairment. Gerontology. 2009;55(5):570–81. doi: 10.1159/000228918.
    1. Bangen KJ, Jak AJ, Schiehser DM, Delano-Wood L, Tuminello E, Han SD, Delis DC, Bondi MW. Complex activities of daily living vary by mild cognitive impairment subtype. Journal of the International Neuropsychological Society. 2010;16:630–639. doi: 10.1017/S1355617710000330.
    1. Aretouli E, Brandt J. Everyday functioning in mild cognitive impairment and its relationship with executive cognition. Int J Geriatr Psychiatry. 2010 Mar;25(3):224–33. doi: 10.1002/gps.2325.
    1. Teng E, Becker BW, Woo E, Cummings JL, Lu PH. Subtle deficits in instrumental activities of daily living in subtypes of mild cognitive impairment. Dement Geriatr Cogn Disord. 2010;30(3):189–97. doi: 10.1159/000313540.
    1. Teng E, Becker BW, Woo E, Knopman DS, Cummings JL, Lu PH. Utility of the Functional Activities Questionnaire for Distinguishing Mild Cognitive Impairment From Very Mild Alzheimer Disease. Alzheimer Dis Assoc Disord. 2010 Jun 29;:348–353. doi: 10.1097/WAD.0b013e3181e2fc84.
    1. Perneczky R, Pohl C, Sorg C, Hartmann J, Komossa K, Alexopoulos P, Wagenpfeil S, Kurz A. Complex activities of daily living in mild cognitive impairment: conceptual and diagnostic issues. Age Ageing. 2006 May;35(3):240–5. doi: 10.1093/ageing/afj054.
    1. Park B, Jun JK, Park J. Cognitive impairment and depression in the early 60s: which is more problematic in terms of instrumental activities of daily living? Geriatr Gerontol Int. 2013 Apr 7; doi: 10.1111/ggi.12055.
    1. Tarnanas I, Harper B, Majer A, Testerman R. World Intellectual Property Organization: Patentscope. 2009. [2013-07-30]. Virtual Reality Interface System, EPO patent WO2010075481 .
    1. Perneczky R, Pohl C, Sorg C, Hartmann J, Tosic N, Grimmer T, Heitele S, Kurz A. Impairment of activities of daily living requiring memory or complex reasoning as part of the MCI syndrome. Int J Geriatr Psychiatry. 2006 Feb;21(2):158–62. doi: 10.1002/gps.1444.
    1. Rahimi F, Duval C, Jog M, Bee C, South A, Jog M, Edwards R, Boissy P. Capturing whole-body mobility of patients with Parkinson disease using inertial motion sensors: expected challenges and rewards. Conf Proc IEEE Eng Med Biol Soc. 2011;2011:5833–8. doi: 10.1109/IEMBS.2011.6091443.
    1. Yamaguchi DA, Foloppe P, Richard E, Allain P. A dual-modal virtual reality kitchen for (re)learning of everyday cooking activities in Alzheimer’s disease. Presence: Teleoperators and Virtual Environments. 2012:43–57. doi: 10.1162/PRESa00080.
    1. Sheikh JI, Yesavage JA. Geriatric Depression Scale (GDS). Recent evidence and development of a shorter version. In: Brink TL, editor. Clinical Gerontology: A Guide to Assessment and Intervention. New York: The Haworth Press; 1986. pp. 165–173.
    1. Visser PJ, Verhey FR, Boada M, Bullock R, De Deyn PP, Frisoni GB, Frolich L, Hampel H, Jolles J, Jones R, Minthon L, Nobili F, Olde Rikkert M, Ousset PJ, Rigaud AS, Scheltens P, Soininen H, Spiru L, Touchon J, Tsolaki M, Vellas B, Wahlund LO, Wilcock G, Winblad B. Development of screening guidelines and clinical criteria for predementia Alzheimer's disease. The DESCRIPA Study. Neuroepidemiology. 2008;30(4):254–65. doi: 10.1159/000135644.
    1. Dodge H, Mattek N, Austin D, Hayes T. In-home walking speeds and variability trajectories associated with mild cognitive impairment. Neurology. 2012;78(24):1946–1952. doi: 10.1212/WNL.0b013e318259e1de.
    1. Laird NM, Ware JH. Random-effects models for longitudinal data. Biometrics. 1982 Dec;38(4):963–74.
    1. Tukey JW. The philosophy of multiple comparisons. Statist Sci. 1991 Feb;6(1):100–116. doi: 10.1214/ss/1177011945.
    1. Akobeng AK. Understanding diagnostic tests 3: Receiver operating characteristic curves. Acta Paediatr. 2007 May;96(5):644–7. doi: 10.1111/j.1651-2227.2006.00178.x.
    1. Slavin M, Brodaty H, Kochan N, Crawford JD, Trollor J, Draper B, Sachdev PS. Prevalence and predictors of “subjective cognitive complaints” in the Sydney Memory and Ageing Study. Am J Geriatr Psychiatry. 2010 Aug;18(8):701–10.
    1. Simoes M, Castro L, Ribeiro O, Salgado T, Paz C. P03-94 Subjective Memory Complaints and Mild Cognitive Impairment. European Psychiatry. 2009 Jan;24:S1093. doi: 10.1016/S0924-9338(09)71326-4.
    1. Leonardi C, Mennecozzi C, Not E, Pianesi R, Zancanaro M. Designing a familiar technology for elderly people. Gerontechnology. 2008;7(2):151. doi: 10.4017/gt.2008.07.02.088.00.
    1. Slater M. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos Trans R Soc Lond B Biol Sci. 2009 Dec 12;364(1535):3549–57. doi: 10.1098/rstb.2009.0138.

Source: PubMed

3
Se inscrever