Comparison of Time Taken to Assess Cognitive Function Using a Fully Immersive and Automated Virtual Reality System vs. the Montreal Cognitive Assessment

Wei Teen Wong, Ngiap Chuan Tan, Jie En Lim, John Carson Allen Jr, Wan Sian Lee, Joanne Hui Min Quah, Muthulakshmi Paulpandi, Tuan Ann Teh, Soon Huat Lim, Rahul Malhotra, Wei Teen Wong, Ngiap Chuan Tan, Jie En Lim, John Carson Allen Jr, Wan Sian Lee, Joanne Hui Min Quah, Muthulakshmi Paulpandi, Tuan Ann Teh, Soon Huat Lim, Rahul Malhotra

Abstract

Introduction: Dementia is increasingly prevalent globally. Existing questionnaire-based cognitive assessment tools may not comprehensively assess cognitive function and real-time task-performance across all cognitive domains. CAVIRE (Cognitive Assessment by VIrtual REality), a fully immersive virtual reality system incorporating automated audio-visual instructions and a scoring matrix was developed to assess the six cognitive domains, with potential to maintain consistency in execution of the testing environment and possibly time-saving in busy primary care practice. Aims: This is a feasibility study to compare the completion times of the questionnaire-based Montreal Cognitive Assessment (MoCA) and the CAVIRE in cognitively-healthy Asian adults aged between 35 and 74 years, overall, and in and across each 10-year age group (35-44; 45-54; 55-64; 65-74). Methods: A total of 100 participants with a MoCA score of 26 or more were recruited equally into the four 10-year age groups at a primary care clinic in Singapore. Completion time for the MoCA assessment for each participant was recorded. They were assessed using the CAVIRE, comprising 13 segments featuring common everyday activities assessing all six cognitive domains, and the completion time was also recorded through the embedded automated scoring and timing framework. Results: Completion time for CAVIRE as compared to MoCA was significantly (p < 0.01) shorter, overall (mean difference: 74.9 (SD) seconds) and in each age group. Younger, vs. older, participants completed both the MoCA and CAVIRE tasks in a shorter time. There was a greater variability in the completion time for the MoCA, most markedly in the oldest group, whereas completion time was less variable for the CAVIRE tasks in all age groups, with most consistency in the 45-54 year-age group. Conclusion: We demonstrate almost equivalent completion times for a VR and a questionnaire-based cognition assessment, with inter-age group variation in VR completion time synonymous to that in conventional screening methods. The CAVIRE has the potential to be an alternative screening modality for cognition in the primary care setting.

Keywords: MoCA = Montreal Cognitive Assessment; assessment; cognition; dementia; domain; virtual reality.

Conflict of interest statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Copyright © 2021 Wong, Tan, Lim, Allen, Lee, Quah, Paulpandi, Teh, Lim and Malhotra.

Figures

FIGURE 1
FIGURE 1
Cognitive domains assessed in the Cognitive Assessment by VIrtual REality (CAVIRE) segments.
FIGURE 2
FIGURE 2
Scatter plot of Montreal Cognitive Assessment (MoCA) vs. Virtual Reality (CAVIRE) total time taken.
FIGURE 3
FIGURE 3
Total time taken (sec), MoCA vs. Virtual Reality (CAVIRE), overall.
FIGURE 4
FIGURE 4
Total time taken (sec), MoCA vs. Virtual Reality (CAVIRE), by age groups.
FIGURE 5
FIGURE 5
Difference [MoCA—VR (CAVIRE)] in total time taken (sec).
FIGURE 6
FIGURE 6
Mean (95% CI) total time taken (sec) for MoCA and VR (CAVIRE).

References

    1. Abd Razak M. A., Ahmad N. A., Chan Y. Y., Mohamad Kasim N., Yusof M., Abdul Ghani M. K. A., et al. (2019). Validity of screening tools for dementia and mild cognitive impairment among the elderly in primary health care: a systematic review. Public Health 169 84–92. 10.1016/j.puhe.2019.01.001
    1. Alegret M., Boada-Rovira M., Vinyes-Junqué G., Valero S., Espinosa A., Hernández I., et al. (2009). Detection of visuoperceptual deficits in preclinical and mild Alzheimer’s disease. J. Clin. Exp. Neuropsychol. 31 860–867. 10.1080/13803390802595568
    1. Alzheimer’s Disease Association Singapore (2020). Dementia Projection in Singapore. Available online at: (accessed August 29, 2020).
    1. Billingham S. A., Whitehead A. L., Julious S. A. (2013). An audit of sample sizes for pilot and feasibility trials being undertaken in the United Kingdom registered in the United Kingdom Clinical Research Network database. BMC Med. Res. Methodol. 13:104. 10.1186/1471-2288-13-104
    1. Bohil C. J., Alicea B., Biocca F. A. (2011). Virtual reality in neuroscience research and therapy. Nat. Rev. Neurosci. 12 752–762. 10.1038/nrn3122
    1. Cullen B., O’Neill B., Evans J. J., Coen R. F., Lawlor B. A. (2007). A review of screening tests for cognitive impairment. J. Neurol. Neurosurg. Psychiatry 78 790–799. 10.1136/jnnp.2006.095414
    1. Gauthier S., Reisberg B., Zaudig M., Petersen R. C., Ritchie K., Broich K., et al. (2006). Mild cognitive impairment. Lancet 367 1262–1270. 10.1016/S0140-6736(06)68542-5
    1. Kourtesis P., Collina S., Doumas L. A., MacPherson S. E. (2019). Technological competence is a pre-condition for effective implementation of virtual reality head mounted displays in human neuroscience: a technological review and meta-analysis. Front. Hum. Neurosci. 13:342. 10.3389/fnhum.2019.00342
    1. Kourtesis P., Collina S., Doumas L. A. A., MacPherson S. E. (2021). Validation of the Virtual Reality Everyday Assessment Lab (VR-EAL): an immersive virtual reality neuropsychological battery with enhanced ecological validity. J. Int. Neuropsychol. Soc. 27 181–196. 10.1017/S1355617720000764
    1. Kourtesis P., Korre D., Collina S., Doumas L. A., MacPherson S. E. (2020). Guidelines for the development of immersive virtual reality software for cognitive neuroscience and neuropsychology: the development of Virtual Reality Everyday Assessment Lab (VR-EAL), a neuropsychological test battery in immersive virtual reality. Front. Comput. Sci. 1:12. 10.3389/fcomp.2019.00012
    1. Lim J. E., Wong W. T., Teh T. A., Lim S. H., Allen J. C., Jr., Quah J. H. M., et al. (2021). A fully-immersive and automated virtual reality system to assess the six domains of cognition: protocol for a feasibility study. Front. Aging Neurosci. 12:604670. 10.3389/fnagi.2020.604670
    1. Miyake A., Shah P. (1999). Models of Working Memory: Mechanisms of Active Maintenance and Executive Control. New York, NY: Cambridge University Press. 10.1017/CBO9781139174909
    1. MoCA Clinic and Institute, MoCA Test Inc. (2020). Upcoming Mandatory Trainig for MoCA Testing. Available online at: (accessed September 1, 2020).
    1. Ng A., Chew I., Narasimhalu K., Kandiah N. (2013). Effectiveness of Montreal Cognitive Assessment for the diagnosis of mild cognitive impairment and mild Alzheimer’s disease in Singapore. Singapore Med. J. 54 616–619. 10.11622/smedj.2013220
    1. Pensieri C., Pennacchini M. (2014). Overview: virtual reality in medicine. J. Virtual Worlds Res. 7 1–34. 10.4101/jvwr.v7i1.6364
    1. Rieck J. R., Rodrigue K. M., Boylan M. A., Kennedy K. M. (2017). Age-related reduction of BOLD modulation to cognitive difficulty predicts poorer task accuracy and poorer fluid reasoning ability. Neuroimage 147 262–271. 10.1016/j.neuroimage.2016.12.022
    1. Sabbagh M. N., Boada M., Borson S., Chilukuri M., Dubois B., Ingram J., et al. (2020). Early detection of Mild Cognitive Impairment (MCI) in primary care. J. Prev. Alzheimers Dis. 7 165–170. 10.14283/jpad.2020.21
    1. Slater M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci. 364 3549–3557. 10.1098/rstb.2009.0138
    1. Slater M., Sanchez-Vives M. V. (2016). Enhancing our lives with immersive virtual reality. Front. Robot. AI 3:74. 10.3389/frobt.2016.00074
    1. Somrak A., Pogačnik M., Guna J. (2021). Suitability and comparison of questionnaires assessing virtual reality-induced symptoms and effects and user experience in virtual environments. Sensors 21:1185. 10.3390/s21041185
    1. Subramaniam M., Chong S. A., Vaingankar J. A., Abdin E., Chua B. Y., Chua H. C., et al. (2015). Prevalence of dementia in people aged 60 years and above: results from the WiSE study. J. Alzheimers Dis. 45 1127–1138. 10.3233/JAD-142769
    1. Wong A., Nyenhuis D., Black S. E., Law L. S., Lo E. S., Kwan P. W., et al. (2015). Montreal Cognitive Assessment 5-minute protocol is a brief, valid, reliable, and feasible cognitive screen for telephone administration. Stroke 46 1059–1064. 10.1161/STROKEAHA.114.007253
    1. World Health Organisation (2020). Dementia. Available online at: (accessed September 21, 2020).

Source: PubMed

3
購読する