Assessment of Parkinsonian gait in older adults with dementia via human pose tracking in video data

Andrea Sabo, Sina Mehdizadeh, Kimberley-Dale Ng, Andrea Iaboni, Babak Taati, Andrea Sabo, Sina Mehdizadeh, Kimberley-Dale Ng, Andrea Iaboni, Babak Taati

Abstract

Background: Parkinsonism is common in people with dementia, and is associated with neurodegenerative and vascular changes in the brain, or with exposure to antipsychotic or other dopamine antagonist medications. The detection of parkinsonian changes to gait may provide an opportunity to intervene and address reversible causes. In this study, we investigate the use of a vision-based system as an unobtrusive means to assess severity of parkinsonism in gait.

Methods: Videos of walking bouts of natural gait were collected in a specialized dementia unit using a Microsoft Kinect sensor and onboard color camera, and were processed to extract sixteen 3D and eight 2D gait features. Univariate regression to gait quality, as rated on the Unified Parkinson's Disease Rating Scale (UPDRS) and Simpson-Angus Scale (SAS), was used to identify gait features significantly correlated to these clinical scores for inclusion in multivariate models. Multivariate ordinal logistic regression was subsequently performed and the relative contribution of each gait feature for regression to UPDRS-gait and SAS-gait scores was assessed.

Results: Four hundred one walking bouts from 14 older adults with dementia were included in the analysis. Multivariate ordinal logistic regression models incorporating selected 2D or 3D gait features attained similar accuracies: the UPDRS-gait regression models achieved accuracies of 61.4 and 62.1% for 2D and 3D features, respectively. Similarly, the SAS-gait models achieved accuracies of 47.4 and 48.5% with 2D or 3D gait features, respectively.

Conclusions: Gait features extracted from both 2D and 3D videos are correlated to UPDRS-gait and SAS-gait scores of parkinsonism severity in gait. Vision-based systems have the potential to be used as tools for longitudinal monitoring of parkinsonism in residential settings.

Keywords: Computer vision; Dementia; Gait; Human pose tracking; Parkinsonism.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Schematic of data collection equipment in hallway of dementia inpatient unit of a hospital. The Microsoft Kinect (a) begins recording when the RFID tags on the participants’ pants (b) are detected by the radio-frequency antennae in the walls (c)
Fig. 2
Fig. 2
Confusion matrices for regression to final multivariate regression models to UPDRS-gait (top) and SAS-gait (bottom) clinical scores using 2D (left) and 3D (right) gait features

References

    1. Allan LM, Ballard CG, Burn DJ, Kenny RA. Prevalence and severity of gait disorders in Alzheimer’s and non-Alzheimer’s dementias. J Am Geriatr Soc. 2005;53:1681–1687. doi: 10.1111/j.1532-5415.2005.53552.x.
    1. Caligiuri M, Jeste D, Lacro J. Antipsychotic-induced movement disorders in the elderly. Drugs Aging. 2000;17:363–384. doi: 10.2165/00002512-200017050-00004.
    1. Rochon PA, Stukel TA, Sykora K, Gill S, Garfinkel S, Anderson GM, et al. Atypical antipsychotics and parkinsonism. Archives of internal medicine. Am Med Assoc. 2005;165:1882–1888.
    1. Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martinez-Martin P, et al. Movement Disorder Society-sponsored revision of the unified Parkinson’s disease rating scale (MDS-UPDRS): scale presentation and clinimetric testing results. Mov Disord. 2008;23:2129–2170. doi: 10.1002/mds.22340.
    1. Simpson GM, Angus JWS. A rating scale for extrapyramidal side effects. Acta Psychiatr Scand. 1970;45:11–19. doi: 10.1111/j.1600-0447.1970.tb02066.x.
    1. Henderson EJ, Lord SR, Brodie MA, Gaunt DM, Lawrence AD, Close JCT, et al. Rivastigmine for gait stability in patients with Parkinson’s disease (ReSPonD): a randomised, double-blind, placebo-controlled, phase 2 trial. Lancet Neurol. 2016;15:249–258. doi: 10.1016/S1474-4422(15)00389-0.
    1. Cuzzolin F, Sapienza M, Esser P, Saha S, Franssen MM, Collett J, et al. Metric learning for Parkinsonian identification from IMU gait measurements. Gait Posture. 2017;54:127–132. doi: 10.1016/j.gaitpost.2017.02.012.
    1. De Lima ALS, Hahn T, Evers LJW, De Vries NM, Cohen E, Afek M, et al. Feasibility of large-scale deployment of multiple wearable sensors in Parkinson’s disease. PLoS One. 2017;12:e0189161. doi: 10.1371/journal.pone.0189161.
    1. Caramia C, Torricelli D, Schmid M, Muñoz-Gonzalez A, Gonzalez-Vargas J, Grandas F, et al. IMU-based classification of Parkinson’s disease from gait: a sensitivity analysis on sensor location and feature selection. IEEE J Biomed Health Inform. 2018;22:1765–1774. doi: 10.1109/JBHI.2018.2865218.
    1. Eltoukhy M. Microsoft Kinect can distinguish differences in over-ground gait between older persons with and without Parkinson’s disease. Med Eng Phys. 2017;44:1–7. doi: 10.1016/j.medengphy.2017.03.007.
    1. Geerse DJ, Roerdink M, Marinus J, van Hilten JJ. Assessing Walking Adaptability in Parkinson’s Disease: “The Interactive Walkway”. Front Neurol. 2018;9:1096. doi: 10.3389/fneur.2018.01096.
    1. Galna B, Barry G, Jackson D, Mhiripiri D, Olivier P, Rochester L. Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson’s disease. Gait Posture. 2014;39:1062–1068. doi: 10.1016/j.gaitpost.2014.01.008.
    1. Dranca L, de Abetxuko Ruiz de Mendarozketa L, Goñi A, Illarramendi A, Gomez IN, Alvarado MD, et al. Using Kinect to classify Parkinson’s disease stages related to severity of gait impairment. BMC Bioinformatics. 2018;19:471. doi: 10.1186/s12859-018-2488-4.
    1. Jiao J, Yuan L, Tang W, Deng Z, Wu Q. A post-rectification approach of depth images of Kinect v2 for 3D reconstruction of indoor scenes. ISPRS Int J Geo Inform. 2017;6:349. doi: 10.3390/ijgi6110349.
    1. Moon S, Park Y, Ko DW, Suh IH. Multiple kinect sensor fusion for human skeleton tracking using Kalman filtering. Int J Adv Robotic Syst. 2016;13:65. doi: 10.5772/62415.
    1. Nieto-Hidalgo M, Ferrández-Pastor FJ, Valdivieso-Sarabia RJ, Mora-Pascual J, García-Chamizo JM. A vision based proposal for classification of normal and abnormal gait using RGB camera. J Biomed Inform. 2016;63:82–89. doi: 10.1016/j.jbi.2016.08.003.
    1. Verlekar T, Soares L, Correia P. Automatic classification of gait impairments using a Markerless 2D video-based system. Sensors. 2018;18:2743. doi: 10.3390/s18092743.
    1. Wei SE, Ramakrishna V, Kanade T, Sheikh Y. Convolutional pose machines. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE Computer Society; 2016. p. 4724–32.
    1. Yan S, Xiong Y, Lin D. Spatial temporal graph convolutional networks for skeleton-based action recognition. Thirty-second AAAI conference on artificial intelligence. 2018.
    1. Li MH, Mestre TA, Fox SH, Taati B. Vision-based assessment of parkinsonism and levodopa-induced dyskinesia with pose estimation. J Neuroeng Rehabil. 2018;15:97. doi: 10.1186/s12984-018-0446-z.
    1. Li MH, Mestre TA, Fox SH, Taati B. Automated assessment of levodopa-induced dyskinesia: evaluating the responsiveness of video-based features. Parkinsonism Relat Disord. 2018;53:42–45. doi: 10.1016/j.parkreldis.2018.04.036.
    1. Mehdizadeh S, Dolatabadi E, Ng K-D, Mansfield A, Flint A, Taati B, et al. Vision-based assessment of gait features associated with falls in people with dementia. J Gerontol. 2019; Available from. 10.1093/gerona/glz187.
    1. Dolatabadi E, Zhi YX, Flint AJ, Mansfield A, Iaboni A, Taati B. The feasibility of a vision-based sensor for longitudinal monitoring of mobility in older adults with dementia. Arch Gerontol Geriatr. 2019;82:200–206. doi: 10.1016/j.archger.2019.02.004.
    1. Cao Z, Simon T, Wei S-E, Sheikh Y. Realtime multi-person 2d pose estimation using part affinity fields. 2017. pp. 7291–7299.
    1. Dolatabadi E, Taati B, Mihailidis A. Automated classification of pathological gait after stroke using ubiquitous sensing technology, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Orlando: IEEE; 2016. p. 6150–3.
    1. Dolatabadi E, Taati B, Mihailidis A. Concurrent validity of the Microsoft Kinect for windows v2 for measuring spatiotemporal gait parameters. Med Eng Phys. 2016;38:952–958. doi: 10.1016/j.medengphy.2016.06.015.
    1. Ng K, Mehdizadeh S, Iaboni A, Mansfield A, Flint A, Taati B. Measuring gait variables using computer vision to assess mobility and fall risk in older adults with dementia. IEEE J Transl Eng Health Med. 2020;8:1-9. 10.1109/JTEHM.2020.2998326.
    1. Huitema RB, Hof AL, Postema K. Ultrasonic motion analysis system—measurement of temporal and spatial gait parameters. J Biomech. 2002;35:837–842. doi: 10.1016/S0021-9290(02)00032-5.
    1. Ng K-DRB. Vision based human pose estimation for gait assessment of older adults with dementia. 2019.
    1. Park K, Roemmich RT, Elrod JM, Hass CJ, Hsiao-Wecksler ET. Effects of aging and Parkinson’s disease on joint coupling, symmetry, complexity and variability of lower limb movements during gait. Clin Biomech. 2016;33:92–97. doi: 10.1016/j.clinbiomech.2016.02.012.
    1. Roiz Rde M, EWA C, Pazinatto MM, Reis JG, Cliquet A, Jr, Barasnevicius-Quagliato E. Gait analysis comparing Parkinson’s disease with healthy elderly subjects. Arq Neuropsiquiatr. 2010;68:81–86. doi: 10.1590/S0004-282X2010000100018.
    1. Mirelman A, Bonato P, Camicioli R, Ellis TD, Giladi N, Hamilton JL, et al. Gait impairments in Parkinson’s disease. Lancet Neurol. 2019;18(7):697–708. doi: 10.1016/S1474-4422(19)30044-4.
    1. de Deus FT, Santos García D, Macías AM. Inter-rater variability in motor function assessment in Parkinson’s disease between experts in movement disorders and nurses specialising in PD management. Neurología. 2019;34:520–526. doi: 10.1016/j.nrl.2017.03.005.
    1. Post B, Merkus MP, de Bie RMA, de Haan RJ, Speelman JD. Unified Parkinson’s disease rating scale motor examination: are ratings of nurses, residents in neurology, and movement disorders specialists interchangeable? Mov Disord. 2005;20:1577–1584. doi: 10.1002/mds.20640.

Source: PubMed

Sponzoři a spolupracovníci

Zdravotní podmínky

Drogové intervence

3
Předplatit