Quantification and recognition of parkinsonian gait from monocular video imaging using kernel-based principal component analysis

Shih-Wei Chen, Sheng-Huang Lin, Lun-De Liao, Hsin-Yi Lai, Yu-Cheng Pei, Te-Son Kuo, Chin-Teng Lin, Jyh-Yeong Chang, You-Yin Chen, Yu-Chun Lo, Shin-Yuan Chen, Robby Wu, Siny Tsang, Shih-Wei Chen, Sheng-Huang Lin, Lun-De Liao, Hsin-Yi Lai, Yu-Cheng Pei, Te-Son Kuo, Chin-Teng Lin, Jyh-Yeong Chang, You-Yin Chen, Yu-Chun Lo, Shin-Yuan Chen, Robby Wu, Siny Tsang

Abstract

Background: The computer-aided identification of specific gait patterns is an important issue in the assessment of Parkinson's disease (PD). In this study, a computer vision-based gait analysis approach is developed to assist the clinical assessments of PD with kernel-based principal component analysis (KPCA).

Method: Twelve PD patients and twelve healthy adults with no neurological history or motor disorders within the past six months were recruited and separated according to their "Non-PD", "Drug-On", and "Drug-Off" states. The participants were asked to wear light-colored clothing and perform three walking trials through a corridor decorated with a navy curtain at their natural pace. The participants' gait performance during the steady-state walking period was captured by a digital camera for gait analysis. The collected walking image frames were then transformed into binary silhouettes for noise reduction and compression. Using the developed KPCA-based method, the features within the binary silhouettes can be extracted to quantitatively determine the gait cycle time, stride length, walking velocity, and cadence.

Results and discussion: The KPCA-based method uses a feature-extraction approach, which was verified to be more effective than traditional image area and principal component analysis (PCA) approaches in classifying "Non-PD" controls and "Drug-Off/On" PD patients. Encouragingly, this method has a high accuracy rate, 80.51%, for recognizing different gaits. Quantitative gait parameters are obtained, and the power spectrums of the patients' gaits are analyzed. We show that that the slow and irregular actions of PD patients during walking tend to transfer some of the power from the main lobe frequency to a lower frequency band. Our results indicate the feasibility of using gait performance to evaluate the motor function of patients with PD.

Conclusion: This KPCA-based method requires only a digital camera and a decorated corridor setup. The ease of use and installation of the current method provides clinicians and researchers a low cost solution to monitor the progression of and the treatment to PD. In summary, the proposed method provides an alternative to perform gait analysis for patients with PD.

Figures

Figure 1
Figure 1
A general schematic of the experimental setup used for video recording. The participant wears a light suit to enhance the contrast between the individual and the dark background. The participant walks along the course (approximately 6 m) in front of the video camera (located approximately 4.1 m away). To ensure that the captured data reflect the gait performance during the steady-state walking period, the camera videotapes only the middle 3 m of each walking trial.
Figure 2
Figure 2
A flow-chart of gait analysis and recognition.
Figure 3
Figure 3
The trimmed 64 × 64 pixel binary walking sequence silhouettes of non-PD control (top) and Parkinson's disease (PD) patients in the "Drug-Off" (middle) and "Drug-On" (bottom) states.
Figure 4
Figure 4
An example of step image frames from a non-PD control subject. (a) Step image frames from a non-PD control subject. The top panel is the original sequential walking image frames with 240 × 320 pixels. The bottom panel is the trimmed 64 × 64 pixels binary silhouettes of the top image frames. (b) The magnitudes of the associated sequential primary KPCA components. For simplicity, the primary KPCA component is denoted as 1stKPC. The green dots indicate the magnitudes of the sequential 1stKPCs. (c) The power spectrum of (b) using a 2048-point DFT and rectangular window with a length, L, of 64 points.
Figure 5
Figure 5
The representations of 1stKPC gait feature for non-PD control subjects and PD patients, respectively. (a) The 1stKPC waveform of a selected non-PD control participant. (b) The 1stKPC waveform of a selected PD patient in the "Drug-Off" state. (c) The 1stKPC waveform of the same PD patient in the "Drug-On" state. The red circles and black squares represent the local maximums and minimums, which reflect the occurrences of mid-swings and heel strikes, respectively.
Figure 6
Figure 6
The gait frequency spectra of (a) PD patients in the "Drug-Off" state (red solid line) and the "Drug-On" state and (b) the non-PD controls.
Figure 7
Figure 7
Equipment setup used to measure gait parameters with the GAITRite® mat and its recording system, and the KPCA-based method.
Figure 8
Figure 8
Sequential gait image frames from a healthy subject walking on the GAITRite® walkway system. (a) Sequential gait image frames from a healthy subject walking on the GAITRite walkway system. The top panels are the original sequential walking image frames containing 240 × 320 pixels. The bottom panels are the trimmed 64 × 64 pixel binary silhouettes of the top image frames. (b) The 1stKPC waveform of a selected non-PD control volunteer participating in the preliminary experiment. The green dots indicate the magnitudes of the sequential 1stKPCs.

References

    1. Parkinson J. An essay on the shaking palsy. Journal of Neuropsychiatry and Clinical Neurosciences. 2002;14(2):223–236. doi: 10.1176/appi.neuropsych.14.2.223.
    1. Filion M, Tremblay L. Abnormal spontaneous activity of globus pallidus neurons in monkeys with MPTP-induced parkinsonism. Brain research. 1991;547(1):140–144. doi: 10.1016/0006-8993(91)90585-J.
    1. Filion M, Tremblay L, Bedard PJ. Abnormal influences of passive limb movement on the activity of globus pallidus neurons in parkinsonian monkeys. Brain research. 1988;444(1):165–176. doi: 10.1016/0006-8993(88)90924-9.
    1. Lang A, Lozano A. Parkinson's disease. Second of two parts. The New England journal of medicine. 1998;339(16):1130–1143. doi: 10.1056/NEJM199810153391607.
    1. Yang YR, Lee YY, Cheng SJ, Lin PY, Wang RY. Relationships between gait and dynamic balance in early Parkinson's disease. Gait & posture. 2008;27(4):611–615. doi: 10.1016/j.gaitpost.2007.08.003.
    1. Rosin R, Topka H, Dichgans J. Gait initiation in Parkinson's disease. Movement disorders. 1997;12(5):682–690. doi: 10.1002/mds.870120509.
    1. Martinez Martin P, Gil Nagel A, Gracia LM, Gomez JB, Martinez Sarries J, Bermejo F. Unified Parkinson's disease rating scale characteristics and structure. Movement disorders. 1994;9(1):76–83. doi: 10.1002/mds.870090112.
    1. Hubble JP, Pahwa R, Michalek DK, Thomas C, Koller WC. Interactive video conferencing: a means of providing interim care to Parkinson's disease patients. Movement disorders. 1993;8(3):380–382. doi: 10.1002/mds.870080326.
    1. Lozano A, Lang A, Galvez-Jimenez N, Miyasaki J, Duff J, Hutchison W, Dostrovsky J. Effect of GPi pallidotomy on motor function in Parkinson's disease. The Lancet. 1995;346(8987):1383–1387. doi: 10.1016/S0140-6736(95)92404-3.
    1. Kepple T, Stanhope S, Lohmann K, Roman N. A video-based technique for measuring ankle--subtalar motion during stance. Journal of biomedical engineering. 1990;12(4):273–280. doi: 10.1016/0141-5425(90)90001-4.
    1. Chang LG, JA Burne R. An automated form of video image analysis applied to classification of movement disorders. Disability & Rehabilitation. 2000;22(1-2):97–108. doi: 10.1080/096382800297169.
    1. Krawetz P, Nance P. Gait analysis of spinal cord injured subjects: Effects of injury level and spasticity. Archives of physical medicine and rehabilitation. 1996;77(7):635–638. doi: 10.1016/S0003-9993(96)90000-3.
    1. Borghese N, Bianchi L, Lacquaniti F. Kinematic determinants of human locomotion. The Journal of Physiology. 1996;494:863–879.
    1. Baker R. Gait analysis methods in rehabilitation. Journal of NeuroEngineering and Rehabilitation. 2006;3(1):4–13. doi: 10.1186/1743-0003-3-4.
    1. Cho C, Osaki Y, Kunin M, Cohen B, Olanow CW, Raphan T. A Model-Based Approach for Assessing Parkinsonian Gait and Effects of Levodopa and Deep Brain Stimulation. Proceedings of the 28th IEEE EMBS Annual International Conference: Aug. 30 2006-Sept. 3 2006 2006; Nwe York City. 2006. pp. 1228–1231.
    1. Huang PS, Harris CJ, Nixon MS. Human gait recognition in canonical space using temporal templates. IEE Proceedings of Vision, Image and Signal Processing. 1999;146(2):93–100. doi: 10.1049/ip-vis:19990187.
    1. Nixon MS, Carter JN, Grant MG, Gordon L, Hayfron-Acquah JB. Automatic recognition by gait: progress and prospects. Sensor Review. 2003;23(4):323–331. doi: 10.1108/02602280310496845.
    1. Little J, Boyd J. Recognizing people by their gait: the shape of motion. Videre: Journal of Computer Vision Research. 1998;1(2):1–32.
    1. Niyogi SA, Adelson EH. Analyzing and recognizing walking figures in XYT. IEEE Proceedings of Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'94): 21-23 Jun 1994 1994. 1994. pp. 469–474.
    1. Murase H, Sakai R. Moving object recognition in eigenspace representation: gait analysis and lip reading. Pattern recognition letters. 1996;17(2):155–162. doi: 10.1016/0167-8655(95)00109-3.
    1. Huang PS, Harris CJ, Nixon MS. Recognising humans by gait via parametric canonical space. Artificial Intelligence in Engineering. 1999;13(4):359–366. doi: 10.1016/S0954-1810(99)00008-4.
    1. Scholkopf B, Smola A, Muller KR. Nonlinear component analysis as a kernel eigenvalue problem. Neural computation. 1998;10(5):1299–1319. doi: 10.1162/089976698300017467.
    1. Sarkar S, Phillips PJ, Liu Z, Vega IR, Grother P, Bowyer KW. The human ID gait challenge problem: Data sets, performance, and analysis. IEEE transactions on pattern analysis and machine intelligence. 2005. pp. 162–177.
    1. Polat K, Gunes S. Automatic determination of diseases related to lymph system from lymphography data using principles component analysis (PCA), fuzzy weighting pre-processing and ANFIS. Expert Systems with Applications. 2007;33(3):636–641. doi: 10.1016/j.eswa.2006.06.004.
    1. Bow S-T. Pattern Recognition and Image Preprocessing. 2. Marcel Dekker, Inc. New York, NY, USA; 2002.
    1. Duda RO, Hart PE, Stork DG. Pattern classification. 2. New York: John Wiley & Sons; 2000.
    1. Wang L, Tan T, Ning H, Hu W. Silhouette analysis-based gait recognition for human identification. IEEE transactions on pattern analysis and machine intelligence. 2003. pp. 1505–1518.
    1. Turk M, Pentland A. Eigenfaces for recognition. Journal of cognitive neuroscience. 1991;3(1):71–86. doi: 10.1162/jocn.1991.3.1.71.
    1. Ruderman DL. Origins of scaling in natural images. Vision research. 1997;37(23):3385–3398. doi: 10.1016/S0042-6989(97)00008-4.
    1. Brigham EO. The fast Fourier transform and its applications. Englewood Cliffs, N.J.: Prentice Hall; 1988.
    1. O'Sullivan JD, Said CM, Dillon LC, Hoffman M, Hughes AJ. Gait analysis in patients with Parkinson's disease and motor fluctuations: influence of levodopa and comparison with other measures of motor function. Mov Disord. 1998;13(6):900–906. doi: 10.1002/mds.870130607.
    1. Vokaer M, Azar NA, de Beyl DZ. Effects of levodopa on upper limb mobility and gait in Parkinson's disease. Journal of Neurology, Neurosurgery & Psychiatry. 2003;74(9):1304–1307. doi: 10.1136/jnnp.74.9.1304.
    1. Lubik S, Fogel W, Tronnier V, Krause M, Konig J, Jost W. Gait analysis in patients with advanced Parkinson disease: different or additive effects on gait induced by levodopa and chronic STN stimulation. Journal of neural transmission. 2006;113(2):163–173. doi: 10.1007/s00702-005-0310-8.
    1. Ferrandez AM, Blin O. A comparison between the effect of intentional modulations and the action of L-dopa on gait in Parkinson's disease. Behavioural brain research. 1991;45(2):177–183. doi: 10.1016/S0166-4328(05)80083-X.
    1. O'Sullivan JD, Said CM, Dillon LC, Hoffman M, Hughes AJ. Gait analysis in patients with Parkinson's disease and motor fluctuations: influence of levodopa and comparison with other measures of motor function. Movement disorders. 1998;13(6):900–906. doi: 10.1002/mds.870130607.
    1. Rajput A, Rozdilsky B, Rajput A, Ang L. Levodopa efficacy and pathological basis of Parkinson syndrome. Clinical neuropharmacology. 1990;13(6):553–558. doi: 10.1097/00002826-199012000-00007.
    1. Menz HB, Latt MD, Tiedemann A, Mun San Kwan M, Lord SR. Reliability of the GAITRite walkway system for the quantification of temporo-spatial parameters of gait in young and older people. Gait & posture. 2004;20(1):20–25. doi: 10.1016/S0966-6362(03)00068-7.

Source: PubMed

3
Tilaa