Motion Sequence Alignment for A Kinect-Based In-Home Exercise System for Lymphatic Health and Lymphedema Intervention

An-Ti Chiang, Qi Chen, Yao Wang, Mei R Fu, An-Ti Chiang, Qi Chen, Yao Wang, Mei R Fu

Abstract

Using Kinect sensors to monitor and provide feedback to patients performing intervention or rehabilitation exercises is an upcoming trend in healthcare. However, the users' motion sequences differ significantly even when doing the same exercise and are not temporally aligned, making the evaluation of the correctness of their movement challenging. We have developed a method to divide the long motion sequence for each exercise into multiple subsequences, each corresponding to the transition of one key pose to another. We also developed a subsequence-based dynamic time warping algorithm that can automatically detect the endpoint of each subsequence with minimum delay, while simultaneously aligning the detected subsequence to the reference subsequence for the exercise. These methods have been integrated into a prototype system for guiding patients at risks for breast-cancer related lymphedema to perform a set of lymphatic exercises in order to promote lymphatic health and reduce the risk of lymphedema. The system can provide relevant feedback to the patient performing an exercise in real time.

Figures

Fig. 1
Fig. 1
Proposed system flowchart
Fig. 2
Fig. 2
The subsequences and repetitions in “horizontal pumping” exercise
Fig. 3
Fig. 3
Traces of the left wrist x-coordinate while users performing a subsequence in the ”Horizontal Pumping” exercise. (a) Standardized MOCAP traces; (b) Aligned traces by stretching all traces to the same length; (c) Aligned traces by aligning at two key transition points.
Fig. 4
Fig. 4
The reference sequence and a user’s motion sequence of the x coordinate of the left wrist during Exercise 4. Each “sec” indicate a subsequence.

References

    1. Alexiadis DS, Kelly P, Daras P, et al. Proceedings of the 19th ACM international conference on Multimedia. ACM; 2011. Evaluating a dancer’s performance using kinect-based skeleton tracking.
    1. Yurtman A, Barshan B. Information Sciences and Systems. Springer; 2013. Detection and evaluation of physical therapy exercises by dynamic time warping using wearable motion sensor units.
    1. Wei W, Lu Y, Printz CD, et al. Proceedings of the conference on Wireless Health. ACM; 2015. Motion data alignment and real-time guidance in cloud-based virtual training system.
    1. Chiang AT, Chen Q, Wang Y, et al. Proceedings of the 2nd International Workshop on Multimedia for Personal Health and Health Care, MMHealth ’17. ACM; 2017. Denoising of joint tracking data by kinect sensors using clustered gaussian process regression.
    1. Fu MR, Axelrod D, Guth AA, et al. Proactive approach to lymphedema risk reduction: a prospective study. Annals of surgical oncology. 2014
    1. Fu MR, Axelrod D, Guth AA, et al. Usability and feasibility of health it interventions to enhance self-care for lymphedema symptom management in breast cancer survivors. Internet interventions. 2016
    1. Fu MR, Axelrod D, Guth AA, et al. mhealth self-care interventions: managing symptoms following breast cancer treatment. Mhealth. 2016
    1. Sakoe H, Chiba S. Dynamic programming algorithm optimization for spoken word recognition. IEEE transactions on acoustics, speech, and signal processing. 1978

Source: PubMed

3
Subskrybuj