Deep-Learning Approach to Predict Survival Outcomes Using Wearable Actigraphy Device Among End-Stage Cancer Patients

Tien Yun Yang, Pin-Yu Kuo, Yaoru Huang, Hsiao-Wei Lin, Shwetambara Malwade, Long-Sheng Lu, Lung-Wen Tsai, Shabbir Syed-Abdul, Chia-Wei Sun, Jeng-Fong Chiou, Tien Yun Yang, Pin-Yu Kuo, Yaoru Huang, Hsiao-Wei Lin, Shwetambara Malwade, Long-Sheng Lu, Lung-Wen Tsai, Shabbir Syed-Abdul, Chia-Wei Sun, Jeng-Fong Chiou

Abstract

Survival prediction is highly valued in end-of-life care clinical practice, and patient performance status evaluation stands as a predominant component in survival prognostication. While current performance status evaluation tools are limited to their subjective nature, the advent of wearable technology enables continual recordings of patients' activity and has the potential to measure performance status objectively. We hypothesize that wristband actigraphy monitoring devices can predict in-hospital death of end-stage cancer patients during the time of their hospital admissions. The objective of this study was to train and validate a long short-term memory (LSTM) deep-learning prediction model based on activity data of wearable actigraphy devices. The study recruited 60 end-stage cancer patients in a hospice care unit, with 28 deaths and 32 discharged in stable condition at the end of their hospital stay. The standard Karnofsky Performance Status score had an overall prognostic accuracy of 0.83. The LSTM prediction model based on patients' continual actigraphy monitoring had an overall prognostic accuracy of 0.83. Furthermore, the model performance improved with longer input data length up to 48 h. In conclusion, our research suggests the potential feasibility of wristband actigraphy to predict end-of-life admission outcomes in palliative care for end-stage cancer patients. Clinical Trial Registration: The study protocol was registered on ClinicalTrials.gov (ID: NCT04883879).

Keywords: actigraphy; deep learning; long short-term memory networks; palliative care; performance status; prognostic accuracy; survival prediction; wearable technology.

Conflict of interest statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Copyright © 2021 Yang, Kuo, Huang, Lin, Malwade, Lu, Tsai, Syed-Abdul, Sun and Chiou.

Figures

Figure 1
Figure 1
The basic architecture (A) and data pre-processing and architectural flow (B) of the Long Short-Term Memory model. Symbol x and h represent the input and output values of the LSTM cell. Symbol c represents the value of the memory cell in each LSTM cell. Subscript t represents the time step.
Figure 2
Figure 2
The Receiver Operating Characteristic curve of Karnofsky Performance Status (blue) and Palliative Prognostic Index (green).
Figure 3
Figure 3
The representative activity pattern of patients with clinical outcomes of death (A) and discharged in stable condition (B). The red points on the graph indicated that the patient had taken off the device.
Figure 4
Figure 4
Confusion matrices of the preliminary prediction model. (A): Confusion matrix of the testing dataset, with normalization. (B): Confusion matrix of the testing dataset, without normalization.
Figure 5
Figure 5
Confusion matrices of the final prediction model. (A) Confusion matrix of the testing dataset, with normalization. (B) Confusion matrix of the testing dataset, without normalization.

References

    1. Steinhauser KE, Christakis NA, Clipp EC, McNeilly M, McIntyre L, Tulsky JA. Factors considered important at the end of life by patients, family, physicians, and other care providers. JAMA. (2000) 284:2476–82. 10.1001/jama.284.19.2476
    1. Steinhauser KE, Christakis NA, Clipp EC, McNeilly M, Grambow S, Parker J, et al. . Preparing for the end of life: preferences of patients, families, physicians, and other care providers. J Pain Symptom Manage. (2001) 22:727–37. 10.1016/S0885-3924(01)00334-7
    1. Kirk P, Kirk I, Kristjanson LJ. What do patients receiving palliative care for cancer and their families want to be told? A Canadian and Australian qualitative study. BMJ. (2004) 328:1343. 10.1136/bmj.38103.423576.55
    1. Pirovano M, Maltoni M, Nanni O, Marinari M, Indelli M, Zaninetta G, et al. . A new palliative prognostic score: a first step for the staging of terminally ill cancer patients. Italian multicenter and study group on palliative care. J Pain Symptom Manage. (1999) 17:231–9. 10.1016/S0885-3924(98)00145-6
    1. Glare P, Virik K. Independent prospective validation of the PaP score in terminally ill patients referred to a hospital-based palliative medicine consultation service. J Pain Symptom Manage. (2001) 22:891–8. 10.1016/S0885-3924(01)00341-4
    1. Tarumi Y, Watanabe SM, Lau F, Yang J, Quan H, Sawchuk L, et al. . Evaluation of the palliative prognostic score (PaP) and routinely collected clinical data in prognostication of survival for patients referred to a palliative care consultation service in an acute care hospital. J Pain Symptom Manage. (2011) 42:419–31. 10.1016/j.jpainsymman.2010.12.013
    1. Morita T, Tsunoda J, Inoue S, Chihara S. The palliative prognostic index: a scoring system for survival prediction of terminally ill cancer patients. Support Care Cancer. (1999) 7:128–33. 10.1007/s005200050242
    1. Stone CA, Tiernan E, Dooley BA. Prospective validation of the palliative prognostic index in patients with cancer. J Pain Symptom Manage. (2008) 35:617–22. 10.1016/j.jpainsymman.2007.07.006
    1. Kao CY, Hung YS, Wang HM, Chen JS, Chin TL, Lu CY, et al. . Combination of initial palliative prognostic index and score change provides a better prognostic value for terminally ill cancer patients: a six-year observational cohort study. J Pain Symptom Manage. (2014) 48:804–14. 10.1016/j.jpainsymman.2013.12.246
    1. Gwilliam B, Keeley V, Todd C, Gittins M, Roberts C, Kelly L, et al. . Development of prognosis in palliative care study (PiPS) predictor models to improve prognostication in advanced cancer: prospective cohort study. BMJ Support Palliat Care. (2012) 2:63–71. 10.1136/bmjspcare.2012.d4920rep
    1. Kim ES, Lee JK, Kim MH, Noh HM, Jin YH. Validation of the prognosis in palliative care study predictor models in terminal cancer patients. Korean J Fam Med. (2014) 35:283–94. 10.4082/kjfm.2014.35.6.283
    1. Forrest LM, McMillan DC, McArdle CS, Angerson WJ, Dunlop DJ. Evaluation of cumulative prognostic scores based on the systemic inflammatory response in patients with inoperable non-small-cell lung cancer. Br J Cancer. (2003) 89:1028–30. 10.1038/sj.bjc.6601242
    1. Laird BJ, Kaasa S, McMillan DC, Fallon MT, Hjermstad MJ, Fayers P, et al. . Prognostic factors in patients with advanced cancer: a comparison of clinicopathological factors and the development of an inflammation-based prognostic system. Clin Cancer Res. (2013) 19:5456–64. 10.1158/1078-0432.CCR-13-1066
    1. Karnofsky DA, Burchenal JH. The clinical evaluation of chemotherapeutic agents in cancer. In: MC M, editor. Evaluation of Chemotherapeutic Agents. New York, NY: Columbia University Press; (1949). p. 196.
    1. Oken MM, Creech RH, Tormey DC, Horton J, Davis TE, McFadden ET, et al. . Toxicity and response criteria of the eastern cooperative oncology group. Am J Clin Oncol. (1982) 5:649–55. 10.1097/00000421-198212000-00014
    1. Anderson F, Downing GM, Hill J, Casorso L, Lerch N. Palliative performance scale (PPS): a new tool. J Palliat Care. (1996) 12:5–11. 10.1177/082585979601200102
    1. Blagden SP, Charman SC, Sharples LD, Magee LR, Gilligan D. Performance status score: do patients and their oncologists agree? Br J Cancer. (2003) 89:1022–7. 10.1038/sj.bjc.6601231
    1. Kelly CM, Shahrokni A. Moving beyond karnofsky and ECOG performance status assessments with new technologies. J Oncol. (2016) 2016:6186543. 10.1155/2016/6186543
    1. Christakis NA, Lamont EB. Extent and determinants of error in doctors' prognoses in terminally ill patients: prospective cohort study. BMJ. (2000) 320:469–72. 10.1136/bmj.320.7233.469
    1. Michael JC, El Nokali NE, Black JJ, Rofey DL. Mood and ambulatory monitoring of physical activity patterns in youth with polycystic ovary syndrome. J Pediatr Adolesc Gynecol. (2015) 28:369–72. 10.1016/j.jpag.2014.10.010
    1. Langenberg S, Schulze M, Bartsch M, Gruner-Labitzke K, Pek C, Köhler H, et al. . Physical activity is unrelated to cognitive performance in pre-bariatric surgery patients. J Psychosom Res. (2015) 79:165–70. 10.1016/j.jpsychores.2015.03.008
    1. Kawagoshi A, Kiyokawa N, Sugawara K, Takahashi H, Sakata S, Miura S, et al. . Quantitative assessment of walking time and postural change in patients with COPD using a new triaxial accelerometer system. Int J Chron Obstruct Pulmon Dis. (2013) 8:397–404. 10.2147/COPD.S49491
    1. Carvalho EV, Reboredo MM, Gomes EP, Teixeira DR, Roberti NC, Mendes JO, et al. . Physical activity in daily life assessed by an accelerometer in kidney transplant recipients and hemodialysis patients. Transplant Proc. (2014) 46:1713–7. 10.1016/j.transproceed.2014.05.019
    1. Wielopolski J, Reich K, Clepce M, Fischer M, Sperling W, Kornhuber J, et al. . Physical activity and energy expenditure during depressive episodes of major depression. J Affect Disord. (2015) 174:310–6. 10.1016/j.jad.2014.11.060
    1. Gresham G, Hendifar AE, Spiegel B, Neeman E, Tuli R, Rimel BJ, et al. . Wearable activity monitors to assess performance status and predict clinical outcomes in advanced cancer patients. NPJ Digit Med. (2018) 1:27. 10.1038/s41746-018-0032-6
    1. Kuo TBJ, Li JY, Chen CY, Lin YC, Tsai MW, Lin SP, et al. . Influence of accelerometer placement and/or heart rate on energy expenditure prediction during uphill exercise. J Mot Behav. (2018) 50:127–33. 10.1080/00222895.2017.1306481
    1. Barsasella D, Syed-Abdul S, Malwade S, Kuo TBJ, Chien M-J, Núñez-Benjumea FJ, et al. . Sleep quality among breast and prostate cancer patients: a Comparison between subjective and objective measurements. Healthcare. (2021) 9:785. 10.3390/healthcare9070785
    1. Kolen JF, Kremer SC. A Field Guide to Dynamical Recurrent Networks. New York, NY: John Wiley & Sons; (2001).
    1. Lingras P, Sharma S, Zhong M. Prediction of recreational travel using genetically designed regression and time-delay neural network models. Transportation Res Record. (2002) 1805:16–24. 10.3141/1805-03
    1. Bengio Y, Simard P, Frasconi P. Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw. (1994) 5:157–66. 10.1109/72.279181
    1. Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. (1997) 9:1735–80. 10.1162/neco.1997.9.8.1735
    1. Gers FA, Schmidhuber J, Cummins F. Learning to forget: continual prediction with lSTM. Neural Comput. (2000) 12:2451–71. 10.1162/089976600300015015
    1. Siami-Namini S, Tavakoli N, Namin AS. editors. A comparison of ARIMA and LSTM in forecasting time series. In: 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA). Orlando, FL: (2018). 10.1109/ICMLA.2018.00227
    1. Karmiani D, Kazi R, Nambisan A, Shah A, Kamble V. editors. Comparison of predictive algorithms: backpropagation, SVM, LSTM and kalman filter for stock market. In: 2019 Amity International Conference on Artificial Intelligence (AICAI). Dubai: (2019). 10.1109/AICAI.2019.8701258
    1. Umematsu T, Sano A, Taylor S, Picard RW. editors. Improving students' daily life stress forecasting using LSTM neural networks. In: 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI). Chicago, IL: (2019). 10.1109/BHI.2019.8834624
    1. Hwang SS, Scott CB, Chang VT, Cogswell J, Srinivas S, Kasimis B. Prediction of survival for advanced cancer patients by recursive partitioning analysis: role of karnofsky performance status, quality of life, and symptom distress. Cancer Invest. (2004) 22:678–87. 10.1081/CNV-200032911
    1. Jang RW, Caraiscos VB, Swami N, Banerjee S, Mak E, Kaya E, et al. . Simple prognostic model for patients with advanced cancer based on performance status. J Oncol Pract. (2014) 10:e335–41. 10.1200/JOP.2014.001457
    1. Nilanon T, Nocera LP, Martin AS, Kolatkar A, May M, Hasnain Z, et al. . Use of wearable activity tracker in patients with cancer undergoing chemotherapy: toward evaluating risk of unplanned health care encounters. JCO Clin Cancer Inform. (2020) 4:839–53. 10.1200/CCI.20.00023
    1. Ancoli-Israel S, Cole R, Alessi C, Chambers M, Moorcroft W, Pollak CP. The role of actigraphy in the study of sleep and circadian rhythms. Sleep. (2003) 26:342–92. 10.1093/sleep/26.3.342
    1. Sulli G, Lam MTY, Panda S. Interplay between circadian clock and cancer: new frontiers for cancer treatment. Trends Cancer. (2019) 5:475–94. 10.1016/j.trecan.2019.07.002
    1. Ergen T, Kozat SS. Online training of lSTM networks in distributed systems for variable length data sequences. IEEE Trans Neural Netw Learn Syst. (2018) 29:5159–65. 10.1109/TNNLS.2017.2770179

Source: PubMed

3
Prenumerera