Comparative analysis of predictive methods for early assessment of compliance with continuous positive airway pressure therapy

Xavier Rafael-Palou, Cecilia Turino, Alexander Steblin, Manuel Sánchez-de-la-Torre, Ferran Barbé, Eloisa Vargiu, Xavier Rafael-Palou, Cecilia Turino, Alexander Steblin, Manuel Sánchez-de-la-Torre, Ferran Barbé, Eloisa Vargiu

Abstract

Background: Patients suffering obstructive sleep apnea are mainly treated with continuous positive airway pressure (CPAP). Although it is a highly effective treatment, compliance with this therapy is problematic to achieve with serious consequences for the patients' health. Unfortunately, there is a clear lack of clinical analytical tools to support the early prediction of compliant patients.

Methods: This work intends to take a further step in this direction by building compliance classifiers with CPAP therapy at three different moments of the patient follow-up, before the therapy starts (baseline) and at months 1 and 3 after the baseline.

Results: Results of the clinical trial shows that month 3 was the time-point with the most accurate classifier reaching an f1-score of 87% and 84% in cross-validation and test. At month 1, performances were almost as high as in month 3 with 82% and 84% of f1-score. At baseline, where no information of patients' CPAP use was given yet, the best classifier achieved 73% and 76% of f1-score in cross-validation and test set respectively. Subsequent analyzes carried out with the best classifiers of each time point revealed baseline factors (i.e. headaches, psychological symptoms, arterial hypertension and EuroQol visual analog scale) closely related to the prediction of compliance independently of the time-point. In addition, among the variables taken only during the follow-up of the patients, Epworth and the average nighttime hours were the most important to predict compliance with CPAP.

Conclusions: Best classifiers reported high performances after one month of treatment, being the third month when significant differences were achieved with respect to the baseline. Four baseline variables were reported relevant for the prediction of compliance with CPAP at each time-point. Two characteristics more were also highlighted for the prediction of compliance at months 1 and 3.

Trial registration: ClinicalTrials.gov Identifier, NCT03116958 . Retrospectively registered on 17 April 2017.

Keywords: Continuous positive airway pressure; Machine learning; Obtrusive sleep apnea; Predictive methods.

Conflict of interest statement

Ethics approval and consent to participate

Ethics approval was obtained from the Human Research Ethics Committee of University Hospital of Arnau de Vilanova (Lleida) with the reference number 10/2014, in accordance with the Declaration of Helsinki, and written informed consent to participate was obtained from each patient included in the investigation.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Figures

Fig. 1
Fig. 1
Pipeline steps designed for building classifiers for compliance with the CPAP therapy
Fig. 2
Fig. 2
ROC curves for cross-validation and test of the best pipeline for dataset D0
Fig. 3
Fig. 3
ROC curves for cross-validation and test of the best pipeline for dataset D1
Fig. 4
Fig. 4
ROC curves for cross-validation and test of the best pipeline for dataset D3
Fig. 5
Fig. 5
Learning curves of the best pipeline for dataset D0
Fig. 6
Fig. 6
Learning curves of the best pipeline for dataset D1
Fig. 7
Fig. 7
Learning curves of the best pipeline for dataset D3
Fig. 8
Fig. 8
Best pipelines results in cross-validation and test at different time-points
Fig. 9
Fig. 9
Stability scores and feature weights of the best pipeline for dataset D0
Fig. 10
Fig. 10
Stability scores and feature weights of the best pipeline for dataset D1
Fig. 11
Fig. 11
Stability scores and feature weights of the best pipeline for dataset D3

References

    1. Smith PL, Hudgel DW, Olson L, Partinen M, Rapoport DM, Rosen CL, Skatrud JB, Waldhorn RE, Westbrook PR, Young T. Indications and standards for use of nasal continuous positive airway pressure (cpap) in sleep apnea syndromes. Am J Respir Crit Care Med. 1994;150(6 I):1738–45.
    1. Kribbs NB, Pack AI, Kline LR, Smith PL, Schwartz AR, Schubert NM, Redline S, Henry JN, Getsy JE, Dinges DF. Objective measurement of patterns of nasal cpap use by patients with obstructive sleep apnea. Am Rev Respir Dis. 1993;147(4):887–95. doi: 10.1164/ajrccm/147.4.887.
    1. Prosise GL, Berry RB. Oral-nasal continuous positive airway pressure as a treatment for obstructive sleep apnea. CHEST J. 1994;106(1):180–6. doi: 10.1378/chest.106.1.180.
    1. Sanders MH, Kern NB, Stiller RA, Strollo PJ, Martin TJ, Atwood CW. Cpap therapy via oronasal mask for obstructive sleep apnea. CHEST J. 1994;106(3):774–9. doi: 10.1378/chest.106.3.774.
    1. Sullivan C, Berthon-Jones M, Issa F, Eves L. Reversal of obstructive sleep apnoea by continuous positive airway pressure applied through the nares. Lancet. 1981;317(8225):862–5. doi: 10.1016/S0140-6736(81)92140-1.
    1. Engleman HM, Martin SE, Kingshott RN, Mackay TW, Deary IJ, Douglas NJ. Randomised placebo controlled trial of daytime function after continuous positive airway pressure (cpap) therapy for the sleep apnoea/hypopnoea syndrome. Thorax. 1998;53(5):341–5. doi: 10.1136/thx.53.5.341.
    1. Marin JM, Carrizo SJ, Vicente E, Agusti AG. Long-term cardiovascular outcomes in men with obstructive sleep apnoea-hypopnoea with or without treatment with continuous positive airway pressure: an observational study. Lancet. 2005;365(9464):1046–53. doi: 10.1016/S0140-6736(05)74229-X.
    1. Hussain SF, Irfan M, Waheed Z, Alam N, Mansoor S, Islam M. Compliance with continuous positive airway pressure (cpap) therapy for obstructive sleep apnea among privately paying patients-a cross sectional study. BMC Pulm Med. 2014;14(1):188. doi: 10.1186/1471-2466-14-188.
    1. Campos-Rodriguez F, Martinez-Alonso M, Sanchez-de-la-Torre M, Barbe F, Network SS, et al. Long-term adherence to continuous positive airway pressure therapy in non-sleepy sleep apnea patients. Sleep Med. 2016;17:1–6. doi: 10.1016/j.sleep.2015.07.038.
    1. Weaver TE, Chasens ER. Continuous positive airway pressure treatment for sleep apnea in older adults. Sleep Med Rev. 2007;11(2):99–111. doi: 10.1016/j.smrv.2006.08.001.
    1. McArdle N, Devereux G, Heidarnejad H, Engleman HM, Mackay TW, Douglas NJ. Long-term use of cpap therapy for sleep apnea/hypopnea syndrome. Am J Respir Crit Care Med. 1999;159(4):1108–14. doi: 10.1164/ajrccm.159.4.9807111.
    1. Kohler M, Smith D, Tippett V, Stradling JR. Predictors of long-term compliance with continuous positive airway pressure. Thorax. 2010;65(9):829–32. doi: 10.1136/thx.2010.135848.
    1. Krieger J, Kurtz D, Petiau C, Sforza E, Trautmann D. Long-term compliance with cpap therapy in obstructive sleep apnea patients and in snorers. Sleep. 1996;19(suppl_9):136–43. doi: 10.1093/sleep/19.suppl_9.S136.
    1. Chen Y-F, Hang L-W, Huang C-S, Liang S-J, Chung W-S. Polysomnographic predictors of persistent continuous positive airway pressure adherence in patients with moderate and severe obstructive sleep apnea. Kaohsiung J Med Sci. 2015;31(2):83–9. doi: 10.1016/j.kjms.2014.11.004.
    1. Budhiraja R, Parthasarathy S, Drake CL, Roth T, Sharief I, Budhiraja P, Saunders V, Hudgel DW. Early cpap use identifies subsequent adherence to cpap therapy. Sleep. 2007;30(3):320–4.
    1. Çınar M, Engin M, Engin EZ, Ateşçi YZ. Early prostate cancer diagnosis by using artificial neural networks and support vector machines. Expert Syst Appl. 2009;36(3):6357–61. doi: 10.1016/j.eswa.2008.08.010.
    1. Hassanien AE, Moftah HM, Azar AT, Shoman M. Mri breast cancer diagnosis hybrid approach using adaptive ant-based segmentation and multilayer perceptron neural networks classifier. Appl Soft Comput. 2014;14:62–71. doi: 10.1016/j.asoc.2013.08.011.
    1. Lee SK, Kang B-Y, Kim H-G, Son Y-J. Predictors of medication adherence in elderly patients with chronic diseases using support vector machine models. Healthcare Inform Res. 2013;19(1):33–41. doi: 10.4258/hir.2013.19.1.33.
    1. Bourdes V, Ferrieres J, Amar J, Amelineau E, Bonnevay S, Berlion M, Danchin N. Prediction of persistence of combined evidence-based cardiovascular medications in patients with acute coronary syndrome after hospital discharge using neural networks. Med Biol Eng Comput. 2011;49(8):947–55. doi: 10.1007/s11517-011-0785-4.
    1. Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20(3):273–97.
    1. Bishop C, Bishop CM, et al.Neural networks for pattern recognition: Oxford University Press; 1995.
    1. Auria L, Moro RA. Support vector machines (SVM) as a technique for solvency analysis; 2008. DIW Berlin, German Institute for Economic Research.
    1. Cox DR. The regression analysis of binary sequences. J R Stat Soc Ser B (Methodol). 1958:215–242.
    1. Rokach L, Maimon O. Data mining with decision trees: theory and applications. Data Mining with Decision Trees: Theory and Applications. Edited by Lior Rokach and Oded Maimon. Published by World Scientific Publishing Co. Pte. Ltd.,# 9789814590082, 2014. 2014.
    1. Ross BC. Mutual information between discrete and continuous data sets. PloS ONE. 2014;9(2):87357. doi: 10.1371/journal.pone.0087357.
    1. Inza I, Calvo B, Armañanzas R, Bengoetxea E, Larrañaga P, Lozano JA. Machine learning: an indispensable tool in bioinformatics. Springer; 2010. pp. 25–48.
    1. Bermingham ML, Pong-Wong R, Spiliopoulou A, Hayward C, Rudan I, Campbell H, Wright AF, Wilson JF, Agakov F, Navarro P, et al. Application of high-dimensional feature selection: evaluation for genomic prediction in man. Sci Rep. 2015;5:10312. doi: 10.1038/srep10312.
    1. Guyon I, Elisseeff A. An introduction to variable and feature selection. J Mach Learn Res. 2003;3(Mar):1157–82.
    1. Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, Coller H, Loh ML, Downing JR, Caligiuri MA, et al. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science. 1999;286(5439):531–7. doi: 10.1126/science.286.5439.531.
    1. Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc Ser B (Methodol). 1996:267–88.
    1. Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. Smote: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321–57. doi: 10.1613/jair.953.
    1. Altman NS. An introduction to kernel and nearest-neighbor nonparametric regression. Am Stat. 1992;46(3):175–85.
    1. Ho TK. Random decision forests. Document Analysis and Recognition, 1995. In: Proceedings of the Third International Conference On. vol 1. IEEE: 1995. p. 278–82.
    1. Friedman J, Hastie T, Tibshirani R. The elements of statistical learning,. Vol 1, Issue 10. New York: Springer series in statistics; 2001.
    1. Cawley GC, Talbot NL. On over-fitting in model selection and subsequent selection bias in performance evaluation. J Mach Learn Res. 2010;11(Jul):2079–107.
    1. Meinshausen N, Bühlmann P. Stability selection. J R Stat Soc Ser B (Stat Methodol) 2010;72(4):417–73. doi: 10.1111/j.1467-9868.2010.00740.x.
    1. Raudys SJ, Jain AK, et al. Small sample size effects in statistical pattern recognition: Recommendations for practitioners. IEEE Trans Pattern Anal Mach Intell. 1991;13(3):252–64. doi: 10.1109/34.75512.
    1. Cawley GC, Talbot NL. On over-fitting in model selection and subsequent selection bias in performance evaluation. J Mach Learn Res. 2010;11(Jul):2079–107.
    1. Weaver TE, Kribbs NB, Pack AI, Kline LR, Chugh DK, Maislin G, Smith PL, Schwartz AR, Schubert NM, Gillen KA, et al. Night-to-night variability in cpap use over the first three months of treatment. Sleep. 1997;20(4):278–83. doi: 10.1093/sleep/20.4.278.
    1. Schölkopf B, Smola AJ. Learning with kernels: support vector machines, regularization, optimization, and beyond.MIT; 2002.
    1. Weber R, Schek H-J, Blott S. A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces. In: Proc. of the VLDB conference, New York, 1998: 1998. p. 194–205.
    1. Kristiansen HA, Kværner KJ, Akre H, Øverland B., Sandvik L, Russell MB. Sleep apnoea headache in the general population. Cephalalgia. 2012;32(6):451–8. doi: 10.1177/0333102411431900.
    1. Stepnowsky C, Marler MR, Ancoli-Israel S. Determinants of nasal cpap compliance. Sleep Med. 2002;3(3):239–47. doi: 10.1016/S1389-9457(01)00162-9.
    1. Aloia M, Arnedt J, Stepnowsky C, Hecht J, Borrelli B. Predicting treatment adherence in obstructive sleep apnea using principles of behavior change. J Clin Sleep Med JCSM Off Publ Am Acad Sleep Med. 2005;1(4):346–53.
    1. Lazarus RS, Folkman S. Coping and adaptation. The handbook of behavioral medicine. Vol 282325. New York: Guilford; 1984.
    1. Stepnowsky Jr CJ, Bardwell WA, Moore PJ, Ancoli-Israel S, Dimsdale JE. Psychologic correlates of compliance with continuous positive airway pressure. Sleep. 2002;25(7):758–62. doi: 10.1093/sleep/25.7.758.
    1. Martínez-García MA, Capote F, Campos-Rodríguez F, Lloberes P, de Atauri MJD, Somoza M, Masa JF, González M, Sacristán L, Barbé F, et al. Effect of cpap on blood pressure in patients with obstructive sleep apnea and resistant hypertension: the hiparco randomized clinical trial. Jama. 2013;310(22):2407–15. doi: 10.1001/jama.2013.281250.
    1. Schmidlin M, Fritsch K, Matthews F, Thurnheer R, Senn O, Bloch KE. Utility indices in patients with the obstructive sleep apnea syndrome. Respiration. 2010;79(3):200–8. doi: 10.1159/000222094.
    1. Chakravorty I, Cayton R, Szczepura A. Health utilities in evaluating intervention in the sleep apnoea/hypopnoea syndrome. Eur Respir J. 2002;20(5):1233–8. doi: 10.1183/09031936.00.00014401.
    1. Tamanna Sadeka, Campbell Douglas, Warren Richard, Ullah Mohammad I. Effect of CPAP Therapy on Symptoms of Nocturnal Gastroesophageal Reflux among Patients with Obstructive Sleep Apnea. Journal of Clinical Sleep Medicine. 2016;12(09):1257–1261. doi: 10.5664/jcsm.6126.
    1. Li D, Liu D, Wang X, He D. Self-reported habitual snoring and risk of cardiovascular disease and all-cause mortality. Atherosclerosis. 2014;235(1):189–95. doi: 10.1016/j.atherosclerosis.2014.04.031.
    1. Campos-Rodriguez F, Pena-Grinan N, Reyes-Nunez N, De la Cruz-Moron I, Perez-Ronchel J, De la Vega-Gallardo F, Fernandez-Palacin A. Mortality in obstructive sleep apnea-hypopnea patients treated with positive airway pressure. CHEST J. 2005;128(2):624–33. doi: 10.1378/chest.128.2.624.
    1. Chai-Coetzer CL, Luo Y-M, Antic NA, Zhang X-L, Chen B-Y, He Q-Y, Heeley E, Huang S-G, Anderson C, Zhong N-S, et al. Predictors of long-term adherence to continuous positive airway pressure therapy in patients with obstructive sleep apnea and cardiovascular disease in the save study. Sleep. 2013;36(12):1929–37. doi: 10.5665/sleep.3232.
    1. Ghosh D, Allgar V, Elliott M. Identifying poor compliance with cpap in obstructive sleep apnoea: a simple prediction equation using data after a two week trial. Respir Med. 2013;107(6):936–42. doi: 10.1016/j.rmed.2012.10.008.
    1. Popescu G, Latham M, Allgar V, Elliott M. Continuous positive airway pressure for sleep apnoea/hypopnoea syndrome: usefulness of a 2 week trial to identify factors associated with long term use. Thorax. 2001;56(9):727–33. doi: 10.1136/thorax.56.9.727.
    1. Weaver TE, Maislin G, Dinges DF, Bloxham T, George CF, Greenberg H, Kader G, Mahowald M, Younger J, Pack AI. Relationship between hours of cpap use and achieving normal levels of sleepiness and daily functioning. Sleep. 2007;30(6):711–9. doi: 10.1093/sleep/30.6.711.
    1. Rafael-Palou X, Vargiu E, Turino C, Steblin A, Sánchez-de-la-Torre M, Barbé F. Towards an intelligent monitoring system for patients with obstructive sleep apnea. ICST Trans Ambient Syst. 2017;4:1.
    1. Vargiu E, Fernández JM, Miralles F, Nakar S, Weijers V, Meetsma H, Mariani S, Mamei M, Zambonelli F, Michel F, Matthes F, Kelly J, Eaglesham J, Kaye R. Patient empowerment and case management in connecare. In: International Conference on Integrated Care, Utrecht, May 23-25, 2018: 2018.

Source: PubMed

3
Subskrybuj