Two-year death prediction models among patients with Chagas Disease using machine learning-based methods

Ariela Mota Ferreira, Laércio Ives Santos, Ester Cerdeira Sabino, Antonio Luiz Pinho Ribeiro, Léa Campos de Oliveira-da Silva, Renata Fiúza Damasceno, Marcos Flávio Silveira Vasconcelos D'Angelo, Maria do Carmo Pereira Nunes, Desirée Sant Ana Haikal, Ariela Mota Ferreira, Laércio Ives Santos, Ester Cerdeira Sabino, Antonio Luiz Pinho Ribeiro, Léa Campos de Oliveira-da Silva, Renata Fiúza Damasceno, Marcos Flávio Silveira Vasconcelos D'Angelo, Maria do Carmo Pereira Nunes, Desirée Sant Ana Haikal

Abstract

Chagas disease (CD) is recognized by the World Health Organization as one of the thirteen most neglected tropical diseases. More than 80% of people affected by CD will not have access to diagnosis and continued treatment, which partly supports the high morbidity and mortality rate. Machine Learning (ML) can identify patterns in data that can be used to increase our understanding of a specific problem or make predictions about the future. Thus, the aim of this study was to evaluate different models of ML to predict death in two years of patients with CD. ML models were developed using different techniques and configurations. The techniques used were: Random Forests, Adaptive Boosting, Decision Tree, Support Vector Machine, and Artificial Neural Networks. The adopted settings considered only interview variables, only complementary exam variables, and finally, both mixed. Data from a cohort study with CD patients called SaMi-Trop were analyzed. The predictor variables came from the baseline; and the outcome, which was death, came from the first follow-up. All models were evaluated in terms of Sensitivity, Specificity and G-mean. Among the 1694 individuals with CD considered, 134 (7.9%) died within two years of follow-up. Using only the predictor variables from the interview, the different techniques achieved a maximum G-mean of 0.64 in predicting death. Using only the variables from complementary exams, the G-mean was up to 0.77. In this configuration, the protagonism of NT-proBNP was evident, where it was possible to observe that an ML model using only this single variable reached G-mean of 0.76. The configuration that mixed interview variables and complementary exams achieved G-mean of 0.75. ML can be used as a useful tool with the potential to contribute to the management of patients with CD, by identifying patients with the highest probability of death. Trial Registration: This trial is registered with ClinicalTrials.gov, Trial ID: NCT02646943.

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1. Flowchart of the process of…
Fig 1. Flowchart of the process of selecting predictor variables based on cross-validation analysis for predicting death among patients with CD within two years of follow-up.
Fig 2. Flowchart of patients included and…
Fig 2. Flowchart of patients included and excluded from the cohort and of eligible patients in the study and in the models obtained.
SaMi-Trop Project. Minas Gerais.
Fig 3. Performance of models in predicting…
Fig 3. Performance of models in predicting death for patients with CD, within two years, according to each machine learning technique adopted.
Fig 3A: Considering the interview variables. Fig 3B: Considering the variables of complementary exams. Fig 3C: Considering the variables of complementary exams, excluding the categorized NT-proBNP variable. Fig 3D: Considering the variables of complementary exams, considering only the NT-proBNP variable. Fig 3E: Considering the interview variables and complementary exam variables.
Fig 4. Importance of predictor variables of…
Fig 4. Importance of predictor variables of complementary exams for predicting death in patients with CD, within two years, according to Random Forests ranking.

References

    1. Martins-Melo FR, Ramos Júnior AN, Alencar CH, Heukelbach J. Prevalence of Chagas disease in Brazil: a systematic review and meta-analysis. Acta Trop. 2014. Feb;130:167–74 doi: 10.1016/j.actatropica.2013.10.002
    1. Nunes MC, Dones W, Morillo CA, Encina JJ, Ribeiro AL. Chagas disease: an overview of clinical and epidemiological aspects. Journal of the American College of Cardiology. 2013;62(9):767–76. Epub 2013/06/19. doi: 10.1016/j.jacc.2013.05.046
    1. Ribeiro AL, Nunes MP, Teixeira MM, Rocha MO. Diagnosis and management of Chagas disease and cardiomyopathy. Nature reviews Cardiology. 2012;9(10):576–89. Epub 2012/08/01. doi: 10.1038/nrcardio.2012.109
    1. Nunes MCP, Beaton A, Acquatella H, Bern C, Bolger AF, Echeverria LE, et al.. Chagas Cardiomyopathy: An Update of Current Clinical Knowledge and Management: A Scientific Statement From the American Heart Association. Circulation. 2018;138(12):e169–e209. Epub 2018/10/26. doi: 10.1161/CIR.0000000000000599
    1. Sabino EC, Ribeiro AL, Salemi VM, Di Lorenzo Oliveira C, Antunes AP, Menezes MM, et al.. Ten-year incidence of Chagas cardiomyopathy among asymptomatic Trypanosoma cruzi-seropositive former blood donors. Circulation. 2013;127(10):1105–15. Epub 2013/02/09 doi: 10.1161/CIRCULATIONAHA.112.123612
    1. Pereira Nunes M do C, Barbosa MM, Ribeiro AL, Amorim Fenelon LM, Rocha MO. Predictors of mortality in patients with dilated cardiomyopathy: relevance of chagas disease as an etiological factor. Rev Esp Cardiol 2010; 63(7): 788–97 doi: 10.1016/s1885-5857(10)70163-8
    1. Martins-Melo FR, Carneiro M, Ribeiro ALP, Bezerra JMT, Werneck GL. Burden of Chagas disease in Brazil, 1990–2016: findings from the Global Burden of Disease Study 2016. Int J Parasitol. 2019. Mar;49(3–4):301–310. doi: 10.1016/j.ijpara.2018.11.008
    1. Elis Borde, Marco Akerman, Pellegrini Filho Alberto. Mapping of capacities for research on health and its social determinants in Brazil. Cad. Saúde Pública. 2014. Oct; 30 (10): 2081–2091 doi: 10.1590/0102-311x00162513
    1. Minchole A, Rodriguez B. Artificial intelligence for the electrocardiogram. Nature medicine. 2019;25(1):22–3. Epub 2019/01/09. doi: 10.1038/s41591-018-0306-1
    1. Deo, Rahul C. Machine learning in medicine. Circulation, v. 132, n. 20, p. 1920–1930, 2015. doi: 10.1161/CIRCULATIONAHA.115.001593
    1. Wiens Jenna; Shenoy Erica S. Machine learning for healthcare: on the verge of a major shift in healthcare epidemiology. Clinical Infectious Diseases, v. 66, n. 1, p. 149–153, 2018. doi: 10.1093/cid/cix731
    1. Ludermir TB. Inteligência Artificial e Aprendizado de Máquina: estado atual e tendências. Estudos Avançados. 2021, v. 35, n. 101, pp. 85–94.
    1. Sady CCR, Ribeiro ALP. Symbolic features and classification via support vector machine for predicting death in patients with Chagas disease. Comput Biol Med. 2016. Mar 1;70:220–227. doi: 10.1016/j.compbiomed.2016.01.016
    1. Cardoso CS, Sabino EC, Oliveira CDL, Oliveira LC, Ferreira AM, Cunha-Neto E, et al.. Longitudinal study of patients with chronic Chagas cardiomyopathy in Brazil (SaMi-Trop project): a cohort profile. BMJ Open. 2016; 6: e011181. doi: 10.1136/bmjopen-2016-011181
    1. Maisel A, Mueller C, Adams K Jr, Anker SD, Aspromonte N, Cleland JG, et al.. State of the art: using natriuretic peptide levels in clinical practice. Eur J Heart Fail. 2008. Sep;10(9):824–39. doi: 10.1016/j.ejheart.2008.07.014
    1. Genuer Robin; POGGI Jean-Michel; TULEAU-MALOT Christine. Variable selection using random forests. Pattern recognition letters, v. 31, n. 14, p. 2225–2236, 2010.
    1. Breiman Leo. Random forests. Machine learning, v. 45, n. 1, p. 5–32, 2001.
    1. Friedman Jerome H. Greedy function approximation: a gradient boosting machine. Annals of statistics, p. 1189–1232, 2001
    1. Breiman Leo et al.. Classification and regression trees. CRC press, 1984.
    1. Cristianini Nello et al.. An introduction to support vector machines and other kernel-based learning methods. Cambridge university press, 2000.
    1. Zurada Jacek M. Introduction to artificial neural systems. St. Paul: West, 1992.
    1. CHAWLA Nitesh V. et al.. SMOTE: synthetic minority over-sampling technique. Journal of artificial intelligence research, v. 16, p. 321–357, 2002.
    1. Francisco Priscila Maria Stolses Bergamo, Azevedo Barros Marilisa Berti de, José Segri Neuber, Porto Alves Maria Cecília Goi, Galvão Cesar Chester Luiz, Carvalho Malta Deborah. Comparação de estimativas para o auto-relato de condições crônicas entre inquérito domiciliar e telefônico—Campinas (SP), Brasil. Rev. bras. epidemiol. [Internet]. 2011. Sep [cited 2018 Dec 04]; 14 (Suppl 1): 5–15.
    1. Assis MMA, Villa TCS, Nascimento MAA. Acesso aos serviços de saúde: uma possibilidade a ser construída na prática. Cien Saude Colet 2003;8(3):815–823.
    1. Lima JC, Azoury EB, Bastos LHCV, Coutinho MM, Pereira NN, Ferreira SCC. Desigualdades no acesso e utilização de serviços de saúde no Brasil. Saúde Debate 2002;26(60):62–70
    1. Basquiera A, Sembaj A, Aguerri A, Omelianiuk M, Guzmán S, Barral JM, Caeiro T, Madoery R, Salomone O. Risk progression to chronic chagas cardiomyopathy: Influence of male sex and of parasitaemia detected by polymerase chain reaction. Heart. 2003;89:1186–1190 doi: 10.1136/heart.89.10.1186
    1. Georg I, Hasslocher-Moreno AM, Xavier SS, Holanda MTd , Roma EH, Bonecini-Almeida MdG. Evolution of anti-trypanosoma cruzi antibody production in patients with chronic chagas disease: Correlation between antibody titers and development of cardiac disease severity. PLoS neglected tropical diseases. 2017;11:e0005796 doi: 10.1371/journal.pntd.0005796
    1. Lima-Costa MF, Cesar CC, Peixoto SV, Ribeiro AL. Plasma B-type natriuretic peptide as a predictor of mortality in community-dwelling older adults with Chagas disease: 10-year follow-up of the Bambui Cohort Study of Aging. Am J Epidemiol. 2010. Jul 15;172(2):190–6. doi: 10.1093/aje/kwq106
    1. Di Lorenzo Oliveira C, Nunes MCP, Colosimo EA, de Lima EM, Cardoso CS, Ferreira AM, de Oliveira LC, Moreira CHV, Bierrenbach AL, Haikal DSA, Peixoto SV, Lima-Costa MF, Sabino EC, Ribeiro ALP. Risk Score for Predicting 2-Year Mortality in Patients With Chagas Cardiomyopathy From Endemic Areas: SaMi-Trop Cohort Study. J Am Heart Assoc. 2020. Mar 17;9(6):e014176. doi: 10.1161/JAHA.119.014176 Epub 2020 Mar 11. Erratum in: J Am Heart Assoc. 2021 Feb 2;10(3):e014649. PMCID: PMC7335521.
    1. Ferreira AM, Sabino ÉC, Oliveira LCd, Oliveira CDL, Cardoso CS, et al.. (2020) Impact of the social context on the prognosis of Chagas disease patients: Multilevel analysis of a Brazilian cohort. PLOS Neglected Tropical Diseases 14(6): e0008399 doi: 10.1371/journal.pntd.0008399
    1. Araújo DV; Souza CPR. Análise de Custo-Efetividade do Peptídeo Natriurético Tipo-B Comparado ao Julgamento Clínico em Pacientes com Dispnéia Aguda no Contexto do Sistema Único de Saúde. Rev SOCERJ. 2008;21(4):217–225 julho/agosto
    1. Rassi A Jr, Rassi A, Little WC, Xavier SS, Rassi SG, Rassi AG, et al.. Development and validation of a risk score for predicting death in Chagas’ heart disease. N Engl J Med. 2006;355(8):799–808. doi: 10.1056/NEJMoa053241
    1. De Souza AC, Salles G, Hasslocher-Moreno AM, de Sousa AS, Alvarenga Americano do Brasil PE, Saraiva RM, et al.. Development of a risk score to predict sudden death in patients with Chaga’s heart disease. Int J Cardiol. 2015;187:700–4. doi: 10.1016/j.ijcard.2015.03.372
    1. Instituto Brasileiro de Geografia e Estatística (BR). Censo demográfico 2010. Rio de Janeiro; 2012.
    1. Ferreira AM; Sabino EC; Moreira HF; Cardoso CS; Oliveira CL; Ribeiro ALP; Ramos BC; Haikal DS. Avaliação do conhecimento acerca do manejo clínico de portadores da doença de Chagas em região endêmica no Brasil. Rev. APS; 21(3): 345–354, 2018.
    1. Damasceno RF, Sabino EC, Ferreira AM, Ribeiro ALP, Moreira HF, et al.. (2020) Challenges in the care of patients with Chagas disease in the Brazilian public health system: A qualitative study with primary health care doctors. PLOS Neglected Tropical Diseases 14(11): e0008782. doi: 10.1371/journal.pntd.0008782
    1. Triantafyllidis AK, Tsanas A. Applications of Machine Learning in Real-Life Digital Health Interventions: Review of the Literature. J Med Internet Res 2019;21(4):e12286 doi: 10.2196/12286

Source: PubMed

3
S'abonner