Discovery and Analytical Validation of a Vocal Biomarker to Monitor Anosmia and Ageusia in Patients With COVID-19: Cross-sectional Study

Eduardo Higa, Abir Elbéji, Lu Zhang, Aurélie Fischer, Gloria A Aguayo, Petr V Nazarov, Guy Fagherazzi, Eduardo Higa, Abir Elbéji, Lu Zhang, Aurélie Fischer, Gloria A Aguayo, Petr V Nazarov, Guy Fagherazzi

Abstract

Background: The COVID-19 disease has multiple symptoms, with anosmia and ageusia being the most prevalent, varying from 75% to 95% and from 50% to 80% of infected patients, respectively. An automatic assessment tool for these symptoms will help monitor the disease in a fast and noninvasive manner.

Objective: We hypothesized that people with COVID-19 experiencing anosmia and ageusia had different voice features than those without such symptoms. Our objective was to develop an artificial intelligence pipeline to identify and internally validate a vocal biomarker of these symptoms for remotely monitoring them.

Methods: This study used population-based data. Participants were assessed daily through a web-based questionnaire and asked to register 2 different types of voice recordings. They were adults (aged >18 years) who were confirmed by a polymerase chain reaction test to be positive for COVID-19 in Luxembourg and met the inclusion criteria. Statistical methods such as recursive feature elimination for dimensionality reduction, multiple statistical learning methods, and hypothesis tests were used throughout this study. The TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) Prediction Model Development checklist was used to structure the research.

Results: This study included 259 participants. Younger (aged <35 years) and female participants showed higher rates of ageusia and anosmia. Participants were aged 41 (SD 13) years on average, and the data set was balanced for sex (female: 134/259, 51.7%; male: 125/259, 48.3%). The analyzed symptom was present in 94 (36.3%) out of 259 participants and in 450 (27.5%) out of 1636 audio recordings. In all, 2 machine learning models were built, one for Android and one for iOS devices, and both had high accuracy-88% for Android and 85% for iOS. The final biomarker was then calculated using these models and internally validated.

Conclusions: This study demonstrates that people with COVID-19 who have anosmia and ageusia have different voice features from those without these symptoms. Upon further validation, these vocal biomarkers could be nested in digital devices to improve symptom assessment in clinical practice and enhance the telemonitoring of COVID-19-related symptoms.

Trial registration: Clinicaltrials.gov NCT04380987; https://ichgcp.net/clinical-trials-registry/NCT04380987.

Keywords: AI; COVID-19; ageusia; anosmia; artificial intelligence; biomarker; device; digital; digital assessment tool; digital health; disease; loss of smell; loss of taste; medical informatics; noninvasive; pandemic; symptoms; telehealth; telemonitoring; tool; vocal biomarker.

Conflict of interest statement

Conflicts of Interest: None declared.

©Eduardo Higa, Abir Elbéji, Lu Zhang, Aurélie Fischer, Gloria A Aguayo, Petr V Nazarov, Guy Fagherazzi. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 08.11.2022.

Figures

Figure 1
Figure 1
Learning pipeline to the discovery of biomarkers. (A) Data collection from Predi-COVID and exclusion criteria. (B) Data treatment of audio data and studied outcome. (C) Data analysis for both audio formats done in parallel.
Figure 2
Figure 2
Sample plot with linear separation between 3gp and m4a audio formats. Principal component analysis was used on the extracted features, and the first 2 dimensions were used to plot the samples.
Figure 3
Figure 3
Final models for each audio format. (A) Biomarkers and P values from two-sided student's t-test for the presence of anosmia and ageusia were calculated using the probability of classifying as positive. (B) Confusion matrix of the best model. (c) ROC AUC curve. Class 0 represents absence of symptoms and Class 1 the presence of it. ROC AUC: area under the receiver operating characteristic curve.

References

    1. Samaranayake LP, Fakhruddin KS, Panduwawala C. Sudden onset, acute loss of taste and smell in coronavirus disease 2019 (COVID-19): a systematic review. Acta Odontol Scand. 2020 Aug;78(6):467–473. doi: 10.1080/00016357.2020.1787505.
    1. Ibekwe TS, Fasunla Ayotunde James, Orimadegun Adebola Emmanuel. Systematic review and meta-analysis of smell and taste disorders in COVID-19. OTO Open. 2020 Sep 11;4(3):2473974X20957975. doi: 10.1177/2473974X20957975. 10.1177_2473974X20957975
    1. Passali Giulio Cesare, Bentivoglio Anna Rita. Comment to the article "olfactory and gustatory dysfunctions as a clinical presentation of mild-to-moderate forms of the coronavirus disease (COVID-19): a multicenter European study". Eur Arch Otorhinolaryngol. 2020 Aug;277(8):2391–2392. doi: 10.1007/s00405-020-06024-5. 10.1007/s00405-020-06024-5
    1. Huang N, Pérez Paola, Kato T, Mikami Y, Okuda K, Gilmore RC, Conde CD, Gasmi B, Stein S, Beach M, Pelayo E, Maldonado JO, Lafont BA, Jang S, Nasir N, Padilla RJ, Murrah VA, Maile R, Lovell W, Wallet SM, Bowman NM, Meinig SL, Wolfgang MC, Choudhury SN, Novotny M, Aevermann BD, Scheuermann RH, Cannon G, Anderson CW, Lee RE, Marchesan JT, Bush M, Freire M, Kimple AJ, Herr DL, Rabin J, Grazioli A, Das S, French BN, Pranzatelli T, Chiorini JA, Kleiner DE, Pittaluga S, Hewitt SM, Burbelo PD, Chertow D, NIH COVID-19 Autopsy Consortium. HCA OralCraniofacial Biological Network. Frank K, Lee J, Boucher RC, Teichmann SA, Warner BM, Byrd KM. SARS-CoV-2 infection of the oral cavity and saliva. Nat Med. 2021 May;27(5):892–903. doi: 10.1038/s41591-021-01296-8. 10.1038/s41591-021-01296-8
    1. Lechien JR, Chiesa-Estomba CM, De Siati DR, Horoi M, Le Bon SD, Rodriguez A, Dequanter D, Blecic S, El Afia F, Distinguin L, Chekkoury-Idrissi Y, Hans S, Delgado IL, Calvo-Henriquez C, Lavigne P, Falanga C, Barillari MR, Cammaroto G, Khalife M, Leich P, Souchay C, Rossi C, Journe F, Hsieh J, Edjlali M, Carlier R, Ris L, Lovato A, De Filippis C, Coppee F, Fakhry N, Ayad T, Saussez S. Olfactory and gustatory dysfunctions as a clinical presentation of mild-to-moderate forms of the coronavirus disease (COVID-19): a multicenter European study. Eur Arch Otorhinolaryngol. 2020 Aug;277(8):2251–2261. doi: 10.1007/s00405-020-05965-1. 10.1007/s00405-020-05965-1
    1. Menni C, Valdes AM, Freidin MB, Sudre CH, Nguyen LH, Drew DA, Ganesh S, Varsavsky T, Cardoso MJ, El-Sayed Moustafa JS, Visconti A, Hysi P, Bowyer RCE, Mangino M, Falchi M, Wolf J, Ourselin S, Chan AT, Steves CJ, Spector TD. Real-time tracking of self-reported symptoms to predict potential COVID-19. Nat Med. 2020 Jul;26(7):1037–1040. doi: 10.1038/s41591-020-0916-2. 10.1038/s41591-020-0916-2
    1. Lefèvre Nicolas, Corazza F, Valsamis J, Delbaere A, De Maertelaer V, Duchateau J, Casimir G. The number of X chromosomes influences inflammatory cytokine production following toll-like receptor stimulation. Front Immunol. 2019 May 09;10:1052. doi: 10.3389/fimmu.2019.01052. doi: 10.3389/fimmu.2019.01052.
    1. Crook H, Raza S, Nowell J, Young M, Edison P. Long covid-mechanisms, risk factors, and management. BMJ. 2021 Jul 26;374:n1648. doi: 10.1136/bmj.n1648.
    1. Rebholz H, Braun RJ, Ladage D, Knoll W, Kleber C, Hassel AW. Loss of olfactory function—early Indicator for COVID-19, other viral infections and neurodegenerative disorders. Front Neurol. 2020 Oct 26;11:569333. doi: 10.3389/fneur.2020.569333. doi: 10.3389/fneur.2020.569333.
    1. Kovács Tibor. Mechanisms of olfactory dysfunction in aging and neurodegenerative disorders. Ageing Res Rev. 2004 Apr;3(2):215–32. doi: 10.1016/j.arr.2003.10.003.S1568163703000631
    1. Kershaw JC, Mattes RD. Nutrition and taste and smell dysfunction. World J Otorhinolaryngol Head Neck Surg. 2018 Mar;4(1):3–10. doi: 10.1016/j.wjorl.2018.02.006. S2095-8811(18)30020-9
    1. Asiaee M, Vahedian-Azimi Amir, Atashi SS, Keramatfar A, Nourbakhsh M. Voice quality evaluation in patients with COVID-19: an acoustic analysis. J Voice. 2020 Oct 01; doi: 10.1016/j.jvoice.2020.09.024. S0892-1997(20)30368-4
    1. Fagherazzi G, Fischer A, Betsou F, Vaillant M, Ernens I, Masi S, Mossong J, Staub T, Brault D, Bahlawane C, Rashid MA, Ollert M, Gantenbein M, Huiart L. Protocol for a prospective, longitudinal cohort of people with COVID-19 and their household members to study factors associated with disease severity: the Predi-COVID study. BMJ Open. 2020 Nov 23;10(11):e041834. doi: 10.1136/bmjopen-2020-041834. bmjopen-2020-041834
    1. Tanasa IA, Manciuc C, Carauleanu A, Navolan DB, Bohiltea RE, Nemescu D. Anosmia and ageusia associated with coronavirus infection (COVID-19) - what is known? Exp Ther Med. 2020 Sep;20(3):2344–2347. doi: 10.3892/etm.2020.8808. ETM-0-0-8808
    1. openSMILE 3.0. audEERING. [2021-07-01].
    1. Schuller B, Steidl S, Batliner A, Hirschberg J, Burgoon JK, Baird A, Elkins A, Zhang Y, Coutinho E, Evanini K. The INTERSPEECH 2016 Computational Paralinguistics Challenge: deception, sincerity & native language. Interspeech 2016; September 8-12, 2016; San Francisco, CA. 2016. pp. 2001–2005.
    1. openSMILE Python. audEERING. [2021-07-01].
    1. Tang Y, Zhang YQ, Huang Z. Development of two-stage SVM-RFE gene selection strategy for microarray expression data analysis. IEEE/ACM Trans Comput Biol Bioinform. 2007 Aug 13;4(3):365–81. doi: 10.1109/TCBB.2007.70224.
    1. sklearn.ensemble.RandomForestClassifier. scikit-learn. [2021-08-01]. .
    1. 1.6. Nearest neighbors. scikit-learn. [2021-08-01]. .
    1. 1.4. Support vector machines. scikit-learn. [2021-08-01]. .
    1. Machine learning in Python. scikit-learn. [2021-08-01].
    1. Walter SD. The partial area under the summary ROC curve. Stat Med. 2005 Jul 15;24(13):2025–40. doi: 10.1002/sim.2103.
    1. Body mass index (BMI) World Health Organization. [2021-06-01]. .
    1. VynZ Research Global voice assistant market is set to reach USD 5,843.8 million by 2024, observing a CAGR of 27.7% during 2019–2024: VynZ Research. Globe Newswire. 2020. Jan 28, [2021-08-01]. .
    1. Diaz-Asper C, Chandler C, Turner RS, Reynolds B, Elvevåg Brita. Acceptability of collecting speech samples from the elderly via the telephone. Digit Health. 2021 Apr 17;7:20552076211002103. doi: 10.1177/20552076211002103. 10.1177_20552076211002103
    1. Tracy JM, Özkanca Yasin, Atkins DC, Hosseini Ghomi R. Investigating voice as a biomarker: deep phenotyping methods for early detection of Parkinson's disease. J Biomed Inform. 2020 Apr;104:103362. doi: 10.1016/j.jbi.2019.103362. S1532-0464(19)30282-5
    1. Arora S, Visanji NP, Mestre TA, Tsanas A, AlDakheel A, Connolly BS, Gasca-Salas C, Kern DS, Jain J, Slow EJ, Faust-Socher A, Lang AE, Little MA, Marras C. Investigating voice as a biomarker for leucine-rich repeat kinase 2-associated Parkinson's disease. J Parkinsons Dis. 2018 Oct 17;8(4):503–510. doi: 10.3233/JPD-181389.JPD181389
    1. Ahmed S, Haigh AF, de Jager CA, Garrard P. Connected speech as a marker of disease progression in autopsy-proven Alzheimer's disease. Brain. 2013 Dec;136(Pt 12):3727–37. doi: 10.1093/brain/awt269. awt269
    1. Toth L, Hoffmann I, Gosztolya G, Vincze V, Szatloczki G, Banreti Z, Pakaski M, Kalman J. A speech recognition-based solution for the automatic detection of mild cognitive impairment from spontaneous speech. Curr Alzheimer Res. 2018;15(2):130–138. doi: 10.2174/1567205014666171121114930. CAR-EPUB-87015
    1. Martínez-Sánchez Francisco, Meilán Juan José G, Carro J, Ivanova O. A Prototype for the voice analysis diagnosis of Alzheimer's disease. J Alzheimers Dis. 2018 Jun 19;64(2):473–481. doi: 10.3233/JAD-180037.JAD180037
    1. Maor E, Sara JD, Orbelo DM, Lerman LO, Levanon Y, Lerman A. Voice signal characteristics are independently associated with coronary artery disease. Mayo Clin Proc. 2018 Jul;93(7):840–847. doi: 10.1016/j.mayocp.2017.12.025.S0025-6196(18)30030-2
    1. Sara JDS, Maor E, Borlaug B, Lewis BR, Orbelo D, Lerman LO, Lerman A. Non-invasive vocal biomarker is associated with pulmonary hypertension. PLoS One. 2020 Apr 16;15(4):e0231441. doi: 10.1371/journal.pone.0231441. PONE-D-19-27216
    1. Ni X, Ouyang W, Jeong H, Kim J, Tzaveils A, Mirzazadeh A, Wu C, Lee JY, Keller M, Mummidisetty CK, Patel M, Shawen N, Huang J, Chen H, Ravi S, Chang J, Lee K, Wu Y, Lie F, Kang YJ, Kim JU, Chamorro LP, Banks AR, Bharat A, Jayaraman A, Xu S, Rogers JA. Automated, multiparametric monitoring of respiratory biomarkers and vital signs in clinical and home settings for COVID-19 patients. Proc Natl Acad Sci U S A. 2021 May 11;118(19):e2026610118. doi: 10.1073/pnas.2026610118. 2026610118
    1. Shimon C, Shafat G, Dangoor I, Ben-Shitrit A. Artificial intelligence enabled preliminary diagnosis for COVID-19 from voice cues and questionnaires. J Acoust Soc Am. 2021 Feb;149(2):1120. doi: 10.1121/10.0003434.
    1. Jayalakshmy S, Sudha GF. Scalogram based prediction model for respiratory disorders using optimized convolutional neural networks. Artif Intell Med. 2020 Mar;103:101809. doi: 10.1016/j.artmed.2020.101809.S0933-3657(19)30498-1
    1. Santos REA, da Silva MG, do Monte Silva MCB, Barbosa DAM, Gomes ALDV, Galindo LCM, da Silva Aragão Raquel, Ferraz-Pereira KN. Onset and duration of symptoms of loss of smell/taste in patients with COVID-19: a systematic review. Am J Otolaryngol. 2021 Mar;42(2):102889. doi: 10.1016/j.amjoto.2020.102889. S0196-0709(20)30583-4
    1. Brann DH, Tsukahara T, Weinreb C, Lipovsek M, Van den Berge K, Gong B, Chance R, Macaulay IC, Chou H, Fletcher RB, Das D, Street K, de Bezieux HR, Choi Y, Risso D, Dudoit S, Purdom E, Mill J, Hachem RA, Matsunami H, Logan DW, Goldstein BJ, Grubb MS, Ngai J, Datta SR. Non-neuronal expression of SARS-CoV-2 entry genes in the olfactory system suggests mechanisms underlying COVID-19-associated anosmia. Sci Adv. 2020 Jul 31;6(31):eabc5801. doi: 10.1126/sciadv.abc5801. sciadv.abc5801
    1. Meunier N, Briand L, Jacquin-Piques A, Brondel L, Pénicaud Luc. COVID 19-induced smell and taste impairments: putative impact on physiology. Front Physiol. 2020 Jan 26;11:625110. doi: 10.3389/fphys.2020.625110. doi: 10.3389/fphys.2020.625110.

Source: PubMed

3
購読する