Assessment of the Feasibility of Using Noninvasive Wearable Biometric Monitoring Sensors to Detect Influenza and the Common Cold Before Symptom Onset

Emilia Grzesiak, Brinnae Bent, Micah T McClain, Christopher W Woods, Ephraim L Tsalik, Bradly P Nicholson, Timothy Veldman, Thomas W Burke, Zoe Gardener, Emma Bergstrom, Ronald B Turner, Christopher Chiu, P Murali Doraiswamy, Alfred Hero, Ricardo Henao, Geoffrey S Ginsburg, Jessilyn Dunn, Emilia Grzesiak, Brinnae Bent, Micah T McClain, Christopher W Woods, Ephraim L Tsalik, Bradly P Nicholson, Timothy Veldman, Thomas W Burke, Zoe Gardener, Emma Bergstrom, Ronald B Turner, Christopher Chiu, P Murali Doraiswamy, Alfred Hero, Ricardo Henao, Geoffrey S Ginsburg, Jessilyn Dunn

Abstract

Importance: Currently, there are no presymptomatic screening methods to identify individuals infected with a respiratory virus to prevent disease spread and to predict their trajectory for resource allocation.

Objective: To evaluate the feasibility of using noninvasive, wrist-worn wearable biometric monitoring sensors to detect presymptomatic viral infection after exposure and predict infection severity in patients exposed to H1N1 influenza or human rhinovirus.

Design, setting, and participants: The cohort H1N1 viral challenge study was conducted during 2018; data were collected from September 11, 2017, to May 4, 2018. The cohort rhinovirus challenge study was conducted during 2015; data were collected from September 14 to 21, 2015. A total of 39 adult participants were recruited for the H1N1 challenge study, and 24 adult participants were recruited for the rhinovirus challenge study. Exclusion criteria for both challenges included chronic respiratory illness and high levels of serum antibodies. Participants in the H1N1 challenge study were isolated in a clinic for a minimum of 8 days after inoculation. The rhinovirus challenge took place on a college campus, and participants were not isolated.

Exposures: Participants in the H1N1 challenge study were inoculated via intranasal drops of diluted influenza A/California/03/09 (H1N1) virus with a mean count of 106 using the median tissue culture infectious dose (TCID50) assay. Participants in the rhinovirus challenge study were inoculated via intranasal drops of diluted human rhinovirus strain type 16 with a count of 100 using the TCID50 assay.

Main outcomes and measures: The primary outcome measures included cross-validated performance metrics of random forest models to screen for presymptomatic infection and predict infection severity, including accuracy, precision, sensitivity, specificity, F1 score, and area under the receiver operating characteristic curve (AUC).

Results: A total of 31 participants with H1N1 (24 men [77.4%]; mean [SD] age, 34.7 [12.3] years) and 18 participants with rhinovirus (11 men [61.1%]; mean [SD] age, 21.7 [3.1] years) were included in the analysis after data preprocessing. Separate H1N1 and rhinovirus detection models, using only data on wearble devices as input, were able to distinguish between infection and noninfection with accuracies of up to 92% for H1N1 (90% precision, 90% sensitivity, 93% specificity, and 90% F1 score, 0.85 [95% CI, 0.70-1.00] AUC) and 88% for rhinovirus (100% precision, 78% sensitivity, 100% specificity, 88% F1 score, and 0.96 [95% CI, 0.85-1.00] AUC). The infection severity prediction model was able to distinguish between mild and moderate infection 24 hours prior to symptom onset with an accuracy of 90% for H1N1 (88% precision, 88% sensitivity, 92% specificity, 88% F1 score, and 0.88 [95% CI, 0.72-1.00] AUC) and 89% for rhinovirus (100% precision, 75% sensitivity, 100% specificity, 86% F1 score, and 0.95 [95% CI, 0.79-1.00] AUC).

Conclusions and relevance: This cohort study suggests that the use of a noninvasive, wrist-worn wearable device to predict an individual's response to viral exposure prior to symptoms is feasible. Harnessing this technology would support early interventions to limit presymptomatic spread of viral respiratory infections, which is timely in the era of COVID-19.

Conflict of interest statement

Conflict of Interest Disclosures: Dr McClain reported receiving grants from Defense Advanced Research Projects Agency (DARPA) during the conduct of the study; in addition, Dr McClain had a patent for molecular signatures of acute respiratory infections pending. Dr Tsalik reported receiving personal fees from and being the cofounder of Predigen Inc outside the submitted work. Dr Burke reported receiving grants from DARPA during the conduct of the study and serving as a consultant for Predigen Inc outside the submitted work. Dr Turner reported receiving grants from Duke University during the conduct of the study. Dr Chiu reported receiving grants from DARPA during the conduct of the study and grants from Wellcome Trust, Medical Research Council, and the European Commission outside the submitted work. Dr Doraiswamy reported receiving grants from DARPA and nonfinancial support from Lumos Labs during the conduct of the study and receiving grants from Salix, Avanir, Avid, the National Institutes of Health, Cure Alzheimer’s Fund, Karen L. Wrenn Trust, Steve Aoki Foundation, the Office of Naval Research, and the Department of Defense and personal fees from Clearview, Verily, Vitakey, Transposon, Neuroglee, Brain Forum, and Apollo outside the submitted work; in addition, Dr Doraiswamy had a patent for infection detection using wearables pending, a patent for diagnosis of Alzheimer disease pending, a patent for treatment of Alzheimer disease pending, and a patent for infection detection through cognitive variability pending. Dr Ginsburg reported being the founder of Predigen Inc outside the submitted work. No other disclosures were reported.

Figures

Figure 1.. Flow Diagram and Graphical Abstract…
Figure 1.. Flow Diagram and Graphical Abstract of Study
RV indicates rhinovirus; RT-PCR, reverse transcription polymerase chain reaction; and wearables, wearable biometric monitoring sensors.
Figure 2.. Infection Severity Categorization Based on…
Figure 2.. Infection Severity Categorization Based on Functional Clustering of Daily Symptoms and Shedding
A, H1N1 influenza. B, Rhinovirus. ID indicates identification.
Figure 3.. Performance Metrics of the Best-Performing…
Figure 3.. Performance Metrics of the Best-Performing Models for Predicting Infection Status (Infected vs Noninfected)
A, Receiver operating characteristic (ROC) curves for the best-performing models of infection status for the H1N1 influenza, rhinovirus, and combined virus challenges. B, Confusion matrices for a sample of models in A. C, Mean (SD) accuracy of leave-one-out, cross-validated (LOOCV) models in A. NI-B indicates noninfected vs infected, both; NI-C, noninfected vs infected, clinical; and NI-D, noninfected vs infected, data driven.
Figure 4.. Model Accuracy Over Time Across…
Figure 4.. Model Accuracy Over Time Across All Viral Challenges, Infectious Status Groupings, and Infection Severity Groupings
A, H1N1 influenza. B, Rhinovirus. C, Both viruses combined. Mild-moderate, mild to moderate; NI-C, noninfected vs infected, clinical; NI-mild, noninfected vs infected, mild; NI-mild-moderate, noninfected vs infected, mild to moderate; NI-moderate, noninfected vs infected, moderate; and wearables, wearable biometric monitoring sensors.
Figure 5.. Performance Metrics of the Best-Performing…
Figure 5.. Performance Metrics of the Best-Performing Models for Predicting Infection Severity
A, Receiver operating characteristic (ROC) curves for the best-performing models of infection status for the H1N1 influenza, rhinovirus, and combined virus challenges. B, Confusion matrices for a sample of models in A. C, Mean (SD) accuracy of leave-one-out, cross-validated (LOOCV) models in A. Mild-moderate indicates mild to moderate; NI-C, noninfected vs infected, clinical; NI-mild, noninfected vs infected, mild; NI-mild-moderate, noninfected vs infected, mild to moderate; and NI-moderate, noninfected vs infected, moderate.

References

    1. Clayville LR. Influenza update: a review of currently available vaccines. P T. 2011;36(10):659-684.
    1. Worrall G. Common cold. Can Fam Physician. 2011;57(11):1289-1290.
    1. Jacobs SE, Lamson DM, St George K, Walsh TJ. Human rhinoviruses. Clin Microbiol Rev. 2013;26(1):135-162. doi:10.1128/CMR.00077-12
    1. Centers for Disease Control and Prevention. Manual for the surveillance of vaccine-preventable diseases: chapter 6: influenza. March 29, 2019. Accessed September 20, 2020.
    1. Fraser C, Donnelly CA, Cauchemez S, et al. ; WHO Rapid Pandemic Assessment Collaboration . Pandemic potential of a strain of influenza A (H1N1): early findings. Science. 2009;324(5934):1557-1561. doi:10.1126/science.1176062
    1. Furukawa NW, Brooks JT, Sobel J. Evidence supporting transmission of severe acute respiratory syndrome coronavirus 2 while presymptomatic or asymptomatic. Emerg Infect Dis. 2020;26(7):e201595. doi:10.3201/eid2607.201595
    1. She X, Zhai Y, Henao R, et al. . Adaptive multi-channel event segmentation and feature extraction for monitoring health outcomes. IEEE Trans Biomed Eng. 2021;68(8):2377-2388. doi:10.1109/TBME.2020.3038652
    1. Li X, Dunn J, Salins D, et al. . Digital health: tracking physiomes and activity using wearable biosensors reveals useful health-related information. PLoS Biol. 2017;15(1):e2001402. doi:10.1371/journal.pbio.2001402
    1. Mishra T, Wang M, Metwally AA, et al. . Pre-symptomatic detection of COVID-19 from smartwatch data. Nat Biomed Eng. 2020;4(12):1208-1220. doi:10.1038/s41551-020-00640-6
    1. Munos B, Baker PC, Bot BM, et al. . Mobile health: the power of wearables, sensors, and apps to transform clinical trials. Ann N Y Acad Sci. 2016;1375(1):3-18. doi:10.1111/nyas.13117
    1. Bent B, Goldstein BA, Kibbe WA, Dunn JP. Investigating sources of inaccuracy in wearable optical heart rate sensors. NPJ Digi Med. 2020;3:18. doi:10.1038/s41746-020-0226-6
    1. Bent B, Wang K, Grzesiak E, et al. . The digital biomarker discovery pipeline: An open-source software platform for the development of digital biomarkers using mHealth and wearables data. J Clin Transl Sci. 2020;5(1):e19. doi:10.1017/cts.2020.511
    1. Dunn J, Runge R, Snyder M. Wearables and the medical revolution. Per Med. 2018;15(5):429-448. doi:10.2217/pme-2018-0044
    1. Witt D, Kellogg R, Snyder M, Dunn J. Windows into human health through wearables data analytics. Curr Opin Biomed Eng. 2019;9:28-46. doi:10.1016/j.cobme.2019.01.001
    1. Nguyen VQ, Abe S, Sun G, et al. . Rapid screening for influenza using a multivariable logistic regression model to save labor at a clinic in Iwaki, Fukushima, Japan. Am J Infect Control. 2014;42(5):551-553. doi:10.1016/j.ajic.2014.01.019
    1. Matsui T, Hakozaki Y, Suzuki S, et al. . A novel screening method for influenza patients using a newly developed non-contact screening system. J Infect. 2010;60(4):271-277. doi:10.1016/j.jinf.2010.01.005
    1. Mattéi J, Teyssier G, Pichot V, et al. . Autonomic dysfunction in 2009 pandemic influenza A (H1N1) virus–related infection: a pediatric comparative study. Auton Neurosci. 2011;162(1-2):77-83. doi:10.1016/j.autneu.2011.03.003
    1. Radin JM, Wineinger NE, Topol EJ, Steinhubl SR. Harnessing wearable device data to improve state-level real-time surveillance of influenza-like illness in the USA: a population-based study. Lancet Digit Health. 2020;2(2):e85-e93. doi:10.1016/S2589-7500(19)30222-5
    1. Karjalainen J, Viitasalo M. Fever and cardiac rhythm. Arch Intern Med. 1986;146(6):1169-1171. doi:10.1001/archinte.1986.00360180179026
    1. Zhu G, Li J, Meng Z, et al. . Learning from large-scale wearable device data for predicting epidemics trend of COVID-19. Discrete Dyn Nat Soc. 2020;2020:1-8. doi:10.1155/2020/6664405
    1. Shapiro A, Marinsek N, Clay I, et al. . Characterizing COVID-19 and influenza in the real world via person-generated health data. Patterns. 2021;2(1):100188. doi:10.1016/j.patter.2020.100188
    1. Paltiel AD, Zheng A, Walensky RP. Assessment of SARS-CoV-2 screening strategies to permit the safe reopening of college campuses in the United States. JAMA Netw Open. 2020;3(7):e2016818. doi:10.1001/jamanetworkopen.2020.16818
    1. Natarajan A, Su HW, Heneghan C. Assessment of physiological signs associated with COVID-19 measured using wearable devices. NPJ Digit Med. 2020;3(1):156. doi:10.1038/s41746-020-00363-7
    1. Ahmad S, Tejuja A, Newman KD, Zarychanski R, Seely AJ. Clinical review: a review and analysis of heart rate variability and the diagnosis and prognosis of infection. Crit Care. 2009;13(6):232. doi:10.1186/cc8132
    1. Wee BYH, Lee JH, Mok YH, Chong SL. A narrative review of heart rate and variability in sepsis. Ann Transl Med. 2020;8(12):768. doi:10.21037/atm-20-148
    1. Quer G, Radin JM, Gadaleta M, et al. . Wearable sensor data and self-reported symptoms for COVID-19 detection. Nat Med. 2021;27(1):73-77. doi:10.1038/s41591-020-1123-x
    1. Hirten RP, Danieletto M, Tomalin L, et al. . Use of physiological data from a wearable device to identify SARS-CoV-2 infection and symptoms and predict COVID-19 diagnosis: observational study. J Med Internet Res. 2021;23(2):e26107. doi:10.2196/26107
    1. Selinheimo S, Vasankari T, Jokela M, et al. . The association of psychological factors and healthcare use with the discrepancy between subjective and objective respiratory-health complaints in the general population. Psychol Med. 2019;49(1):121-131. doi:10.1017/S0033291718000582
    1. Schmutz A, Jacques J, Bouveyron C, Cheze L, Martin P. Clustering multivariate functional data in group-specific functional subspaces. Comput Stat. 2020;35;1101-1131. doi:10.1007/s00180-020-00958-4
    1. Bouveyron C, Jacques J.. Model-based clustering of time series in group-specific functional subspaces. Adv Data Anal Classif. 2011;5(4):281-300. doi:10.1007/s11634-011-0095-6
    1. Jackson GG, Dowling HF. Transmission of the common cold to volunteers under controlled conditions, IV: specific immunity to the common cold. J Clin Invest. 1959;38(5):762-769. doi:10.1172/JCI103857
    1. Woods CW, McClain MT, Chen M, et al. . A host transcriptional signature for presymptomatic detection of infection in humans exposed to influenza H1N1 or H3N2. PLoS One. 2013;8(1):e52198. doi:10.1371/journal.pone.0052198
    1. Zaas AK, Chen M, Varkey J, et al. . Gene expression signatures diagnose influenza and other symptomatic respiratory viral infections in humans. Cell Host Microbe. 2009;6(3):207-217. doi:10.1016/j.chom.2009.07.006
    1. Turner RB. Ineffectiveness of intranasal zinc gluconate for prevention of experimental rhinovirus colds. Clin Infect Dis. 2001;33(11):1865-1870. doi:10.1086/324347
    1. Shaffer F, Ginsberg JP. An overview of heart rate variability metrics and norms. Front Public Health. 2017;5:258. doi:10.3389/fpubh.2017.00258
    1. Dunn J, Kidzinski L, Runge R, et al. . Wearable sensors enable personalized predictions of clinical laboratory measurements. Nat Med. 2021;27(6):1105-1112. doi:10.1038/s41591-021-01339-0
    1. mlxtend. Exhaustive feature selector. Accessed September 20, 2020.
    1. scikit learn, 1.11.2: Forests of randomized trees. Accessed September 20, 2020.
    1. Urbanowicz RJ, Moore JH. ExSTraCS 2.0: description and evaluation of a scalable learning classifier system. Evol Intell. 2015;8(2):89-116. doi:10.1007/s12065-015-0128-8
    1. Šimundić AM. Measures of diagnostic accuracy: basic definitions. EJIFCC. 2009;19(4):203-211.
    1. Goldenberg A, Nestor B, Hunter J, et al. . Dear watch, should I get a COVID test? designing deployable machine learning for wearables. Research Square. Preprint posted online May 19, 2021. doi:10.21203/-505984/v1
    1. Miller DJ, Capodilupo JV, Lastella M, et al. . Analyzing changes in respiratory rate to predict the risk of COVID-19 infection. PLoS One. 2020;15(12):e0243693. doi:10.1371/journal.pone.0243693
    1. Menni C, Valdes AM, Freidin MB, et al. . Real-time tracking of self-reported symptoms to predict potential COVID-19. Nat Med. 2020;26(7):1037-1040. doi:10.1038/s41591-020-0916-2
    1. Smarr BL, Aschbacher K, Fisher SM, et al. . Feasibility of continuous fever monitoring using wearable devices. Sci Rep. 2020;10(1):21640. doi:10.1038/s41598-020-78355-6
    1. Shapiro A, Marinsek N, Clay I, et al. . Characterizing COVID-19 and influenza illnesses in the real world via person-generated health data. Patterns (N Y). 2020;2(1):100188. doi:10.1016/j.patter.2020.100188
    1. Vogels EA. About one-in-five Americans use a smart watch or fitness tracker. Pew Research Center. Accessed July 3, 2020.
    1. Goldsack JC, Coravos A, Bakker JP, et al. . Verification, analytical validation, and clinical validation (V3): the foundation of determining fit-for-purpose for Biometric Monitoring Technologies (BioMeTs). NPJ Digit Med. 2020;3(1):55. doi:10.1038/s41746-020-0260-4

Source: PubMed

3
Subskrybuj