Hearables: Multimodal physiological in-ear sensing
Valentin Goverdovsky, Wilhelm von Rosenberg, Takashi Nakamura, David Looney, David J Sharp, Christos Papavassiliou, Mary J Morrell, Danilo P Mandic, Valentin Goverdovsky, Wilhelm von Rosenberg, Takashi Nakamura, David Looney, David J Sharp, Christos Papavassiliou, Mary J Morrell, Danilo P Mandic
Abstract
Future health systems require the means to assess and track the neural and physiological function of a user over long periods of time, and in the community. Human body responses are manifested through multiple, interacting modalities - the mechanical, electrical and chemical; yet, current physiological monitors (e.g. actigraphy, heart rate) largely lack in cross-modal ability, are inconvenient and/or stigmatizing. We address these challenges through an inconspicuous earpiece, which benefits from the relatively stable position of the ear canal with respect to vital organs. Equipped with miniature multimodal sensors, it robustly measures the brain, cardiac and respiratory functions. Comprehensive experiments validate each modality within the proposed earpiece, while its potential in wearable health monitoring is illustrated through case studies spanning these three functions. We further demonstrate how combining data from multiple sensors within such an integrated wearable device improves both the accuracy of measurements and the ability to deal with artifacts in real-world scenarios.
Conflict of interest statement
The authors declare that they have no competing interests.
Figures
References
- Lee, S. M. et al. Self-adhesive epidermal carbon nanotube electronics for tether-free long-term continuous recording of biosignals. Sci. Rep. 4 (2014).
- Ko D, Lee C, Lee EJ, Lee SH, Jung KY. A dry and flexible electrode for continuous-EEG monitoring using silver balls based polydimethylsiloxane (PDMS) Biomed. Eng. Lett. 2012;2:18–23. doi: 10.1007/s13534-012-0049-8.
- Myers AC, Huang H, Zhu Y. Wearable silver nanowire dry electrodes for electrophysiological sensing. RSC Adv. 2015;5:11627–11632. doi: 10.1039/C4RA15101A.
- Salvo P, et al. A 3D printed dry electrode for ECG/EEG recording. Sensors Actuators, A Phys. 2012;174:96–102. doi: 10.1016/j.sna.2011.12.017.
- Chi YM, Jung TP, Cauwenberghs G. Dry-contact and noncontact biopotential electrodes: Methodological review. IEEE Rev. Biomed. Eng. 2010;3:106–119. doi: 10.1109/RBME.2010.2084078.
- Chiou J-C, Ko L-W, Lin C-T. Using novel MEMS EEG nensors in detecting drowsiness application. Proc. IEEE Biomed. Circuits Syst. Conf. 2006;95:33–36.
- Grozea C, Voinescu CD, Fazli S. Bristle-sensors – low-cost flexible passive dry EEG electrodes for neurofeedback and BCI applications. J. Neural Eng. 2011;8:025008. doi: 10.1088/1741-2560/8/2/025008.
- Lopez-Gordo MA, Sanchez-Morillo D, Pelayo Valle F. Dry EEG electrodes. Sensors (Basel) 2014;14:12847–12870. doi: 10.3390/s140712847.
- Norton JJS, et al. Soft, curved electrode systems capable of integration on the auricle as a persistent brain–computer interface. Proc. Natl. Acad. Sci. 2015;112:3920–3925. doi: 10.1073/pnas.1424875112.
- Looney D, et al. The in-the-ear recording concept: User-centered and wearable brain monitoring. IEEE Pulse. 2012;3:32–42. doi: 10.1109/MPUL.2012.2216717.
- Hoon Lee J, et al. CNT/PDMS-based canal-typed ear electrodes for inconspicuous EEG recording. J. Neural Eng. 2014;11:046014. doi: 10.1088/1741-2560/11/4/046014.
- Debener S, Emkes R, De Vos M, Bleichner M. Unobtrusive ambulatory EEG using a smartphone and flexible printed electrodes around the ear. Sci. Rep. 2015;5:16743. doi: 10.1038/srep16743.
- Goverdovsky V, Looney D, Kidmose P, Mandic DP. In-ear EEG from viscoelastic generic earpieces: Robust and unobtrusive 24/7 monitoring. IEEE Sensors Journal. 2016;16:271–277. doi: 10.1109/JSEN.2015.2471183.
- Looney D, Goverdovsky V, Rosenzweig I, Morrell MJ, Mandic DP. Wearable in-ear encephalography sensor for monitoring sleep. Preliminary Observations from Nap Studies. Ann. Am. Thorac. Soc. 2016;13:2229–2233. doi: 10.1513/AnnalsATS.201605-342BC.
- Goverdovsky V, Looney D, Kidmose P, Papavassiliou C, Mandic DP. Co-located multimodal sensing: A next generation solution for wearable health. IEEE Sensors Journal. 2015;15:138–145. doi: 10.1109/JSEN.2014.2338612.
- Kidmose P, Looney D, Ungstrup M, Rank ML, Mandic DP. A study of evoked potentials from ear-EEG. IEEE Trans. Biomed. Eng. 2013;60:2824–2830. doi: 10.1109/TBME.2013.2264956.
- Herdman AT, et al. Intracerebral sources of human auditory steady-state responses. Brain Topography. 2002;15:69–86. doi: 10.1023/A:1021470822922.
- Di Russo F, Martínez A, Sereno MI, Pitzalis S, Hillyard SA. Cortical sources of the early components of the visual evoked potential. Hum. Brain Mapp. 2002;15:95–111. doi: 10.1002/hbm.10010.
- Eoh HJ, Chung MK, Kim SH. Electroencephalographic study of drowsiness in simulated driving with sleep deprivation. Int. J. Ind. Ergon. 2005;35:307–320. doi: 10.1016/j.ergon.2004.09.006.
- Simon M, et al. EEG alpha spindle measures as indicators of driver fatigue under real traffic conditions. Clin. Neurophysiol. 2011;122:1168–1178. doi: 10.1016/j.clinph.2010.10.044.
- Looney, D., Goverdovsky, V., Kidmose, P. & Mandic, D. P. Subspace denoising of EEG artefacts via multivariate EMD. In Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 4688–4692 (2014).
- Looney, D. & Mandic, D. A machine learning enhanced empirical mode decomposition. In Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 1897–1900 (2008).
- Kubichek, R. Mel-cepstral distance measure for objective speech quality assessment. In Proc. IEEE Pacific Rim Conf. on Communications Computers and Signal Process., vol. 1, 125–128 vol. 1 (1993).
- Corbishley P, Rodríguez-Villegas E. Breathing detection: Towards a miniaturized, wearable, battery-operated monitoring system. IEEE Trans. Biomed. Eng. 2008;55:196–204. doi: 10.1109/TBME.2007.910679.
- Pressler, G., Mansfield, J., Pasterkamp, H. & Wodicka, G. Detection of respiratory sounds within the ear canal. In Proc. Second Jt. Annu. Conf. Annu. Fall Meet. Biomed. Eng. Soc., vol. 2, 1529–1530 (2002).
- Venema B, et al. Advances in reflective oxygen saturation monitoring with a novel in-ear sensor system: Results of a human hypoxia study. IEEE Trans. Biomed. Eng. 2012;59:2003–10. doi: 10.1109/TBME.2012.2196276.
- Rosenzweig I, et al. Changes in neurocognitive architecture in patients with obstructive sleep apnea treated with continuous positive airway pressure. EBioMedicine. 2016;7:221–229. doi: 10.1016/j.ebiom.2016.03.020.
- Andreuccetti, D., Fossi, R. & Petrucci, C. An internet resource for the calculation of the dielectric properties of body tissues in the frequency range 10 Hz–100 GHz. IFAC-CNR, Florence (Italy) (1997).
- Gabriel C, Gabriel S, Corthout E. The dielectric properties of biological tissues: I. Literature survey. Physics in Medicine and Biology. 1996;41:2231–2249. doi: 10.1088/0031-9155/41/11/001.
- Gabriel S, Lau RW, Gabriel C. The dielectric properties of biological tissues: II. Measurements in the frequency range 10 Hz to 20 GHz. Physics in Medicine and Biology. 1996;41:2251–2269. doi: 10.1088/0031-9155/41/11/002.
- Gabriel S, Lau RW, Gabriel C. The dielectric properties of biological tissues: III. Parametric models for the dielectric spectrum of tissues. Physics in Medicine and Biology. 1996;41:2271–2293. doi: 10.1088/0031-9155/41/11/003.
Source: PubMed