Evaluation of a contactless neonatal physiological monitor in Nairobi, Kenya

Dee Wang, William M Macharia, Roseline Ochieng, Dorothy Chomba, Yifat S Hadida, Roman Karasik, Dustin Dunsmuir, Jesse Coleman, Guohai Zhou, Amy Sarah Ginsburg, J Mark Ansermino, Dee Wang, William M Macharia, Roseline Ochieng, Dorothy Chomba, Yifat S Hadida, Roman Karasik, Dustin Dunsmuir, Jesse Coleman, Guohai Zhou, Amy Sarah Ginsburg, J Mark Ansermino

Abstract

Background: Globally, 2.5 million neonates died in 2018, accounting for 46% of under-5 deaths. Multiparameter continuous physiological monitoring (MCPM) of neonates allows for early detection and treatment of life-threatening health problems. However, neonatal monitoring technology is largely unavailable in low-resource settings.

Methods: In four evaluation rounds, we prospectively compared the accuracy of the EarlySense under-mattress device to the Masimo Rad-97 pulse CO-oximeter with capnography reference device for heart rate (HR) and respiratory rate (RR) measurements in neonates in Kenya. EarlySense algorithm optimisations were made between evaluation rounds. In each evaluation round, we compared 200 randomly selected epochs of data using Bland-Altman plots and generated Clarke error grids with zones of 20% to aid in clinical interpretation.

Results: Between 9 July 2019 and 8 January 2020, we collected 280 hours of MCPM data from 76 enrolled neonates. At the final evaluation round, the EarlySense MCPM device demonstrated a bias of -0.8 beats/minute for HR and 1.6 breaths/minute for RR, and normalised spread between the 95% upper and lower limits of agreement of 6.2% for HR and 27.3% for RR. Agreement between the two MCPM devices met the a priori-defined threshold of 30%. The Clarke error grids showed that all observations for HR and 197/200 for RR were within a 20% difference.

Conclusion: Our research indicates that there is acceptable agreement between the EarlySense and Masimo MCPM devices in the context of large within-subject variability; however, further studies establishing cost-effectiveness and clinical effectiveness are needed before large-scale implementation of the EarlySense MCPM device in neonates.

Trial registration number: NCT03920761.

Keywords: intensive care units; neonatal; neonatology; technology.

Conflict of interest statement

Competing interests: YSH and RK are employed by EarlySense. All other authors declare no competing interests.

© Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY. Published by BMJ.

Figures

Figure 1
Figure 1
(A) Overview of the set-up showing the Masimo Rad-97 device with touchscreen interface (1), pulse oximeter probe (2), Nomoline for capnography (3), EarlySense processing unit (4), EarlySense under-mattress sensor (5). (B) Close-up of the EarlySense sensor under a mattress. The EarlySense sensor is connected to the processing unit that processes, stores data and sends results wirelessly to the remote display unit where the data are presented.
Figure 2
Figure 2
Bland-Altman plots for heart rate (HR). (A) Open-label round. (B) Closed-label round one. (C) Closed-label round two. (D) Closed-label round three. Colours indicate which participant neonate is associated with the measurement pair.
Figure 3
Figure 3
Clarke error grids for closed-label round three measurements. (A) Comparison of heart rate (HR) measurements. (B) Comparison of EarlySense respiratory rate (RR) to Masimo Rad-97 RR manual count. Each dot represents a data pair, with the colour intensity proportional to density of data pairs. Region A (in green) contains data pairs that are within 20% of the Masimo Rad-97 device value. Region B (in yellow) contains data pairs not within 20% that would not lead to unnecessary treatment. Regions C, D and E are in red. C includes data pairs leading to unnecessary treatment. D includes data pairs with a failure in detecting low or high HR/RR events and E includes data pairs where low and high HR/RR events are confused.
Figure 4
Figure 4
Bland-Altman plots for manual counts of respiratory rate (RR). (A) Open-label round. (B) Closed-label round one. (C) Closed-label round two. (D) Closed-label round three. Colours indicate which participant neonate is associated with the measurement pair.

References

    1. World Health Organization . Newborns: improving survival and well-being, 2020. Available: [Accessed 22 Jan 2021].
    1. United Nations . Ensure healthy lives and promote well-being for all at all ages, 2020. Available: [Accessed 22 Jan 2021].
    1. Lawn JE, Osrin D, Adler A, et al. . Four million neonatal deaths: counting and attribution of cause of death. Paediatr Perinat Epidemiol 2008;22:410–6. 10.1111/j.1365-3016.2008.00960.x
    1. Buist M, Bernard S, Nguyen TV, et al. . Association between clinically abnormal observations and subsequent in-hospital mortality: a prospective study. Resuscitation 2004;62:137–41. 10.1016/j.resuscitation.2004.03.005
    1. Cuthbertson BH, Boroujerdi M, McKie L, et al. . Can physiological variables and early warning scoring systems allow early recognition of the deteriorating surgical patient? Crit Care Med 2007;35:402–9. 10.1097/01.CCM.0000254826.10520.87
    1. Fairchild KD, Schelonka RL, Kaufman DA, et al. . Septicemia mortality reduction in neonates in a heart rate characteristics monitoring trial. Pediatr Res 2013;74:570–5. 10.1038/pr.2013.136
    1. Warburton A, Monga R, Sampath V, et al. . Continuous pulse oximetry and respiratory rate trends predict short-term respiratory and growth outcomes in premature infants. Pediatr Res 2019;85:494–501. 10.1038/s41390-018-0269-4
    1. Kumar N, Akangire G, Sullivan B, et al. . Continuous vital sign analysis for predicting and preventing neonatal diseases in the twenty-first century: big data to the forefront. Pediatr Res 2020;87:210–20. 10.1038/s41390-019-0527-0
    1. Dünser MW, Baelani I, Ganbold L. A review and analysis of intensive care medicine in the least developed countries. Crit Care Med 2006;34:1234–42. 10.1097/01.CCM.0000208360.70835.87
    1. Ginsburg AS, Nkwopara E, Macharia W, et al. . Evaluation of non-invasive continuous physiological monitoring devices for neonates in Nairobi, Kenya: a research protocol. BMJ Open 2020;10:e035184. 10.1136/bmjopen-2019-035184
    1. Coleman J, Ginsburg AS, Macharia WM, et al. . Identification of thresholds for accuracy comparisons of heart rate and respiratory rate in neonates. Gates Open Res 2021;5:93. 10.12688/gatesopenres.13237.2
    1. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986;1:307–10.
    1. Dehkordi P, Garde A, Karlen W, et al. . Pulse rate variability compared with heart rate variability in children with and without sleep disordered breathing. Annu Int Conf IEEE Eng Med Biol Soc 2013;2013:6563–6. 10.1109/EMBC.2013.6611059
    1. Katz Y, Karasik R, Shinar Z. Contact-free piezo electric sensor used for real-time analysis of inter beat interval series. Comput Cardiol 2016;43:769–72. 10.22489/CinC.2016.222-272
    1. Mora N, Cocconcelli F, Matrella G, et al. . Accurate heartbeat detection on ballistocardiogram accelerometric traces. IEEE Trans Instrum Meas 2020;69:9000–9. 10.1109/TIM.2020.2998644
    1. Eisenberg ME, Givony D, Levin R. Acoustic respiration rate and pulse oximetry-derived respiration rate: a clinical comparison study. J Clin Monit Comput 2020;34:139–46. 10.1007/s10877-018-0222-4
    1. Patel M, Mohr M, Lake D, et al. . Clinical associations with immature breathing in preterm infants: part 2-periodic breathing. Pediatr Res 2016;80:28–34. 10.1038/pr.2016.58
    1. United Nations Children’s Fund . Target product profile acute respiratory infection diagnostic aid (ARIDA), 2014. Available: [Accessed 23 Jan 2021].
    1. Critchley LA, Critchley JA. A meta-analysis of studies using bias and precision statistics to compare cardiac output measurement techniques. J Clin Monit Comput 1999;15:85–91. 10.1023/A:1009982611386
    1. Ermer S, Brewer L, Orr J, et al. . Comparison of 7 different sensors for detecting low respiratory rates using a single breath detection algorithm in Nonintubated, Sedated volunteers. Anesth Analg 2019;129:399–408. 10.1213/ANE.0000000000003793
    1. Ben-Ari J, Zimlichman E, Adi N, et al. . Contactless respiratory and heart rate monitoring: validation of an innovative tool. J Med Eng Technol 2010;34:393–8. 10.3109/03091902.2010.503308
    1. Breteler MJM, KleinJan EJ, Dohmen DAJ, et al. . Vital signs monitoring with wearable sensors in high-risk surgical patients: a clinical validation study. Anesthesiology 2020;132:424–39. 10.1097/ALN.0000000000003029
    1. Byakika-Kibwika P, Muwonge M, Watts W, et al. . Lessons learned from implementing a rapid test of a technology device in a tertiary hospital in Uganda. Ann Glob Health 2015;81:725-30. 10.1016/j.aogh.2015.12.009
    1. Steinhubl SR, Feye D, Levine AC, et al. . Validation of a portable, deployable system for continuous vital sign monitoring using a multiparametric wearable sensor and personalised analytics in an Ebola treatment centre. BMJ Glob Health 2016;1:e000070. 10.1136/bmjgh-2016-000070
    1. Mugyenyi GR, Atukunda EC, Ngonzi J, et al. . Functionality and acceptability of a wireless fetal heart rate monitoring device in term pregnant women in rural southwestern Uganda. BMC Pregnancy Childbirth 2017;17:178. 10.1186/s12884-017-1361-1
    1. Ngonzi J, Boatin A GM, Wylie B. A functionality and acceptability study of wireless maternal vital sign monitor in a tertiary university teaching hospital in rural Uganda. J Womens Health Gynecol 2017;4:1–8. 10.17303/jwhg.2017.4.103
    1. Kevat AC, Bullen DVR, Davis PG, et al. . A systematic review of novel technology for monitoring infant and newborn heart rate. Acta Paediatr 2017;106:710–20. 10.1111/apa.13786
    1. Ginsburg AS, Lenahan JL, Izadnegahdar R, et al. . A systematic review of tools to measure respiratory rate in order to identify childhood pneumonia. Am J Respir Crit Care Med 2018;197:1116–27. 10.1164/rccm.201711-2233CI
    1. Anton O, Fernandez R, Rendon-Morales E, et al. . Heart rate monitoring in newborn babies: a systematic review. Neonatology 2019;116:199–210. 10.1159/000499675
    1. Ginsburg AS, Kinshella MLW, Naanyu V. Feasibility, usability, and acceptability of multiparameter continuous physiological monitoring technologies in neonates among healthcare providers and caregivers at a private tertiary hospital in Nairobi, Kenya: a qualitative study. J Med Internet Res 2021:e0.

Source: PubMed

Подписаться