Performance of a commercial multi-sensor wearable (Fitbit Charge HR) in measuring physical activity and sleep in healthy children

Job G Godino, David Wing, Massimiliano de Zambotti, Fiona C Baker, Kara Bagot, Sarah Inkelis, Carina Pautz, Michael Higgins, Jeanne Nichols, Ty Brumback, Guillaume Chevance, Ian M Colrain, Kevin Patrick, Susan F Tapert, Job G Godino, David Wing, Massimiliano de Zambotti, Fiona C Baker, Kara Bagot, Sarah Inkelis, Carina Pautz, Michael Higgins, Jeanne Nichols, Ty Brumback, Guillaume Chevance, Ian M Colrain, Kevin Patrick, Susan F Tapert

Abstract

Purpose: This study sought to assess the performance of the Fitbit Charge HR, a consumer-level multi-sensor activity tracker, to measure physical activity and sleep in children.

Methods: 59 healthy boys and girls aged 9-11 years old wore a Fitbit Charge HR, and accuracy of physical activity measures were evaluated relative to research-grade measures taken during a combination of 14 standardized laboratory- and field-based assessments of sitting, stationary cycling, treadmill walking or jogging, stair walking, outdoor walking, and agility drills. Accuracy of sleep measures were evaluated relative to polysomnography (PSG) in 26 boys and girls during an at-home unattended PSG overnight recording. The primary analyses included assessment of the agreement (biases) between measures using the Bland-Altman method, and epoch-by-epoch (EBE) analyses on a minute-by-minute basis.

Results: Fitbit Charge HR underestimated steps (~11.8 steps per minute), heart rate (~3.58 bpm), and metabolic equivalents (~0.55 METs per minute) and overestimated energy expenditure (~0.34 kcal per minute) relative to research-grade measures (p< 0.05). The device showed an overall accuracy of 84.8% for classifying moderate and vigorous physical activity (MVPA) and sedentary and light physical activity (SLPA) (sensitivity MVPA: 85.4%; specificity SLPA: 83.1%). Mean estimates of bias for measuring total sleep time, wake after sleep onset, and heart rate during sleep were 14 min, 9 min, and 1.06 bpm, respectively, with 95.8% sensitivity in classifying sleep and 56.3% specificity in classifying wake epochs.

Conclusions: Fitbit Charge HR had adequate sensitivity in classifying moderate and vigorous intensity physical activity and sleep, but had limitations in detecting wake, and was more accurate in detecting heart rate during sleep than during exercise, in healthy children. Further research is needed to understand potential challenges and limitations of these consumer devices.

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1. Bland-Altman plots for average steps…
Fig 1. Bland-Altman plots for average steps (A), heart rate (B), energy expenditure (kcal) (C) and METs (D) per minute.
The central dotted line represents the Bland-Altman biases; the thin dotted lines represent the Bland-Altman agreement limits.
Fig 2. Bland-Altman plots for Total Sleep…
Fig 2. Bland-Altman plots for Total Sleep Time (TST), Sleep Onset Latency (SOL), and Wake After Sleep Onset (WASO).
The central dotted lines represent the Bland-Altman biases; the thin dotted lines represent the Bland-Altman agreement limits. *PSG is considered the gold standard for sleep assessment, therefore, mean bias was plotted against the PSG measurement alone and not the average of measures from PSG and the Fitbit Charge HR.
Fig 3. Bland-Altman plots for nocturnal Heart…
Fig 3. Bland-Altman plots for nocturnal Heart Rate (HR).
The thick dotted lines represent the Bland-Altman bias; the thin dotted lines represent the Bland-Altman upper and lower agreement limits.

References

    1. Hallal PC, Bauman AE, Heath GW, Kohl HW, Lee I-M, Pratt M. Physical activity: more of the same is not enough. Lancet [Internet]. 2012. July 21 [cited 2013 Feb 28];380(9838):190–1. Available from:
    1. Luyster FS, Strollo PJ, Zee PC, Walsh JK, Boards of Directors of the American Academy of Sleep Medicine and the Sleep Research Society. Sleep: a health imperative. Sleep [Internet]. 2012. June 1;35(6):727–34. Available from:
    1. Hallal PC, Andersen LB, Bull FC, Guthold R, Haskell W, Ekelund U. Global physical activity levels: Surveillance progress, pitfalls, and prospects. Lancet [Internet]. 2012. July 21 [cited 2013 Mar 4];380(9838):247–57. Available from:
    1. Cappuccio FP, D’Elia L, Strazzullo P, Miller MA. Sleep duration and all-cause mortality: A systematic review and meta-analysis of prospective studies. Sleep. 2010;33(5):585–92. 10.1093/sleep/33.5.585
    1. Wareham N, Rennie K. The assessment of physical activity in individuals and populations: Why try to be more precise about how physical activity is assessed? Int J Obes. 1998;22(Supplement 2):S30–8.
    1. Lynch J, Smith GD. A life course approach to chronic disease epidemiology. Annu Rev Public Health [Internet]. 2005. January [cited 2014 Oct 17];26:1–35. Available from:
    1. Troiano RP, McClain JJ, Brychta RJ, Chen KY. Evolution of accelerometer methods for physical activity research. Br J Sports Med [Internet]. 2014. April 29 [cited 2014 Jun 12];1–5. Available from:
    1. Meltzer LJ, Montgomery-Downs HE, Insana SP, Walsh CM. Use of actigraphy for assessment in pediatric sleep research. Sleep Med Rev [Internet]. 2012. October;16(5):463–75. Available from:
    1. Dobkin BH, Dorsch A. The promise of mHealth: daily activity monitoring and outcome assessments by wearable sensors. Neurorehabil Neural Repair [Internet]. 2015. [cited 2015 Jan 7];25(9):788–98. Available from:
    1. Ubrani J, Llamas R, Shirer M. Wristwear Dominates the Wearables Market While Clothing and Earwear Have Market-Beating Growth by 2021, According to IDC [Internet]. International Data Corporation. 2017 [cited 2018 Jan 29].
    1. Brage S, Westgate K, Franks PW, Stegle O, Wright A, Ekelund U, et al. Estimation of free-living energy expenditure by heart rate and movement sensing: A doubly-labelled water study. PLoS One. 2015;10(9):1–19.
    1. Brage S, Ekelund U, Brage N, Hennings M a, Froberg K, Franks PW, et al. Hierarchy of individual calibration levels for heart rate and accelerometry to measure physical activity. J Appl Physiol [Internet]. 2007. August [cited 2013 Jul 16];103(2):682–92. Available from:
    1. Brage S, Brage N, Franks PW, Ekelund U, Wong M-Y, Andersen LB, et al. Branched equation modeling of simultaneous accelerometry and heart rate monitoring improves estimate of directly measured physical activity energy expenditure. J Appl Physiol [Internet]. 2004. January [cited 2011 Jun 29];96(1):343–51. Available from:
    1. Thompson D, Batterham AM, Bock S, Robson C, Stokes K. Assessment of low-to-moderate intensity physical activity thermogenesis in young adults using synchronized heart rate and accelerometry with branched-equation modeling. J Nutr. 2006. April;136(4):1037–42. 10.1093/jn/136.4.1037
    1. de Zambotti M, Baker FC, Willoughby AR, Godino JG, Wing D, Patrick K, et al. Measures of sleep and cardiac functioning during sleep using a multi-sensory commercially-available wristband in adolescents. Physiol Behav. 2016. May;158:143–9. 10.1016/j.physbeh.2016.03.006
    1. de Zambotti M, Goldstone A, Claudatos S, Colrain IM, Baker FC. A validation study of Fitbit Charge 2™ compared with polysomnography in adults. Chronobiol Int [Internet]. 2018. April;35(4):465–76. Available from:
    1. Klepin K, Wing D, Higgins M, Nichols J, Godino JG. Validity of Cardiorespiratory Fitness Measured with Fitbit Compared to VO2max. Med Sci Sports Exerc [Internet]. 2019. May 17;(In press). Available from:
    1. Wright SP, Hall Brown TS, Collier SR, Sandberg K. How consumer physical activity monitors could transform human physiology research. Am J Physiol Regul Integr Comp Physiol [Internet]. 2017. March 1;312(3):R358–67. Available from:
    1. Small Steps Labs LLC. Fitbit Research Library [Internet]. 2017 [cited 2017 Jul 10].
    1. Wang R, Blackburn G, Desai M, Phelan D, Gillinov L, Houghtaling P, et al. Accuracy of Wrist-Worn Heart Rate Monitors. JAMA Cardiol [Internet]. 2016;313(6):625–6. Available from:
    1. Lee J-M, Kim Y, Welk GJ. Validity of Consumer-Based Physical Activity Monitors. [Internet]. Vol. 46, Medicine and science in sports and exercise. 2014. [cited 2014 Jun 5]. 1840–8 p. Available from:
    1. Kooiman TJM, Dontje ML, Sprenger SR, Krijnen WP, van der Schans CP, de Groot M. Reliability and validity of ten consumer activity trackers. BMC Sports Sci Med Rehabil [Internet]. 2015;7(1):24 Available from:
    1. Wang L, Liu T, Wang Y, Li Q, Yi J, Inoue Y. Evaluation on Step Counting Performance of Wristband Activity Monitors in Daily Living Environment. IEEE Access [Internet]. 2017;5:13020–7. Available from:
    1. Gardner RF, Voss C, Dean PH, Harris KC. Validation of the Fitbit Charge Heart Rate™ Device To Monitor Physical Activity in Children With Congenital Heart Disease. Can J Cardiol [Internet]. 2016;32(10):S130 Available from:
    1. LaMunion SR, Blythe AL, Hibbing PR, Kaplan AS, Clendenin BJ, Crouter SE. Use of Consumer Monitors for Estimating Energy Expenditure in Youth. Appl Physiol Nutr Metab [Internet]. 2019. July 3;6:1873–9. Available from:
    1. American College of Sports Medicine. ACSM’s guidelines for exercise testing and prescription. Ninth Edit Philadelphia: Wolters Kluwer/Lippincott Williams & Wilkins Health; 2014. 1–480 p.
    1. Berry RB, Brooks R, Gamaldo C, Harding SM, Lloyd RM, Quan SF, et al. AASM Scoring Manual Updates for 2017 (Version 2.4). J Clin Sleep Med [Internet]. 2017. May 15;13(5):665–6. Available from:
    1. Sadeh A, Sharkey KM, Carskadon MA. Activity-based sleep-wake identification: an empirical test of methodological issues. Sleep [Internet]. 1994. April;17(3):201–7. Available from:
    1. De Zambotti M, Cellini N, Goldstone A, Colrain IM, Baker FC. Wearable Sleep Technology in Clinical and Research Settings. Med Sci Sports Exerc. 2019;
    1. Farabi SS, Quinn L, Carley DW. Validity of Actigraphy in Measurement of Sleep in Young Adults With Type 1 Diabetes. J Clin Sleep Med [Internet]. 2017. May 15;13(5):669–74. Available from:
    1. Roane BM, Van Reen E, Hart CN, Wing R, Carskadon MA. Estimating sleep from multisensory armband measurements: validity and reliability in teens. J Sleep Res [Internet]. 2015. December;24(6):714–21. Available from:
    1. Dooley EE, Golaszewski NM, Bartholomew JB. Estimating Accuracy at Exercise Intensities: A Comparative Study of Self-Monitoring Heart Rate and Physical Activity Wearable Devices. JMIR mHealth uHealth [Internet]. 2017;5(3):e34 Available from:
    1. Physical Activity Guidelines Advisory Committee. 2008 physical activity guidelines for americans. Washington, DC; 2008.
    1. Evenson KR, Catellier DJ, Gill K, Ondrak KS, McMurray RG. Calibration of two objective measures of physical activity for children. J Sports Sci [Internet]. 2008;26(14):1557–65. Available from:
    1. Tudor-Locke C, Barreira T V, Schuna JM, Mire EF, Chaput J-P, Fogelholm M, et al. Improving wear time compliance with a 24-hour waist-worn accelerometer protocol in the International Study of Childhood Obesity, Lifestyle and the Environment (ISCOLE). Int J Behav Nutr Phys Act [Internet]. 2015;12(1). Available from:
    1. de Zambotti M, Baker FC, Willoughby AR, Godino JG, Wing D, Patrick K, et al. Measures of sleep and cardiac functioning during sleep using a multi-sensory commercially-available wristband in adolescents. Physiol Behav [Internet]. 2016. May 1;158(Imc):143–9. Available from:
    1. Meltzer LJ, Walsh CM, Traylor J, Westin AML. Direct comparison of two new actigraphs and polysomnography in children and adolescents. Sleep [Internet]. 2012. January 1;35(1):159–66. Available from:
    1. Sadeh A. The role and validity of actigraphy in sleep medicine: an update. Sleep Med Rev [Internet]. 2011. August [cited 2014 Oct 2];15(4):259–67. Available from:
    1. Meltzer LJ, Hiruma LS, Avis K, Montgomery-Downs H, Valentin J. Comparison of a Commercial Accelerometer with Polysomnography and Actigraphy in Children and Adolescents. Sleep [Internet]. 2015. August 1;38(8):1323–30. Available from:
    1. Montgomery-Downs HE, Insana SP, Bond JA. Movement toward a novel activity monitoring device. Sleep Breath [Internet]. 2012. September;16(3):913–7. Available from:
    1. de Zambotti M, Goldstone A, Claudatos S, Colrain IM, Baker FC. A validation study of Fitbit Charge 2™ compared with polysomnography in adults. Chronobiol Int. 2018;
    1. Depner CM, Cheng PC, Devine JK, Khosla S, de Zambotti M, Robillard R, et al. Wearable technologies for developing sleep and circadian biomarkers: a summary of workshop discussions. Sleep. 2020;
    1. de Zambotti M, Cellini N, Menghini L, Sarlo M, Baker FC. Sensors Capabilities, Performance, and Use of Consumer Sleep Technology. Sleep Medicine Clinics. 2020.
    1. Bagot KS, Matthews SA, Mason M, Squeglia LM, Fowler J, Gray K, et al. Current, future and potential use of mobile and wearable technologies and social media data in the ABCD study to increase understanding of contributors to child health. Dev Cogn Neurosci [Internet]. 2018. August;32:121–9. Available from:
    1. Fakier N, Wild LG. Associations among sleep problems, learning difficulties and substance use in adolescence. J Adolesc [Internet]. 2011. August;34(4):717–26. Available from:
    1. Pasch KE, Laska MN, Lytle LA, Moe SG. Adolescent sleep, risk behaviors, and depressive symptoms: are they linked? Am J Health Behav [Internet]. 2010;34(2):237–48. Available from:
    1. de Rezende LFM, Rodrigues Lopes M, Rey-López JP, Matsudo VKR, Luiz ODC. Sedentary behavior and health outcomes: an overview of systematic reviews. PLoS One [Internet]. 2014;9(8):e105620 Available from:
    1. Marcus CL, Traylor J, Biggs SN, Roberts RS, Nixon GM, Narang I, et al. Feasibility of comprehensive, unattended ambulatory polysomnography in school-aged children. J Clin Sleep Med. 2014;

Source: PubMed

3
Abonneren