Establishing the Convergent Validity of the Travel Habit Questions in the Health Behavior in School-Aged Children Questionnaire by Quantifying Active Travel in Norwegian Adolescents

Lena Malnes, Tommy Haugen, Bjørge Herman Hansen, Elin Kolle, Sveinung Berntsen, Lena Malnes, Tommy Haugen, Bjørge Herman Hansen, Elin Kolle, Sveinung Berntsen

Abstract

Background: Active travel (cycling or walking to school) can be a substantial part of adolescents' daily physical activity. Research on transport activities primarily relies on self-reported indices of travel mode and travel time. However, many researchers do not report the psychometric properties of their instruments. The Health Behavior in School-aged Children (HBSC) questionnaire is a commonly used instrument, but the items in this questionnaire on travel habits have not yet been validated. The present study was conducted to investigate the convergent validity and agreement between the HBSC items and a travel diary on (1) transport mode to and from school and (2) travel time to school.

Methods: The study sample consisted of 50 participants in the 9th grade (15 ± 0.3 years, 62% girls) from seven Norwegian schools. Outcome variables included transport mode and travel time derived from the HBSC items and a five-day travel diary. Convergent validity was assessed by evaluating Cohen's kappa for travel mode and the correlation coefficient (Spearman Rho) for travel time. Simple agreement calculations between the two measurement methods were also conducted.

Results: The association between the HBSC questionnaire and the diary for travel mode to and from school was κ = 0.63 (P < 0.001) and κ = 0.77 (P < 0.001), respectively. The total agreement between the HBSC questionnaire and the diary for was 78%. However, the agreement was higher for walking (88%) and cycling (91%) than for motorized transport (67%). For travel time, the Spearman correlation coefficient was ρ = 0.60 (P < 0.001) between the HBSC questionnaire and the diary. The total agreement on travel time was 67%; however, active commuters (86%) seemed to more accurately estimated travel time than motorized commuters (55%).

Conclusion: Although the overall agreement between the HBSC questionnaire and the diary for mode of transport was 78%, the HBSC questionnaire may underestimate the prevalence of motorized transport compared to walking and cycling.

Trial registration: ClinicalTrials.gov, identifier: NCT03817047.

Keywords: active commuting; agreement; cycling; logs; travel diary; travel habits; validation; walking.

Conflict of interest statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Copyright © 2022 Malnes, Haugen, Hansen, Kolle and Berntsen.

Figures

Figure 1
Figure 1
Percentage (%) of participants to (n = 47) and from (n = 46) school divided by means of transport from travel diaries.
Figure 2
Figure 2
Percentage of reported transport modes to (n = 47) and from (n = 46) school in the questionnaire, stratified by transport mode from travel diaries.
Figure 3
Figure 3
Typical travel duration (median) to school logged in travel diaries (dot) categorized by each participants response from the HBSC questionnaire. Green shadow background indicates the categorize from HBSC in the graph. Vertical line = median in each questionnaire response.

References

    1. Bakker E. A., Hartman Y. A. W., Hopman M. T. E., Hopkins N. D., Graves L. E. F., Dunstan D. W. (2020). Validity and reliability of subjective methods to assess sedentary behaviour in adults: a systematic review and meta-analysis. Int. J. Behav. Nutr. Phys. Act. 17, 75. 10.1186/s12966-020-00972-1
    1. Bowling N. A., Gibson A. M., Houpt J. W., Brower C. K. (2020). Will the questions ever end? Person-level increases in careless responding during questionnaire completion. Org. Res. Methods 24, 718–738. 10.1177/1094428120947794
    1. Carlson J. A., Jankowska M. M., Meseck K., Godbole S., Natarajan L., Raab F. (2015). Validity of PALMS GPS scoring of active and passive travel compared with SenseCam. Med. Sci. Sports Exerc. 47, 662–667. 10.1249/MSS.0000000000000446
    1. Chillón P., Evenson K. R., Vaughn A. (2011). Ward DSJIJoBN, activity P. A systematic review of interventions for promoting active transportation to school. Int. J. Behav. Nutr. Phys. Act. 8, 10. 10.1186/1479-5868-8-10
    1. Doherty A., Kelly P., Foster C. (2013). Wearable cameras: identifying healthy transportation choices. IEEE Pervasive Comput. 12, 44–47. 10.1109/MPRV.2013.21
    1. Evenson K. R., Neelon B., Ball S. C., Vaughn A., Ward D. S. (2008). Validity and reliability of a school travel survey. J. Phys. Act. Health 5, 1–15. 10.1123/jpah.5.s1.s1
    1. Everson B., Mackintosh K. A., McNarry M. A., Todd C., Stratton G. (2019). Can wearable cameras be used to validate school-aged children's lifestyle behaviours? Children 6, 20. 10.3390/children6020020
    1. Gropp K., Janssen I., Pickett W. (2013). Active transportation to school in Canadian youth: should injury be a concern? Inj. Prev. 19, 64–67. 10.1136/injuryprev-2012-040335
    1. Gropp K. M., Pickett W., Janssen I. (2012). Multi-level examination of correlates of active transportation to school among youth living within 1 mile of their school. Int. J. Behav. Nutr. Phys. Act. 9, 124. 10.1186/1479-5868-9-124
    1. Heale R., Twycross A. (2015). Validity and reliability in quantitative studies. Evid. Based Nurs. 18, 66–67. 10.1136/eb-2015-102129
    1. Helmerhorst H. H. J., Brage S., Warren J., Besson H., Ekelund U. (2012). A systematic review of reliability and objective criterion-related validity of physical activity questionnaires. Int. J. Behav. Nutr. Phys. Act. 9, 103. 10.1186/1479-5868-9-103
    1. Herrador-Colmenero M., Perez-Garcia M., Ruiz J., Chillon P. (2014). Assessing modes and frequency of commuting to school in youngsters: a systematic review. Pediatr. Exerc. Sci. 26, 291–341. 10.1123/pes.2013-0120
    1. Hollein T., Vasickova J., Bucksch J., Kalman M., Sigmundov D., Dijk J. P. (2017). School physical activity policies and active transport to school among pupils in the Czech Republic. J. Transport Health 6, 306–312. 10.1016/j.jth.07,008.
    1. Ian J., Karen C. R., Wendy T. (2017). Adherence to the 24-hour movement guidelines among 10- to 17-year-old Canadians. Health Promot. Chronic Dis. Prev. Canada 37, 369–375. 10.24095/hpcdp.37.11.01
    1. Kelly P., Doherty A., Mizdrak A., Marshall S., Kerr J., Legge A. (2014). High group level validity but high random error of a self-report travel diary, as assessed by wearable cameras. J. Transport Health 1, 190–201. 10.1016/j.jth.04,003.
    1. Klesges L. M., Baranowski T., Beech B., Cullen K., Murray D. M., Rochon J. (2003). Social desirability bias in self-reported dietary, physical activity and weight concerns measures in 8- to 10-year-old African-American girls: results from the Girls health Enrichment Multisite Studies (GEMS). Prev. Med. (2004) 38, 78–87. 10.1016/j.ypmed.07,003.
    1. Kohl H. W., Craig C. L., Lambert E. V., Inoue S., Alkandari J. R., Leetongin G., et al. . (2012). The pandemic of physical inactivity: global action for public health. Lancet 380, 294–305. 10.1016/S0140-6736(12)60898-8
    1. Kolle E., Steene-Johannessen J., Andersen L. B., Anderssen S. A. (2009). Seasonal variation in objectively assessed physical activity among children and adolescents in Norway: a cross-sectional study. Int. J. Behav. Nutr. Phys. Act. 6, 36. 10.1186/1479-5868-6-36
    1. Landis J. R., Koch G. G. (1977). The measurement of observer agreement for categorical data. Biometrics 33, 159–174. 10.2307/2529310
    1. Larouche R., Eryuzlu S., Livock H., Leduc G., Faulkner G., Trudeau F. (2017). Test-retest reliability and convergent validity of measures of children's travel behaviours and independent mobility. J. Transport Health 6, 105–118. 10.1016/j.jth.05,360.
    1. Larouche R., Mammen G., Rowe D. A., Faulkner G. (2018). Effectiveness of active school transport interventions: a systematic review and update. BMC Public Health 18, 206. 10.1186/s12889-017-5005-1
    1. Liu C., Susilo Y. O., Karlström A. (2017). Weather variability and travel behaviour–what we know and what we do not know. Transport Rev. 37, 715–741. 10.1080/01442017,1293188.
    1. Loureiro N., Gaspar d. e. M. (2014). Planning, research T. Why don't they walk or cycle? Reflections on active home–school transportation among Portuguese adolescents: the role of environmental perceptions. Urban Plan. Transport Res. 2, 265–273. 10.1080/21650020.2014.922896
    1. Lu W., McKyer E. L. J., Lee C., Goodson P., Ory M. G., Wang S. (2014). Perceived barriers to children's active commuting to school: a systematic review of empirical, methodological and theoretical evidence. Int. J. Behav. Nutr. Phys. Act. 11, 140. 10.1186/s12966-014-0140-x
    1. Lubans D. R., Boreham C. A., Kelly P., Foster C. E. (2011). The relationship between active travel to school and health-related fitness in children and adolescents: a systematic review. Int. J. Behav. Nutr. Phys. Act. 8, 5. 10.1186/1479-5868-8-5
    1. Morgan K., Hallingberg B., Littlecott H., Murphy S., Fletcher A., Roberts C. (2016). Predictors of physical activity and sedentary behaviours among 11-16 year olds: multilevel analysis of the 2013 Health Behaviour in School-aged Children (HBSC) study in Wales. BMC Public Health 16, 569. 10.1186/s12889-016-3213-8
    1. Pavelka J., Sigmundová D., Hamrík Z., Kalman M., Sigmund E., Mathisen F. (2017). Trends in active commuting to school among Czech Schoolchildren from 2006 to 2014. Cent. Eur. J. Public Health 25, 21–25. 10.21101/cejph.a5095
    1. Petrunoff N. A., Xu H., Rissel C., Wen L. M., van der Ploeg H. P. (2013). Measuring workplace travel behaviour: validity and reliability of survey questions. J. Environ. Public Health 2013, 423035. 10.1155/2013/423035
    1. Roberts C., Freeman J., Samdal O. (2009). The Health Behaviour in School-aged Children (HBSC) study: methodological developments and current tensions. Int. J. Public Health 54, 140–150. 10.1007/s00038-009-5405-9
    1. Rolstad S., Adler J., Rydén A. (2011). Response burden and questionnaire length: is shorter better? a review and meta-analysis. Value Health 14, 1101–1108. 10.1016/j.jval.06,003.
    1. Sahlqvist S., Song Y., Ogilvie D. (2012). Is active travel associated with greater physical activity? The contribution of commuting and non-commuting active travel to total physical activity in adults. Prev. Med. 55, 206–211. 10.1016/j.ypmed.06,028.
    1. Solberg R. B., Steene-Johannessen J., Anderssen S. A., Ekelund U., Säfvenbom R., Haugen T. (2021). Effects of a school-based physical activity intervention on academic performance in 14-year old adolescents: a cluster randomized controlled trial - the School in Motion study. BMC Public Health 21, 871. 10.1186/s12889-021-10901-x
    1. Steene-Johannessen J., Hansen B. H., Dalene K. E., Kolle E., Northstone K., Møller N. C. (2020). Variations in accelerometry measured physical activity and sedentary time across Europe–harmonized analyses of 47,497 children and adolescents. Int. J. Behav. Nutr. Phys. Act. 17, 38. 10.1186/s12966-020-00930-x
    1. Tremblay M. S., Barnes J. D., González S. A., Katzmarzyk P. T., Onywera V. O., Reilly J. J. (2016). Global matrix 2.0: report card grades on the physical activity of children and youth comparing 38 countries. J. Phys. Act. Health 13, 343–366. 10.1123/jpah.2016-0594
    1. Vach W.. (2005). The dependence of Cohen's kappa on the prevalence does not matter. J. Clin. Epidemiol. 58, 655–661. 10.1016/j.jclinepi.02,021.
    1. Villa-González E., Barranco-Ruiz Y., Evenson K. R., Chillón P. (2018). Systematic review of interventions for promoting active school transport. Prev. Med. 111, 115–134. 10.1016/j.ypmed.02,010.
    1. Warburton D. E., Charlesworth S., Ivey A., Nettlefold L., Bredin S. S. (2010). A systematic review of the evidence for Canada's Physical Activity Guidelines for Adults. Int. J. Behav. Nutr. Phys. Act. 7, 39. 10.1186/1479-5868-7-39
    1. Warrens M. J.. (2015). Five ways to look at Cohen's kappa. J. Psychol. Psychother. 5:1. 10.4172/2161-0487.1000197
    1. Yang X., Telama R., Hirvensalo M., Tammelin T., Viikari J. S., Raitakari O. T. (2014). Active commuting from youth to adulthood and as a predictor of physical activity in early midlife: the young Finns study. Prev. Med. 59, 5–11. 10.1016/j.ypmed.10.019
    1. Yang Y., Ivey S. S., Levy M. C., Royne M. B., Klesges L. M. (2016). Active travel to school: findings from the survey of US health behavior in school-aged children, 2009–2010. J. Sch. Health. 86, 464–471. 10.1111/josh.12395

Source: PubMed

3
Suscribir