Non-response and external validity in a school-based quasi-experimental study 'The Healthy Primary School of the Future': A cross-sectional assessment

E A Boudewijns, J J S Pepels, D van Kann, K Konings, C P van Schayck, M Willeboordse, E A Boudewijns, J J S Pepels, D van Kann, K Konings, C P van Schayck, M Willeboordse

Abstract

Limited evidence is available about (non)-representativeness of participants in health-promoting interventions. The Dutch Healthy Primary School of the Future (HPSF)-study is a school-based study aiming to improve health through altering physical activity and dietary behaviour, that started in 2015 (registered in ClinicalTrials.gov on 14-06-2016, NCT02800616). The study has a response rate of 60%. A comprehensive non-responder analysis was carried out, and responders were compared with schoolchildren from the region and the Netherlands using a cross-sectional design. External sources were consulted to collect non-responder, regional, and national data regarding relevant characteristics including sex, demographics, health, and lifestyle. The Chi-square test, Mann-Whitney U test, or Student's t-test were used to analyse differences. The analyses showed that responders (n = 494) were comparable with non-responders (n = 348) and regional data (n = 6172) with regard to sex and health. Responders did not significantly differ from regional data with regard to lifestyle. Responders had significantly higher educated parents compared to non-responders and were more often of autochthonous ethnicity compared to regional data. Major differences were observed between responders and schoolchildren in the Netherlands, regarding, among others sex, ethnicity, and parental employment rates. We conclude that a potential healthy-volunteer effect in the HPSF-sample is limited. External validity is high when compared to the regional population but low when compared to the national sample. For future intervention studies, we advise to evaluate outcome measures according to regional/national standards and to cooperate with external parties in early stages of research to be able to assess and enhance generalisability.

Keywords: BMI, Body Mass Index; CBS, Statistics Netherlands (Centraal Bureau voor de Statistiek); DUO, Dutch Education Executive Agency (Dienst Uitvoering Onderwijs); External validity; GDPR, General Data Protection Regulation; GGD, Regional Public Health Services (Gemeentelijke Gezondheids Dienst Zuid Limburg); HPSF, Healthy Primary School of the Future; IOTF, International Obesity Task Force; JGZ, Youth Healthcare (Jeugd Gezondheidszorg); Lifestyle; Non-response bias; OML, Educational Monitor Limburg (OnderwijsMonitor Limburg); Representativeness; SDQ, Strength and Difficulties Questionnaire; SES, Socio-economic status; School-based study; Selection bias; VCP, Dutch National Food Consumption Survey (Voedsel Consumptie Peiling).

References

    1. Allison P.D. vol. 136. US: Sage publications; Thousand Oaks, CA: 2001. Missing data.
    1. Amorim L.D., Bangdiwala S.I., McMurray R.G., Creighton D., Harrell J. Intraclass correlations among physiologic measures in children and adolescents. Nurs. Res. 2007;56(5):355–360.
    1. Brussaard J., Brants H., Bouman M., Löwik M. The study population: general characteristics and potential confounding factors. Eur. J. Clin. Nutr. 1997;51:S19–S24.
    1. CBS Lengte en gewicht van personen, ondergewicht en overgewicht. 2015. Available from.
    1. Chassang G. The impact of the EU general data protection regulation on scientific research. Ecancermedicalscience. 2017;11
    1. Cole T.J., Lobstein T. Extended international (IOTF) body mass index cut-offs for thinness, overweight and obesity. Pediatr Obes. 2012;7(4):284–294.
    1. Danielzik S., Czerwinski-Mast M., Langnäse K., Dilba B., Müller M. Parental overweight, socioeconomic status and high birth weight are the major determinants of overweight and obesity in 5–7 y-old children: baseline data of the Kiel Obesity Prevention Study (KOPS) Int. J. Obes. 2004;28(11):1494.
    1. de Winter A.F., Oldehinkel A.J., Veenstra R., Brunnekreef J.A., Verhulst F.C., Ormel J. Evaluation of non-response bias in mental health determinants and outcomes in a large sample of pre-adolescents. Eur. J. Epidemiol. 2005;20(2):173–181.
    1. Drivsholm T., Eplov L.F., Davidsen M., Jørgensen T., Ibsen H., Hollnagel H. Representativeness in population-based studies: a detailed description of non-response in a Danish cohort study. Scand J Public Health. 2006;34(6):623–631.
    1. DUO . 2015. Toelichting Gewichtenregeling basisonderwijs per 1 januari 2015.
    1. Esbensen F.-A., Melde C., Taylor T.J., Peterson D. Active parental consent in school-based research: how much is enough and how do we get it? Eval. Rev. 2008;32(4):335–362.
    1. Groeneveld I.F., Proper K.I., van der Beek A.J., Hildebrandt V.H., van Mechelen W. Factors associated with non-participation and drop-out in a lifestyle intervention for workers with an elevated risk of cardiovascular disease. Int. J. Behav. Nutr. Phys. Act. 2009;6(1):80.
    1. Jansen M.K.E. [Seeking the Limburg-factor]. GGD Zuid Limburg; Geleen: 2015. Op zoek naar de Limburg-factor.
    1. Jordan S., Watkins A., Storey M., Allen S.J., Brooks C.J., Garaiova I. Volunteer bias in recruitment, retention, and blood sample donation in a randomised controlled trial involving mothers and their children at six months and two years: a longitudinal analysis. PLoS One. 2013;8(7)
    1. Korkeila K., Suominen S., Ahvenainen J., Ojanlatva A., Rautava P., Helenius H. Non-response and related factors in a nation-wide health survey. Eur. J. Epidemiol. 2001;17(11):991–999.
    1. Lindsted K.D., Fraser G.E., Steinkohl M., Beeson W.L. Healthy volunteer effect in a cohort study: temporal resolution in the Adventist Health Study. J. Clin. Epidemiol. 1996;49(7):783–790.
    1. Martikainen P., Laaksonen M., Piha K., Lallukka T. Does survey non-response bias the association between occupational social class and health? Scand J Public Health. 2007;35(2):212–215.
    1. Nohr E.A., Liew Z. How to investigate and adjust for selection bias in cohort studies. Acta Obstet. Gynecol. Scand. 2018;97(4):407–416.
    1. Peil.Bewegingsonderwijs . Inspectie van Onderwijs; 2018. Einde basis- en speciaal basisonderwijs 2016/2017.
    1. Pinsky P., Miller A., Kramer B., Church T., Reding D., Prorok P. Evidence of a healthy volunteer effect in the prostate, lung, colorectal, and ovarian cancer screening trial. Am. J. Epidemiol. 2007;165(8):874–881.
    1. Plachta-Danielzik S., Bartel C., Raspe H., Thyen U., Landsberg B., Müller M.J. Assessment of representativity of a study population–experience of the Kiel Obesity Prevention Study (KOPS) Obes Facts. 2008;1(6):325–330.
    1. Steenbakkers M.V.A., Janssen-Goffin M.J.H., Hajema K.J. In: GGD Zuid-Limburg: Regionaal rapport Volksgezondheid Toekomst Verkenning 2014. GGD Zuid Limburg; Geleen: 2014. Een nieuwe kijk op gezondheid in Zuid-Limburg [a new vision on health in South-Limburg]
    1. Struijk E.A., May A.M., Beulens J.W., van Gils C.H., Monninkhof E.M., van der Schouw Y.T. Mortality and cancer incidence in the EPIC-NL cohort: impact of the healthy volunteer effect. Eur. J. Pub. Health. 2014;25(1):144–149.
    1. Van Kann D.H., Jansen M., De Vries S., De Vries N., Kremers S. Active living: development and quasi-experimental evaluation of a school-centered physical activity intervention for primary school children. BMC Public Health. 2015;15(1):1315.
    1. Van Loon A.J.M., Tijhuis M., Picavet H.S.J., Surtees P.G., Ormel J. Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann. Epidemiol. 2003;13(2):105–110.
    1. Van Rossum C., Fransen H., Verkaik-Kloosterman J., Buurma-Rethans E., Ocké M. 2011. Dutch National Food Consumption Survey 2007–2010: Diet of Children and Adults Aged 7 to 69 Years.
    1. Van Widenfelt B.M., Goedhart A.W., Treffers P.D., Goodman R. Dutch version of the Strengths and Difficulties Questionnaire (SDQ) Eur Child Adolesc Psychiatry. 2003;12(6):281–289.
    1. Vermeiren A.P., Willeboordse M., Oosterhoff M., Bartelink N., Muris P., Bosma H. Socioeconomic multi-domain health inequalities in Dutch primary school children. Eur. J. Pub. Health. 2018;28(4):610–616.
    1. Viggiano A., Viggiano E., Di Costanzo A., Viggiano A., Andreozzi E., Romano V. Kaledo, a board game for nutrition education of children and adolescents at school: cluster randomized controlled trial of healthy lifestyle promotion. Eur. J. Pediatr. 2015;174(2):217–228.
    1. Waters E., Gibbs L., Tadic M., Ukoumunne O.C., Magarey A., Okely A.D. Cluster randomised trial of a school-community child health promotion and obesity prevention intervention: findings from the evaluation of fun 'n healthy in Moreland! BMC Public Health. 2018;18(1):92.
    1. Wennlöf A.H., Yngve A., Sjöström M. Sampling procedure, participation rates and representativeness in the Swedish part of the European Youth Heart Study (EYHS) Public Health Nutr. 2003;6(3):291–298.
    1. Willeboordse M., Jansen M., Van den Heijkant S., Simons A., Winkens B., de Groot R.H. The Healthy Primary School of the Future: study protocol of a quasi-experimental study. BMC Public Health. 2016;16(1):639.

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe