Assessing the effectiveness of training models for national scale-up of an evidence-based nutrition and physical activity intervention: a group randomized trial

Rebekka M Lee, Jessica L Barrett, James G Daly, Rebecca S Mozaffarian, Catherine M Giles, Angie L Cradock, Steven L Gortmaker, Rebekka M Lee, Jessica L Barrett, James G Daly, Rebecca S Mozaffarian, Catherine M Giles, Angie L Cradock, Steven L Gortmaker

Abstract

Background: There is a great need to identify implementation strategies to successfully scale-up public health interventions in order to achieve their intended population impact. The Out-of-school Nutrition and Physical Activity group-randomized trial previously demonstrated improvements in children's vigorous physical activity and the healthfulness of foods and beverages consumed. This implementation study aimed to assess the effects and costs of two training models to scale-up this evidence-based intervention.

Methods: A 3-arm group-randomized trial was conducted to compare effectiveness of in-person and online training models for scaling up the intervention compared to controls. One-third of sites were randomized to the in-person train-the-trainer model: local YMCA facilitators attended a training session and then conducted three learning collaborative meetings and technical assistance. One-third were assigned to the online model, consisting of self-paced monthly learning modules, videos, quizzes, and facilitated discussion boards. Remaining sites served as controls. Fifty-three afterschool sites from three YMCA Associations in different regions of the country completed baseline and follow-up observations using a validated tool of afterschool nutrition and physical activity practices. We used multivariable regression models, accounting for clustering of observations, to assess intervention effects on an aggregate afterschool practice primary outcome, and conducted secondary analyses of nine intervention goals (e.g. serving water). Cost data were collected to determine the resources to implement each training model.

Results: Changes in the primary outcome indicate that, on average, sites in the in-person arm achieved 0.44 additional goals compared to controls (95%CI 0.02, 0.86, p = 0.04). Increases in the number of additional goals achieved in sites in the online arm were not significantly greater than control sites (+ 0.28, 95% CI -0.18, 0.73, p = 0.24). Goal-specific improvements were observed for increasing water offered in the in-person arm and fruits and vegetables offered in the online arm. The cost per person trained was $678 for the in-person training model and $336 for the on-line training model.

Conclusions: This pilot trial presents promising findings on implementation strategies for scale-up. It validated the in-person training model as an effective approach. The less expensive online training may be a useful option for geographically disbursed sites where in-person training is challenging.

Trial registration: Although this study does not report the results of a health care intervention on human subjects, it is a randomized trial and was therefore retrospectively registered in ClinicalTrials.gov on July 4, 2019 in accordance with the BMC guidelines to ensure the complete publication of all results (NCT04009304).

Keywords: Afterschool; Children; Cost; Implementation; Nutrition; Obesity prevention; Out-of-school time; Physical activity; Training.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Consort diagram for Out-of-School Time Nutrition & Physical Activity national scale-up trial, 2016–2017
Fig. 2
Fig. 2
Framework of study intervention, implementation strategies, and outcomes adapted from Proctor’s Conceptual Model of Implementation Research
Fig. 3
Fig. 3
Proportion of intervention sites selecting each OSNAP goal

References

    1. Colditz GA, K.M. E. The promise and challenges of dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. New York: Oxford University Press; 2017.
    1. Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. National Institutes of Health approaches to dissemination and implementation science: current and future directions. Am J Public Health. 2012;102(7):1274–1281. doi: 10.2105/AJPH.2012.300755.
    1. World Health Organization and ExpandNet . Nine steps for developing a scaling-up strategy. Geneva: WHO; 2010.
    1. Institute of Medicine . Bridging the Evidence Gap in Obesity Prevention: A Framework to Inform Decision Making. Washington D.C: The National Academies Press; 2010.
    1. Hales CM, Fryar CD, Carroll MD, Freedman DS, Ogden CL. Trends in obesity and severe obesity prevalence in US youth and adults by sex and age, 2007-2008 to 2015-2016. JAMA. 2018;319(16):1723–1725. doi: 10.1001/jama.2018.3060.
    1. Ogden CL, Carroll MD, Lawman HG, Fryar CD, Kruszon-Moran D, Kit BK, et al. Trends in obesity prevalence among children and adolescents in the United States, 1988-1994 through 2013-2014. JAMA. 2016;315(21):2292–2299. doi: 10.1001/jama.2016.6361.
    1. Institute of Medicine . Preventing childhood obesity: health in the balance. Washington, D.C.: National Academies Press; 2005.
    1. Afterschool Alliance . America after 3PM: afterschool programs in demand. Washington, D.C.: Afterschool Alliance; 2014.
    1. Carver PR, Iruka IU, Chapman C. National Household Education Surveys Program of 2005: after-school programs and activities. Washington, D.C.: National Center for Education Statistics; 2006.
    1. Cradock AL, Barrett JL, Giles CM, Lee RM, Kenney EL, de Blois ME, et al. Promoting physical activity with the out of school nutrition and physical activity (OSNAP) initiative: a cluster-randomized controlled trial. JAMA Pediatr. 2016;170(2):155–162. doi: 10.1001/jamapediatrics.2015.3406.
    1. Lee RM, Okechukwu C, Emmons KM, Gortmaker SL. Impact of implementation factors on children’s water consumption in the out-of-school nutrition and physical activity group-randomized trial. New Dir Youth Dev. 2014;2014(143):79–101. doi: 10.1002/yd.20105.
    1. Lee RM, Giles CM, Cradock AL, Emmons KM, Okechukwu C, Kenney EL, et al. Impact of the Out-of-School Nutrition and Physical Activity (OSNAP) Group Randomized Controlled Trial on Children’s Food, Beverage, and Calorie Consumption among Snacks Served. J Acad Nutr Diet. 2018;118(8):1425–1437. doi: 10.1016/j.jand.2018.04.011.
    1. Kenney EL, Giles CM, de Blois ME, Gortmaker SL, Chinfatt S, Cradock AL. Improving nutrition and physical activity policies in afterschool programs: results from a group-randomized controlled trial. Prev Med. 2014;66:159–166. doi: 10.1016/j.ypmed.2014.06.011.
    1. Giles CM, Kenney EL, Gortmaker SL, Lee RM, Thayer JC, Mont-Ferguson H, et al. Increasing water availability during afterschool snack: evidence, strategies, and partnerships from a group randomized trial. Am J Prev Med. 2012;43(3 Suppl 2):S136–S142. doi: 10.1016/j.amepre.2012.05.013.
    1. Gortmaker SL, Peterson K, Wiecha J, Sobol AM, Dixit S, Fox MK, et al. Reducing obesity via a school-based interdisciplinary intervention among youth: planet health. Arch Pediatr Adolesc Med. 1999;153(4):409–418. doi: 10.1001/archpedi.153.4.409.
    1. Beets MW, Weaver RG, Moore JB, Turner-McGrievy G, Pate RR, Webster C, et al. From policy to practice: strategies to meet physical activity standards in YMCA afterschool programs. Am J Prev Med. 2014;46(3):281–288. doi: 10.1016/j.amepre.2013.10.012.
    1. Story M, Kaphingst KM, French S. The role of child care settings in obesity prevention. Future Child. 2006;16:143–168. doi: 10.1353/foc.2006.0010.
    1. Lee RM, Gortmaker SL. Health dissemination and implementation within schools. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. New York: Oxford University Press; 2017.
    1. Ward DS, Benjamin SE, Ammerman AS, Ball SC, Neelon BH, Bangdiwala SI. Nutrition and physical activity in child care - results from an environmental intervention. Am J Prev Med. 2008;35(4):352–356. doi: 10.1016/j.amepre.2008.06.030.
    1. Fitzgibbon ML, Stolley M, Schiffer L, Van Horn L, KauferChristoffel K, Dyer A. Two-year follow-up results for hip-hop to health Jr.: a randomized controlled trial for overweight prevention in preschool minority children. J Pediatr. 2005;146(5):618–625. doi: 10.1016/j.jpeds.2004.12.019.
    1. Wiecha JL, Hall G, Gannett E, Roth B. Development of healthy eating and physical activity quality standards for out-of-school time programs. Child Obes. 2012;8(6):572–576. doi: 10.1089/chi.2012.0030.
    1. Bouffard S, Little P. Promoting quality through professional development: a framework for evaluation. Cambridge: Harvard Family Research Project, Harvard Graduate School of Education; 2004.
    1. Kirchner JE, Waltz TJ, Powell BJ, Smith JL, Proctor EK. Implementation strategies. Dissemination and implementation research in health. 2. New York: Oxford University Press; 2017.
    1. Cattaneo A, Buzzetti R. Breastfeeding res training W. quality improvement report - effect on rates of breast feeding of training for the baby friendly hospital initiative. Br Med J. 2001;323(7325):1358–1362. doi: 10.1136/bmj.323.7325.1358.
    1. Martino S, Ball SA, Nich C, Canning-Ball M, Rounsaville BJ, Carroll KM. Teaching community program clinicians motivational interviewing using expert and train-the-trainer strategies. Addiction. 2011;106(2):428–441. doi: 10.1111/j.1360-0443.2010.03135.x.
    1. Dunn C, Thomas C, Ward D, Pegram L, Webber K, Cullitan C. Design and implementation of a nutrition and physical activity curriculum for child care settings. Prev Chronic Dis. 2006;3(2):A58.
    1. Trost SG, Messner L, Fitzgerald K, Roths B. A nutrition and physical activity intervention for family child care homes. Am J Prev Med. 2011;41(4):392–398. doi: 10.1016/j.amepre.2011.06.030.
    1. Johnson SD, Aragon SR, Shaik N. Comparative analysis of learner satisfaction and learning outcomes in online and face-to-face learning environments. J Interact Learn Res. 2000;11(1):29–49.
    1. Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions - a meta-analysis. JAMA. 2008;300(10):1181–1196. doi: 10.1001/jama.300.10.1181.
    1. Bartley S, Golek J. Evaluating the cost effectiveness of online and face-to-face instruction. Palmerston North: International Forum of Educational Technology & Society; 2004. pp. 167–175.
    1. Schweizer H. E-learning in business. J Manag Educ. 2004;28(6):674–692. doi: 10.1177/1052562903252658.
    1. Au LE, Whaley S, Rosen NJ, Meza M, Ritchie LD. Online and in-person nutrition education improves breakfast knowledge, attitudes, and behaviors: a randomized trial of participants in the special supplemental nutrition program for women, infants, and children. J Acad Nutr Diet. 2016;116(3):490–500. doi: 10.1016/j.jand.2015.10.012.
    1. Benjamin S, Tate D, Bangdiwala S, Neelon B, Ammerman A, Dodds J, et al. Preparing child care health consultants to address childhood overweight: a randomized controlled trial comparing web to in-person training. Matern Child Health J. 2008;12(5):662–669. doi: 10.1007/s10995-007-0277-1.
    1. Yoong SL, Williams CM, Finch M, Wyse R, Jones J, Freund M, et al. Childcare service centers' preferences and intentions to use a web-based program to implement healthy eating and physical activity policies and practices: a cross-sectional study. J Med Internet Res. 2015;17(5):e108. doi: 10.2196/jmir.3639.
    1. Ward DS, Vaughn AE, Mazzucca S, Burney R. Translating a child care based intervention for online delivery: development and randomized pilot study of go NAPSACC. BMC Public Health. 2017;17(1):891. doi: 10.1186/s12889-017-4898-z.
    1. Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for reporting implementation studies (StaRI) statement. BMJ. 2017;356:6.
    1. Partnership for a Healthier America . Creating Healthier Places for YMCA of the USA. 2016.
    1. Wiecha JL, Hall G, Gannett E, Roth B. Development of healthy eating and physical activity quality standards for out-of-school time programs. Child Obes. 2012;8(6):572–576. doi: 10.1089/chi.2012.0030.
    1. Proctor E, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health Ment Health Serv Res. 2009;36(1):24–34. doi: 10.1007/s10488-008-0197-4.
    1. Lee RM, Emmons KM, Okechukwu CA, Barrett JL, Kenney EL, Cradock AL, et al. Validity of a practitioner-administered observational tool to measure physical activity, nutrition, and screen time in school-age programs. Int J Behav Nutr Phys Act. 2014;11:145. doi: 10.1186/s12966-014-0145-5.
    1. Giles CM, Kenney EL, Gortmaker SL, Lee RM, Thayer JC, Mont-Ferguson H, et al. Increasing water availability during afterschool snack evidence, strategies, and partnerships from a group randomized trial. Am J Prev Med. 2012;43(3):S136–SS42. doi: 10.1016/j.amepre.2012.05.013.
    1. Stokols D. Translating social ecological theory into guidelines for community health promotion. Am J Health Promot. 1996;10(4):282–298. doi: 10.4278/0890-1171-10.4.282.
    1. Bandura A. Social Foudations of thought and action. Inglewood Cliffs: Prentice-Hall; 1986.
    1. Canvas LSM Salt Lake City, UT2018 [Available from: .
    1. Drummond MFSM, Torrance GW, O’Brien BJ, Stoddart GL. Methods for the economic evaluation of health care Programmes. 3. New York: Oxford University Press; 2005.
    1. Gold MR, Siegel JE, Russell LB, Weinstein MC. Cost-effectiveness in health and medicine. New York: Oxford University Press; 1996.
    1. Gortmaker SL, Wang YC, Long MW, Giles CM, Ward ZJ, Barrett JL, et al. Three interventions that reduce childhood obesity are projected to save more than they cost to implement. Health Aff (Millwood) 2015;34(11):1932–1939. doi: 10.1377/hlthaff.2015.0631.
    1. Cradock AL, Barrett JL, Kenney EL, Giles CM, Ward ZJ, Long MW, et al. Using cost-effectiveness analysis to prioritize policy and programmatic approaches to physical activity promotion and obesity prevention in childhood. Prev Med. 2017;95:S17–S27. doi: 10.1016/j.ypmed.2016.10.017.
    1. Grossman J, Lind C, Hayes C, Mcmaken J, Gersick A. The cost of quality out-of-school time programs. New York: The Wallace Foundation; 2009.
    1. Holt Cheryl L, Tagai Erin K, Santos Sherie Lou Zara, Scheirer Mary Ann, Bowie Janice, Haider Muhiuddin, Slade Jimmie. Web-based versus in-person methods for training lay community health advisors to implement health promotion workshops: participant outcomes from a cluster-randomized trial. Translational Behavioral Medicine. 2018;9(4):573–582. doi: 10.1093/tbm/iby065.
    1. Rose G. Sick individuals and sick populations. Int J Epidemiol. 1985;14:32–38. doi: 10.1093/ije/14.1.32.

Source: PubMed

3
Suscribir