Does the Delivery System Matter? The Scaling-Out of a School-Based Resilience Curriculum to the Social Services Sector

Josefine L Lilja, Birgitta Kimber, Charli Eriksson, Barbro Henriksson, Therése Skoog, Josefine L Lilja, Birgitta Kimber, Charli Eriksson, Barbro Henriksson, Therése Skoog

Abstract

Background: The context is highly relevant to the implementation of new health-related programs and is an implicit or explicit part of the major implementation models in the literature. The Resilience Curriculum (RESCUR) program was developed to foster the psychosocial development of children in early and primary education. RESCUR seeks specifically to decrease children's vulnerability. It aims to promote the emotional and social learning of children who may be at risk of leaving school pre-maturely, social exclusion and mental-health problems. The program is taught using a teachers' manual to support consistency of delivery, a parents' guide, and a resource package. This study aimed to examine the scaling-out of RESCUR to social services, and specifically to test if implementation differs between the school and social services sectors. Methods: RESCUR was implemented in schools and social services in Sweden 2017-2019. Data were collected via group leaders' self-reports and observation protocols for 3 months after implementation started. There were 34 self-reports from schools, and 12 from the social services sector; 30 observation protocols were collected from schools, and 10 from social services. We examined whether there were differences in implementation outcomes (in, for example, dosage, duration, fidelity, adaptation, quality of delivery) between the two delivery systems. Descriptive statistics were prepared and non-parametric tests of significance conducted to compare implementation-related factors across the two settings. Results: Analyses of both the observation protocols and group leaders' self-reports revealed that RESCUR was well-implemented in both schools and social services. The results showed a few significant differences in the outcomes of implementation between the sectors. First, regarding observations, school staff more often adapted the pace of RESCUR lessons to ensure that the children could understand than did social services staff (p < 0.01). Second, social services staff demonstrated greater interest in students and sensitivity to the needs of individual students than did school staff (p = 0.02). Regarding self-reports, social services staff reported having delivered more (p = 0.4) and longer (p < 0.01) lessons than did school staff. Second, school staff reported greater fidelity to (p = 0.02) and less adaptation of (p < 0.01) the intervention than did social services staff. Both observations and self-reports, however, indicated a high fidelity of implementation. Conclusions: Overall, the findings suggest that the resilience program, designed for delivery in schools, can be scaled-out to social services with its implementation outcomes retained. Further research is needed to test the effectiveness of the program regarding child health-related outcomes. Clinical Trial Registration: National Institute of Health, ClinicalTrials.gov, identifier: NCT03655418. Registered August 31, 2018.

Keywords: implementation; resilience curriculum; scaling-out; school; social services.

Conflict of interest statement

BK and CE co-authored the RESCUR program. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Copyright © 2021 Lilja, Kimber, Eriksson, Henriksson and Skoog.

References

    1. Meyers DC, Durlak JA, Wandersman A. The quality implementation framework: a synthesis of critical steps in the implementation process. Am J Community Psychol. (2012) 50:462–80. 10.1007/s10464-012-9522-x
    1. Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. (2008) 41:327–50. 10.1007/s10464-008-9165-0
    1. Durlak JA, Weissberg R, Dymicki A, Taylor R, Schellinger K. The impact of enhancing students' social and emotional learning: a meta-analysis of school-based universal interventions. Child Dev. (2011) 82:405–32. 10.1111/j.1467-8624.2010.01564.x
    1. Wigelsworth M, Lendrum A, Oldfield J, Scott A, Ten Bokkel I, Tate K, et al. . The impact of trial stage, developer involvement and international transferability on universal social and emotional learning programme outcomes: a meta-analysis. Cambridge J Educ. (2016) 46:347–76. 10.1080/0305764X.2016.1195791
    1. Cefai C, Matsopoulos A, Bartolo P, Galea K, Gavogiannaki M, Assunta Zanetti M, et al. . A resilience curriculum for early years and elementary schools in Europe: enhancing quality education. Croatian J Educ. (2014) 16:11–32.
    1. Cefai C, Cavioni V, Bartolo P, Simoes C, Ridicki Miljevic R, Bouilet D, et al. . Social inclusion and social justice: a resilience curriculum for early years and elementary schools in Europe. J Multicultural Educ. (2015) 9:122–39. 10.1108/JME-01-2015-0002
    1. Berkel C, Mauricio AM, Schoenfelder E, Sandler IN. Putting the pieces together: an integrated model of program implementation. Prev Sci. (2011) 12:23–33. 10.1007/s11121-010-0186-1
    1. Mihalic SF, Fagan AA, Argamaso S. Implementing the LifeSkills training drug prevention program: factors related to implementation fidelity. Implementation Sci. (2008) 3:5. 10.1186/1748-5908-3-5
    1. Olofsson V, Skoog T, Tillfors M. Implementing group based parenting programs: a narrative review. Child Youth Serv Rev. (2016) 69:67–81. 10.1016/j.childyouth.2016.07.004
    1. Nilsen P, Bernhardsson S. Context matters in implementation science: a scoping review of determinant frameworks that describe contextual determinants for implementation outcomes. BMC Health Serv Res. (2019) 19:189. 10.1186/s12913-019-4015-3
    1. Aarons GA, Sklar M, Mustanski B, Benbow N, Brown CH. “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implement Sci. (2017) 12:111. 10.1186/s13012-017-0640-6
    1. Eriksson C, Kimber B, Skoog T. Design and implementation of RESCUR in Sweden for promoting resilience in children: a study protocol. BMC Public Health. (2018) 18:1250. 10.1186/s12889-018-6145-7
    1. Skolverket . National Curriculum for the Compulsory School, Preschool Class and School-Age Educare. Stockholm (2018). Retrieved from: (accessed April 16, 2021).
    1. Social Services Act (2001:453) . Stockholm: Swedish Government (Chapter 5:1) (2001). Retrieved from: (accessed April 16, 2021).
    1. Kimber B, Sandell R, Bremberg S. Social and emotional training in Swedish schools for the promotion of mental health: an effectiveness study of 5 years of intervention. Health Educ Res. (2008) 23:931–40. 10.1093/her/cyn040
    1. Sklad M, Diekstra R, Ritter M, Ben J. Effectiveness of school-based universal social, emotional and behavioral programs: do they enhance students' development in the area of skill behavior and adjustment? Psychol Schools. (2012) 49:892–909. 10.1002/pits.21641
    1. Greenberg M. Promoting resilience in children and youth: preventive interventions and their interface with neuroscience. Ann NY Acad Sci. (2007) 1094:139–50. 10.1196/annals.1376.013
    1. Dray J, Bowman J, Campbell E, Freund M, Wolfenden L, Hodder RK, et al. . Systematic review of universal resilience-focused interventions targeting child and adolescent mental health in the school setting. J Am Acad Child Adolesc Psychiatry. (2017) 556:813–24. 10.1016/j.jaac.2017.07.780
    1. Kam CM, Greenberg MT, Walls CT. Examining the role of implementation quality in school-based prevention using the PATHS curriculum. Prev Sci. (2003) 4:55–63. 10.1023/A:1021786811186
    1. Humphrey N, Barlow A, Lendrum A. Quality matters: implementation moderates student outcomes in the PATHS curriculum. Prev Sci. (2018) 19:197–208. 10.1007/s11121-017-0802-4
    1. Kimber B, Skoog T, Sandell R. Teacher change and development during training for a social and emotional learning program in Sweden. Int J Emot Educ. (2013) 5:1.
    1. Humprey N, Lendrum A, Wigelsworth M. Social and Emotional Aspects if Learning (SEAL) Programme in Secondary Schools: National Evaluation. Research Report DFE-RR049. London: Department of Education; (2010). p. 125.
    1. Schoon I. Risk and Resilience. Adaptations in Changing Times. Cambridge: Cambridge University Press; (2006).
    1. Masten AA. Resilience comes of age: reflections on the past and outlook for the next generation of research. In: Glantz MD, Johnson JL, editors. Resilience and Development: Positive Life Adaptations. New York: Kluwer Academic; (1999). p. 281–96.
    1. Sapienza JK, Masten AS. Understanding and promoting resilience in children and Youth. Curr Opin Psychiatry. (2011) 24:267–73. 10.1097/YCO.0b013e32834776a8
    1. Kumpfer KL. Factors and processes contributing to resilience. The Resilience Framework. In: Glantz MD, Johnson JL, editors. Resilience and Development: Positive Life Adaptations. New York: Kluwer Academic; (1999). p. 179–224.
    1. Rutter M. Psychosocial resilience and protective mechanisms. Am J Orthop. (1987) 57:316–31. 10.1111/j.1939-0025.1987.tb03541.x
    1. Rutter M. Resilience in the face of adversity. Protective factors and resistance to psychiatric disorder. Br J Psychiatry. (1985) 147:598–611. 10.1192/bjp.147.6.598
    1. Greenberg MT. School-based prevention: current status and future challenges. Effective Educ. (2012) 2:27–52. 10.1080/19415531003616862
    1. Arnesen A, Meek-Hansen W, Ogden T, Sørlie M. Positiv læringsstøtte i skolen. Alle med! [Positive support for learning in school. Everybody together]. Oslo: Universitetsforlaget; (2014).
    1. Humphrey N. HeadStart Intervention Implementation Survey. Manchester: The University of Manchester; (2016).
    1. Durlak JA. What everybody should know about implementation. In Durlak JA, Demitrovich CE, Weissberg RP, Gullotta TP, editors. Handbook of Social and Emotional Learning. Research and Practice. New York: The Guilford Press; (2015). p. 395–403.
    1. Lendrum A, Humphrey N. The importance of studying the implementation of interventions in school settings. Oxford Rev Educ. (2012) 38:635–65. 10.1080/03054985.2012.734800
    1. Rabin B, Brownson R, Haire-Joshu D, Kreuter M, Weaver N. A glossary for dissemination and implementation research in health. J Public Health Manag Pract. (2008) 14:117–23. 10.1097/
    1. Fixsen DL, Blase KA, Naoom SF, Wallace F. Core implementation components. Res Soc Work Pract. (2009) 19:531–40. 10.1177/1049731509335549
    1. Bryan ML, Jenkins SP. Multilevel modelling of country effects: a cautionary tale. Eur Socio Rev. (2015) 32:3–22. 10.1093/esr/jcv059
    1. Scherbaum CA, Ferreter JM. Estimating statistical power and required sample sizes for organizational research using multilevel modeling. Organ Res Methods. (2009) 12:347–67. 10.1177/1094428107308906

Source: PubMed

3
Abonneren