Supporting Sustainable Positive Interactions in the Child Welfare System: The R3 Supervisor Strategy (R3)

Opportunities to implement and evaluate system-wide change are rare. This observational, Hybrid II study leverages a real-world, system-initiated roll-out of R3, a supervisor-targeted implementation strategy aimed at infusing the use of evidence-based principles across multiple levels of the workforce within a public child welfare system. This project aims to study the effectiveness of R3 in impacting organizational inner-context variables and subsequent positive outcomes for one of the nation's most costly and vulnerable populations-families involved in the child welfare system.

Study Overview

• Status: Completed
• Conditions: Behavioral
• Intervention / Treatment: Behavioral: R3 Supervisor Implementation Strategy

Detailed Description

Large knowledge gaps remain regarding strategies to promote change in public child welfare systems (CWS), yet opportunities to evaluate strategies to create system-wide change and the resulting public health impact are rare. The CWS in the United States is populated with vulnerable children and families at high risk for negative outcomes, including substance use, risky sexual behavior, delinquency, incarceration, homelessness, and early mortality. This proposal addresses the National Institute of Health (NIH) priority to understand methods for "scale-up and sustainability of evidence-based interventions." Leveraging a real-world, federally funded, system-initiated effort to infuse the use of evidence-based principles throughout the multi-levels of the Tennessee CWS workforce, this study will evaluate the effectiveness of a supervisor-targeted implementation strategy in creating organizational change and subsequent positive family outcomes. The R3 Supervisor Strategy was developed to modify the way that the CWS workforce supports families toward completing their treatment plans, by utilizing evidence-based behavioral principles found in previous intervention trials to improve system-level outcomes, including child permanency, stability, and well-being. The R3 strategy provides training, consultation, and fidelity-monitoring to supervisors, who are centrally positioned in the system between caseworkers (who have daily interactions with CWS-involved families) and leadership (who make decisions that affect the organization in which families receive services). The three Rs include reinforcement of (1) effort, (2) relationships and roles, and (3) small steps toward goal achievement. R3 is founded on social learning theory; these reinforcement targets are encouraged in interactions between supervisors and their supervisee- caseworkers and between caseworkers and the families they serve. Utilizing a variation of a dynamic wait-listed design, four Tennessee CWS regions (serving over 12,000 children annually) that have been awarded a federal Title-IV-E Waiver and have opted to adopt R3 as part of their waiver plan will be observed. The CWS workforce (n = 85 regional administrators, 50 supervisors, and 220 caseworkers) will be recruited to participate in a Hybrid Type II trial of the effectiveness of R3 in achieving organizational and subsequent positive system-level, client-level outcomes. This project will examine the potential of R3 to influence supervisor interactions with caseworkers and subsequent family outcomes (Aim 1); the impact of R3 on organizational characteristics known to impact staff retention and the successful adoption of innovations such as climate, leadership, readiness, and citizenship (Aim 2); and the potential for maintaining fidelity standards to the R3 strategy as consultation and coaching are fully transferred to the system (Aim3). This project will inform the potential for R3 to effectively infuse evidence-based principles into the daily interactions of those involved in the CWS, and to narrow the gap for achieving outcomes for one of the nations most costly and vulnerable populations-families involved in the child welfare system.

• Study Type: Observational
• Enrollment (Actual): 531

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 17 years and older (Adult, Older Adult)
• Accepts Healthy Volunteers: No
• Genders Eligible for Study: All

• Sampling Method: Non-Probability Sample

Study Population

The population being studied is the child welfare workforce including supervisors and their staff

Description

Inclusion Criteria:

• Child Welfare Workforce in the state of Tennessee

Exclusion Criteria:

• Contract Workers

Study Plan

How is the study designed?

Design Details

• Observational Models: Cohort
• Time Perspectives: Prospective

Number of groups / cohorts

4

Cohorts and Interventions

Group / Cohort	Intervention / Treatment
R3 Supervisor Strategy Region 1; First cohort to be trained and monitored with remote coaching in the R3 model	Behavioral: R3 Supervisor Implementation Strategy; Supervisors will be trained to provide supervision to their caseworkers using R3 principles and strategies. Monthly monitoring and remote coaching will be provided.; Other Names: R3
R3 Supervisor Strategy Region 2; Second cohort to be trained and monitored with remote coaching in the R3 model	Behavioral: R3 Supervisor Implementation Strategy; Supervisors will be trained to provide supervision to their caseworkers using R3 principles and strategies. Monthly monitoring and remote coaching will be provided.; Other Names: R3
R3 Supervisor Strategy Region 3; Third cohort to be trained and monitored with remote coaching in the R3 model	Behavioral: R3 Supervisor Implementation Strategy; Supervisors will be trained to provide supervision to their caseworkers using R3 principles and strategies. Monthly monitoring and remote coaching will be provided.; Other Names: R3
R3 Supervisor Strategy Region 4; Fourth cohort to be trained and monitored with remote coaching in the R3 model	Behavioral: R3 Supervisor Implementation Strategy; Supervisors will be trained to provide supervision to their caseworkers using R3 principles and strategies. Monthly monitoring and remote coaching will be provided.; Other Names: R3

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Examination of child welfare supervisor ratings using the Fidelity of R3 Implementation for Supervisors (FRI_S) standardized measurement.	The Fidelity of R3 Implementation for Supervisors (FRI_S) measure will be used to rate supervisors' monthly delivery of the R3 model with fidelity over time, from baseline to 36 months.	Monthly for 3 years from baseline to 36 months

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Organizational Climate, Leadership, Readiness, Attitudes toward Evidence-Based Practice:	Organizational health and factors known to be related to successful adoption of new practices will be collected from child welfare staff members annually for 3 years.	Once a year for 3 years

Collaborators and Investigators

• Sponsor: Oregon Social Learning Center
• Collaborators: National Institute on Drug Abuse (NIDA)

Study record dates

Study Major Dates

• Study Start (Actual): September 15, 2015
• Primary Completion (Actual): July 31, 2021
• Study Completion (Actual): July 31, 2021

Study Registration Dates

• First Submitted: June 14, 2016
• First Submitted That Met QC Criteria: April 5, 2017
• First Posted (Actual): April 11, 2017

Study Record Updates

• Last Update Posted (Actual): December 17, 2021
• Last Update Submitted That Met QC Criteria: December 16, 2021
• Last Verified: November 1, 2021

More Information

Terms related to this study

• Other Study ID Numbers: R01DA040416 (NIH)

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: No