Strengthening Families Program Online (SFPonline)

January 5, 2023 updated by: Strengthening Families Program LLC

Strengthening Families Program Online for Teens and Families

This Phase II SBIR tests a newly developed web-based online parenting skills training and youth drug prevention program based on the evidenced-based "Strengthening Families Program." The study design involves a three-condition parallel randomized control trial contrasting: (1) SFP Online, (2) SFP Home-use DVD/videos, and (3) Wait-Listed Controls.

DELIVERY OF INTERVENTION: The intervention condition, SFP Online, is a highly interactive, multimedia condition testing a 10-session online program with two intersecting tracks, one for parents and one for youth. Both tracks involve completion of three mini-lessons per week delivered online for 10 weeks. For the parent track (biological parents, caregivers or legal guardians), each lesson entails learning nurturing parenting skills that strengthen family bonds, setting clear boundaries with positive discipline, and monitoring youth's social activities and emotional well-being. The youth lessons teach social competence-based skills and drug refusal skills. For both tracks, lesson material is scaffolded in an integrated fashion, with challenge quizzes and process evaluations interspersed throughout the lessons. Each track includes a gaming portion to increase engagement and reinforce lesson content through stealth learning. The SFP Home-use DVD/video series is an 11-session program with the same content as the online version, but is not interactive. It is viewed either online or using a DVD player at home. In the Wait-Listed control condition, parents receive emails with food recipes and nutritional information over the same 10-week period; while their children receive emails with riddles and puzzles. At the conclusion of a 2-month follow-up period the wait-listed controls receive the SFP Online intervention, thus doubling the size of the intervention treatment condition. A second design feature is the use of a non-inferiority trial (NIT) to empirically examine the efficacy of SFP Online when compared to the Home-use DVD/videos and Group Norms data. The Group Norms, which serve as a benchmark of SFP effectiveness, is a representative, demographically matched sample of n=1400 families drawn from a database of over 6,000 families that have taken the full 14-session traditional class format of SFP. Effects sizes, using the partial eta-squared statistic, will be compared between conditions for the major outcome measures.

Study Overview

Detailed Description

This study tests a new web-based online parenting skills training and youth drug prevention program based on the evidence-based Strengthening Families Program. The study design involves a three-condition parallel randomized control trial contrasting: (1) SFP Online, (2) SFP Home-use DVD/videos, and (3) Wait-Listed Controls. The intervention condition, SFP Online, is an interactive, multimedia condition testing a 10-session online program with interrelated tracks for parents and youth. Both tracks involve completion of three mini-lessons per week delivered online for 10 weeks. Each track includes a gaming portion to increase engagement and reinforce lesson content through stealth learning. The SFP Home-use DVD/video series is an 11-session program with the same content as the online version, but is delivered via an online video presentation or a DVD player. The Wait-Listed control condition receives emails with recipes over the same 10-week period; their youth receive riddles. At the conclusion of a 10-week waiting period, the wait-listed controls receive the SFP Online intervention. Our statistical analysis addresses the differences between the online and Home-use DVD/video conditions.

A second design feature is a Non-Inferiority Trial (NIT) to empirically examine the efficacy of SFP Online when compared to the SFP Group Norms data. The Group Norms, which serves as a benchmark of SFP effectiveness, is a representative, demographically matched sample of n=1400 families drawn from a database of 6,000 families who have attended the full SFP 14-session classes. Effects sizes, using the partial eta-squared statistic, will be compared between conditions for the major outcome measures. The effect sizes will be adjusted for demographics differences at the individual level as well as implementation factors. The margin of equivalence for the effect size comparison between conditions is set at 10% (the effect sizes for the SFP Online program outcomes will be at least 10% larger than the corresponding effect sizes for the SFP videos or Group Norms).

RECRUITMENT: The investigators will recruit 240 families with at least one parent/caregiver and youth (n=480 participants), with 80 families randomly assigned to each experimental condition. Recruitment is handled by 24 SFP recruiters who sent Letters of Support. They are ethnically diverse and geographically dispersed across the U.S. They have access to multiple races/ethnicities and marginalized families. Each recruiter is targeting recruitment of 10 families (24 recruiters x 10 families).

ASSIGNMENT: Individual families will be randomly assigned to one of three interventions with a computerized random number generator to eliminate selection bias and control unobserved confounding variables that contribute to program outcomes. We will examine the distribution of relevant demographic variables (race/ethnicity, income, education, adult and child age) to assure balance between conditions at baseline. We conduct analyses to detect significant program differences in intervention effects by these variables.

STATISTICAL ANALYSIS: Prior to evaluating program effects, we examine pretest equivalence between experimental conditions using appropriate tests for categorical or continuous baseline measures. Significant differences are controlled in covariate-adjusted models evaluating program efficacy. This analysis uses a 3 (condition) x 2 (baseline risk) ANOVA with continued presence in the study as the dependent variable. We also examine whether there is any differential attrition by condition (i.e., coding attrition as 1/0 and using logistic regression models to predict retention). We also use confirmatory techniques to contrast variance/ covariance matrixes between conditions to assess whether patterns of statistical relations differ by condition. Differential attrition by condition could potentially limit internal validity (intervention effects might be confounded with attrition effects) or external validity (generalizability to other families). Data analyses begins by generating simple descriptive statistics on all baseline measures (e.g., frequencies, means, variance), repeating this procedure for the posttest and the 2-month follow-up data. Distributions are examined for skewness and kurtosis and response patterns. Chi-square tests, point bi-serial and Pearson correlations are used to examine Statistical relations between baseline predictors (i.e., checking for multicollinearity), demographics, and outcome variables will be assessed using appropriate measures of association and evaluated for statistical significance using chi-square, t, and F tests). Violating assumptions of normality and homoscedasticity (often encountered in family research and when assessing youth self-report drug use) will require data transformations (e.g., logarithmic, arcsine, spline, or percentile weighting). If the transformations fail to normalize the data, we can use nonparametric tests (e.g., Kendall's Tau, Mann-Whitney U-test, Wilcoxon Rank Sum, Spearman's correlation, and Freidman's ANOVA). For non-Gaussian distributions that arise from low frequency behaviors we can employ Poisson regression, zero-inflated, and two-part semicontinuous models to adjust for highly skewed distributions with a preponderance of zeroes.

MISSING DATA. There may be some participants that fail to take the outcome evaluation surveys, stop participating in the intervention or are reluctant to provide data. These occurrences represent different faces of attrition (withdrawal and poor adherence) and must be examined carefully. We assume that data is missing completely at random (MCAR), or that the mechanisms causing the missing data are "ignorable" with no bias in the condition comparison; however, we apply Little's test of MCAR for multivariate data to determine if missing data bias the results. Regardless of how it arises, the complete-data-methods used require using multiple imputation procedures to obtain efficient parameter estimates. We use Full Information Maximum Likelihood estimation to recover the missing data. A reasonable number of imputations is 10 given the efficiency of imputation with relatively low levels of missingness. The 10 imputed datasets are then combined using multiple inference procedures that adjust standard errors for missing data uncertainty142 producing more efficient parameter estimates.

INTENTION TO TREAT. Noncompliance arises because participants may fail to finish all the lessons, take none at all, or only take the assessments without being exposed to the lessons. This makes those who complete the lessons no longer a "random sample of the original group." Intention-to-treat (ITT) is a strategy for analyzing data in which participants remain in the experimental condition they were assigned regardless of their lesson completion or non-compliance status. Using sensitivity analyses, the data from completers is then contrasted to a dataset with cases excluded post-randomization because they were not exposed to the entire curriculum (efficacy subset analyses). This approach assumes that data from censored cases are missing at random (MAR) and the outcomes were obtained in an unbiased manner. Sensitivity analyses will compare outcomes based on different levels of lesson completion (relaxing the exclusion rule) with this procedure repeated leaving intervention exposure (number of sessions) continuous, as participants may benefit from any exposure. We will also use the complier average causal effects (CACE) estimation method to address differences in compliance with the intervention and its effects on program outcomes. Using CACE analysis, multiple groups (mixtures) are formed corresponding to their level of compliance (i.e., engagement) and treatment assignment (SFPOnline or SFP DVD/videos). Program outcomes are then contrasted between these mixtures using traditional logistic regression methods. We can further categorize compliers based on their observed lesson completion rates, yielding low- vs. high-compliers in each condition. Furthermore, engagement can be conditioned based on participant-level covariates (i.e., marital status, income, stress, drug use, or family size). ITT and CACE techniques keep the randomized design intact, mitigates bias from differential program completion, and enables us to make causal inferences about intervention effects in this sample. In the event that non-completing participants are not randomly dispersed among conditions, we will also report effect sizes among those who completed the lessons and took the Post Surveys.

TESTS OF CONFOUNDING. Even with random assignment to experimental conditions and reduction in any pretest imbalances between them, confounding effects could remain a threat to validity (i.e., program effects could be biased). As a result, we will examine selected variables measured at baseline for evidence of any imbalance (i.e., pretest equivalence) and perform secondary analyses in which we model pretreatment covariates to account for between-group, outcome differences. This examination will be conducted using generalized linear models. Pretreatment differences can be participant specific (e.g., demographics). There is some evidence supporting inclusion of covariates in order to be able to causally attribute differences between the conditions to the intervention. Their inclusion increases model precision and boosts power and this efficiency holds for binary outcomes as well should we choose to model youth drug use in this manner.

MANIPULATION CHECKS. We anticipate that certain relationships will be mediated by other variables. Our longitudinal study design allows us to make rigorous inferences regarding causal processes, addressing the putative mechanisms and treatment construct validity through which SFP works. We assume sequential ignorability even though the mediator is assessed post-randomization. We can statistically assess the decrement in magnitude of the direct effect, adjusted for the indirect effects. This case extends to longitudinal data with more than one putative mediator by the tracing rule for path analysis. The longitudinal design also provides temporal separation of the pretest, intervention (weeks 1-10), posttest (weeks 10-11), and the 2-month follow-up (weeks 18-20). We use the multivariate delta method to compute standard errors for mediated effects, which simulations have shown to produce accurate estimates based on bootstrap confidence intervals for the mediated effect. Potential mediators in these longitudinal models assessing program efficacy include measures of parenting efficacy, skills performance (based on interim quizzes), parent-child communication, monitoring, boundary setting, and levels of engagement (based on satisfaction, lesson completion and usage metrics).

EFFECT MODIFICATION. A limited set of post-hoc analyses will explore homogeneity of the intervention effect across participant subgroups. These analyses help gain precision in knowing whether program effects were optimized for certain groups.

POWER. In estimating power, we assumed: (1) three experimental conditions, (2) multiple waves of data collection, (3) random effects associated with estimated outcomes ranging between .35-.45 and differing types of outcome measures (dichotomous vs. continuous). We project the ability to recruit 80 families (1 parent/caregiver + 1 youth) in each experimental condition over the recruitment period. With large sample sizes (n=480), we can detect significant effects across most effect sizes.

Study Type

Interventional

Enrollment (Anticipated)

480

Phase

  • Not Applicable

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Contact

Study Contact Backup

Study Locations

    • Utah
      • Salt Lake City, Utah, United States, 84103
        • Strengthening Families Program LLC

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

11 years and older (Child, Adult, Older Adult)

Accepts Healthy Volunteers

No

Genders Eligible for Study

All

Description

Inclusion Criteria:

  • Computer access
  • Internet access
  • Child between 11 and 17
  • Adult and child must have functional email
  • Only one child per family will be included unless the household has twins, in which case both children can participate
  • Adult (parent or legal guardian) provides informed consent and gives permission for child to participate
  • Child assents to participate

Exclusion Criteria:

  • Intellectual disabilities (i.e., cognitive impairment that prohibits use of the computer)
  • Language difficulties (must read and understand spoken English)
  • Not having children that meet the intervention age criteria (11-17)
  • Not having an electronically signed consent/permission form - adult
  • Not having an electronically signed assent form - youth

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

  • Primary Purpose: Prevention
  • Allocation: Randomized
  • Interventional Model: Parallel Assignment
  • Masking: None (Open Label)

Arms and Interventions

Participant Group / Arm
Intervention / Treatment
Active Comparator: Strengthening Families Program Online eLearning Game
This arm of the study receives a 10-session online family-based intervention with separate, but intersecting, tracks for parents and youth. Each lesson contains 3 mini-lessons per week and includes behavioral skills training and interactive multimedia lessons with video vignettes that target parenting skills, family cohesion, organization, communication, social skills, and drug prevention for youth. The youth track is highly gamified to stimulate engagement and reinforce the core active ingredients. There are self-correcting quizzes to assess learning, and process evaluation to determine program fidelity and engagement. There are learning theory instructional design elements with scaffolding, stealth learning, and theoretical principles of social learning, social interactional, and family systems theory. There is a highly animated game families can play upon successful completion of each lesson, using game points they earned through quizzes and practices. There is a 3-month follow-up.
Families (parent/caregiver and children) are to play-test a highly interactive online gamified version of the Strengthening Families Program called SFP Online, with 10 lessons that utilize three 10-minute mini-sessions and games that teach parents evidence-based parenting and family relationship skills and teach youth social, life, and alcohol and drug refusal skills. Skills are reinforced through gaming. Game points are achieved by right answers to self-correcting mini-quizzes for low-stakes failure and through actual reported home practice of the skills. The SFP parenting skills have been shown to reduce risk factors and increase protective factors that prevent youth substance abuse.
Active Comparator: SFP Home-use DVD/video series
This arm of the study receives an 11-session home-use DVD or coupon code for viewing the SFP videos online at home that contains the same SFP skills and lesson content as the online condition. However, the lesson material is not animated and involves simply viewing the videos at home. This arm represents an "attention-control" condition as the requirements of participation and exposure to the intervention will match the online condition, as participants use the Internet or a DVD player to view lesson material in a self-paced format. There are no differences in recruitment for this condition; all assignment to experimental conditions is based on their recruiter's location using a randomized control trial design. Participants in this condition will be provided a hyperlink URL to answer pre- and posttest assessments and at the 3-month follow-up. Process evaluation materials will be delivered via a hyperlink to a commercial survey vendor during the trial and at the conclusion.
Family views an 11-session SFP video series online or at home using a DVD that contains the same program and lesson content as the online condition; however, the lesson material is more static without the interaction required in the gamified version of SFP Online.
Active Comparator: Wait-Listed Control

This arm of the study receives no active intervention for the initial intervention period of 11 weeks; however, following conclusion of the initial trial the wait-listed control sites are then administered the 10-session SFP Online intervention. During the initial trial of 11 weeks, participants in this condition receive weekly email reminders that contain riddles and puzzles for youth and parents receive nutritional information and food preparation recipes. The intent of these weekly emails is to stimulate continued participation and reduce attrition.

Individual families will be randomly assigned to one of the three interventions with a computerized random number generator.

Families (parent/caregiver and children) are to play-test a highly interactive online gamified version of the Strengthening Families Program called SFP Online, with 10 lessons that utilize three 10-minute mini-sessions and games that teach parents evidence-based parenting and family relationship skills and teach youth social, life, and alcohol and drug refusal skills. Skills are reinforced through gaming. Game points are achieved by right answers to self-correcting mini-quizzes for low-stakes failure and through actual reported home practice of the skills. The SFP parenting skills have been shown to reduce risk factors and increase protective factors that prevent youth substance abuse.
Families receive no active intervention for 22 weeks; however, during this wait time, participants receive weekly email reminders that contain riddles and puzzles for youth and parents receive nutritional information and food preparation recipes. Following conclusion of the initial trial the wait-listed control sites are then administered the 10-session SFP Online intervention
No Intervention: SFP Group Norms
This arm of the study provides a means to conduct a non-inferiority trial contrasting the active intervention conditions (SFP Online and Home-use DVD/videos) to the traditional 14-session in-person group-delivery format, which serves as a benchmark of effectiveness for SFP. There is no data collection as the Group Norms are part of an existing database of families that already took SFP classes. All effect size comparisons are conducted using secondary data analysis. The expected margin of equivalence is set at 10% so that any condition that exceeds another in the magnitude of effect size is considered as 'good as' the comparison condition. All effect sizes will be adjusted for demographic and site-specific factors to control for clustering and within-site contextual factors that can influence program outcomes.

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Change in family cohesion as assessed using the Moos Family Environment Scale
Time Frame: The investigators will assess all participants at baseline, again 10-weeks later at posttest following delivery of the intervention, and again at 22 weeks post-baseline for follow-up
The investigators will assess family cohesion over time using the Moos Family Environment Scale. An example of a questions is: "I praise my child when he/she behaves well" (alpha=.79). Responses are on a 5-point scale: "1=Never;" "2=Rarely;" "3=Sometimes;" "4=Often;" "5=Almost Always;" with five (5) being the highest value.
The investigators will assess all participants at baseline, again 10-weeks later at posttest following delivery of the intervention, and again at 22 weeks post-baseline for follow-up
Change in parents' setting clear, firm rules against youth substance use as assessed using the Kumpfer Strengthening Families Program (SFP) Skills Instrument
Time Frame: The investigators will assess all participants at baseline, again 10-weeks later at posttest following delivery of the intervention, and again at 22 weeks post-baseline for follow-up
The investigators will assess change in parents' setting clear, firm rules against youth substance use over time using the Kumpfer SFP Skills instrument. An example is: "Our family has set clear rules about no youth alcohol or drug use"; alpha=.79). Responses are on a 5-point scale: "1=Never;" "2=Almost never;" "3=Sometimes;" "4=Often; "5=Almost Always" with 5 being the highest value
The investigators will assess all participants at baseline, again 10-weeks later at posttest following delivery of the intervention, and again at 22 weeks post-baseline for follow-up
Change in parental supervision of children as assessed using the Kumpfer Strengthening Families Program (SFP) Skills instrument.
Time Frame: The investigators will assess all participants at baseline, again 10-weeks later at posttest following delivery of the intervention, and again at 22 weeks post-baseline for follow-up
The investigators will assess parental supervision of their children over time using the Kumpfer Strengthening Families Program (SFP) Skills instrument. An example is: "I know where my child is and who he/she is with"; alpha=.70). Responses are on a 5-point scale: "1=Never;" "2=Almost never;" "3=Sometimes;" "4=Often;" "5=Almost Always" with 5 being the highest value.
The investigators will assess all participants at baseline, again 10-weeks later at posttest following delivery of the intervention, and again at 22 weeks post-baseline for follow-up
Change in youth attitude favorable to alcohol use over time as assessed using the Bach Harrison Prevention Needs Assessment (PNA) Instrument
Time Frame: The investigators will assess all participants at baseline, again 10-weeks later at posttest following delivery of the intervention, and again at 22 weeks post-baseline for follow-up
The investigators will assess change in youth attitude favorable to alcohol use using questions from the Bach Harrison Prevention Needs Assessment (PNA) a nationally representative epidemiological survey targeting youth that is used in 14 states. An example of a question is: "How wrong do you think it is for someone your age to drink beer, wine or hard liquor (vodka, whiskey, or gin) at least once or twice a month?" Responses are on a 5 point scale: "1=Not wrong at all;" "2= a little bit wrong;" "3=Sometimes wrong;" "4=Wrong;" "5=Very Wrong;" with 5 being the highest value.
The investigators will assess all participants at baseline, again 10-weeks later at posttest following delivery of the intervention, and again at 22 weeks post-baseline for follow-up

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Investigators

  • Principal Investigator: Karol L Kumpfer, PhD, Strengthening Families Program LLC

Publications and helpful links

The person responsible for entering information about the study voluntarily provides these publications. These may be about anything related to the study.

General Publications

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

December 15, 2022

Primary Completion (Anticipated)

September 30, 2023

Study Completion (Anticipated)

September 30, 2023

Study Registration Dates

First Submitted

December 20, 2019

First Submitted That Met QC Criteria

December 30, 2019

First Posted (Actual)

January 2, 2020

Study Record Updates

Last Update Posted (Estimate)

January 6, 2023

Last Update Submitted That Met QC Criteria

January 5, 2023

Last Verified

January 1, 2023

More Information

Terms related to this study

Other Study ID Numbers

  • StrengtheningFamilies

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

Yes

IPD Plan Description

Outcome report from the study will be made public and available as soon as it is completed. ,

IPD Sharing Time Frame

When study and evaluation are completed estimated August 2022

IPD Sharing Access Criteria

Find link on company website

IPD Sharing Supporting Information Type

  • Study Protocol
  • Statistical Analysis Plan (SAP)
  • Informed Consent Form (ICF)
  • Clinical Study Report (CSR)
  • Analytic Code

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Substance Abuse

Clinical Trials on Strengthening Families Program Online eLearning Game

3
Subscribe