Precision-Based Approach to Matching Evidence-Based Interventions to Students With Externalizing Behaviors (SIMSRCT)

March 1, 2023 updated by: Yanchen Zhang, University of Iowa

Precision-Based Approach to Matching Evidence-Based Interventions to Individual Needs of Students With Externalizing Behaviors: A Double-Masked Randomized Controlled Trial

Although prevalent across schools in the US, the "One-Size-Fits-All" (OSFA) approach to selecting evidence-based interventions (EBIs) for student externalizing behaviors often yields lackluster outcomes, due to the mismatch between the EBI and students' heterogeneous needs. Emerging literature highlighted the promise of the precision approach to intervention (e.g., Student Intervention Matching System; SIMS), whereas EBIs were selected based on the match between a student's individual needs and the active components of EBIs. This pilot study tested the efficacy, feasibility, and acceptability of SIMS to match EBIs to students with externalizing behaviors. The investigators ran a double-masked randomized waitlist-controlled trial in a diverse urban district. Students at risk for externalizing behaviors were recruited and randomly assigned to the treatment (EBIs matched via SIMS) or control condition (mismatched social-skill training). Students received EBIs based on assigned condition for 10 weeks. Students' externalizing behaviors were assessed via a multi-method approach at baseline and 10-week posttest. Teachers rated the feasibility and acceptability of SIMS at 10-week posttest. The investigators used cluster-adjusted ANCOVAs to compare efficacy of matched EBIs via SIMS against that of the mismatched social skill training in reducing student externalizing behaviors.

Study Overview

Status

Status

Indicates the current recruitment status or the expanded access status.
Completed

Conditions

Conditions

The disease, disorder, syndrome, illness, or injury that is being studied. On ClinicalTrials.gov, conditions may also include other health-related issues, such as lifespan, quality of life, and health risks.

Intervention / Treatment

Intervention / Treatment

A process or action that is the focus of a clinical study. Interventions include drugs, medical devices, procedures, vaccines, and other products that are either investigational or already available. Interventions can also include noninvasive approaches, such as education or modifying diet and exercise.

Study Type

Study Type

Describes the nature of a clinical study. Study types include interventional studies (also called clinical trials), observational studies (including patient registries), and expanded access.
Interventional

Enrollment (Actual)

Enrollment

The number of participants in a clinical study. The "anticipated" enrollment is the target number of participants that the researchers need for the study.
51

Phase

Phase

The stage of a clinical trial studying a drug or biological product, based on definitions developed by the U.S. Food and Drug Administration (FDA). The phase is based on the study's objective, the number of participants, and other characteristics. There are five phases: Early Phase 1 (formerly listed as Phase 0), Phase 1, Phase 2, Phase 3, and Phase 4. Not Applicable is used to describe trials without FDA-defined phases, including trials of devices or behavioral interventions.
  • Not Applicable

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Locations

  • United States
    • Minnesota
      • Minneapolis, Minnesota, United States, 55455
        • University of Minnesota-Twin Cities

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Eligibility Criteria

The key requirements that people who want to participate in a clinical study must meet or the characteristics they must have. Eligibility criteria consist of both inclusion criteria (which are required for a person to participate in the study) and exclusion criteria (which prevent a person from participating). Types of eligibility criteria include whether a study accepts healthy volunteers, has age or age group requirements, or is limited by sex.

Ages Eligible for Study

9 years to 12 years (Child)

Accepts Healthy Volunteers

No

Genders Eligible for Study

All

Description

Inclusion Criteria:

  • with a moderate risk for externalizing behavioral problems, which was indicated by a score between 4 and 8 on the Student Risk Screening Scale-Externalizing.
  • receiving the majority of services in general education settings
  • in 3rd, 4th, or 5th grade level.

Exclusion Criteria:

  • severe risk for externalizing problems, which was indicated by a score exceeding 8 on the Student Risk Screening Scale-Externalizing. The students at severe risk will be referred to the school counselor for appropriate service.

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

  • Primary Purpose: Treatment
  • Allocation: Randomized
  • Interventional Model: Parallel Assignment
  • Masking: Triple

Arms and Interventions

Participant Group / Arm

Participant Group / Arm

A group or subgroup of participants in a clinical trial that receives a specific intervention/treatment, or no intervention, according to the trial's protocol.
Intervention / Treatment

Intervention / Treatment

A process or action that is the focus of a clinical study. Interventions include drugs, medical devices, procedures, vaccines, and other products that are either investigational or already available. Interventions can also include noninvasive approaches, such as education or modifying diet and exercise.
Experimental: Treatment: Student Intervention Matching System
In the treatment condition, the students received a performance-based interventions matched to their individual needs and characteristics based on Student Intervention Matching System (SIMS).
Behavioral: Student Intervention Matching System (SIMS)
The Student Intervention Matching System (SIMS) is a pre-intervention matching assessment following the behavioral consultation model. The SIMS entails three steps to sequentially assess and then match students' individual characteristics to precise acquisition- or performance-based interventions. The 1st step corresponds to the "problem identification" stage in behavioral consultation. The 2nd step corresponds to the "problem analysis" stage of behavioral consultation.The 3rd step of SIMS corresponds to the "implementation planning" and "evaluation" stages of behavioral consultation.
Active Comparator: Active control: group-based social skills training
In the control condition, students received an unconditionally mismatched acquisition-based EBI (group-based social skills training).
Behavioral: group-based social skills training
In the control condition, students received an unconditionally mismatched acquisition-based intervention (group-based social skills training). We selected group-based social skills training for four reasons: (a) participating schools had already been delivering it as their treatment-as-usual, (b) it is a common intervention in US schools, (c) it is only effective for students with acquisition needs, and (d) it represents a counterfactual contrast to the treatment condition because externalizing behaviors driven by performance needs will be reduced more by performance-based interventions than acquisition-based ones.

What is the study measuring?

Primary Outcome Measures

Primary Outcome Measures

In a clinical study's protocol, the planned outcome measure that is the most important for evaluating the effect of an intervention/treatment. Most clinical studies have one primary outcome measure, but some have more than one.
Outcome Measure
Measure Description
Time Frame
Change in the frequency of students' externalizing behaviors from baseline to 10-week follow-up
Time Frame: Start of the study (baseline) and End of the study (10-week posttest)
The Direct Behavior Rating- Multi-Item Scale (DBR-MIS) is a pragmatic and low-inference assessment of an operationally defined problem behavior on a specific dimension (frequency, intensity, or duration of externalizing behaviors; Christ et al., 2009). The educators complete the DBR-MIS based on their observations of the target student in the setting where the problem behavior usually occurs for a pre-specified period. The DBR-MIS contains three items corresponding to disruptive behaviors, aggressive behavior, and noncompliance, which were summed into a total score of externalizing behaviors. Each item was rated on a 10-point Likert scale ranging from "0%; Never" to "50%; Sometimes" to "100%; Always".
Start of the study (baseline) and End of the study (10-week posttest)
Change in the severity of students' externalizing behaviors from baseline to 10-week follow-up
Time Frame: Start of the study (baseline), and End of the study (10-week posttest)
The Social Skills Improvement System-Rating Scale (SSIS-RS; Elliott et al., 2008) is a brief and intervention-oriented assessment of students' needs in social skills and problem behaviors. Given the scope of this study, only the "externalizing behavior subscale" were used. Each item was rated on a 3-point Likert scale (0= Never, 1= Seldom, 2 = Often, and 3= Almost Always) based on the frequency of a student's externalizing behavior. High scores indicate more frequent externalizing behaviors.
Start of the study (baseline), and End of the study (10-week posttest)

Secondary Outcome Measures

Secondary Outcome Measures

In a clinical study's protocol, a planned outcome measure that is not as important as the primary outcome measure for evaluating the effect of an intervention but is still of interest. Most clinical studies have more than one secondary outcome measure.
Outcome Measure
Measure Description
Time Frame
Feasibility and Acceptability
Time Frame: End of the study (10-week posttest)
The school teams and designated implementers of matched EBIs rated the feasibility and acceptability of the EBIs matched via SIMS. Given the scope of this study, we used two subscales, Feasibility (7-item) and Acceptability (9-item), from the Usage Rating Profile-Intervention Revised (URP-IR; Chafouleas et al., 2011). All items were rated on a 6-point Likert scale ranging from 1 "strongly disagree" to 6 "strongly agree".
End of the study (10-week posttest)
Intervention Fidelity
Time Frame: End of the study (10-week posttest)
The designated implementers of matched EBIs (e.g., teachers, paraprofessionals, or behavioral specialists) used EBI-specific checklists to assess their intervention fidelity. Given the scope of this study and the common practice in school-based intervention research, we used implementers' adherence to the EBI protocols as the primary indicator of intervention fidelity. Fidelity checklists were developed by (a) operationalizing the core components of an EBI, and (b) having implementers to self-report how many core components they delivered as intended for the target student during a specific period.
End of the study (10-week posttest)

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Sponsor

The organization or person who initiates the study and who has authority and control over the study.
University of Iowa

Collaborators

Collaborators

An organization other than the sponsor that provides support for a clinical study. This support may include activities related to funding, design, implementation, data analysis, or reporting.
University of Minnesota

Publications and helpful links

The person responsible for entering information about the study voluntarily provides these publications. These may be about anything related to the study.

General Publications

  • Chafouleas SM. Direct Behavior Rating: A review of the issues and research in its development. Education and Treatment of Children. 2011;34(4):575-91.
  • Elliott SN, Gresham FM, Frank JL, Beddow III PA. Intervention validity of social behavior rating scales: Features of assessments that link results to treatment plans. Assessment for effective intervention. 2008 Dec;34(1):15-24.
  • Christ TJ, Riley-Tillman TC, Chafouleas SM. Foundation for the development and use of Direct Behavior Rating (DBR) to assess and evaluate student behavior. Assessment for Effective Intervention. 2009 Sep;34(4):201-13.

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

Study Start

The actual date on which the first participant was enrolled in a clinical study. The "anticipated" study start date is the date that the researchers think will be the study start date.
August 25, 2018

Primary Completion (Actual)

Primary Completion

The date on which the last participant in a clinical study was examined or received an intervention to collect final data for the primary outcome measure. Whether the clinical study ended according to the protocol or was terminated does not affect this date. For clinical studies with more than one primary outcome measure with different completion dates, this term refers to the date on which data collection is completed for all the primary outcome measures. The "anticipated" primary completion date is the date that the researchers think will be the primary completion date for the study.
November 10, 2018

Study Completion (Actual)

Study Completion

The date on which the last participant in a clinical study was examined or received an intervention/treatment to collect final data for the primary outcome measures, secondary outcome measures, and adverse events (that is, the last participant's last visit). The "anticipated" study completion date is the date that the researchers think will be the study completion date.
December 1, 2018

Study Registration Dates

First Submitted

First Submitted

The date on which the study sponsor or investigator first submitted a study record to ClinicalTrials.gov. There is typically a delay of a few days between the first submitted date and the record's availability on ClinicalTrials.gov (the first posted date).
February 21, 2023

First Submitted That Met QC Criteria

First Submitted That Met QC Criteria

The date on which the study sponsor or investigator first submits a study record that is consistent with National Library of Medicine (NLM) quality control (QC) review criteria. The sponsor or investigator may need to revise and submit a study record one or more times before NLM's QC review criteria are met. It is the responsibility of the sponsor or investigator to ensure that the study record is consistent with the NLM QC review criteria.
March 1, 2023

First Posted (Estimate)

First Posted

The date on which the study record was first available on ClinicalTrials.gov after National Library of Medicine (NLM) quality control (QC) review has concluded. There is typically a delay of a few days between the date the study sponsor or investigator submitted the study record and the first posted date.
March 3, 2023

Study Record Updates

Last Update Posted (Estimate)

Last Update Posted

The most recent date on which changes to a study record were made available on ClinicalTrials.gov. There may be a delay between when the changes were submitted to ClinicalTrials.gov by the study's sponsor or investigator (the last update submitted date) and the last update posted date.
March 3, 2023

Last Update Submitted That Met QC Criteria

Last Update Submitted That Met QC Criteria

The most recent date on which the study sponsor or investigator submitted changes to a study record that are consistent with National Library of Medicine (NLM) quality control (QC) review criteria. It is the responsibility of the sponsor or investigator to ensure that the study record is consistent with the NLM QC review criteria.
March 1, 2023

Last Verified

Last Verified

The most recent date on which the study sponsor or investigator confirmed the information about a clinical study on ClinicalTrials.gov as accurate and current. If a study with a recruitment status of recruiting; not yet recruiting; or active, not recruiting has not been confirmed within the past 2 years, the study's recruitment status is shown as unknown.
March 1, 2023

More Information

Terms related to this study

Other Study ID Numbers

Other Study ID Numbers

Identifiers or ID numbers other than the NCT number that are assigned to a clinical study by the study's sponsor, funders, or others. These numbers may include unique identifiers from other trial registries and National Institutes of Health grant numbers.
  • SIMS001

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

YES

IPD Plan Description

The de-identified datasets generated and analyzed during the current study are available upon request to the principle investigator.

IPD Sharing Time Frame

From February 1st, 2023 with no ending date.

IPD Sharing Access Criteria

Public upon request to the principle investigator

IPD Sharing Supporting Information Type

  • STUDY_PROTOCOL
  • SAP
  • ANALYTIC_CODE

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Cookie Settings

We use cookies to ensure that we give you the best experience on our website. For more details carefully read our Privacy and Cookies Policy. ...>>>You can change your preferences or withdraw your consent at any time by deleting the cookies from your website or computer as described in the policy. Please accept it and choose your preferences by ticking the corresponding boxes in the "Manage Settings" section below. Please carefully read our Terms of Service before you proceed with using any part of this website.
«Manage Settings