Organizational Skills Training - Tier 2 (OST-T2)
Evaluation of Organizational Skills Training (OST) Program for Upper Elementary Students
Study Overview
Status
Status
Conditions
Conditions
Intervention / Treatment
Intervention / Treatment
Detailed Description
Context: Although multiple factors influence school functioning, executive function (EF) deficits have been found to be a key predictor of academic achievement. EF is a higher order cognitive ability associated with persistent goal-directed behavior. Organization, time management, and planning (OTMP) skills are aspects of EF that are particularly associated with children's academic performance. Organizational demands increase over the course of early schooling and are relatively high by 3rd through 5th grade. Poor OTMP skills during this period adversely impact academic functioning. In the late elementary school grades, as students are expected to become more organized, some students have difficulty learning these skills in spite of classroom supports provided by teachers, placing them at increased risk for academic failure.
Objectives: The purpose of this study was to conduct an evaluation of the Organizational Skills Training Program - Tier 2 version (OST-T2), a fully developed intervention for students in general education. The proposed study builds upon research demonstrating the efficacy of a clinic-based version of the OST intervention (OST-C) in remediating OTMP skills deficits and improving academic functioning for 3rd, 4th and 5th graders with attention-deficit hyperactivity disorder (ADHD), and a recent pilot research demonstrating the feasibility and potential effectiveness of a school-based version of OST provided by end users ("school partners") for 3rd through 5th graders. It also builds upon research training school staff to implement evidence-based interventions with high fidelity.
Study Design: This is a cluster-randomized trial with a treatment as usual (TAU) control group.
Setting/Participants: Schools (22) were located in Pennsylvania and New Jersey and include urban and suburban schools serving a diverse population. Students (3rd to 5th grade) who are struggling the most with OTMP deficits and whose academic performance is negatively impacted by their OTMP deficits will be referred to the study team by their general education teachers.
Study Interventions and Measures: OST-T2 is a small group skills training intervention, with parents and teachers supporting children's use of new skills. The program manual includes strategies for training and coaching school staff, referred to as school partners, to effectively implement OST-T2 and guidelines to modify the program for implementation in diverse schools with diverse students. Each student session includes: (a) homework review to assess completion of between-session skills implementation; (b) skill-building activities, which include the use of modeling, shaping, guided practice, and reinforcement for organized behavior; and (c) activities to promote generalization of skills. Sessions address four organizational challenges: (a) tracking assignments, (b) managing materials, (c) managing time, and (d) planning for long term assignments.
Investigators measured the following: intervention fidelity, stakeholder engagement, student OTMP skills, student academic self-efficacy, student academic outcomes, student characteristics, feasibility, usability, and acceptability of OST-T2. In addition, investigators tracked the interventions that are offered as treatment-as-usual in TAU schools. A cost analysis related to the implementation of OST-T2 will also be completed.
Study Type
Study Type
Enrollment (Actual)
Enrollment
Phase
Phase
- Not Applicable
Contacts and Locations
Study Locations
-
-
New York
-
New York, New York, United States, 10016
- New York University
-
-
Pennsylvania
-
Philadelphia, Pennsylvania, United States, 19104
- University of Pennsylvania
-
Philadelphia, Pennsylvania, United States, 19146
- Children's Hospital of Philadelphia
-
-
Participation Criteria
Eligibility Criteria
Eligibility Criteria
Ages Eligible for Study
- Child
- Adult
- Older Adult
Accepts Healthy Volunteers
Description
Inclusion Criteria:
Any student enrolled in grades 3 through 5 in one of the participating schools who meets the following criteria.
- First, students will be recommended by their general education teacher if the following are true: (a) students who are struggling the most with OTMP skills, (b) whose OTMP skill deficits are the students' primary concern (c) whose academic performance is negatively impacted by their OTMP deficits, and (d) who have at least one parent who speaks English.
- Second, students must have or be at risk for developing OTMP deficits.
Exclusion Criteria:
- Students will be excluded if they are in a pull-out special education classroom for more than 50% of the day as the organizational demands for these students may differ from those students placed mostly in general education.
- Students with a one-to-one aide will be excluded because the presence of an aide substantially alters how an organizational intervention is implemented.
- Students from families in which both caregivers do not speak English will be excluded because the program has not yet been developed for non-English speakers.
- Only one student per family will be included in the study.
Study Plan
How is the study designed?
Design Details
- Primary Purpose: Treatment
- Allocation: Randomized
- Interventional Model: Parallel Assignment
- Masking: Single
Number of Arms
Arms and Interventions
Participant Group / ArmParticipant Group / Arm |
Intervention / TreatmentIntervention / Treatment |
|---|---|
|
Experimental: OST-T2 Intervention group
Small group skills training for students in grades 3 through 5 with difficulties with organization, time management, and planning skills.
Includes parent and teacher involvement to support student skills use.
|
OST-T2 is a small group skills training intervention, with parents and teachers supporting children's use of new skills.
The program manual includes strategies for training and coaching school staff, referred to as school partners, to effectively implement OST-T2 and guidelines to modify the program for implementation in diverse schools with diverse students.
Each student session includes: (a) homework review to assess completion of between-session skills implementation; (b) skill-building activities, which include the use of modeling, shaping, guided practice, and reinforcement for organized behavior; and (c) activities to promote generalization of skills.
Sessions address four organizational challenges: (a) tracking assignments, (b) managing materials, (c) managing time, and (d) planning for long term assignments.
|
|
No Intervention: Treatment as usual control group
Strategies currently in use by schools to address organization, time management, and planning skills problems.
|
What is the study measuring?
Primary Outcome Measures
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Students' Organizational Functioning - Teacher Report
Time Frame: Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
The Children's Organizational Skills Scales - Teacher Version (COSS-T) was used to assess changes in OTMP functioning at home and school over several time points.
COSS total scores have good discriminant validity and are sensitive to treatment effects.
Each COSS version uses a 4-point rating scale (1=Hardly ever or never to 4=Just about all of the time).
Higher scores indicate a worse outcome.
Although the COSS yields three subscale scores, only the total score of 28 items was used to reduce the number of measures in the analyses.
The mean item score was calculated and used in analyses; possible range is from 1 to 4.
|
Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
|
Students' Organizational Functioning - Parent Report
Time Frame: Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
The Children's Organizational Skills Scales - Parent Version (COSS-P) was used to assess changes in OTMP functioning at home and school over several time points.
COSS total scores have good discriminant validity and are sensitive to treatment effects.
Each COSS version uses a 4-point rating scale (1=Hardly ever or never to 4=Just about all of the time).
Higher scores indicate a worse outcome.
Although the COSS yields three subscale scores, only the 26-item total score was used to reduce the number of measures in the analyses.
The mean item score was calculated and used in analyses; possible range is from 1 to 4.
|
Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
Secondary Outcome Measures
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Students' Homework Performance - Teacher Report
Time Frame: Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
The Homework Performance Questionnaire (HPQ-T)-Teacher version was used to assess changes in students' homework behavior during the past 4 weeks.
Each item is rated on a five-point scale corresponding to amount of time student demonstrated the behavior in the previous 4-week period (0 = 0% to 39% of the time; 1 = 40% to 69% of the time; 2 = 70% to 79% of the time; 3 = 80% to 89% of the time; 4 = 90% to 100% of the time).Higher scores indicate better outcome.
The 9-item Student Self-Regulation factor was used in the analyses.
This factor has been demonstrated to have strong psychometric properties.
Mean item score was used in analyses; possible range is from 0 to 4.
|
Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
|
Students' Homework Performance - Parent Report
Time Frame: Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
The Homework Problem Checklist (HPC) is a 20-item parent-report measure that was used to assess changes in student homework performance.
Parents indicate the frequency with which student engage in behavior during homework time at home on a four-point scale (0 = never to 3 = very often).
The psychometric properties of this instrument have been shown to be acceptable, and the HPC was sensitive to treatment effects in the previous OST-C study.
The total HPC score was used in the analyses.
Higher scores indicate worse outcomes.
Mean item score was calculated and used in analyses; possible range is from 0 to 3.
|
Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
|
Student Academic Proficiency
Time Frame: Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
The Academic Proficiency Scale (APS) is a teacher-report measure that assesses (changes in) proficiency in six academic subjects relative to standard expectations (1=Well below standard expected at this time of year; 3=At standard; 5=Well above standard).
Higher scores indicate a better outcome.
Ratings were averaged across six academic subjects; mean item score is the unit of analysis.
Possible range is from 1 to 5. Reliability is acceptable (alpha = .84),
and this measure is sensitive to OST treatment effects.
|
Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
|
Student Academic Competence
Time Frame: Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
The Academic Competence Evaluation Scales (ACES) is a teacher-report scale that assesses changes in the academic competence of students in kindergarten through grade 12.
The Reading/Language Arts and Math subscales of this measure were used.
Items are rated from 1 = far below to 5 = far above grade level.
Higher scores indicate better outcome.
Alpha coefficients and test-retest correlations for these subscales have been shown to be above .90.
The average item score for Reading/Language Arts (11 items) and Math (8 items) subscales were calculated.
Then the average of these subscale scores was used in the analyses.
Possible range is from 1 to 5.
|
Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
|
Student Academic Grades
Time Frame: Baseline, 5-months
|
Student report card grades for the first marking period of the year students participate in OST-T2/TAU and for the last marking period of the academic year of participation were used to examine impact on academic performance.
Grades were harmonized across participating school districts to a uniform grading scale (ranging from low of 1 to high of 4).
A composite academic grade score was computed for each student based on their grades in math and reading/language arts (possible range = 1 to 4).
Higher scores indicate better outcomes.
|
Baseline, 5-months
|
|
Student Self-efficacy
Time Frame: Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
Patterns of Adaptive Learning Scales (PALS) was used to evaluate changes in students' perceptions of their ability to overcome challenges to perform their class work (e.g., "I can do even the hardest work in this class if I try.").
Items are rated on a 5-item scale from 1 = not at all true to 5 = very true.
Higher scores indicate better outcomes.
Mean item scores were used in analyses; possible range is from 1 to 5.
|
Baseline, 14-weeks (post-treatment), 5-months and 12-months
|
Collaborators and Investigators
Sponsor
Sponsor
Collaborators
Collaborators
Investigators
Investigators
- Principal Investigator: Thomas Power, PhD, Children's Hospital of Philadelphia
- Principal Investigator: Jenelle Nissley-Tsiopoinis, PhD, Children's Hospital of Philadelphia
- Principal Investigator: Jennifer Mautone, PhD, Children's Hospital of Philadelphia
Publications and helpful links
General Publications
- Abikoff H, Gallagher R, Wells KC, Murray DW, Huang L, Lu F, Petkova E. Remediating organizational functioning in children with ADHD: immediate and long-term effects from a randomized controlled trial. J Consult Clin Psychol. 2013 Feb;81(1):113-28. doi: 10.1037/a0029648. Epub 2012 Aug 13.
- Best JR, Miller PH, Naglieri JA. Relations between Executive Function and Academic Achievement from Ages 5 to 17 in a Large, Representative National Sample. Learn Individ Differ. 2011 Aug;21(4):327-336. doi: 10.1016/j.lindif.2011.01.007.
- Best JR, Miller PH, Jones LL. Executive Functions after Age 5: Changes and Correlates. Dev Rev. 2009 Sep 1;29(3):180-200. doi: 10.1016/j.dr.2009.05.002.
- Abikoff, H., & Gallagher, R. (2009). Children's organizational skills scales (COSS), technical manual. North Tonawanda, NY: Multi-Health Systems.
- Eiraldi R, McCurdy B, Khanna M, Mautone J, Jawad AF, Power T, Cidav Z, Cacia J, Sugai G. A cluster randomized trial to evaluate external support for the implementation of positive behavioral interventions and supports by school personnel. Implement Sci. 2014 Jan 15;9:12. doi: 10.1186/1748-5908-9-12.
- Langberg JM, Dvorsky MR, Evans SW. What specific facets of executive function are associated with academic functioning in youth with attention-deficit/hyperactivity disorder? J Abnorm Child Psychol. 2013 Oct;41(7):1145-59. doi: 10.1007/s10802-013-9750-z.
Study record dates
Study Major Dates
Study Start (Actual)
Study Start
Primary Completion (Actual)
Primary Completion
Study Completion (Actual)
Study Completion
Study Registration Dates
First Submitted
First Submitted
First Submitted That Met QC Criteria
First Submitted That Met QC Criteria
First Posted (Actual)
First Posted
Study Record Updates
Last Update Posted (Actual)
Last Update Posted
Last Update Submitted That Met QC Criteria
Last Update Submitted That Met QC Criteria
Last Verified
Last Verified
More Information
Terms related to this study
Keywords
Other Study ID Numbers
Other Study ID Numbers
- 17-014227
- R305A170052-20 (Other Grant/Funding Number: US Dept. of Education)
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
IPD Plan Description
IPD Sharing Time Frame
IPD Sharing Access Criteria
IPD Sharing Supporting Information Type
- STUDY_PROTOCOL
- ICF
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.
Clinical Trials on Executive Function
-
NCT05694377Active, not recruitingCognitive Function | Executive Function
-
NCT06770192Recruiting
-
NCT02199808CompletedExecutive Function
-
NCT05593965CompletedExecutive Function
-
NCT06286943Not yet recruiting
-
NCT03828734Completed
-
NCT03491488UnknownExecutive Function
-
NCT06710678RecruitingExecutive Function (Cognition)
Clinical Trials on Organizational Skills Training - Tier 2 (OST-T2)
-
NCT07089745RecruitingADHD | ADHD - Attention Deficit Disorder With Hyperactivity
-
NCT02663986CompletedAttention Deficit Hyperactivity Disorder (ADHD)
-
NCT04108273CompletedADHD | Neurodevelopmental Disorders | Attention Deficit Hyperactivity Disorder
-
NCT00381407CompletedAttention Deficit Disorder With Hyperactivity
-
NCT07281092RecruitingADHD | ADHD - Attention Deficit Disorder With Hyperactivity
-
NCT06733376RecruitingPTSD - Post Traumatic Stress Disorder
-
NCT01809431CompletedGestational Diabetes
-
NCT00251212CompletedViolence | Alcohol Abuse
-
NCT06294834CompletedParaplegia | Paralysis, Legs