Examining the Active Ingredients of Consultation of a Parent-mediated Intervention for Autism

Examining the Active Ingredients of Consultation to Improve Implementation of a Parent-mediated Intervention for Children With Autism in the Community Mental Health System

Parent-mediated interventions are considered best practice for treating children with autism spectrum disorder, but these interventions are underutilized in community settings. Implementation strategies like consultation can improve the implementation of these interventions, but little is known about the active ingredients of consultation. This study uses an experimental design (ABCD single-case design with multiple baselines) to identify the active ingredients of a consultation model designed to support the implementation of a parent-mediated intervention for autism spectrum disorder in a low-resourced community mental health system.

Study Overview

• Status: Completed
• Conditions: Autism Spectrum Disorder
• Intervention / Treatment: Other: Consultee-centered administrative consultation

Detailed Description

There are multiple evidence-based practices (EBPs) to treat autism spectrum disorder (ASD), yet the gap from when EBPs are developed to when they reach community settings is 17 years. EBPs are consistently underused in community settings despite their well-studied effectiveness. One such EBP for treating ASD in young children is parent-mediated intervention.

Consultation is one method of supporting implementation that involves providing clinicians with support and feedback from intervention experts. For this study, consultation on an evidence-based parent-mediated intervention, Project ImPACT, will be the focus. Understanding the active ingredients that go into consultation is important to understand how consultation works so that it can be tailored to best meet the needs of community settings. This single-case experimental design (SCED) will manipulate three potential ingredients of consultation: feedback on taped sessions, case support, and skill rehearsal.

Groups of 3-5 providers per agency will be given 2 weeks to complete a 6-hour self-directed online tutorial on Project ImPACT utilized regularly by Project ImPACT consultants. Next, each agency will be randomly assigned to baselines lasting 3-6 weeks, followed by 4 weeks of each consultation component (total of 12 weeks). All agencies will receive consultation. The order of the consultation components will be randomized using a random number generator such that each agency has an equal chance of receiving one of the predetermined permutations of phases which are labeled in alphabetical order (e.g., equally as likely to be randomized to ABCD order as ADBC order). Across each phase, providers will record one session per week with their enrolled family and submit it via a HIPAA-compliant Drop-box link. Providers will complete weekly online questionnaires on implementation outcomes, with time reserved during consultation sessions to complete them. After consultation, providers will submit a final recorded session and questionnaire 8-weeks post-consultation. Caregivers will complete a measure of social communication for their child via online questionnaire at baseline, twice during consultation, and after 8 weeks post-consultation.

The feedback phase will involve the consultant and peers responding to the 5-minute clips of recorded telehealth sessions with praise and constructive feedback. The case support phase will be a time for the consultant and peers to assist in any challenges faced; for example, this could include issues with telehealth, caregiver coaching, or family/child needs. The skill rehearsal phase will allow for consultees to practice their clinical skills via role play.

This study will have 4 aims:

Specific Aim 1: Identify the potential active ingredients of the consultation model by evaluating its effects on providers' treatment adherence and parent-mediated intervention competence. The investigators predict that the feedback component will improve adherence and competence over and above improvements from the case support and skill rehearsal components.

Specific Aim 2: Examine the relative feasibility, acceptability, and appropriateness of each consultation component using a SCED component analysis. Feasibility is the extent to which a practice can be successfully carried out within a setting. Acceptability is the extent to which a practice is agreeable and satisfactory. Appropriateness is the perceived fit or relevance of a practice to address a problem. The investigators predict that providers will perceive the case support component to be the most feasible, acceptable, and appropriate of all components.

Specific Aim 3: Examine the effects of the consultation model on case penetration and the feasibility, acceptability, and appropriateness of the EBP (Project ImPACT). The investigators predict case penetration (i.e., total number of Project ImPACT cases on a provider's caseload divided by the total number of eligible clients) and EBP feasibility, acceptability, and appropriateness to increase over time.

Exploratory Aim 4: Demonstrate associated social communication outcomes for Medicaid-enrolled children with ASD from baseline to post-consultation. Given that consultation leads to improved adherence and child outcomes and Project ImPACT results in improved child social communication outcomes, the investigators predict that our consultation model will be associated with improvements in child social communication skills.

• Study Type: Interventional
• Enrollment (Actual): 41
• Phase: Not Applicable

Contacts and Locations

Study Locations

• United States
  • Michigan
    • East Lansing, Michigan, United States, 48824
      • Michigan State University

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 18 years and older (Adult, Older Adult)
• Accepts Healthy Volunteers: No

Description

Groups of 3-5 providers will be recruited from four applied behavior analysis (ABA) agencies (~20 providers in total) that contract with regional community mental health agencies to provide ABA services to Medicaid-enrolled children with autism spectrum disorder (ASD). Families on the providers' caseloads will be enrolled.

Inclusion Criteria for Providers:

• Have at least one caregiver on their caseload who would be appropriate for Project ImPACT and who agrees to enroll in the study and have their sessions recorded.

Exclusion Criteria for Providers:

• Not qualified to bill for ABA services through the Medicaid Autism Benefit.
• Under age 18

Inclusion Criteria for Caregivers:

• Parent or guardian of a child who has a community diagnosis of ASD established using the Autism Diagnostic Observation Schedule (a gold standard ASD assessment), receives services through the Medicaid Autism Benefit (requires a household income at or below 133% of the federal poverty line), is between the ages of 18 months and 6 years, which is the age range targeted for Project ImPACT, and has at least 1 session per week with the provider.
• Child's provider is enrolled in the study.

Exclusion Criteria for Caregivers:

• Under age 18

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Health Services Research
• Allocation: Randomized
• Interventional Model: Parallel Assignment
• Masking: Single

Number of Arms

3

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
No Intervention: Baseline; Following completing the online tutorial, each agency will have a baseline lasting 3-6 weeks (this will be staggered by agency).
Experimental: Treatment (Consultation); Consultation will be conducted in 4-week phases that correspond to the three consultation components. The phases will occur in a randomized order. During a given phase, no components of any other phases will be provided. Feedback phase. Consultees will submit 5-minute clips of session recordings of their Project ImPACT session with their enrolled family for feedback. Oral feedback will be provided by the consultant and peers. Case support phase. The consultant will lead the group in problem-solving common barriers that providers experience with their cases. Skill rehearsal phase. The consultant will lead skill rehearsal practices in which providers role play elements of a Project ImPACT session.	Other: Consultee-centered administrative consultation; The consultee-centered administrative consultation model expressly focuses on supporting providers to increase EBP implementation within their specific setting.
No Intervention: Follow Up; During the follow-up period, consultation will not occur, and providers will continue implementing Project ImPACT with their cases. Eight weeks post-consultation, providers will submit a recorded Project ImPACT session with their enrolled family. Providers and caregivers will complete a final online questionnaire.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Treatment Adherence	The Project ImPACT Coaching Fidelity Checklist is a measure of treatment adherence. It uses a 3-point scale -- Observed (1), Partially Observed (.5), and Not Observed (0). Higher scores indicate higher treatment adherence. Based on scoring guidelines for this measure, scores for each item are multiplied by an item-specific weight value. Scores for each item are then summed and divided by the total number of items scored, yielding a score ranging from 0 to 100.	23-26 weeks
Parent-mediated Intervention Competence	Parent-mediated intervention competence will be assessed via Parent Empowerment and Coaching in Early Intervention (PEACE) coding which utilizes a 5-point scale to assess for competency in delivering collaborative coaching techniques used in parent-mediated interventions. The scale used is: Never (1), Rarely (2), Sometimes (3), Often (4), and Almost Always (5). The minimum value on the scale is 1 and the maximum is 5. Higher scores indicate higher parent-mediated intervention competence.	23-26 weeks
Case Penetration	Case penetration will be measured weekly using the Penetrability Formula and will be expressed using provider report of the total number of Project ImPACT cases on their caseload divided by the total number of eligible clients with ASD on their Medicaid Autism Benefit caseload. This is expressed as a percentage. Higher percentage values indicate higher case penetration.	23-26 weeks
Ratings of the Usability of Each Consultation Component	Clinicians reported on the usability of each consultation component weekly across the 4 weeks of each consultation condition using the Implementation Strategy Usability Scale (Lyon et al., 2021). This 10-item questionnaire uses a 5-point Likert scale to examine clinician perceptions about the complexity of using an implementation strategy. The scale is unidimensional and has no subscales. Based on scoring guidelines, a formula is used to calculate the total usability score, which ranges from 0-100. Higher scores indicate higher usability; higher scores indicate higher ratings of the participant's ability to use the strategy with ease. The formula involves the following: for each odd numbered item, subtract 1 from the Likert rating value to get the new value; for each even numbered item, subtract the Likert rating value from 5 to get a new value; then sum all new values and multiply by 2.5.	23-26 weeks
Ratings of Perceptions of Project ImPACT	Providers completed the Perceived Characteristics of Intervention Scale (PCIS; Cook et al., 2015) weekly about their perceptions of Project ImPACT. This 18-item questionnaire includes items related to various constructs from Rogers' Diffusions of Innovation theory (Rogers, 2010). All items are rated on a 7-point Likert scale and the overall PCIS score is established by computing the mean of all items. The minimum score is 1.00 and maximum is 7.00. Higher values indicate more positive perceptions of the intervention.	23-26 weeks
Child Social Communication Skills	The Autism Impact Measure has 41 items rated on a 5-point scale ranging from Never (1) to Always (5). The overall score is calculated by summing the scores on two scales (frequency and impact). Higher values indicate a higher frequency and impact of autism-related concerns child functioning. The minimum value is 82 and the maximum value is 410.	23-26 weeks

Collaborators and Investigators

• Sponsor: Michigan State University
• Investigators: Principal Investigator: Brooke Ingersoll, Michigan State University

Study record dates

Study Major Dates

• Study Start (Actual): October 1, 2021
• Primary Completion (Actual): October 14, 2022
• Study Completion (Actual): March 30, 2023

Study Registration Dates

• First Submitted: November 29, 2020
• First Submitted That Met QC Criteria: December 3, 2020
• First Posted (Actual): December 4, 2020

Study Record Updates

• Last Update Posted (Actual): April 3, 2025
• Last Update Submitted That Met QC Criteria: March 18, 2025
• Last Verified: March 1, 2025

More Information

Terms related to this study

• Keywords: Autism Spectrum Disorder; Parent Training; Medicaid; Consultation; Parent-mediated intervention
• Additional Relevant MeSH Terms: Mental Disorders; Neurodevelopmental Disorders; Child Development Disorders, Pervasive; Autism Spectrum Disorder; Autistic Disorder
• Other Study ID Numbers: R40MC27705

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No