Measuring outcome in an early intervention program for toddlers with autism spectrum disorder: use of a curriculum-based assessment

Elizabeth C Bacon, Sarah Dufek, Laura Schreibman, Aubyn C Stahmer, Karen Pierce, Eric Courchesne, Elizabeth C Bacon, Sarah Dufek, Laura Schreibman, Aubyn C Stahmer, Karen Pierce, Eric Courchesne

Abstract

Measuring progress of children with autism spectrum disorder (ASD) during intervention programs is a challenge faced by researchers and clinicians. Typically, standardized assessments of child development are used within research settings to measure the effects of early intervention programs. However, the use of standardized assessments is not without limitations, including lack of sensitivity of some assessments to measure small or slow progress, testing constraints that may affect the child's performance, and the lack of information provided by the assessments that can be used to guide treatment planning. The utility of a curriculum-based assessment is discussed in comparison to the use of standardized assessments to measure child functioning and progress throughout an early intervention program for toddlers with risk for ASD. Scores derived from the curriculum-based assessment were positively correlated with standardized assessments, captured progress masked by standardized assessments, and early scores were predictive of later outcomes. These results support the use of a curriculum-based assessment as an additional and appropriate method for measuring child progress in an early intervention program. Further benefits of the use of curriculum-based measures for use within community settings are discussed.

Figures

Figure 1
Figure 1
aSLP scores for each participant over time. Each participant is depicted by one line. The aSLP was administered to each child at intake into the early intervention program and every 3 months thereafter. The aSLP score depicts the number of skills mastered at each assessment. Significant changes were seen in aSLP scores from intake to exit from the early intervention program.
Figure 2
Figure 2
Correlations between the aSLP scores and MSEL ELC and VABS ABC at intake and exit of the early intervention program. Correlation coefficients are reported for Pearson correlations and partial correlations controlling for the amount of time in intervention. Significant positive correlations were found between all measures.
Figure 3
Figure 3
Correlation between MSEL ELC change scores and aSLP change scores (i.e., change in scores from intake to exit). Correlation coefficients are reported for the Pearson correlation and partial correlation controlling for the amount of time each child was in treatment. A significant positive correlation was found. Children exhibited an average of 97 aSLP skills learned on average and an average change score of 8 on the MSEL ELC.
Figure 4
Figure 4
Correlation (controlling for the amount of time each child was in treatment) between VABS ABC change scores and aSLP change scores (i.e., change in scores from intake to exit). Correlation coefficients are reported for the Pearson correlation and partial correlation controlling for the amount of time each child was in treatment. A significant positive correlation was found. Children exhibited an average of 97 aSLP skills learned on average and an average change score of −1 on the VABS ABC.
Figure 5
Figure 5
A linear regression between aSLP scores at 3 months and exit. aSLP scores at 3 months into treatment significantly predicted aSLP scores when participants exited the program.

References

    1. Aldred C, Green J, Adams C. A new social communication intervention for children with autism: pilot randomised controlled treatment study suggesting effectiveness. Journal of Child Psychology and Psychiatry and Allied Disciplines. 2004;45(8):1420–1430.
    1. Ben-Itzchak E, Zachor DA. The effects of intellectual functioning and autism severity on outcome of early behavioral intervention for children with autism. Research in Developmental Disabilities. 2007;28(3):287–303.
    1. Charman T, Taylor E, Drew A, Cockerill H, Brown J-A, Baird G. Outcome at 7 years of children diagnosed with autism at age 2: predictive validity of assessments conducted at 2 and 3 years of age and pattern of symptom change over time. Journal of Child Psychology and Psychiatry and Allied Disciplines. 2005;46(5):500–513.
    1. Luyster R, Qiu S, Lopez K, Lord C. Predicting outcomes of children referred for autism using the MacArthur-Bates Communicative Development Inventory. Journal of Speech, Language, and Hearing Research. 2007;50(3):667–681.
    1. Rickards AL, Walstab JE, Wright-Rossi RA, Simpson J, Reddihough DS. One-year follow-up of the outcome of a randomized controlled trial of a home-based intervention programme for children with autism and developmental delay and their families. Child. 2009;35(5):593–602.
    1. Matson JL. Determining treatment outcome in early intervention programs for autism spectrum disorders: a critical analysis of measurement issues in learning based interventions. Research in Developmental Disabilities. 2007;28(2):207–218.
    1. Yoder P, Compton D. Identifying predictors of treatment response. Mental Retardation and Developmental Disabilities Research Reviews. 2004;10(3):162–168.
    1. Rapin I. Value and limitations of preschool cognitive tests, with an emphasis on longitudinal study of children on the autistic spectrum. Brain and Development. 2003;25(8):546–548.
    1. Akshoomoff N. Use of the Mullen Scales of Early Learning for the assessment of young children with Autism Spectrum Disorders. Child Neuropsychology. 2006;12(4-5):269–277.
    1. Akshoomoff N, Stahmer AC, Corsello C, Mahrer NE. What happens next? Follow-up from the children’s toddler school program. Journal of Positive Behavior Interventions. 2010;12(4):245–253.
    1. Rosenbaum P. Screening tests and standardized assessments used to identify and characterize developmental delays. Seminars in Pediatric Neurology. 1998;5(1):27–32.
    1. Stahmer AC, Carter C. An empirical examination of toddler development in inclusive childcare. Early Child Development and Care. 2005;175(4):321–333.
    1. Stahmer AC, Ingersoll B. Inclusive programming for toddlers with autism spectrum disorders: outcomes from the children’s toddler school. Journal of Positive Behavior Interventions. 2004;6(2):67–82.
    1. Kanne SM, Gerber AJ, Quirmbach LM, Sparrow SS, Cicchetti DV, Saulnier CA. The role of adaptive behavior in autism spectrum disorders: implications for functional outcome. Journal of Autism and Developmental Disorders. 2011;41(8):1007–1018.
    1. Koegel LK, Koegel RL, Smith A. Variables related to differences in standardized test outcomes for children with autism. Journal of Autism and Developmental Disorders. 1997;27(3):233–243.
    1. Kaufman AS. Practice effects. In: Sternberg R, editor. Encyclopedia of Human Intelligence. New York, NY, USA: Macmillan Publishing Company; 1994. pp. 828–833.
    1. Sattler JM. Assessment of Children, Jerome. 3rd edition. San Diego, Calif, USA: M. Sattler Publisher; 1986.
    1. Pierce K, Carter C, Weinfeld M, et al. Detecting, studying, and treating autism early: the one-year well-baby check-up approach. Journal of Pediatrics. 2011;159(3):458–465.
    1. Wetherby A, Prizant B. Communication and Symbolic Behavior Scales Developmental Profile. 1st edition. Baltimore, Md, USA: Paul H. Brookes; 2002.
    1. Lord C, Rutter M, DiLavore PC, Risi S. Autism Diagnostic Observation Schedule. Los Angeles, Calif, USA: Western Psychological Services; 1999.
    1. Arick J, Loos L, Falco R, Krug D. The Star Program: Strategies for Teaching Based on Autism Research. Austin, Tex, USA: Pro-Ed; 2004.
    1. Lovaas OI. Behavioral treatment and normal educational and intellectual functioning in young autistic children. Journal of Consulting and Clinical Psychology. 1987;55(1):3–9.
    1. Maurice C, Green G, Luce S. Behavioral Intervention For Young Children With Autism: A Manual For Parents and Professionals. Austin, Tex, USA: Pro-Ed; 1996.
    1. Smith T. Discrete trial training in the treatment of autism. Focus on Autism and Other Developmental Disabilities. 2001;16(2):86–92.
    1. Koegel RL, O’Dell MC, Koegel LK. A natural language teaching paradigm for nonverbal autistic children. Journal of Autism and Developmental Disorders. 1987;17(2):187–200.
    1. Koegel RL, Schreibman L, Good A, Cerniglia L, Murphy C, Koegel L. How to Teach Pivotal Behaviors to Children with Autism: A Training Manual. Santa Barbara, Calif, USA: University of California; 1989.
    1. Brown F, Evans IM, Weed KA, Owen V. Delineating functional competencies: component model. The Association for Persons with Severe Handicaps. 1987;12(2):117–124.
    1. McClannahan LE, Krantz PJ. Activity Schedules for Children With Autism: Teaching Independent Behavior. Bethesda, Md, USA: Woodbine House; 1999.
    1. Ingersoll B, Dvortcsak A. Teaching Social Communication to Children with Autism. New York, NY, USA: The Guildford Press; 2010.
    1. Mullen EM. Mullen Scales of Early Learning. Circle Pines, Minn, USA: American Guidance Service; 1995.
    1. Wechsler D. Wechsler Preschool and Primary Scale of Intelligence. 3rd edition. San Antonio, Tex, USA: Psychological Corporation; 2002.
    1. Sparrow SS, Cicchetti DV, Balla DA. Vineland Adaptive Behavior Scales. Circle Pines, Minn, USA: American Guidance Service; 1984.
    1. Matson JL, Konst MJ. What is the evidence for long term effects of early autism interventions? Research in Autism Spectrum Disorders. 2013;7(3):475–479.
    1. Bolte EE, Diehl JJ. Measurement tools and target symptoms/skills used to assess treatment response for individuals with autism spectrum disorder. Journal of Autism and Developmental Disorders. 2013;43(11):2491–2501.

Source: PubMed

3
Tilaa