The Development of a New Test for Consecutive Assessment of Narrative Skills in Iranian School-Age Children

Saeide Beytollahi, Zahra Soleymani, Shohreh Jalaie, Saeide Beytollahi, Zahra Soleymani, Shohreh Jalaie

Abstract

Background: The assessment of narrative skills in young children is essential for early identification of potential learning and literacy-related difficulties. The present study aimed to develop a validated and reliable test for consecutive assessment of narrative skills in Iranian school-age children.

Methods: To elicit story retelling by the children, 14 pictures (each a discrete test) were developed based on which 14 stories were scripted in accordance with the Stein and Glenn model. The pictures were presented to 50 typically developing (TD) children and seven children with autism spectrum disorder (ASD) in Kerman, Iran, 2018. The recorded audio of retold stories by the children was transcribed and analyzed using the monitoring indicator of scholarly language (MISL) instrument. The SPSS software (Version: 18.0) was used to analyze the data with the significance level set at 0.05.

Results: A high correlation between the total MISL score of each test and each MISL item (r>0.5) confirmed the construct validity of our test. A comparison of the mean total MISL score between the TD and ASD groups showed significant differences (P<0.001) for all pictures. The internal consistency coefficient was >0.7 between all the MISL items and the intraclass correlation coefficient between the test and retest scores was >0.96 for all pictures. The repeated measures ANOVA did not indicate significant differences (P=0.15) between the total MISL scores of the pictures.

Conclusion: The validity and reliability of the developed test were confirmed, suggesting it can be used for consecutive assessment and monitoring of the narrative skills in school-aged children.

Keywords: Autism spectrum disorder; Language tests; Narration; Psychometrics.

Copyright: © Iranian Journal of Medical Sciences.

Figures

Figure 1
Figure 1
A sample of the 14 single-scene pictures that was illustrated.
Figure 2
Figure 2
The figure shows one of the pictures used in the exercise session.

References

    1. Spencer TD, Slocum TA. The effect of a narrative intervention on story retelling and personal story generation skills of preschoolers with risk factors and narrative language delays. Journal of Early Intervention. 2010;32:178–99. doi: 10.1177/1053815110379124.
    1. Costa GM, Rossi NF, Giacheti CM. Performance of Brazilian Portuguese speakers in the Test of Narrative Language (TNL) Codas. 2018;30:e20170148. doi: 10.1590/2317-1782/20182017148.
    1. Mehta PD, Foorman BR, Branum-Martin L, Taylor WP. Literacy as a unidimensional multilevel construct: Validation, sources of influence, and implications in a longitudinal study in grades 1 to 4. Scientific Studies of Reading. 2005;9:85–116.
    1. Pankratz ME, Plante E, Vance R, Insalaco DM. The diagnostic and predictive validity of the Renfrew Bus Story. Lang Speech Hear Serv Sch. 2007;38:390–9. doi: 10.1044/0161-1461(2007/040.
    1. Heilmann J, Miller JF, Nockerts A, Dunaway C. Properties of the narrative scoring scheme using narrative retells in young school-age children. Am J Speech Lang Pathol. 2010;19:154–66. doi: 10.1044/1058-0360(2009/08-0024).
    1. Petersen DB, Spencer TD. The narrative language measures: Tools for language screening, progress monitoring, and intervention planning. Perspectives on Language Learning and Education. 2012;19:119–29. doi: 10.1044/lle19.4.119.
    1. Ketelaars MP, Jansonius K, Cuperus J, Verhoeven L. Narrative competence in children with pragmatic language impairment: a longitudinal study. Int J Lang Commun Disord. 2016;51:162–73. doi: 10.1111/1460-6984.12195.
    1. Soodla P, Kikas E. Macrostructure in the narratives of Estonian children with typical development and language impairment. J Speech Lang Hear Res. 2010;53:1321–33. doi: 10.1044/1092-4388(2010/08-0113).
    1. Eisenberg SL, Ukrainetz TA, Hsu JR, Kaderavek JN, Justice LM, Gillam RB. Noun phrase elaboration in children’s spoken stories. Lang Speech Hear Serv Sch. 2008;39:145–57. doi: 10.1044/0161-1461(2008/014).
    1. Nippold MA. Later language development: School-age children, adolescents, and young adults. California: ERIC; 2016.
    1. Wong AM-Y, Kidd JC, Ho CS-H, Au TK-F. Characterizing the overlap between SLI and dyslexia in Chinese: The role of phonology and beyond. Scientific Studies of Reading. 2010;14:30–57. doi: 10.1080/10888430903242043.
    1. Gillam SL, Hartzheim D, Studenka B, Simonsmeier V, Gillam R. Narrative Intervention for Children With Autism Spectrum Disorder (ASD) J Speech Lang Hear Res. 2015;58:920–33. doi: 10.1044/2015_JSLHR-L-14-0295.
    1. Lok B, McNaught C, Young K. Criterion-referenced and norm-referenced assessments: compatibility and complementarity. Assessment & Evaluation in Higher Education. 2016;41:450–65. doi: 10.1080/02602938.2015.1022136.
    1. Reilly J, Losh M, Bellugi U, Wulfeck B. “Frog, where are you?” Narratives in children with specific language impairment, early focal brain injury, and Williams syndrome. Brain Lang. 2004;88:229–47. doi: 10.1016/S0093-934X(03)00101-9.
    1. Soleymani Z, Nematzadeh S, Tehrani LG, Rahgozar M, Schneider P. Language sample analysis: development of a valid language assessment tool and determining the reliability of outcome measures for Farsi-speaking children. European Journal of Developmental Psychology. 2016;13:275–91. doi: 10.1080/17405629.2016.1152175.
    1. Petersen DB, Gillam SL, Gillam RB. Emerging procedures in narrative assessment: The index of narrative complexity. Topics in language disorders. 2008;28:115–30. doi: 10.1097/01.TLD.0000318933.46925.86.
    1. Gillam SL, Gillam RB, Fargo JD, Olszewski A, Segura H. Monitoring indicators of scholarly language: A progress-monitoring instrument for measuring narrative discourse skills. Communication Disorders Quarterly. 2017;38:96–106. doi: 10.1177/1525740116651442.
    1. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. doi: 10.1016/j.jclinepi.2006.03.012.
    1. Grant R, Nozyce M. Proposed changes to the American Psychiatric Association diagnostic criteria for autism spectrum disorder: implications for young children and their families. Matern Child Health J. 2013;17:586–92. doi: 10.1007/s10995-013-1250-9.
    1. Ahmadi S, Hemmatian S, Khalili Z. Investigation of the psychometric features of the GARS (persion) . Research in Cognitive and Behavioral Journal. 2011;1:87–104.
    1. Samadi SA, Mahmoodizadeh A, McConkey R. A national study of the prevalence of autism among five-year-old children in Iran. Autism. 2012;16:5–14. doi: 10.1177/1362361311407091.
    1. Razavieh A, Shahim S. Retest reliability of the Wechsler Preschool and Primary Scale of Intelligence restandardized in Iran. Psychol Rep. 1990;66:865–6. doi: 10.2466/pr0.1990.66.3.865.
    1. Shurman J, Leone D. Standardized Versus Naturalized: An Evaluation of Child Morphological and Syntactic Assessments. International Journal of Undergraduate Research and Creative Activities. 2015;7:6. doi: 10.7710/2168-0620.1064.
    1. Tang W, Hu J, Zhang H, Wu P, He H. Kappa coefficient: a popular measure of rater agreement. Shanghai Arch Psychiatry. 2015;27:62–7. doi: 10.11919/j.issn.1002-0829.215010. [ ]
    1. Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the academy of marketing science. 2015;43:115–35. doi: 10.1007/s11747-014-0403-8.
    1. Eigsti I-M, de Marchena AB, Schuh JM, Kelley E. Language acquisition in autism spectrum disorders: A developmental review. Research in Autism Spectrum Disorders. 2011;5:681–91. doi: 10.1016/j.rasd.2010.09.001.
    1. Cho E, Kim S. Cronbach’s coefficient alpha: Well known but poorly understood. Organizational Research Methods. 2015;18:207–30. doi: 10.1177/1094428114555994.
    1. Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19:231–40. doi: 10.1519/15184.1.
    1. Landis JR, Koch GG. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics. 1977;33:363–74. doi: 10.2307/2529786.
    1. Westby C, Culatta B. Telling Tales: Personal Event Narratives and Life Stories. Lang Speech Hear Serv Sch. 2016;47:260–82. doi: 10.1044/2016_LSHSS-15-0073.
    1. Siller M, Swanson MR, Serlin G, George A. Internal State Language in the Storybook Narratives of Children with and without Autism Spectrum Disorder: Investigating Relations to Theory of Mind Abilities. Res Autism Spectr Disord. 2014;8:589–96. doi: 10.1016/j.rasd.2014.02.002. [ ]
    1. Stockman IJ. The promises and pitfalls of language sample analysis as an assessment tool for linguistic minority children. Language, Speech, and Hearing Services in Schools. 1996;27:355–66. doi: 10.1044/0161-1461.2704.355.

Source: PubMed

スポンサーと協力者

医学的状態

薬物療法

3
購読する