Psychometric evaluation of two short versions of the Revised Child Anxiety and Depression Scale

Leonie Klaufus, Eva Verlinden, Marcel van der Wal, Mia Kösters, Pim Cuijpers, Mai Chinapaw, Leonie Klaufus, Eva Verlinden, Marcel van der Wal, Mia Kösters, Pim Cuijpers, Mai Chinapaw

Abstract

Background: Anxiety and depression are common in children and adolescents, which can be detected via self-report questionnaires in non-clinical settings like the school environment. Two short versions of the Revised Child Anxiety and Depression Scale (i.e., RCADS-25 and RCADS-20) seem to be feasible for administering at schools. The present study evaluated the psychometric properties of the RCADS-25 and RCADS-20 used as screening instruments for anxiety and depression in a general population of schoolchildren and adolescents.

Methods: The RCADS-25 was completed by 69,487 schoolchildren and adolescents aged 8 to 18. The RCADS-25 and RCADS-20 broad anxiety scales are equal (15 items), but there are two versions of the major depressive disorder (MDD) scale: the RCADS-25 MDD scale (10 items) and the RCADS-20 MDD scale (5 items). The three scales were assessed on structural validity, internal consistency, test-retest reliability, criterion validity, and hypotheses for construct validity.

Results: The RCADS-25/RCADS-20 broad anxiety scale demonstrated a sufficient structural validity (CFI = 0.98, TLI = 0.99, RMSEA = 0.03, SRMR = 0.03), internal consistency (alpha = 0.82), test-retest reliability (ICC = 0.73), criterion validity (AUC = 0.79), and all four hypotheses concerning construct validity were confirmed. The RCADS-25 MDD scale demonstrated a sufficient test-retest reliability (ICC = 0.70) and three out of four hypotheses concerning construct validity were confirmed, but its structural validity was suspect (CFI = 0.89, TLI = 0.94, RMSEA = 0.09, SRMR = 0.06). The RCADS-20 MDD scale demonstrated a sufficient structural validity (CFI = 0.97, TLI = 0.97, RMSEA = 0.08, SRMR = 0.04) and internal consistency (alpha = 0.72). Two out of four hypotheses concerning construct validity were confirmed. The test-retest reliability (ICC = 0.60) was insufficient. Since both MDD scales showed shortcomings, the shortening of the RCADS-25 MDD scale was re-examined post hoc by principal component and reliability analyses. The result was an MDD scale with seven items.

Conclusions: The RCADS-25/RCADS-20 broad anxiety scale is valid and reliable for screening schoolchildren and adolescents, but the RCADS-25 and RCADS-20 MDD scales showed shortcomings. An MDD scale of seven items showed acceptable psychometric properties.

Keywords: Adolescent; Anxiety; Child; Depression; Psychometrics; Questionnaires; Screening.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Receiver operating characteristic curve for the RCADS-25/RCADS-20 broad anxiety scale RCADS = Revised Child Anxiety and Depression Scale

References

    1. Kessler RC, Avenevoli S, Costello EJ, Georgiades K, Green JG, Gruber MJ, et al. Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the National Comorbidity Survey Replication - adolescent supplement. Arch Gen Psychiatry. 2012;69:372–380. doi: 10.1001/archgenpsychiatry.2011.160.
    1. Verhulst FC, van der Ende J, Ferdinand RF, Kasius MC. The prevalence of DSM-III-R diagnoses in a national sample of Dutch adolescents. Arch Gen Psychiatry. 1997;54:329–336. doi: 10.1001/archpsyc.1997.01830160049008.
    1. Beesdo-Baum K, Knappe S. Developmental epidemiology of anxiety disorders. Child Adolesc Psychiatr Clin N Am. 2012;21:457–478. doi: 10.1016/j.chc.2012.05.001.
    1. Clayborne ZM, Varin M, Colman I. Systematic review and meta-analysis: adolescent depression and long-term psychosocial outcomes. J Am Acad Child Adolesc Psychiatry. 2019;58:72–79. doi: 10.1016/j.jaac.2018.07.896.
    1. Johnson D, Dupuis G, Piche J, Clayborne Z, Colman I. Adult mental health outcomes of adolescent depression: a systematic review. Depress Anxiety. 2018;35:700–716. doi: 10.1002/da.22777.
    1. Ormel J, Raven D, van Oort F, Hartman CA, Reijneveld SA, Veenstra R, et al. Mental health in Dutch adolescents: a TRAILS report on prevalence, severity, age of onset, continuity and co-morbidity of DSM disorders. Psychol Med. 2015;45:345–360. doi: 10.1017/S0033291714001469.
    1. National Research Council and Institute of Medicine of the National Academies . Preventing mental, emotional, and behavioral disorders among young people: progress and possibilities. Washington (DC): National Academies Press (US); 2009.
    1. Siu AL. Screening for depression in children and adolescents: US preventive services task force recommendation statement. Ann Intern Med. 2016;164:360–366. doi: 10.7326/M15-2957.
    1. Carnevale T. An integrative review of adolescent depression screening instruments: applicability for use by school nurses. J Child Adolesc Psychiatr Nurs. 2011;24:51–57. doi: 10.1111/j.1744-6171.2010.00256.x.
    1. Green JG, McLaughlin KA, Alegria M, Costello EJ, Gruber MJ, Hoagwood K, et al. School mental health resources and adolescent mental health service use. J Am Acad Child Adolesc Psychiatry. 2013;52:501–510. doi: 10.1016/j.jaac.2013.03.002.
    1. Chorpita BF, Yim L, Moffitt C, Umemoto LA, Francis SE. Assessment of symptoms of DSM-IV anxiety and depression in children: a revised child anxiety and depression scale. Behav Res Ther. 2000;38:835–855. doi: 10.1016/S0005-7967(99)00130-8.
    1. Muris P, Merckelbach H, Schmidt H, Mayer B. The revised version of the screen for child anxiety related emotional disorders (SCARED-R): factor structure in normal children. Personal Individ Differ. 1999;26:99–112. doi: 10.1016/S0191-8869(98)00130-5.
    1. Kovacs M. Rating scales to assess depression in school-aged children. Acta Paedopsychiatr. 1981;46:305–315.
    1. Ebesutani C, Reise SP, Chorpita BF, Ale C, Regan J, Young J, et al. The revised child anxiety and depression scale - short version: scale reduction via exploratory bifactor modeling of the broad anxiety factor. Psychol Assess. 2012;24:833–845. doi: 10.1037/a0027283.
    1. Skoczeń I, Rogoza R, Rogoza M, Ebesutani C, Chorpita B. Structure, reliability, measurement stability, and construct validity of the polish version of the revised child anxiety and depression scale. Assessment. 2017;26:1–12.
    1. Kösters MP, Chinapaw MJ, Zwaanswijk M, van der Wal MF, Koot HM. Structure, reliability, and validity of the revised child anxiety and depression scale (RCADS) in a multi-ethnic urban sample of Dutch children. BMC Psychiatry. 2015;15:132. doi: 10.1186/s12888-015-0509-7.
    1. Sandín B, Chorot P, Valiente RM, Chorpita BF. Development of a 30-item version of the Revised Child Anxiety and Depression Scale. 2010. pp. 165–178.
    1. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63:737–745. doi: 10.1016/j.jclinepi.2010.02.006.
    1. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19:539–549. doi: 10.1007/s11136-010-9606-8.
    1. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. doi: 10.1016/j.jclinepi.2006.03.012.
    1. UCLA Department of Psychology. Child F.I.R.S.T. - Focus on innovation and redesign in systems and treatment. . Accessed 6 Aug 2018.
    1. Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, et al. Schedule for affective disorders and schizophrenia for school-age children - present and lifetime version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry. 1997;36:980–988. doi: 10.1097/00004583-199707000-00021.
    1. Reichart C, Wals M, Hillegers M. Nederlandse vertaling en bewerking kiddie-SADS-lifetime versie (K-SADS-PL) (Dutch translation and adaptation kiddie-SADS-lifetime version [K-SADS-PL]) AZR-Sophia/Altrecht. 2001.
    1. Birmaher B, Brent DA, Chiappetta L, Bridge J, Monga S, Baugher M. Psychometric properties of the screen for child anxiety related emotional disorders (SCARED): a replication study. J Am Acad Child Adolesc Psychiatry. 1999;38:1230–1236. doi: 10.1097/00004583-199910000-00011.
    1. Birmaher B, Khetarpal S, Brent D, Cully M, Balach L, Kaufman J, et al. The screen for child anxiety related emotional disorders (SCARED): scale construction and psychometric characteristics. J Am Acad Child Adolesc Psychiatry. 1997;36:545–553. doi: 10.1097/00004583-199704000-00018.
    1. Bodden D, Braet C, Stikkelbroek Y. CDI-2 zelfrapportagelijst Nederlandse bewerking (CDI-2 self-report questionnaire Dutch adaptation). Amsterdam: Hogrefe Uitgevers; 2016.
    1. Kovacs M. Children’s depression inventory (CDI): manual. Toronto: Multi Health Systems Inc; 1992.
    1. Ulloa RE, Ortiz S, Higuera F, Nogales I, Fresán A, Apiquian R, et al. Interrater reliability of the Spanish version of schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL) Actas Esp Psiquiatr. 2006;34:36–40.
    1. Lauth B, Arnkelsson GB, Magnússon P, Skarphéðinsson GA, Ferrari P, Pétursson H. Validity of K-SADS-PL (schedule for affective disorders and schizophrenia for school-age children-present and lifetime version) depression diagnoses in an adolescent clinical population. Nord J Psychiatry. 2010;64:409–420. doi: 10.3109/08039481003777484.
    1. Villabø MA, Oerbeck B, Skirbekk B, Hansen BH, Kristensen H. Convergent and divergent validity of K-SADS-PL anxiety and attention deficit hyperactivity disorder diagnoses in a clinical sample of school-aged children. Nord J Psychiatry. 2016;70:358–364. doi: 10.3109/08039488.2015.1125944.
    1. Muris P, Merckelbach H, Van Brakel A, Mayer AB. The revised version of the screen for child anxiety related emotional disorders (SCARED-R): further evidence for its reliability and validity. Anxiety Stress Copin. 1999;12:411–425. doi: 10.1080/10615809908249319.
    1. Muris P, Merckelbach H, van Brakel A, Mayer B, van Dongen L. The screen for child anxiety related emotional disorders (SCARED): relationship with anxiety and depression in normal children. Pers Indiv Diff. 1998;24:451–456. doi: 10.1016/S0191-8869(97)00217-1.
    1. Muris P, Gadet B, Moulaert V, Merckelbach H. Correlations between two multidimensional anxiety scales for children. Percept Mot Skills. 1998;87:269–270. doi: 10.2466/pms.1998.87.1.269.
    1. Muris P, Merckelbach H, Mayer B, van Brakel A, Thissen S, Moulaert V, et al. The screen for child anxiety related emotional disorders and its relationship to traditional childhood anxiety measures. J Behav Ther Exp Psychiatry. 1998;29:327–339. doi: 10.1016/S0005-7916(98)00023-8.
    1. Bodden D, Braet C, Stikkelbroek Y. CDI-2 Screeningvragenlijst voor depressie bij kinderen en jongeren: handleiding (CDI-2 screening questionnaire for depression in children and young people: user guide) Amsterdam: Hogrefe Uitgevers; 2016.
    1. Statline. Bevolking; kerncijfers (Population: key figures). . Accessed 10 Jan 2018.
    1. COSMIN. COSMIN Taxonomy of Measurement Properties. . Accessed 25 Nov 2019.
    1. Reeve BB, Hays RD, Bjorner JB, Cook KF, Crane PK, Teresi JA, et al. Psychometric evaluation and calibration of health-related quality of life item banks: plans for the patient-reported outcomes measurement information system (PROMIS) Med Care. 2007;45(Suppl 1):S22–S31. doi: 10.1097/01.mlr.0000250483.85507.04.
    1. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6:1–55. doi: 10.1080/10705519909540118.
    1. MacCallum RC, Browne MW, Sugawara HM. Power analysis and determination of sample size for covariance structure modeling. Psychol Methods. 1996;1:130. doi: 10.1037/1082-989X.1.2.130.
    1. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107:238–246. doi: 10.1037/0033-2909.107.2.238.
    1. Reise SP, Moore TM, Haviland MG. Bifactor models and rotations: exploring the extent to which multidimensional data yield univocal scale scores. J Pers Assess. 2010;92:544–559. doi: 10.1080/00223891.2010.496477.
    1. Reise SP. Invited paper: the rediscovery of bifactor measurement models. Multivariate Behav Res. 2012;47:667–696. doi: 10.1080/00273171.2012.715555.
    1. Reise SP, Scheines R, Widaman KF, Haviland MG. Multidimensionality and structural coefficient bias in structural equation modeling: a bifactor perspective. Educ Psychol Meas. 2013;73:5–26. doi: 10.1177/0013164412449831.
    1. Beesdo K, Pine DS, Lieb R, Wittchen HU. Incidence and risk patterns of anxiety and depressive disorders and categorization of generalized anxiety disorder. Arch Gen Psychiatry. 2010;67:47–57. doi: 10.1001/archgenpsychiatry.2009.177.
    1. Mokkink LB, de Vet HCW, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, et al. COSMIN risk of Bias checklist for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27:1171–1179. doi: 10.1007/s11136-017-1765-4.
    1. Roelofs J, Braet C, Rood L, Timbremont B, van Vlierberghe L, Goossens L, et al. Norms and screening utility of the Dutch version of the Children's depression inventory in clinical and nonclinical youths. Psychol Assess. 2010;22:866–877. doi: 10.1037/a0020593.
    1. Stockings E, Degenhardt L, Lee YY, Mihalopoulos C, Liu A, Hobbs M, et al. Symptom screening scales for detecting major depressive disorder in children and adolescents: a systematic review and meta-analysis of reliability, validity and diagnostic utility. J Affect Disord. 2015;174:447–463. doi: 10.1016/j.jad.2014.11.061.
    1. McElroy E, Fearon P, Belsky J, Fonagy P, Patalay P. Networks of depression and anxiety symptoms across development. J Am Acad Child Adolesc Psychiatry. 2018;57:964–973. doi: 10.1016/j.jaac.2018.05.027.
    1. Brodbeck J, Abbott RA, Goodyer IM, Croudace TJ. General and specific components of depression and anxiety in an adolescent population. BMC Psychiatry. 2011;11:191. doi: 10.1186/1471-244X-11-191.
    1. Gudmundsen GR, Rhew IC, McCauley E, Kim J, Vander SA. Emergence of depressive symptoms from kindergarten to sixth grade. J Clin Child Adolesc Psychol. 2019;48:501–515. doi: 10.1080/15374416.2017.1410823.
    1. Bujang MA, Adnan TH. Requirements for minimum sample size for sensitivity and specificity analysis. J Clin Diagn Res. 2016;10:YE01–YYE6.

Source: PubMed

Sponsorit ja yhteistyökumppanit

Sairaudet

Huumeiden interventiot

3
Tilaa