Mental health among children and adolescents: Construct validity, reliability, and parent-adolescent agreement on the 'Strengths and Difficulties Questionnaire' in Chile

Jorge Gaete, Jesus Montero-Marin, Daniela Valenzuela, Cristian A Rojas-Barahona, Esterbina Olivares, Ricardo Araya, Jorge Gaete, Jesus Montero-Marin, Daniela Valenzuela, Cristian A Rojas-Barahona, Esterbina Olivares, Ricardo Araya

Abstract

The Strengths and Difficulties Questionnaire (SDQ) is a screening tool used to measure psychological functioning among children and adolescents. It has been extensively used worldwide, but its psychometric properties, such as internal structure and reliability, seem to vary across countries. This is the first study exploring the construct validity and reliability of the Spanish version of SDQ among early adolescents (self-reported) and their parents in Latin America. A total of 1,284 early adolescents (9-15 years) and their parents answered the SDQ. We also collected demographic variables. A confirmatory factor analysis was conducted to assess the latent structure of the SDQ. We also used the multitrait-multimethod analysis to separate the true variance on the constructs from variance resulting from measurement methods (self-report vs. parent report), and evaluated the agreement between adolescents and their parents. We found that the original five-factor model was a good solution and the resulting sub-scales had good internal consistency. We also found that the self-reported and parental versions of SDQ provide different information, which are complementary and provide a better picture of the emotional, social, and conduct problems of adolescents. We have added evidence for the construct validity and reliability of the Spanish self-reported and parental SDQ versions in a Chilean sample.

Conflict of interest statement

Competing Interests: The authors have declared that no competing interests exist.

Figures

Fig 1. Flow chart.
Fig 1. Flow chart.
Fig 2. CFA parameters of the SDQ…
Fig 2. CFA parameters of the SDQ for self- and parent- reports (n = 1,284).
Fig 3. Structural MTMM model of the…
Fig 3. Structural MTMM model of the SDQ for Chilean adolescents (n = 1,284) using CFA.

References

    1. Gore FM, Bloem PJN, Patton GC, Ferguson J, Joseph V, Coffey C, et al. Global burden of disease in young people aged 10–24 years: a systematic analysis. Lancet. 2011;377(9783):2093–102. 10.1016/S0140-6736(11)60512-6
    1. Costello DM, Swendsen J, Rose JS, Dierker LC. Risk and protective factors associated with trajectories of depressed mood from adolescence to early adulthood. J Consult Clin Psychol. 2008;76(2):173–83. 10.1037/0022-006X.76.2.173
    1. Vicente B, Saldivia S, de la Barra F, Kohn R, Pihan R, Valdivia M, et al. Prevalence of child and adolescent mental disorders in Chile: a community epidemiological study. J Child Psychol Psychiatry. 2012;53(10):1026–35. 10.1111/j.1469-7610.2012.02566.x .
    1. Vicente B, de la Barra F, Saldivia S, Kohn R, Rioseco P, Melipillan R. Prevalence of child and adolescent psychiatric disorders in Santiago, Chile: a community epidemiological study. Soc Psychiatry Psychiatr Epidemiol. 2012;47(7):1099–109. 10.1007/s00127-011-0415-3 .
    1. Costello EJ. Early detection and prevention of mental health problems: developmental epidemiology and systems of support. J Clin Child Adolesc Psychol. 2016;45(6):710–7. 10.1080/15374416.2016.1236728
    1. Hendren R, Birrell Weisen R, Orley JH, Organization WH. Mental health programmes in schools. 1994.
    1. Fisher J, Cabral dMM, Izutsu T, Vijayakumar L, Belfer M, Omigbodun O. Adolescent Mental Health in Resource-Constrained Settings: A review of the evidence of the nature, prevalence and determinants of common mental health problems and their management in primary health care. Int J Social Psychiatry. 2011;57(1 Suppl):v–vi, 9–116.
    1. World Health Organization. Caring for children and adolescents with mental disorders; setting WHO directions. Geneva: World Health Organization; 2003.
    1. Achenbach TM, Rescorla L. Manual for the ASEBA School-Age Forms & Profiles: An Integrated System of Multi-informant Assessment. Burlington: University of Vermont, Research Center for Children, Youth & Families; 2001.
    1. Warnick EM, Bracken MB, Kasl S. Screening efficiency of the child behavior checklist and strengths and difficulties questionnaire: A systematic review. Child Adolesc Ment Health. 2008;13(3):140–7. 10.1111/j.1475-3588.2007.00461.x
    1. Jellinek MS, Murphy JM, Robinson J, Feins A, Lamb S, Fenton T. Pediatric Symptom Checklist: Screening school-age children for psychosocial dysfunction. J Pediatr. 1988;112(2):201–9. 10.1016/S0022-3476(88)80056-8.
    1. Jellinek MS, Murphy JM, Burns BJ. Brief psychosocial screening in outpatient pediatric practice. J Pediatr. 1986;109(2):371–8. 10.1016/S0022-3476(86)80408-5.
    1. Goodman R. The Strengths and Difficulties Questionnaire: A research note. J Child Psychol Psychiatry. 1997;38(5):581–6. 10.1111/j.1469-7610.1997.tb01545.x
    1. Muris P, Meesters C, Eijkelenboom A, Vincken M. The self-report version of the Strengths and Difficulties Questionnaire: its psychometric properties in 8- to 13-year-old non-clinical children. Br J Clin Psychol. 2004;43(Pt 4):437–48. Epub 2004/11/09. 10.1348/0144665042388982
    1. Montenegro H, Bralic S, Edwards M, Izquierdo T, Maltes S. [School mental health: Standardization of the inventory of behavioural problems and social skills of T. Achenbach in children aged 6 to 11 years]. Santiago: CIDE; 1983. Spanish.
    1. Lecannelier F, Pérez Ewert JC, Groissman S, Gallardo D, Bardet AM, Bascuñan A, et al. Validation of child behavior inventory for children ages 1 1/2 to 5 years (CBCL 1 1/2-5) at the Santiago de Chile City. Universitas Psychologica. 2014;13(2):491–500.
    1. George M, Siraquian X, Mores R. [Adaptation and validation of two screening instruments of mental health of first grade school children of Santiago]. Revista de Psicología. 1995;5:17–25. Spanish.
    1. Guzman MP, Jellinek M, George M, Hartley M, Squicciarini AM, Canenguez KM, et al. Mental health matters in elementary school: first-grade screening predicts fourth grade achievement test scores. Eur Child Adolesc Psychiatry. 2011;20(8):401–11. 10.1007/s00787-011-0191-3
    1. Murphy JM, Guzmán J, McCarthy A, Squicciarini AM, George M, Canenguez K, et al. Mental health predicts better academic outcomes: A longitudinal study of elementary school students in Chile. Child psychiatry Hum Dev. 2015;46(2):245–56. 10.1007/s10578-014-0464-4
    1. Guzmán J, Kessler RC, Squicciarini AM, George M, Baer L, Canenguez KM, et al. Evidence for the effectiveness of a national school-based mental health program in Chile. J Am Acad Child Adolesc Psychiatry. 2015;54(10):799–807.e1. 10.1016/j.jaac.2015.07.005
    1. Halpern ME. [Early detection of psychopathology in vulnerable schoolchildren in the metropolitan region]. Santiago: University of Chile; 2011. Spanish.
    1. Goodman R, Ford T, Corbin T, Meltzer H. Using the Strengths and Difficulties Questionnaire (SDQ) multi-informant algorithm to screen looked-after children for psychiatric disorders. Eur Child Adolesc Psychiatry. 2004;13 Suppl 2:II25–31. 10.1007/s00787-004-2005-3 .
    1. Woerner W, Becker A, Rothenberger A. Normative data and scale properties of the German parent SDQ. Eur Child Adolesc Psychiatry. 2004;13(2):ii3–ii10. 10.1007/s00787-004-2002-6
    1. Klasen H, Woerner W, Rothenberger A, Goodman R. [German version of the Strength and Difficulties Questionnaire (SDQ-German)—overview and evaluation of initial validation and normative results]. Prax Kinderpsychol Kinderpsychiatr. 2003;52(7):491–502. German. .
    1. van Widenfelt BM, Goedhart AW, Treffers PD, Goodman R. Dutch version of the Strengths and Difficulties Questionnaire (SDQ). Eur Child Adolesc Psychiatry. 2003;12(6):281–9. 10.1007/s00787-003-0341-3 .
    1. Obel C, Heiervang E, Rodriguez A, Heyerdahl S, Smedje H, Sourander A, et al. The Strengths and Difficulties Questionnaire in the Nordic countries. Eur Child Adolesc Psychiatry. 2004;13 Suppl 2:Ii32–9. Epub 2004/07/10. 10.1007/s00787-004-2006-2 .
    1. Goodman A, Heiervang E, Fleitlich-Bilyk B, Alyahri A, Patel V, Mullick MS, et al. Cross-national differences in questionnaires do not necessarily reflect comparable differences in disorder prevalence. Soc Psychiatry Psychiatr Epidemiol. 2012;47(8):1321–31. 10.1007/s00127-011-0440-2 .
    1. van der Meer M, Dixon A, Rose D. Parent and child agreement on reports of problem behaviour obtained from a screening questionnaire, the SDQ. Eur Child Adolesc Psychiatry. 2008;17(8):491–7. 10.1007/s00787-008-0691-y
    1. Altendorfer-Kling U, Ardelt-Gattinger E, Thun-Hohenstein L. [The self-report version of the Strengths and Difficulties Questionnaire in an Austrian field sample]. Zeitschrift fur Kinder- und Jugendpsychiatrie und Psychotherapie. 2007;35(4):265–71. German. Epub 2007/11/01. .
    1. Almaqrami MH, Shuwail AY. Validity of the self-report version of the strengths and difficulties questionnaire in Yemen. Saudi Med J. 2004;25(5):592–601. Epub 2004/05/13. .
    1. Goodman R, Renfrew D, Mullick M. Predicting type of psychiatric disorder from Strengths and Difficulties Questionnaire (SDQ) scores in child mental health clinics in London and Dhaka. Eur Child Adolesc Psychiatry. 2000;9(2):129–34. .
    1. Liu SK, Chien YL, Shang CY, Lin CH, Liu YC, Gau SS. Psychometric properties of the Chinese version of Strength and Difficulties Questionnaire. Compr Psychiatry. 2013;54(6):720–30. Epub 2013/02/26. 10.1016/j.comppsych.2013.01.002 .
    1. Yao S, Zhang C, Zhu X, Jing X, McWhinnie CM, Abela JR. Measuring adolescent psychopathology: psychometric properties of the self-report strengths and difficulties questionnaire in a sample of Chinese adolescents. J Adolesc Health. 2009;45(1):55–62. Epub 2009/06/23. 10.1016/j.jadohealth.2008.11.006 .
    1. Marzocchi GM, Capron C, Di Pietro M, Duran Tauleria E, Duyme M, Frigerio A, et al. The use of the Strengths and Difficulties Questionnaire (SDQ) in Southern European countries. Eur Child Adolesc Psychiatry. 2004;13 Suppl 2:Ii40–6. Epub 2004/07/10. .
    1. Gomez-Beneyto M, Nolasco A, Moncho J, Pereyra-Zamora P, Tamayo-Fonseca N, Munarriz M, et al. Psychometric behaviour of the strengths and difficulties questionnaire (SDQ) in the Spanish national health survey 2006. BMC Psychiatry. 2013;13:95 10.1186/1471-244X-13-95 .
    1. Ortuno-Sierra J, Fonseca-Pedrero E, Paino M, Sastre i Riba S, Muniz J. Screening mental health problems during adolescence: psychometric properties of the Spanish version of the Strengths and Difficulties Questionnaire. J Adolesc. 2015;38:49–56. Epub 2014/12/03. 10.1016/j.adolescence.2014.11.001 .
    1. He JP, Burstein M, Schmitz A, Merikangas KR. The Strengths and Difficulties Questionnaire (SDQ): the factor structure and scale validation in U.S. adolescents. J Abnorm Child Psychol. 2013;41(4):583–95. Epub 2012/11/28. 10.1007/s10802-012-9696-6 .
    1. Tsang KLV, Wong PYH, Lo SK. Assessing psychosocial well-being of adolescents: a systematic review of measuring instruments. Child Care Health Dev. 2012;38(5):629–46. 10.1111/j.1365-2214.2011.01355.x
    1. Hoofs H, Jansen NWH, Mohren DCL, Jansen MWJ, Kant IJ. The Context Dependency of the Self-Report Version of the Strength and Difficulties Questionnaire (SDQ): A Cross-Sectional Study between Two Administration Settings. PLoS ONE. 2015;10(4):e0120930 10.1371/journal.pone.0120930
    1. Essau CA, Olaya B, Anastassiou-Hadjicharalambous X, Pauli G, Gilvarry C, Bray D, et al. Psychometric properties of the Strength and Difficulties Questionnaire from five European countries. Int J Methods Psychiatr Res. 2012;21(3):232–45. 10.1002/mpr.1364
    1. Dickey WC, Blumberg SJ. Revisiting the Factor Structure of the Strengths and Difficulties Questionnaire: United States, 2001. Journal of the American Academy of Child and Adolescent Psychiatry. 2004;43(9):1159–67. 10.1097/01.chi.0000132808.36708.a9.
    1. Ruchkin V, Koposov R, Schwab-Stone M. The strength and difficulties questionnaire: Scale validation with Russian adolescents. J Clin Psychol. 2007;63(9):861–9. 10.1002/jclp.20401
    1. Goodman A, Lamping DL, Ploubidis GB. When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the Strengths and Difficulties Questionnaire (SDQ): data from British parents, teachers and children. J Abnorm Child Psychol. 2010;38(8):1179–91. 10.1007/s10802-010-9434-x .
    1. Hill CR, Hughes JN. An examination of the convergent and discriminant validity of the strengths and difficulties questionnaire. Sch Psychol Q. 2007;22(3):380–406. 10.1037/1045-3830.22.3.380
    1. Van Roy B, Veenstra M, Clench-Aas J. Construct validity of the five-factor Strengths and Difficulties Questionnaire (SDQ) in pre-, early, and late adolescence. J Child Psychol Psychiatry. 2008;49(12):1304–12. Epub 2009/01/06. 10.1111/j.1469-7610.2008.01942.x .
    1. Gomez R. Correlated trait–correlated method minus one analysis of the convergent and discriminant validities of the Strengths and Difficulties Questionnaire. Assessment. 2014;21(3):372–82. 10.1177/1073191112457588
    1. Muris P, Meesters C, van den Berg F. The Strengths and Difficulties Questionnaire (SDQ)—further evidence for its reliability and validity in a community sample of Dutch children and adolescents. Eur Child Adolesc Psychiatry. 2003;12(1):1–8. Epub 2003/02/26. 10.1007/s00787-003-0298-2 .
    1. Goodman R. Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry. 2001;40(11):1337–45. Epub 2001/11/09. 10.1097/00004583-200111000-00015 .
    1. Ortuño-Sierra J, Chocarro E, Fonseca-Pedrero E, Riba SSi, Muñiz J. The assessment of emotional and behavioural problems: Internal structure of The Strengths and Difficulties Questionnaire. Int J Clin Health Psychol. 2015;15(3):265–73. 10.1016/j.ijchp.2015.05.005.
    1. Capron C, Thérond C, Duyme M. Psychometric properties of the French version of the self-report and teacher Strengths and Difficulties Questionnaire (SDQ). Eur J Psychol Assess. 2007;23(2):79–88. 10.1027/1015-5759.23.2.79
    1. Brown P, Capella C, Antivilo A. [Psychometric properties of the parent version of the Strengths and Difficulties Questionnaire]. Revista de Psicología. 2014;23(2):28–44. Spanish.
    1. Caqueo A, Urzua A, Ferrer R, Zuniga F, Palma C, Escudero J. [Strengths and difficulties in emotional adjustment of Aymara children from the perspective of children, parents and teachers]. Rev Chil Pediatr. 2014;85(5):561–8. Epub 2015/02/24. 10.4067/S0370-41062014000500006 .
    1. Gaete J, Rojas-Barahona CA, Olivares E, Araya R. Brief report: Association between psychological sense of school membership and mental health among early adolescents. J Adolesc. 2016;50:1–5. 10.1016/j.adolescence.2016.04.002 .
    1. Gaete J, Valenzuela D, Rojas-Barahona C, Valenzuela E, Araya R, Salmivalli C. The KiVa antibullying program in primary schools in Chile, with and without the digital game component: study protocol for a randomized controlled trial. Trials. 2017;18(1):75 10.1186/s13063-017-1810-1 .
    1. Goodman R, Ford T, Simmons H, Gatward R, Meltzer H. Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. Br J Psychiatry. 2000;177:534–9. .
    1. Goodman R. The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry. 1997;38(5):581–6. .
    1. Goodman R, Meltzer H, Bailey V. The Strengths and Difficulties Questionnaire: a pilot study on the validity of the self-report version. Eur Child Adolesc Psychiatry. 1998;7(3):125–30. Epub 1998/11/24. .
    1. Mardia KV. Applications of Some Measures of Multivariate Skewness and Kurtosis in Testing Normality and Robustness Studies. Sankhya. 1974;36(2):115–28.
    1. García E, Gil J, Rodríguez G. [Factorial analysis]. Madrid: La Muralla; 2000, Spanish.
    1. McDonald RP. Test theory: A unified treatment. Mahwah: Lawrence Erlbaum; 1999.
    1. Jöreskog K. Factor analysis by least-squares and maximum-likelihood methods In: Enslein K, Ralston A, Wilf HS, editors. Statistical methods for digital computers. New York: Wiley; 1977. p. 125–53.
    1. Briggs NE, MacCallum RC. Recovery of weak common factors by maximum likelihood and ordinary least squares estimation. Multivariate Behav Res. 2003;38(1):25–56. 10.1207/S15327906MBR3801_2 .
    1. Knol DL, Berger MP. Empirical comparison between factor analysis and multidimensional item response models. Multivariate Behav Res. 1991;26(3):457–77. 10.1207/s15327906mbr2603_5 .
    1. Lee CT, Zhang G, Edwards MC. Ordinary least squares estimation of parameters in exploratory factor analysis with ordinal data. Multivariate Behav Res. 2012;47(2):314–39. 10.1080/00273171.2012.658340 .
    1. Parry CDH, McArdle JJ. An applied comparison of methods for least- squares factor analysis of dichotomous variables. Appl Psychol Meas. 1991;15(1):35–46. 10.1177/014662169101500105
    1. Byrne BM. Structural equation modeling with Amos: Basic concepts, applications and programming. Mahwah: Erlbaum; 2001.
    1. Lévy JP, Martín MT, Román MV. [Optimization according to covariance structures In: Lévy JP, Varela J, editors. Modeling with covariance structures in the social sciences]. Coruña: Netbiblo; 2006. p. 21–2. Spanish.
    1. Lt Hu, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6(1):1–55. 10.1080/10705519909540118
    1. Marsh HW, Hocevar D. Confirmatory Factor Analysis of Multitrait-Multimethod Matrices. J Educ Meas. 1983;20(3):231–48.
    1. King G. The future of the replication movement. Int Stud Perspect. 2003;4(1):100–5.
    1. Russett B. The ‘Journal of Conflict Resolution′s’ policy on replication. Int Stud Perspect. 2003;4(1):88–9.
    1. Costello AB, Osborne JW. Best Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most From Your Analysis. Pract Assess Res Eval. 2005;10(7):1–9.
    1. van de Looij-Jansen PM, Goedhart AW, de Wilde EJ, Treffers PD. Confirmatory factor analysis and factorial invariance analysis of the adolescent self-report Strengths and Difficulties Questionnaire: how important are method effects and minor factors? Br J Clin Psychol. 2011;50(2):127–44. Epub 2011/05/07. 10.1348/014466510X498174 .
    1. Gaete J, Montero-Marin J, Rojas-Barahona CA, Olivares E, Araya R. Validation of the Spanish Version of the Psychological Sense of School Membership (PSSM) Scale in Chilean Adolescents and Its Association with School-Related Outcomes and Substance Use. Front Psychol. 2016;7:1901 10.3389/fpsyg.2016.01901 .
    1. Marsh HW. Positive and negative global self-esteem: a substantively meaningful distinction or artifactors? J Pers Soc Psychol. 1996;70(4):810–9. .
    1. Verhulst F, Dekker M, van der Ende J. Parent, teacher and self-reports as predictors of signs of disturbance in adolescents: whose information carries the most weight? Acta Psychiat Scand. 1997;96(1):75–81. 10.1111/j.1600-0447.1997.tb09909.x

Source: PubMed

Sponsorer og samarbeidspartnere

Medisinsk tilstand

Legemiddelintervensjoner

3
Abonnere