Measurement invariance testing of the PHQ-9 in a multi-ethnic population in Europe: the HELIUS study

Henrike Galenkamp, Karien Stronks, Marieke B Snijder, Eske M Derks, Henrike Galenkamp, Karien Stronks, Marieke B Snijder, Eske M Derks

Abstract

Background: In Western European countries, the prevalence of depressive symptoms is higher among ethnic minority groups, compared to the host population. We explored whether these inequalities reflect variance in the way depressive symptoms are measured, by investigating whether items of the PHQ-9 measure the same underlying construct in six ethnic groups in the Netherlands.

Methods: A total of 23,182 men and women aged 18-70 of Dutch, South-Asian Surinamese, African Surinamese, Ghanaian, Turkish or Moroccan origin were included in the HELIUS study and had answered to at least one of the PHQ-9 items. We conducted multiple group confirmatory factor analyses (MGCFA), with increasingly stringent model constraints (i.e. assessing Configural, Metric, Strong and Strict measurement invariance (MI)), and regression analysis, to confirm comparability of PHQ-9 items across ethnic groups.

Results: A one-factor model, where all nine items reflect a single underlying construct, showed acceptable model fit and was used for MI testing. In each subsequent step, change in goodness-of-fit measures did not exceed 0.015 (RMSEA) or 0.01 (CFI). Moreover, strict invariance models showed good or acceptable model fit (Men: RMSEA = 0.050; CFI = 0.985; Women: RMSEA = 0.058; CFI = 0.979), indicating between-group equality of item clusters, factor loadings, item thresholds and residual variances. Finally, regression analysis did not indicate potential ethnicity-related differential item functioning (DIF) of the PHQ-9.

Conclusions: This study provides evidence of measurement invariance of the PHQ-9 regarding ethnicity, implying that the observed inequalities in depressive symptoms cannot be attributed to DIF.

Keywords: Confirmatory factor analysis; Depressive symptoms; Differential item functioning; HELIUS study; Measurement invariance; PHQ-9.

Conflict of interest statement

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

    1. Ferrari AJ, Charlson FJ, Norman RE, Patten SB, Freedman G, Murray CJL, Vos T, Whiteford HA. Burden of depressive disorders by country, sex, age, and year: findings from the global burden of disease study 2010. PLoS Med. 2013;10(11):e1001547. doi: 10.1371/journal.pmed.1001547.
    1. Lorant V, Deliège D, Eaton W, Robert A, Philippot P, Ansseau M. Socioeconomic inequalities in depression: a meta-analysis. Am J Epidemiol. 2003;157(2):98–112. doi: 10.1093/aje/kwf182.
    1. Fryers T, Melzer D, Jenkins R. Social inequalities and the common mental disorders. Soc Psychiatry Psychiatr Epidemiol. 2003;38(5):229–237. doi: 10.1007/s00127-003-0627-2.
    1. Tinghög P, Hemmingsson T, Lundberg I. To what extent may the association between immigrant status and mental illness be explained by socioeconomic factors? Soc Psychiatry Psychiatr Epidemiol. 2007;42(12):990–996. doi: 10.1007/s00127-007-0253-5.
    1. de Wit MAS, Tuinebreijer WC, Dekker J, Beekman A-JTF, Gorissen WHM, Schrier AC, Penninx BWJH, Komproe IH, Verhoeff AP. Depressive and anxiety disorders in different ethnic groups. Soc Psychiatry Psychiatr Epidemiol. 2008;43(11):905–912. doi: 10.1007/s00127-008-0382-5.
    1. Missinne S, Bracke P. Depressive symptoms among immigrants and ethnic minorities: a population based study in 23 European countries. Soc Psychiatry Psychiatr Epidemiol. 2012;47(1):97–109. doi: 10.1007/s00127-010-0321-0.
    1. Levecque K, Lodewyckx I, Vranken J. Depression and generalised anxiety in the general population in Belgium: a comparison between native and immigrant groups. J Affect Disord. 2007;97(1):229–239. doi: 10.1016/j.jad.2006.06.022.
    1. Rechel B, Mladovsky P, Ingleby D, Mackenbach JP, McKee M. Migration and health in an increasingly diverse Europe. Lancet. 2013;381(9873):1235–1245. doi: 10.1016/S0140-6736(12)62086-8.
    1. Ikram UZ, Snijder MB, Fassaert TJL, Schene AH, Kunst AE, Stronks K. The contribution of perceived ethnic discrimination to the prevalence of depression. The European Journal of Public Health. 2015;25(2):243–248. doi: 10.1093/eurpub/cku180.
    1. Bhugra D. Migration and mental health. Acta Psychiatr Scand. 2004;109(4):243–258. doi: 10.1046/j.0001-690X.2003.00246.x.
    1. Bhugra D. Migration and depression. Acta Psychiatr Scand. 2003;108:67–72. doi: 10.1034/j.1600-0447.108.s418.14.x.
    1. Agyemang C, Denktas S, Bruijnzeels M, Foets M. Validity of the single-item question on self-rated health status in first generation Turkish and Moroccans versus native Dutch in the Netherlands. Public Health. 2006;120(6):543–550. doi: 10.1016/j.puhe.2006.03.002.
    1. Van der Wurff F, Beekman A, Dijkshoorn H, Spijker J, Smits C, Stek M, Verhoeff A. Prevalence and risk-factors for depression in elderly Turkish and Moroccan migrants in the Netherlands. J Affect Disord. 2004;83(1):33–41. doi: 10.1016/j.jad.2004.04.009.
    1. Kleinman A, Good B. Culture and depression. N Engl J Med. 2004;351:951–952. doi: 10.1056/NEJMp048078.
    1. Spijker J, van der Wurff FB, Poort EC, Smits CHM, Verhoeff AP, Beekman ATF. Depression in first generation labour migrants in Western Europe: the utility of the Center for Epidemiologic Studies Depression Scale (CES-D) International Journal of Geriatric Psychiatry. 2004;19(6):538–544. doi: 10.1002/gps.1122.
    1. Kirmayer LJ. Cultural variations in the clinical presentation of depression and anxiety: implications for diagnosis and treatment. J Clin Psychiatry. 2001;62:22–30.
    1. Simon GE, Goldberg DP, Von Korff M, Üstun TB. Understanding cross-national differences in depression prevalence. Psychol Med. 2002;32(04):585–594. doi: 10.1017/S0033291702005457.
    1. Simon GE, VonKorff M, Piccinelli M, Fullerton C, Ormel J. An international study of the relation between somatic symptoms and depression. N Engl J Med. 1999;341(18):1329–1335. doi: 10.1056/NEJM199910283411801.
    1. Groenvold M, Bjorner JB, Klee MC, Kreiner S. Test for item bias in a quality of life questionnaire. J Clin Epidemiol. 1995;48(6):805–816. doi: 10.1016/0895-4356(94)00195-V.
    1. Gregorich SE. Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Med Care. 2006;44(11 Suppl 3):S78. doi: 10.1097/01.mlr.0000245454.12228.8f.
    1. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9. J Gen Intern Med. 2001;16(9):606–613. doi: 10.1046/j.1525-1497.2001.016009606.x.
    1. Wittkampf KA, Naeije L, Schene AH, Huyser J, van Weert HC. Diagnostic accuracy of the mood module of the patient health questionnaire: a systematic review. Gen Hosp Psychiatry. 2007;29(5):388–395. doi: 10.1016/j.genhosppsych.2007.06.004.
    1. Kroenke K, Spitzer RL, Williams JB, Löwe B. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32(4):345–359. doi: 10.1016/j.genhosppsych.2010.03.006.
    1. Teresi JA, Ramirez M, Lai J-S, Silver S. Occurrences and sources of differential item functioning (DIF) in patient-reported outcome measures: description of DIF methods, and review of measures of depression, quality of life and general health. Psychol Sci Q. 2008;50(4):538–8.
    1. Hirsch O, Donner-Banzhoff N, Bachmann V. Measurement equivalence of four psychological questionnaires in native-born Germans, Russian-speaking immigrants, and native-born Russians. J Transcult Nurs. 2013;24(3):225–235. doi: 10.1177/1043659613482003.
    1. Baas KD, Cramer AO, Koeter MW, van de Lisdonk EH, van Weert HC, Schene AH. Measurement invariance with respect to ethnicity of the patient health Questionnaire-9 (PHQ-9) J Affect Disord. 2011;129(1):229–235. doi: 10.1016/j.jad.2010.08.026.
    1. Kessler RC, McGonagle KA, Swartz M, Blazer DG, Nelson CB. Sex and depression in the National Comorbidity Survey I: lifetime prevalence, chronicity and recurrence. J Affect Disord. 1993;29(2–3):85–96. doi: 10.1016/0165-0327(93)90026-G.
    1. Nolen-Hoeksema S, Larson J, Grayson C. Explaining the gender difference in depressive symptoms. J Pers Soc Psychol. 1999;77(5):1061. doi: 10.1037/0022-3514.77.5.1061.
    1. Snijder MB, Galenkamp H, Prins M, Derks EM, Peters RJ, Zwinderman AH, Stronks K. Cohort Profile: the Healthy Life in an Urban Setting (HELIUS) study in Amsterdam, the Netherlands. BMJ Open. 2017. in press.
    1. Stronks K, Snijder MB, Peters RJ, Prins M, Schene AH, Zwinderman AH. Unravelling the impact of ethnicity on health in Europe: the HELIUS study. BMC Public Health. 2013;13(1):1–10. doi: 10.1186/1471-2458-13-402.
    1. Stronks K, Kulu-Glasgow I, Agyemang C. The utility of ‘country of birth’ for the classification of ethnic groups in health research: the Dutch experience. Ethnicity & Health. 2009;14(3):255–269. doi: 10.1080/13557850802509206.
    1. Crane P, Gibbons L, Willig J, Mugavero M, Lawrence S, Schumacher J, Saag M, Kitahata M, Crane H. Measuring depression levels in HIV-infected patients as part of routine clinical care using the nine-item patient health questionnaire (PHQ-9) AIDS Care. 2010;22(7):874–885. doi: 10.1080/09540120903483034.
    1. Huang FY, Chung H, Kroenke K, Delucchi KL, Spitzer RL. Using the patient health questionnaire-9 to measure depression among racially and ethnically diverse primary care patients. J Gen Intern Med. 2006;21(6):547–552. doi: 10.1111/j.1525-1497.2006.00409.x.
    1. Forkmann T, Gauggel S, Spangenberg L, Brähler E, Glaesmer H. Dimensional assessment of depressive severity in the elderly general population: psychometric evaluation of the PHQ-9 using Rasch analysis. J Affect Disord. 2013;148(2):323–330. doi: 10.1016/j.jad.2012.12.019.
    1. Kendel F, Wirtz M, Dunkel A, Lehmkuhl E, Hetzer R, Regitz-Zagrosek V. Screening for depression: Rasch analysis of the dimensional structure of the PHQ-9 and the HADS-D. J Affect Disord. 2010;122(3):241–246. doi: 10.1016/j.jad.2009.07.004.
    1. Beard C, Hsu K, Rifkin L, Busch A, Björgvinsson T. Validation of the PHQ-9 in a psychiatric sample. J Affect Disord. 2016;193:267–273. doi: 10.1016/j.jad.2015.12.075.
    1. Elhai JD, Contractor AA, Tamburrino M, Fine TH, Prescott MR, Shirley E, Chan PK, Slembarski R, Liberzon I, Galea S. The factor structure of major depression symptoms: a test of four competing models using the patient health Questionnaire-9. Psychiatry Res. 2012;199(3):169–173. doi: 10.1016/j.psychres.2012.05.018.
    1. Muthén LKM, B. O. Mplus User’s guide. Seventh edition. In. Muthén & Muthén: Los Angeles, CA; 1998.
    1. Muthén B, Asparouhov T. Latent variable analysis with categorical outcomes: multiple-group and growth modeling in Mplus. Mplus web notes. 2002;4(5):1–22.
    1. Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model. 2007;14(3):464–504. doi: 10.1080/10705510701301834.
    1. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. 2002;9(2):233–255. doi: 10.1207/S15328007SEM0902_5.
    1. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55. doi: 10.1080/10705519909540118.
    1. Fan X, Sivo SA. Sensitivity of fit indices to model misspecification and model types. Multivar Behav Res. 2007;42(3):509–529. doi: 10.1080/00273170701382864.
    1. Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods of psychological research online. 2003;8(2):23–74.
    1. Meade AW, Johnson EC, Braddy PW. Power and sensitivity of alternative fit indices in tests of measurement invariance. J Appl Psychol. 2008;93(3):568. doi: 10.1037/0021-9010.93.3.568.
    1. Bjorner JB, Kosinski M, Ware JE., Jr Calibration of an item pool for assessing the burden of headaches: an application of item response theory to the headache impact test (HIT™) Qual Life Res. 2003;12(8):913–933. doi: 10.1023/A:1026163113446.
    1. Cohen J. Statistical power analysis for the behavioral sciences. 2. New Jersey: Lawrence Erlbaum Associates; 1988.
    1. Schrier AC, de Wit MAS, Rijmen F, Tuinebreijer WC, Verhoeff AP, Kupka RW, Dekker J, Beekman ATF. Similarity in depressive symptom profile in a population-based study of migrants in the Netherlands. Soc Psychiatry Psychiatr Epidemiol. 2010;45(10):941–951. doi: 10.1007/s00127-009-0135-0.
    1. Stark S, Chernyshenko OS, Drasgow F. Detecting differential item functioning with confirmatory factor analysis and item response theory: toward a unified strategy. J Appl Psychol. 2006;91(6):1292. doi: 10.1037/0021-9010.91.6.1292.
    1. Swinnen SGHA, Selten J-P. Mood disorders and migration. Meta-analysis. 2007;190(1):6–10.
    1. Hepner KA, Morales LS, Hays RD, Edelen MO, Miranda J. Evaluating differential item functioning of the PRIME-MD mood module among impoverished black and white women in primary care. Womens Health Issues. 2008;18(1):53–61. doi: 10.1016/j.whi.2007.10.001.

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe