The reliability of the twelve-item general health questionnaire (GHQ-12) under realistic assumptions

Matthew Hankins, Matthew Hankins

Abstract

Background: The twelve-item General Health Questionnaire (GHQ-12) was developed to screen for non-specific psychiatric morbidity. It has been widely validated and found to be reliable. These validation studies have assumed that the GHQ-12 is one-dimensional and free of response bias, but recent evidence suggests that neither of these assumptions may be correct, threatening its utility as a screening instrument. Further uncertainty arises because of the multiplicity of scoring methods of the GHQ-12. This study set out to establish the best fitting model for the GHQ-12 for three scoring methods (Likert, GHQ and C-GHQ) and to calculate the degree of measurement error under these more realistic assumptions.

Methods: GHQ-12 data were obtained from the Health Survey for England 2004 cohort (n = 3705). Structural equation modelling was used to assess the fit of [1] the one-dimensional model [2] the current 'best fit' three-dimensional model and [3] a one-dimensional model with response bias. Three different scoring methods were assessed for each model. The best fitting model was assessed for reliability, standard error of measurement and discrimination.

Results: The best fitting model was one-dimensional with response bias on the negatively phrased items, suggesting that previous GHQ-12 factor structures were artifacts of the analysis method. The reliability of this model was over-estimated by Cronbach's Alpha for all scoring methods: 0.90 (Likert method), 0.90 (GHQ method) and 0.75 (C-GHQ). More realistic estimates of reliability were 0.73, 0.87 and 0.53 (C-GHQ), respectively. Discrimination (Delta) also varied according to scoring method: 0.94 (Likert method), 0.63 (GHQ method) and 0.97 (C-GHQ method).

Conclusion: Conventional psychometric assessments using factor analysis and reliability estimates have obscured substantial measurement error in the GHQ-12 due to response bias on the negative items, which limits its utility as a screening instrument for psychiatric morbidity.

Figures

Figure 1
Figure 1
One dimension ("Psychological Distress") with correlated error terms on the negatively-phrased items.

References

    1. Goldberg DP, Williams P. A user's guide to the General Health Questionnaire. Basingstoke NFER-Nelson; 1988.
    1. Werneke U, Goldberg DP, Yalcin I, Ustun BT. The stability of the factor structure of the General Health Questionnaire. Psychological Medicine. 2000;30:823–9. doi: 10.1017/S0033291799002287.
    1. Hardy GE, Shapiro DA, Haynes CE, Rick JE. Validation of the General Health Questionnaire-12: Using a sample of employees from England's health care services. Psychological Assessment. 1999;11:159–165. doi: 10.1037/1040-3590.11.2.159.
    1. Gilbody S, Touse A, Sheldon T. Routinely administered questionnaires for depression and anxiety: systematic review. BMJ. 2001;332:406–9. doi: 10.1136/bmj.322.7283.406.
    1. Mitchell AA, Werler MM, Shapiro S. Analyses and reanalyses of epidemiologic data: Learning lessons and maintaining perspective. Teratology. 1994:167–168. doi: 10.1002/tera.1420490304.
    1. Guilford JP. Psychometric Methods. McGraw-Hill, New York; 1954.
    1. Martin CR, Newell RJ. Is the 12-item General Health Questionnaire (GHQ-12) confounded by scoring method in individuals with facial disfigurement? Psychology and Health. 2005;20:651–659. doi: 10.1080/14768320500060061.
    1. Shevlin M, Adamson G. Alternative Factor Models and Factorial Invariance of the GHQ-12: A Large Sample Analysis Using Confirmatory Factor Analysis. Psychological Assessment. 2005;17:231–236. doi: 10.1037/1040-3590.17.2.231.
    1. Graetz B. Multidimensional properties of the General Health Questionnaire. Social Psychiatry & Psychiatric Epidemiology. 1991:132–8. doi: 10.1007/BF00782952.
    1. Hankins M. The factor structure of the twelve item General Health Questionnaire (GHQ-12): the result of negative phrasing? Clinical Practice and Epidemiology in Mental Health. 2008;4:10. doi: 10.1186/1745-0179-4-10.
    1. Schmitt N, Stults DM. Factors defined by negatively keyed items: The result of careless respondents? Applied Psychological Measurement. 1985:367–373. doi: 10.1177/014662168500900405.
    1. Cordery JL, Sevastos PP. Responses to the original and revised job diagnostic survey: Is education a factor in responses to negatively worded items? Journal of Applied Psychology. 1993:141–143. doi: 10.1037/0021-9010.78.1.141.
    1. Mook J, Kleijn WC, Ploeg HM. Positively and negatively worded self-report measure of dispositional optimism. Psychological Reports. 1992:275–78. doi: 10.2466/PR0.71.5.275-278.
    1. Marsh HW. Positive and negative global self-esteem: A substantively meaningful distinction or artifactors? Journal of Personality and Social Psychology. 1996:810–819. doi: 10.1037/0022-3514.70.4.810.
    1. Rosenberg M. Society and the adolescent self-image. Princeton, NJ: Princeton University Press; 1965.
    1. Greenberger E, Chuansheng C, Dmitrieva J, Farruggia SP. Item-wording and the dimensionality of the Rosenberg Self-Esteem Scale: do they matter? Personality and Individual Differences. 2003:1241–1254. doi: 10.1016/S0191-8869(02)00331-8.
    1. Strathman A, Gleicher F, Boninger DS, Edwards CS. The consideration of future consequences – weighing immediate and distant outcomes of behavior. Journal of Personality and Social Psychology. 1994:742–752. doi: 10.1037/0022-3514.66.4.742.
    1. Crockett RA, Weinman J, Hankins M, Marteau T. Time orientation and health-related behaviour: measurement in general population samples. Psychology & Health. 2008. pp. 1–18. iFirst.
    1. Hankins M. Questionnaire discrimination: (re)-introducing coefficient Delta. BMC Medical Research Methodology. 2007;7:19. doi: 10.1186/1471-2288-7-19.
    1. Goodchild ME, Duncan-Jones P. Chronicity and the general health questionnaire. British Journal of Psychiatry. 1985:55–61. doi: 10.1192/bjp.146.1.55.
    1. Cronbach LJ. Coefficient Alpha and the internal structure of tests. Psychometrika. 1951:297–334. doi: 10.1007/BF02310555.
    1. Raykov T. Bias of coefficient Alpha for fixed congeneric measures with correlated errors. Applied Psychological Measurement. 2001:69–76. doi: 10.1177/01466216010251005.
    1. Raykov T. Estimation of congeneric scale reliability using covariance structure analysis with nonlinear constraints. British Journal of Mathematical and Statistical Psychology. 2001:315–323. doi: 10.1348/000711001159582.
    1. National Centre for Social Research and University College London . Department of Epidemiology and Public Health, Health Survey for England, 2004 [computer file] Colchester, Essex: UK Data Archive [distributor]; 2006. SN: 5439.
    1. Hankins M. How discriminating are discriminative instruments? Health & Quality of Life Outcomes. 2008.
    1. Byrne B. Structural Equation Modeling With AMOS: Basic Concepts, Applications, and Programming. Lawrence Erlbaum Associates; 2001.

Source: PubMed

Patrocinadores e Colaboradores

Condições médicas

Intervenções de drogas

3
Se inscrever