Comparing CESD-10, PHQ-9, and PROMIS depression instruments in individuals with multiple sclerosis

Dagmar Amtmann, Jiseon Kim, Hyewon Chung, Alyssa M Bamer, Robert L Askew, Salene Wu, Karon F Cook, Kurt L Johnson, Dagmar Amtmann, Jiseon Kim, Hyewon Chung, Alyssa M Bamer, Robert L Askew, Salene Wu, Karon F Cook, Kurt L Johnson

Abstract

Purpose: This study evaluated psychometric properties of the Patient Health Questionnaire-9 (PHQ-9), the Center for Epidemiological Studies Depression Scale-10 (CESD-10), and the 8-item PROMIS Depression Short Form (PROMIS-D-8; 8b short form) in a sample of individuals living with multiple sclerosis (MS).

Research method: Data were collected by a self-reported mailed survey of a community sample of people living with MS (n = 455). Factor structure, interitem reliability, convergent/discriminant validity and assignment to categories of depression severity were examined.

Results: A 1-factor, confirmatory factor analytic model had adequate fit for all instruments. Scores on the depression scales were more highly correlated with one another than with scores on measures of pain, sleep disturbance, and fatigue. The CESD-10 categorized about 37% of participants as having significant depressive symptoms. At least moderate depression was indicated for 24% of participants by PHQ-9. PROMIS-D-8 identified 19% of participants as having at least moderate depressive symptoms and about 7% having at least moderately severe depression. None of the examined scales had ceiling effects, but the PROMIS-D-8 had a floor effect.

Conclusions: Overall, scores on all 3 scales demonstrated essential unidimensionality and had acceptable interitem reliability and convergent/discriminant validity. Researchers and clinicians can choose any of these scales to measure depressive symptoms in individuals living with MS. The PHQ-9 offers validated cutoff scores for diagnosing clinical depression. The PROMIS-D-8 measure minimizes the impact of somatic features on the assessment of depression and allows for flexible administration, including Computerize Adaptive Testing (CAT). The CESD-10 measures 2 aspects of depression, depressed mood and lack of positive affect, while still providing an interpretable total score.

(c) 2014 APA, all rights reserved.

References

    1. Aikens JE, Reinecke MA, Pliskin NH, Fischer JS, Wiebe JS, McCracken LM, Taylor JL. Assessing depressive symptoms in multiple sclerosis: is it necessary to omit items from the original Beck Depression Inventory? Journal of Behavioral Medicine. 1999;22(2):127–142.
    1. American Psychiatric Association . Diagnostic and statistical manual of mental disorders: DSM-IV-TR. 4th ed., text revision ed. American Psychiatric Association; Washington, DC: 2000.
    1. Amtmann D, Cook KF, Jensen MP, Chen WH, Choi S, Revicki D, Lai JS. Development of a PROMIS item bank to measure pain interference. [Research Support, N.I.H., Extramural Validation Studies]. Pain. 2010;150(1):173–182. doi: 10.1016/j.pain.2010.04.025.
    1. Amtmann D, Bamer AM, Noonan V, Lang N, Kim J, Cook KF. Comparison of the psychometric properties of two fatigue scales in multiple sclerosis. Rehabilitaiton Psychology. 2012;57(2):159–166. doi: 10.1037/a0027890.
    1. Andresen EM, Malmgren JA, Carter WB, Patrick DL. Screening for depression in well older adults: evaluation of a short form of the CES-D (Center for Epidemiologic Studies Depression Scale). American Journal of Preventive Medicine. 1994;10(2):77–84.
    1. Bamer AM, Johnson KL, Amtmann DA, Kraft GH. Beyond fatigue: Assessing variables associated with sleep problems and use of sleep medications in multiple sclerosis. Clinical Epidemiolology. 2010;2010(2):99–106. doi: 10.2147/CLEP.S10425.
    1. Bamer AM, Cetin K, Amtmann D, Bowen JD, Johnson KL. Comparing a self report questionnaire with physician assessment for determining multiple sclerosis clinical disease course: a validation study. Multiple Sclerosis. 2007;13(8):1033–7.
    1. Bentler PM. Multivariate analysis with latent variables: Causal modeling. Annual Review of Psychology. 1980;31(1):419–456. doi: 10.1146/annurev.ps.31.020180.002223.
    1. Bishop M, Frain MP. The Multiple Sclerosis Self-Management Scale: Revision and psychometric analysis. Rehabilitation Psychology. 2011;56(2):150–159. doi: 2011-09991-010.
    1. Bombardier CH, Richards JS, Krause JS, Tulsky D, Tate DG. Symptoms of major depression in people with spinal cord injury: implications for screening. Archives of Physical Medicine and Rehabilitation. 2004;85(11):1749–1756. doi: S0003999304010846.
    1. Bowen J, Gibbons L, Gianas A, Kraft GH. Self-administered Expanded Disability Status Scale with functional system scores correlates well with a physician-administered test. Multiple Sclerosis. 2001;7(3):201–206.
    1. Browne MW, Cudeck R. Alternative Ways of Assessing Model Fit. In: Bollen KA, Long S, editors. Testing Structural Equation Models. Sage Publications; Newbury Park, CA: 1993.
    1. Byrne BM. Structural equation modeling with LISREL, PRELIS, and SIMPLIS. Lawrence Erlbaum; Hillsdale, NJ: 1998.
    1. Cameron IM, Crawford JR, Lawton K, Reid IC. Psychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care. British Journal of General Practice. 2008;58(546):32–36. doi: 10.3399/bjgp08X263794.
    1. Cavanaugh S. Depression in the medically ill: Critical issues in diagnostic assessment. Psychosomatics. 1995;36:48–59. doi:10.1016/S0033-3182(95)71707-8.
    1. Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, Hays R. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. Journal of Clinical Epidemiology. 2010;63(11):1179–1194. doi: 10.1016/j.jclinepi.2010.04.011.
    1. Cheng ST, Chan AC, Fung HH. Factorial structure of a short version of the Center for Epidemiologic Studies Depression Scale. International Journal of Geriatric Psychiatry. 2006;21(4):333–336. doi: 10.1002/gps.1467.
    1. Chiaravalloti ND, Deluca J. Self-generation as a means of maximizing learning in multiple sclerosis: an application of the generation effect. Archives Physical Medicine and Rehabilitation. 2002;83(8):1070–1079. doi: 10.1053/apmr.2002.33729.
    1. Choi SW, Podrabsky T, McKinney N, Schalet BD, Cook KF, Cella D. PROSetta Stone® Analysis Report: a Rosetta Stone for Patient Reported Outcomes. 2012;1 Retrived from .
    1. Choi SW, Reise SP, Pilkonis PA, Hays RD, Cella D. Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Quality of Life Research. 2010;19(1):125–136. doi: 10.1007/s11136-009-9560-5.
    1. Chwastiak L, Ehde DM, Gibbons LE, Sullivan M, Bowen JD, Kraft GH. Depressive symptoms and severity of illness in multiple sclerosis: epidemiologic study of a large community sample. American Journal of Psychiatry. 2002;159(11):1862–1868. doi:10.1176/appi.ajp.159.11.1862.
    1. Cole JC, Rabin AS, Smith TL, Kaufman AS. Development and validation of a Rasch-derived CES-D short form. Psychological Assessment. 2004;16(4):360–372. doi: 2004-21195-003.
    1. Conway D, Cohen JA. Emerging oral therapies in multiple sclerosis. Current Neurology and Neuroscience Reports. 2010;10(5):381–388. doi: 10.1007/s11910-010-0125-3.
    1. Conway DS, Miller DM, O'Brien RG, Cohen JA. Long term benefit of multiple sclerosis treatment: an investigation using a novel data collection technique. Multiple Sclerosis. 2012;18(11):1617–1624. doi: 10.1177/1352458512449681.
    1. Cook KF, Bamer AM, Amtmann D, Molton IR, Jensen MP. Six patient-reported outcome measurement information system short form measures have negligible age- or diagnosis-related differential item functioning in individuals with disabilities. Archives of Physical Medicine and Rehabilitation. 2012;93(7):1289–1291. doi: 10.1016/j.apmr.2011.11.022.
    1. Crane PK, Gibbons LE, Willig JH, Mugavero MJ, Lawrence ST, Schumacher JE, Crane HM. Measuring depression levels in HIV-infected patients as part of routine clinical care using the nine-item Patient Health Questionnaire (PHQ-9). AIDS Care. 2010;22(7):874–885. doi: 10.1080/09540120903483034.
    1. de Bonis M, Lebeaux MO, de Boeck P, Simon M, Pichot P. Measuring the severity of depression through a self-report inventory. A comparison of logistic, factorial and implicit models. Journal of Affective Disord. 1991;22(1-2):55–64. doi:10.1016/01650327(91)90084-6.
    1. Dum M, Pickren J, Sobell LC, Sobell MB. Comparing the BDI-II and the PHQ-9 with outpatient substance abusers. Addictive Behaviors. 2008;33(2):381–387. doi: 10.1016/j.addbeh.2007.09.017.
    1. Endicott J. Measurement of depression in patients with cancer. Cancer. 1984;53(10 Suppl):2243–2249.
    1. Everitt BS. The cambridge dictionary of statistics. 2nd ed. Cambridge University Press; New York: 2002.
    1. Feinstein A. Multiple sclerosis and depression. Multiple Sclerosis Journal. 2011;17(11):1276–1281. doi: 10.1177/1352458511417835.
    1. Ferrando SJ, Samton J, Mor N, Nicora S, Findler M, Apatoff B. Patient Health Questionnaire-9 to Screen for Depression in Outpatients With Multiple Sclerosis. International Journal of MS Care. 2007;9(3):99–103. doi: .
    1. First M. Clinical utility: a prerequisite for the adoption of a dimensional approach in. Journal of Abnormal Psychology. 2005;114(4):560–564.
    1. Fisk JD, Ritvo PG, Ross L, Haase DA, Marrie TJ, Schlech WF. Measuring the functional impact of fatigue: initial validation of the fatigue impact scale. Clinical Infectious Diseases. 1994;18(Suppl 1):S79–83.
    1. Fountoulakis KN, Bech P, Panagiotidis P, Siamouli M, Kantartzis S, Papadopoulou A, St Kaprinis G. Comparison of depressive indices: reliability, validity, relationship to anxiety and personality and the role of age and life events. Journal of Affective Disorders. 2007;97(1-3):187–195. doi: 10.1016/j.jad.2006.06.015.
    1. Gardner W, Shear K, Kelleher KJ, Pajer KA, Mammen O, Buysse D, Frank E. Computerized adaptive measurement of depression: a simulation study. BMC Psychiatry. 2004;4:13. doi: 10.1186/1471-244X-4-13.
    1. Gibbons RD, Weiss DJ, Kupfer DJ, Frank E, Fagiolini A, Grochocinski VJ, Immekus JC. Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatric services. 2008;59(4):361. doi: 10.1176/appi.ps.59.4.361.
    1. Halper J, Kennedy P, Miller CM, Morgante L, Namey M, Ross AP. Rethinking cognitive function in multiple sclerosis: a nursing perspective. Journal of Neuroscience Nursing. 2003;35(2):70–81.
    1. Hansson M, Chotai J, Nordstöm A, Bodlund O. Comparison of two self-rating scales to detect depression: HADS and PHQ-9. British Journal of General Practice. 2009;59(566):e283–288. doi: 10.3399/bjgp09X454070.
    1. Hobart J, Thompson A. Assessment measures and clinical scales. In: Guiloff R, editor. Clinical Trials in Neurology. Springer-Verlag; London: 2001. pp. 17–28.
    1. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal. 1999;6(1):1–55. doi: 10.1080/10705519909540118.
    1. Kalpakjian CZ, Toussaint LL, Albright KJ, Bombardier CH, Krause JK, Tate DG. Patient health Questionnaire-9 in spinal cord injury: an examination of factor structure as related to gender. Journal of Spinal Cord Medicine. 2009;32(2):147–156.
    1. Koch M, Mostert J, Heerings M, Uyttenboogaart M, De Keyser J. Fatigue, depression and disability accumulation in multiple sclerosis: a cross-sectional study. European Journal of Neurology. 2009;16(3):348–352. doi: 10.1111/j.1468-1331.2008.02432.x.
    1. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. Journal of General Internal Medicine. 2001;16(9):606–613. doi: jgi01114.
    1. Kroenke K, Spitzer RL, Williams JB, Löwe B. The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: a systematic review. General Hospital Psychiatry. 2010;32(4):345–359. doi: 10.1016/j.genhosppsych.2010.03.006.
    1. Lee AE, Chokkanathan S. Factor structure of the 10-item CES-D scale among community dwelling older adults in Singapore. International Journal of Geriatrric Psychiatry. 2008;23(6):592–597. doi: 10.1002/gps.1944.
    1. Liu H, Cella D, Gershon R, Shen J, Morales LS, Riley W, Hays RD. Representativeness of the Patient-Reported Outcomes Measurement Information System Internet panel. Journal of Clinical Epidemiology. 2010;63(11):1169–1178. doi: 10.1016/j.jclinepi.2009.11.021S0895-4356(10)00172-1.
    1. Lobentanz IS, Asenbaum S, Vass K, Sauter C, Klösch G, Kollegger H, Zeitlhofer J. Factors influencing quality of life in multiple sclerosis patients: disability, depressive mood, fatigue and sleep quality. Acta Neurologica Scandinavica. 2004;110(1):6–13. doi: 10.1111/j.1600-0404.2004.00257.x.
    1. Lowe B, Unutzer J, Callahan CM, Perkins AJ, Kroenke K. Monitoring depression treatment outcomes with the patient health questionnaire-9. Medical Care. 2004;42(12):1194–1201. doi: 00005650-200412000-00006.
    1. Maor Y, Olmer L, Mozes B. The relation between objective and subjective impairment in cognitive function among multiple sclerosis patients-the role of depression. Multiple Sclerosis. 2001;7(2):131–135.
    1. Miller WC, Anton HA, Townson AF. Measurement properties of the CESD scale among individuals with spinal cord injury. Spinal Cord. 2008;46(4):287–292. doi: 10.1038/sj.sc.3102127.
    1. Mohr DC, Goodkin DE, Likosky W, Beutler L, Gatto N, Langan MK. Identification of Beck Depression Inventory items related to multiple sclerosis. Journal of Behavioral Medicine. 1997;20(4):407–414. doi:10.1023/A:1025573315492.
    1. Motl RW, McAuley E. Symptom cluster as a predictor of physical activity in multiple sclerosis: preliminary evidence. Journal of Pain and Symptom Management. 2009;38(2):270–280. doi: 10.1016/j.jpainsymman.2008.08.004.
    1. Motl RW, Suh Y, Weikert M. Symptom cluster and quality of life in multiple sclerosis. Journal of Pain and Symptom Management. 2010;39(6):1025–1032. doi: 10.1016/j.jpainsymman.2009.11.312.
    1. Motl RW, Weikert M, Suh Y, Dlugonski D. Symptom cluster and physical activity in relapsing-remitting multiple sclerosis. Research in Nursing and Health. 2010;33(5):398–412. doi: 10.1002/nur.20396.
    1. Muthén LK, Muthén BO. Mplus User's Guide. 6th ed. Muthén & Muthén; Los Angeles, CA: 1998-2010.
    1. Narrow WE, Clarke DE, Kuramoto SJ, Kraemer HC, Kupfer DJ, Greiner L, Regier DA. DSM-5 field trials in the United States and Canada, Part III: development and reliability testing of a cross-cutting symptom assessment for DSM-5. American Journal of Psychiatry. 2013;170(1):71–82. doi: 10.1176/appi.ajp.2012.12071000.
    1. National Multiple Sclerosis Society Clinical Study Measures: Mental Health Inventory. 2008 Retrieved June 27, 2012, from .
    1. Newland PK, Fearing A, Riley M, Neath A. Symptom clusters in women with relapsing-remitting multiple sclerosis. Journal of Neuroscience Nursing. 2012;44(2):66–71. doi: 10.1097/JNN.0b013e3182478cba.
    1. Patten SB, Beck CA, Williams JV, Barbui C, Metz LM. Major depression in multiple sclerosis: a population-based perspective. Neurology. 2003;61(11):1524–1527.
    1. Patten SB, Lavorato DH, Metz LM. Clinical correlates of CES-D depressive symptom ratings in an MS population. General Hospital Psychiatry. 2005;27(6):439–445. doi: 10.1016/j.genhosppsych.2005.06.010.
    1. Patten SB, Metz LM, Reimer MA. Biopsychosocial correlates of lifetime major depression in a multiple sclerosis population. Multiple Sclerosis. 2000;6(2):115–120. doi: 10.1177/135245850000600210.
    1. Pilkonis PA, Choi SW, Reise SP, Stover AM, Riley WT, Cella D, Group PC. Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): depression, anxiety, and anger. Assessment. 2011;18(3):263–283. doi: 10.1177/1073191111411667.
    1. Radloff LS. The CES-D Scale: a self-report depression scale for research in the general population. Applied Psychological Measurement. 1977;1(3):385–401. doi: 10.1177/014662167700100306.
    1. Rao SM, Huber SJ, Bornstein RA. Emotional changes with multiple sclerosis and Parkinson's disease. Journal of Consulting and Clinical Psychology. 1992;60(3):369–78.
    1. Richardson EJ, Richards JS. Factor Structure of the PHQ-9 Screen for Depression Across Time Since Injury Among Persons With Spinal Cord Injury. Rehabilitation Psychology. 2008;53(2):243–249. doi: 10.1037/0090-5550.53.2.243.
    1. Sakakibara BM, Miller WC, Orenczuk SG, Wolfe DL, SCIRE Research Team Team A systematic review of depression and anxiety measures used with individuals with spinal cord injury. Spinal Cord. 2009;47(12):841–851. doi: 10.1038/sc.2009.93.
    1. Siegert RJ, Abernethy DA. Depression in multiple sclerosis: a review. Journal of Neurology, Neurosurgery, and Psychiatry. 2005;76(4):469–475. doi:10.1136/jnnp.2004.054635.
    1. Sjonnesen K, Berzins S, Fiest KM, M Bulloch AG, Metz LM, Thombs BD, Patten SB. Evaluation of the 9-item Patient Health Questionnaire (PHQ-9) as an assessment instrument for symptoms of depression in patients with multiple sclerosis. Postgradraduate Medicine. 2012;124(5):69–77. doi: 10.3810/pgm.2012.09.2595.
    1. Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. The Journal of the American Medical Association. 1999;282(18):1737–1744.
    1. Steiger JH, Lind JC. Statistically-based tests for the number of common factors.. Paper presented at the Annual spring meeting of the Psychometric Society; Iowa City, IA. 1980.
    1. Teresi JA, Ocepek-Welikson K, Kleinman M, Eimicke JP, Crane PK, Jones RN, Cella D. Analysis of differential item functioning in the depression item bank from the Patient Reported Outcome Measurement Information System (PROMIS): An item response theory approach. Psychol Sci Q. 2009;51(2):148–180.
    1. Tucker LR, Lewis C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973;38:1–10. DOI:10.1007/BF02291170.
    1. Verdier-Taillefer MH, Gourlet V, Fuhrer R, Alpérovitch A. Psychometric properties of the Center for Epidemiologic Studies-Depression scale in multiple sclerosis. Neuroepidemiology. 2001;20(4):262–267. doi:10.1159/000054800.
    1. Vodermaier A, Linden W, Siu C. Screening for emotional distress in cancer patients: a systematic review of assessment instruments. Journal of National Cancer Institute. 2009;101(21):1464–1488. doi: 10.1093/jnci/djp336.
    1. Watson D, Clark LA, Weber K, Assenheimer JS, Strauss ME, Mccormick RA. Testing a Tripartite Model: 1. Evaluating the Convergent and Discriminant Validity of Anxiety and Depression Symptom Scales. Journal of Abnormal Psychology. 1995;104(1):3–14.
    1. White CP, White MB, Russell CS. Invisible and visible symptoms of multiple sclerosis: which are more predictive of health distress? Journal of Neuroscience Nursing. 2008;40(2):85–95. 102. doi:10.1097/01376517-200804000-00007.
    1. Yost JK, Eton DT, Garcia SF, Cella D. Minimally important differences were estimated for six patient-reported outcomes measurement information system-cancer scales in advanced-stage cancer patients. Journal of Clinical Epidemiology. 2011;64:507–516. doi: 10.1016/j.jclinepi.2010.11.018.

Source: PubMed

3
Tilaa