Development of a subjective cognitive decline questionnaire using item response theory: a pilot study

Katherine A Gifford, Dandan Liu, Raymond Romano 3rd, Richard N Jones, Angela L Jefferson, Katherine A Gifford, Dandan Liu, Raymond Romano 3rd, Richard N Jones, Angela L Jefferson

Abstract

Background: Subjective cognitive decline (SCD) may indicate unhealthy cognitive changes, but no standardized SCD measurement exists. This pilot study aims to identify reliable SCD questions.

Methods: 112 cognitively normal (NC, 76±8 years, 63% female), 43 mild cognitive impairment (MCI; 77±7 years, 51% female), and 33 diagnostically ambiguous participants (79±9 years, 58% female) were recruited from a research registry and completed 57 self-report SCD questions. Psychometric methods were used for item-reduction.

Results: Factor analytic models assessed unidimensionality of the latent trait (SCD); 19 items were removed with extreme response distribution or trait-fit. Item response theory (IRT) provided information about question utility; 17 items with low information were dropped. Post-hoc simulation using computerized adaptive test (CAT) modeling selected the most commonly used items (n=9 of 21 items) that represented the latent trait well (r=0.94) and differentiated NC from MCI participants (F(1,146)=8.9, p=0.003).

Conclusion: Item response theory and computerized adaptive test modeling identified nine reliable SCD items. This pilot study is a first step toward refining SCD assessment in older adults. Replication of these findings and validation with Alzheimer's disease biomarkers will be an important next step for the creation of a SCD screener.

Keywords: Subjective cognitive decline; computerized adaptive testing; factor analysis; item-response theory; mild cognitive impairment; psychometrics.

Figures

Fig. 1
Fig. 1
Item reduction process. Abbreviations: SCD, subjective cognitive decline.
Fig. 2
Fig. 2
Test information curves for the bank and selected SCD items. Abbreviations: SCD, subjective cognitive decline; MCI, mild cognitive impairment; NC, cognitively normal; 10th MCI, 10th percentile of SCD ability score for MCI; 90th NC, 90th percentile of SCD ability score for NC.

References

    1. Jessen F., Wiese B., Bachmann C., Eifflaender-Gorfer S., Haller F., Kolsch H. Prediction of dementia by subjective memory impairment: Effects of severity and temporal association with cognitive impairment. Arch Gen Psychiatry. 2010;67:414–422.
    1. Saykin A.J., Wishart H.A., Rabin L.A., Santulli R.B., Flashman L.A., West J.D. Older adults with cognitive complaints show brain atrophy similar to that of amnestic MCI. Neurology. 2006;67:834–842.
    1. Perrotin A., Mormino E.C., Madison C.M., Hayenga A.O., Jagust W.J. Subjective cognition and amyloid deposition imaging: A Pittsburgh compound B positron emission tomography study in normal elderly individuals. Arch Neurol. 2012;69:223–229.
    1. Barnes L.L., Schneider J.A., Boyle P.A., Bienias J.L., Bennett D.A. Memory complaints are related to Alzheimer disease pathology in older persons. Neurology. 2006;67:1581–1585.
    1. Glodzik-Sobanska L., Reisberg B., De Santi S., Babb J.S., Pirraglia E., Rich K.E. Subjective memory complaints: Presence, severity and future outcome in normal older subjects. Dement Geriatr Cogn Disord. 2007;24:177–184.
    1. Gifford K.A., Liu D., Carmona H., Lu Z., Romano R., Tripodis Y., Martin B., Kowall N., Jefferson A.L. Inclusion of an informant yields strong associations between cognitive complaint and longitudinal cognitive outcomes in non-demented elders. J Alzheimers Dis. 2014;43:121–132.
    1. Gifford K.A., Liu D., Lu Z., Tripodis Y., Cantwell N.G., Palmisano J. The source of cognitive complaints predicts diagnostic conversion differentially among nondemented older adults. Alzheimers Dement. 2014;10:319–327.
    1. Wang L., van Belle G., Crane P.K., Kukull W.A., Bowen J.D., McCormick W.C. Subjective memory deterioration and future dementia in people aged 65 and older. J Am Geriatr Soc. 2004;52:2045–2051.
    1. Dik M.G., Jonker C., Comijs H.C., Bouter L.M., Twisk J.W., van Kamp G.J. Memory complaints and APOE-epsilon4 accelerate cognitive decline in cognitively normal elderly. Neurology. 2001;57:2217–2222.
    1. Jorm A.F., Christensen H., Korten A.E., Jacomb P.A., Henderson A.S. Memory complaints as a precursor of memory impairment in older people: A longitudinal analysis over 7-8 years. Psychol Med. 2001;31:441–449.
    1. Purser J.L., Fillenbaum G.G., Wallace R.B. Memory complaint is not necessary for diagnosis of mild cognitive impairment and does not predict 10-year trajectories of functional disability, word recall, or short portable mental status questionnaire limitations. J Am Geriatr Soc. 2006;54:335–338.
    1. Reid L.M., Maclullich A.M. Subjective memory complaints and cognitive impairment in older people. Dement Geriatr Cogn Disord. 2006;22:471–485.
    1. Slavin M.J., Brodaty H., Kochan N.A., Crawford J.D., Trollor J.N., Draper B. Prevalence and predictors of “subjective cognitive complaints” in the Sydney Memory and Ageing Study. Am J Psychiatry. 2010;18:701–710.
    1. Jessen F., Feyen L., Freymann K., Tepest R., Maier W., Heun R. Volume reduction of the entorhinal cortex in subjective memory impairment. Neurobiol Aging. 2006;27:1751–1756.
    1. Wang Y., West J.D., Flashman L.A., Wishart H.A., Santulli R.B., Rabin L.A. Selective changes in white matter integrity in MCI and older adults with cognitive complaints. Biochimica et Biophysica Acta. 2012;1822:423–430.
    1. Jessen F., Wiese B., Cvetanovska G., Fuchs A., Kaduszkiewicz H., Kolsch H. Patterns of subjective memory impairment in the elderly: Association with memory performance. Psychol Med. 2007;37:1753–1762.
    1. Lam L.C., Lui V.W., Tam C.W., Chiu H.F. Subjective memory complaints in Chinese subjects with mild cognitive impairment and early Alzheimer's disease. Int J Geriatr Psychiatry. 2005;20:876–882.
    1. Farias S.T., Mungas D., Reed B.R., Cahn-Weiner D., Jagust W., Baynes K. The measurement of everyday cognition (ECog): Scale development and psychometric properties. Neuropsychology. 2008;22:531–544.
    1. Amariglio R.E., Townsend M.K., Grodstein F., Sperling R.A., Rentz D.M. Specific subjective memory complaints in older persons may indicate poor cognitive function. J Am Geriatr Soc. 2011;59:1612–1617.
    1. Aizenstein H.J., Nebes R.D., Saxton J.A., Price J.C., Mathis C.A., Tsopelas N.D. Frequent amyloid deposition without significant cognitive impairment among the elderly. Arch Neurol. 2008;65:1509–1517.
    1. Blennow K., Hampel H. CSF markers for incipient Alzheimer's disease. Lancet Neurol. 2003;2:605–613.
    1. Jack C.R., Jr., Shiung M.M., Weigand S.D., O'Brien P.C., Gunter J.L., Boeve B.F. Brain atrophy rates predict subsequent clinical conversion in normal elderly and amnestic MCI. Neurology. 2005;65:1227–1231.
    1. Brewer J.B., Magda S., Airriess C., Smith M.E. Fully-automated quantification of regional brain volumes for improved detection of focal atrophy in Alzheimer disease. AJNR Am J Neuroradiol. 2009;30:578–580.
    1. Albert M.S., Dekosky S.T., Dickson D., Dubois B., Feldman H.H., Fox N.C. The diagnosis of mild cognitive impairment due to Alzheimer's disease: Recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. 2011;7:270–279.
    1. Jessen F., Amariglio R.E., van Boxtel M., Breteler M., Ceccaldi M., Chetelat G. A conceptual framework for research on subjective cognitive decline in preclinical Alzheimer's disease. Alzheimers Dement. 2014;10:844–852.
    1. McDonald R.P. Lawrence Erlbaum Associates, Inc.; Mahwah, NJ: 1999. Test theory: A unified treatment.
    1. Lord F.M. Lawrence Erlbaum Associates; Mahwah, NJ: 1980. Applications of item response theory to practical testing problems.
    1. Gibbons R.D., Weiss D.J., Kupfer D.J., Frank E., Fagiolini A., Grochocinski V.J. Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatr Serv. 2008;59:361–368.
    1. Jefferson A.L., Lambe S., Chaisson C., Palmisano J., Horvath K., Karlawish J. Clinical research participation among aging individuals enrolled in an Alzheimer's Disease Center research registry. Journal of Alzheimer's Disease. 2011;23:443–452.
    1. Beekly D.L., Ramos E.M., Lee W.W., Deitrich W.D., Jacka M.E., Wu J. The National Alzheimer's Coordinating Center (NACC) database: The uniform data set. Alzheimer Dis Assoc Disord. 2007;21:249–258.
    1. Morris J.C. The clinical dementia rating (CDR): Current version and scoring rules. Neurology. 1993;43:2412–2414.
    1. Weintraub S., Salmon D., Mercaldo N., Ferris S., Graff-Radford N.R., Chui H. The Alzheimer's Disease Centers' Uniform Data Set (UDS): The neuropsychologic test battery. Alzheimer Dis Assoc Disord. 2009;23:91–101.
    1. Petersen R.C. Mild cognitive impairment as a diagnostic entity. J Intern Med. 2004;256:183–194.
    1. Gilewski M.J., Zelinski E.M., Schaie K.W. The memory functioning questionnaire for assessment of memory complaints in adulthood and old age. Psychol Aging. 1990;5:482–490.
    1. Folstein M.F., Folstein S.E., McHugh P.R. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189–198.
    1. Choi S.W., Swartz R.J. Comparison of CAT item selection criteria for polytomous items. Appl Psychol Meas. 2009;33:419–440.
    1. Choi S.W., Reise S.P., Pilkonis P.A., Hays R.D., Cella D. Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Qual Life Res. 2010;19:125–136.
    1. R Development Core Team. R: A language and environment for statistical computing. 2010. Available at: . Accessed October 31, 2014.
    1. Miranda B., Madureira S., Verdelho A., Ferro J., Pantoni L., Salvadori E. Self-perceived memory impairment and cognitive performance in an elderly independent population with age-related white matter changes. J Neurol Neurosurg Psychiatr. 2008;79:869–873.
    1. Amariglio R.E., Becker J.A., Carmasin J., Wadsworth L.P., Lorius N., Sullivan C. Subjective cognitive complaints and amyloid burden in cognitively normal older individuals. Neuropsychologia. 2012;50:2880–2886.
    1. Wang P.N., Wang S.J., Fuh J.L., Teng E.L., Liu C.Y., Lin C.H. Subjective memory complaint in relation to cognitive performance and depression: A longitudinal study of a rural Chinese population. J Am Geriatr Soc. 2000;48:295–299.
    1. Schofield P.W., Marder K., Dooneief G., Jacobs D.M., Sano M., Stern Y. Association of subjective memory complaints with subsequent cognitive decline in community-dwelling elderly individuals with baseline cognitive impairment. Am J Psychiatry. 1997;154:609–615.
    1. St John P., Montgomery P. Are cognitively intact seniors with subjective memory loss more likely to develop dementia? Int J Geriatr Psychiatry. 2002;17:814–820.
    1. Geerlings M.I., Jonker C., Bouter L.M., Ader H.J., Schmand B. Association between memory complaints and incident Alzheimer's disease in elderly people with normal baseline cognition. Am J Psychiatry. 1999;156:531–537.
    1. Gifford K.A., Liu D., Damon S.M., Chapman W.G., Romano R.R., Samuels L.R. Subjective memory complaint only relates to verbal episodic memory performance in mild cognitive impairment. Journal of Alzheimer's Disease. 2015;44:309–318.
    1. Snitz B.E., Yu L., Crane P.K., Chang C.C., Hughes T.F., Ganguli M. Subjective cognitive complaints of older adults at the population level: An item response theory analysis. Alzheimer Dis Assoc Disord. 2012;26:344–351.
    1. Carr D.B., Gray S., Baty J., Morris J.C. The value of informant versus individual's complaints of memory impairment in early dementia. Neurology. 2000;55:1724–1726.

Source: PubMed

3
订阅