Reliability and validity of composite scores from the NIH Toolbox Cognition Battery in adults

Abstract

This study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) Composite Scores in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20-85 years), gender, education, and ethnicity. The NIHTB-CB contains seven computer-based instruments assessing five cognitive sub-domains: Language, Executive Function, Episodic Memory, Processing Speed, and Working Memory. Participants completed the NIHTB-CB, corresponding gold standard validation measures selected to tap the same cognitive abilities, and sociodemographic questionnaires. Three Composite Scores were derived for both the NIHTB-CB and gold standard batteries: "Crystallized Cognition Composite," "Fluid Cognition Composite," and "Total Cognition Composite" scores. NIHTB Composite Scores showed acceptable internal consistency (Cronbach's alphas=0.84 Crystallized, 0.83 Fluid, 0.77 Total), excellent test-retest reliability (r: 0.86-0.92), strong convergent (r: 0.78-0.90) and discriminant (r: 0.19-0.39) validities versus gold standard composites, and expected age effects (r=0.18 crystallized, r=-0.68 fluid, r=-0.26 total). Significant relationships with self-reported prior school difficulties and current health status, employment, and presence of a disability provided evidence of external validity. The NIH Toolbox Cognition Battery Composite Scores have excellent reliability and validity, suggesting they can be used effectively in epidemiologic and clinical studies.

Figures

Fig. 1

Performance on the Toolbox Crystallized Cognition Composite and the Gold Standard Crystallized Cognition Composite across age groups, adjusted for education. Error bars represent±1 SE.

Fig. 2

Performance on the Toolbox Fluid Cognition Composite and the Gold Standard Fluid Cognition Composite across age groups, adjusted for education. Error bars represent ±1 SE.