NIH EXAMINER: conceptualization and development of an executive function battery

Joel H Kramer, Dan Mungas, Katherine L Possin, Katherine P Rankin, Adam L Boxer, Howard J Rosen, Alan Bostrom, Lena Sinha, Ashley Berhel, Mary Widmeyer, Joel H Kramer, Dan Mungas, Katherine L Possin, Katherine P Rankin, Adam L Boxer, Howard J Rosen, Alan Bostrom, Lena Sinha, Ashley Berhel, Mary Widmeyer

Abstract

Executive functioning is widely targeted when human cognition is assessed, but there is little consensus on how it should be operationalized and measured. Recognizing the difficulties associated with establishing standard operational definitions of executive functioning, the National Institute of Neurological Disorders and Stroke entered into a contract with the University of California-San Francisco to develop psychometrically robust executive measurement tools that would be accepted by the neurology clinical trials and clinical research communities. This effort, entitled Executive Abilities: Measures and Instruments for Neurobehavioral Evaluation and Research (EXAMINER), resulted in a series of tasks targeting working memory, inhibition, set shifting, fluency, insight, planning, social cognition and behavior. We describe battery conceptualization and development, data collection, scale construction based on item response theory, and lay the foundation for studying the battery's utility and validity for specific assessment and research goals.

Conflict of interest statement

None of the authors have any conflicts to disclose.

Figures

Figure 1
Figure 1
Example of Dimensional Set Shifting. Examinees are instructed to match by shape, hence the correct response is the blue rectangle.
Figure 2
Figure 2
Example of Unstructured Task stimuli. Although the puzzle on the left offers more points, the puzzle on the right offers a better benefit:cost ratio because it can be completed much more quickly.

References

    1. Amieva H, Phillips L, Della Sala S. Behavioral dysexecutive symptoms in normal aging. Brain and Cognition. 2003;53(2):129–132.
    1. Arnett PA, Rao SM, Grafman J, Bernardin L, Luchetta T, Binder JR, Lobeck L. Executive functions in multiple sclerosis: an analysis of temporal ordering, semantic encoding, and planning abilities. Neuropsychology. 1997;11(4):535–544.
    1. Aron AR, Watkins L, Sahakian BJ, Monsell S, Barker RA, Robbins TW. Task-set switching deficits in early-stage Huntington’s disease: implications for basal ganglia function. Journal of Cognitive Neuroscience. 2003;15(5):629–642.
    1. Asimakopulos J, Boychuck Z, Sondergaard D, Poulin V, Menard I, Korner-Bitensky N. Assessing executive function in relation to fitness to drive: a review of tools and their ability to predict safe driving. Australian Occupational Therapy Journal. 2012;59(6):402–427. doi: 10.1111/j.1440-1630.2011.00963.
    1. Barkley RA. Differential diagnosis of adults with ADHD: the role of executive function and self-regulation. Journal of Clinical Psychiatry. 2010;71(7):e17. doi: 10.4088/JCP.9066tx1c.
    1. Boone KB, Miller BL, Lee A, Berman N, Sherman D, Stuss DT. Neuropsychological patterns in right versus left frontotemporal dementia. Journal of International Neuropsychological Society. 1999;5(7):616–622.
    1. Buckner RL. Memory and executive function in aging and AD: multiple factors that cause decline and reserve factors that compensate. Neuron. 2004;44(1):195–208.
    1. Caeyenberghs K, Leemans A, Leunissen I, Gooijers J, Michiels K, Sunaert S, Swinnen SP. Altered structural networks and executive deficits in traumatic brain injury patients. Brain Structure and Function. 2012 doi: 10.1007/s00429-012-0494-2.
    1. Cahn-Weiner DA, Boyle PA, Malloy PF. Tests of executive function predict instrumental activities of daily living in community-dwelling older individuals. Applied Neuropsychology. 2002;9(3):187–191.
    1. Cambridge-Cognition. CANTAB®. Cambridge: Cambridge Cognition Limited; 1996.
    1. Case R, Kurland MD, Goldberg J. Operational efficiency and the growth of short-term memory span. Journal of Experimental Child Psychology. 1982;33:386–404.
    1. Chiaravalloti ND, DeLuca J. Assessing the behavioral consequences of multiple sclerosis: an application of the Frontal Systems Behavior Scale (FrSBe) Cognitive and Behavioral Neurology. 2003;16(1):54–67.
    1. Conway AR, Kane MJ, Bunting MF, Hambrick DZ, Wilhelm O, Engle RW. Working memory span tasks: A methodological review and user’s guide. Psychonomic Bulletin Review. 2005;12(5):769–786.
    1. Delis DC, Kaplan E, Kramer JH. Delis-Kaplan Executive Function System. San Antonio: The Psychological Corporation; 2001.
    1. Flores J, Ostrosky F, Lozano A. Batería Neuropsicológica de Funciones Ejecutivas y Lóbulos Frontales (Battery of Executive Functions and Frontal Lobe, Spanish) San Antonio: Pearson, Inc; 2008.
    1. Foong J, Rozewicz L, Quaghebeur G, Davie CA, Kartsounis LD, Thompson AJ, Ron MA. Executive function in multiple sclerosis. The role of frontal lobe pathology. Brain. 1997;120 ( Pt 1):15–26.
    1. Gerstenecker A, Mast B, Duff K, Ferman TJ, Litvan I. Executive dysfunction is the primary cognitive impairment in progressive supranuclear palsy. Archives of Clinical Neuropsychology. 2013;28(2):104–113. doi: 10.1093/arclin/acs098.
    1. Gioia GA, Isquith PK, Guy SC, Kenworthy L. Behavior rating inventory of executive function. Child Neuropsychology. 2000;6(3):235–238. doi: 10.1076/chin.6.3.235.3152.
    1. Griffin SL, Mindt MR, Rankin EJ, Ritchie AJ, Scott JG. Estimating premorbid intelligence: comparison of traditional and contemporary methods across the intelligence continuum. Archives of Clinical Neuropsychology. 2002;17(5):497–507. S0887617701001366 [pii]
    1. Hambleton RK, Swaminathan H, Rogers HJ. Fundamentals of item response theory. Newbury Park, CA: Sage; 1991.
    1. Hellmuth J, Mirsky J, Heuer HW, Matlin A, Jafari A, Garbutt S, Boxer AL. Multicenter validation of a bedside antisaccade task as a measure of executive function. Neurology. 2012;78(23):1824–1831. doi: 10.1212/WNL.0b013e318258f785. WNL.0b013e318258f785 [pii]
    1. Hutchinson AD, Mathias JL. Neuropsychological deficits in frontotemporal dementia and Alzheimer’s disease: a meta-analytic review. Journal of Neurology Neurosurgery and Psychiatry. 2007;78(9):917–928. doi: 10.1136/jnnp.2006.100669.
    1. Kramer JH, Jurik J, Sha SJ, Rankin KP, Rosen HJ, Johnson JK, Miller BL. Distinctive neuropsychological patterns in frontotemporal dementia, semantic dementia, and Alzheimer disease. Cognitive and Behavioral Neurology. 2003;16(4):211–218.
    1. Kray J, Lindenberger U. Adult age differences in task switching. Psychology of Aging. 2000;15(1):126–147.
    1. Krueger CE, Bird AC, Growdon ME, Jang JY, Miller BL, Kramer JH. Conflict monitoring in early frontotemporal dementia. Neurology. 2009;73(5):349–355. doi: 10.1212/WNL.0b013e3181b04b24.
    1. Krueger CE, Rosen HJ, Taylor HG, Espy KA, Schatz J, Rey-Casserly C, Kramer JH. Know thyself: real-world behavioral correlates of self-appraisal accuracy. Clinical Neuropsychologist. 2011;25(5):741–756. doi: 10.1080/13854046.2011.569759.
    1. Levin HS, Hanten G. Executive functions after traumatic brain injury in children. Pediatric Neurology. 2005;33(2):79–93.
    1. Lezak MD. Neuropsychological assessment. 4. New York, NY, USA: 2004.
    1. Luks TL, Oliveira M, Possin KL, Bird A, Miller BL, Weiner MW, Kramer JH. Atrophy in two attention networks is associated with performance on a Flanker task in neurodegenerative disease. Neuropsychologia. 2010;48(1):165–170. doi: 10.1016/j.neuropsychologia.2009.09.001.
    1. Malloy P, Grace J. A review of rating scales for measuring behavior change due to frontal systems damage. Cognitive and Behavioral Neurology. 2005;18(1):18–27.
    1. Mirsky JB, Heuer HW, Jafari A, Kramer JH, Schenk AK, Viskontas IV, Boxer AL. Anti-saccade performance predicts executive function and brain structure in normal elders. Cognitive and Behavioral Neurology. 2011;24(2):50–58. doi: 10.1097/WNN.0b013e318223f6c6.
    1. Miyake A, Friedman NP, Emerson MJ, Witzki AH, Howerter A, Wager TD. The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” tasks: a latent variable analysis. Cognitive Psychology. 2000;41(1):49–100.
    1. Monsell S. Task switching. Trends in Cognitive Science. 2003;7(3):134–140. S1364661303000287 [pii]
    1. Moorhouse P, Song X, Rockwood K, Black S, Kertesz A, Gauthier S, Feldman H. Executive dysfunction in vascular cognitive impairment in the consortium to investigate vascular impairment of cognition study. Journal of Neurological Science. 2010;288(1–2):142–146. doi: 10.1016/j.jns.2009.09.017.
    1. Mungas D, Reed BR, Kramer JH. Psychometrically matched measures of global cognition, memory, and executive function for assessment of cognitive decline in older persons. Neuropsychology. 2003;17(3):380–392.
    1. Munoz DP, Everling S. Look away: the anti-saccade task and the voluntary control of eye movement. Nature Reviews: Neuroscience. 2004;5(3):218–228.
    1. Owen AM, McMillan KM, Laird AR, Bullmore E. N-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies. Human Brain Mapping. 2005;25(1):46–59. doi: 10.1002/hbm.20131.
    1. Paulsen JS. Cognitive impairment in Huntington disease: diagnosis and treatment. Current Neurology and Neuroscience Reports. 2011;11(5):474–483. doi: 10.1007/s11910-011-0215-x.
    1. Peters M, Giesbrecht T, Jelicic M, Merckelbach H. The random number generation task: psychometric properties and normative data of an executive function task in a mixed sample. Journal of International Neuropsychological Society. 2007;13(4):626–634. S1355617707070786.
    1. Possin KL, Feigenbaum D, Rankin KP, Smith GE, Boxer AL, Wood K, Kramer JH. Dissociable executive functions in behavioral variant frontotemporal and Alzheimer dementias. Neurology. 2013;80(24):2180–2185.
    1. Psychology Software Tools, I. E-Prime 2. Sharpsburg, PA: 2009.
    1. Ravizza SM, Ciranni MA. Contributions of the prefrontal cortex and basal ganglia to set shifting. Journal of Cognitive Neuroscience. 2002;14(3):472–483.
    1. Reed BR, Eberling JL, Mungas D, Weiner M, Kramer JH, Jagust WJ. Effects of white matter lesions and lacunes on cortical function. Archives of Neurology. 2004;61(10):1545–1550.
    1. Reitan RM, Wolfson D. The Halstead–Reitan Neuropsychological Test Battery. Tucson: Neuropsychology Press; 1985.
    1. Schenk A, Berhel A, Verde S, Widmeyer M, Kramer JH. (abstract)). Assessing the mental rigidity of FTD patients using a random number generation task. JINS. 2008;14(S1):266.
    1. Shallice T, Burgess PW. Deficits in strategy application following frontal lobe damagein men. Brain. 1991;114:727–741.
    1. Shany-Ur T, Rankin KP. Personality and social cognition in neurodegenerative disease. Current Opinion in Neurology. 2011;24(6):550–555.
    1. Slachevsky A, Villalpando JM, Sarazin M, Hahn-Barma V, Pillon B, Dubois B. Frontal assessment battery and differential diagnosis of frontotemporal dementia and Alzheimer disease. Archives of Neurology. 2004;61(7):1104–1107.
    1. Stuss DT. Traumatic brain injury: relation to executive dysfunction and the frontal lobes. Current Opinion in Neurology. 2011;24(6):584–589. doi: 10.1097/WCO.0b013e32834c7eb9.
    1. Stuss DT, Floden D, Alexander MP, Levine B, Katz D. Stroop performance in focal lesion patients: dissociation of processes and frontal lobe lesion location. Neuropsychologia. 2001;39(8):771–786.
    1. Weintraub S, Dikmen SS, Heaton RK, Tulsky DS, Zelazo PD, Bauer PJ, Gershon RC. Cognition assessment using the NIH Toolbox. Neurology. 2013;80(11 Suppl 3):S54–64. doi: 10.1212/WNL.0b013e3182872ded.
    1. Wilson B, Alderman N, Burgess PW, Emslie H, Evans JJ. Behavioural Assessment of the Dysexecutive Syndrome. Bury St. Edmunds: Thames Valley Test Company; 1996.

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera