Validity of the Symbol Digit Modalities Test as a cognition performance outcome measure for multiple sclerosis

Ralph Hb Benedict, John DeLuca, Glenn Phillips, Nicholas LaRocca, Lynn D Hudson, Richard Rudick, Multiple Sclerosis Outcome Assessments Consortium, Ralph Hb Benedict, John DeLuca, Glenn Phillips, Nicholas LaRocca, Lynn D Hudson, Richard Rudick, Multiple Sclerosis Outcome Assessments Consortium

Abstract

Cognitive and motor performance measures are commonly employed in multiple sclerosis (MS) research, particularly when the purpose is to determine the efficacy of treatment. The increasing focus of new therapies on slowing progression or reversing neurological disability makes the utilization of sensitive, reproducible, and valid measures essential. Processing speed is a basic elemental cognitive function that likely influences downstream processes such as memory. The Multiple Sclerosis Outcome Assessments Consortium (MSOAC) includes representatives from advocacy organizations, Food and Drug Administration (FDA), European Medicines Agency (EMA), National Institute of Neurological Disorders and Stroke (NINDS), academic institutions, and industry partners along with persons living with MS. Among the MSOAC goals is acceptance and qualification by regulators of performance outcomes that are highly reliable and valid, practical, cost-effective, and meaningful to persons with MS. A critical step for these neuroperformance metrics is elucidation of clinically relevant benchmarks, well-defined degrees of disability, and gradients of change that are deemed clinically meaningful. This topical review provides an overview of research on one particular cognitive measure, the Symbol Digit Modalities Test (SDMT), recognized as being particularly sensitive to slowed processing of information that is commonly seen in MS. The research in MS clearly supports the reliability and validity of this test and recently has supported a responder definition of SDMT change approximating 4 points or 10% in magnitude.

Keywords: Multiple sclerosis; Symbol Digit Modalities Test; cognition; performance outcome; processing speed; psychometric validity.

Conflict of interest statement

Declaration of Conflicting Interests: The author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: Dr Benedict receives research support from Accorda, Novartis, Genzyme, Biogen, and Mallinckrodt Pharmaceuticals; is on the speakers’ bureau for EMD Serono (designing CME courses); consults for Biogen, Genentech, Genzyme, Novartis, Abbvie, Roche and Sanofi; and receives royalties from Psychological Assessment Resources. Dr DeLuca receives grant funding from Biogen and EMD Serono, serves on an Advisory board for Biogen, and is on the speakers’ bureau for EMD Serono.

Figures

Figure 1.
Figure 1.
(a) The Symbol Digit Modalities Test as originally developed by Whipple and Pyle in the early 20th century. This is the earliest description of a symbol/number coding task we are able to locate, and neither source refers to a prior version of the task. (b) A scored version of the Digit Symbol Substitution Test as developed for the US Army in the early 1920s, subsequently adapted by the Wechsler intelligence scales. (c) A faux version of the Symbol Digit Modalities Test (SDMT) as presented in an earlier publication on the Brief International Cognitive Assessment for MS (BICAMS).
Figure 2.
Figure 2.
Mean effect sizes and ranges for each of the more commonly used neuropsychological tests in consensus standard batteries. Figure shows the mean effect size as calculated by the Cohen d method where d is the difference between group means divided by the average SD. All d values reflect MS and healthy control group comparisons. SDMT has a larger mean effect size as compared to others depicted.

References

    1. Charcot JM. Lectures on the Diseases of the Nervous System. London: New Sydenham Society, 1877.
    1. Rao SM, Leo GJ, St Aubin-Farbert P. Information processing speed in patients with multiple sclerosis. J Clin Exp Neuropsychol 1989; 11: 471–477.
    1. Peyser JM, Rao SM, LaRocca NG, et al. Guidelines for neuropsychological research in multiple sclerosis. Arch Neurol 1990; 47: 94–97.
    1. Rao SM, Leo GJ, Bernardin L, et al. Cognitive dysfunction in multiple sclerosis. I. Frequency, patterns, and prediction. Neurology 1991; 41: 685–691.
    1. Gronwall DMA. Paced auditory serial addition task: A measure of recovery from concussion. Percept Mot Skills 1977; 44: 367–373.
    1. Smith A. Symbol digit modalities test: Manual. Los Angeles, CA: Western Psychological Services, 1982.
    1. Demaree HA, DeLuca J, Gaudino EA, et al. Speed of information processing as a key deficit in multiple sclerosis: Implications for rehabilitation. J Neurol Neurosurg Psychiatry 1999; 67: 661–663.
    1. DeLuca J, Chelune GJ, Tulsky DS, et al. Is speed of processing or working memory the primary information processing deficit in multiple sclerosis? J Clin Exp Neuropsychol 2004; 26: 550–562.
    1. Denney DR, Lynch SG, Parmenter BA, et al. Cognitive impairment in relapsing and primary progressive multiple sclerosis: Mostly a matter of speed. J Int Neuropsychol Soc 2004; 10: 948–956.
    1. Costa SL, Genova HM, DeLuca J, et al. Information processing speed in multiple sclerosis: Past, present, and future. Mult Scler. Epub ahead of print 9 May 2016. DOI: 10.1177/1352458516645869.
    1. Pyle WH. The examination of school children: A manual of directions and norms. New York: Macmillan, 1913.
    1. Lemmon VW. The relation of reaction time to measures of intelligence, memory and learning. New York: Archives of Psychology, 1927; 94: 1–39.
    1. Whipple GM. Manual of mental and physical tests. Baltimore, MD: Warwick & Sons, 1910.
    1. Yerkes RM. Psychological examining in the United States Army. Washington, DC: Government Printing Office, 1921.
    1. Wechsler D. Wechsler-Bellevue intelligence scale. New York: Psychological Corporation, 1939.
    1. Wechsler D. Wechsler intelligence scale for children. New York: Psychological Corporation, 1949.
    1. Smith A. Ambiguities in concepts and studies of brain damage and organicity. J Nerv Ment Dis 1962; 135: 311–326.
    1. Smith A. Mental deterioration in chronic schizophrenia. J Nerv Ment Dis 1964; 129: 479–487.
    1. Smith A. Consistent sex differences in a specific (decoding) test performance. Educ Psychol Meas 1967; 27: 1077–1083.
    1. Langdon DW. Cognition in multiple sclerosis. Curr Opin Neurol 2011; 24: 244–249.
    1. Rao SM. A manual for the brief, repeatable battery of neuropsychological tests in multiple sclerosis. New York: National Multiple Sclerosis Society, 1991.
    1. Benedict RHB, Fischer JS, Archibald CJ, et al. Minimal neuropsychological assessment of MS patients: A consensus approach. Clin Neuropsychol 2002; 16: 381–397.
    1. Cutter GR, Baier ML, Rudick RA, et al. Development of a multiple sclerosis functional composite as a clinical trial outcome measure. Brain 1999; 122: 871–882.
    1. Fischer JS, Rudick RA, Cutter GR, et al. The Multiple Sclerosis Functional Composite Measure (MSFC): An integrated approach to MS clinical outcome assessment. National MS Society Clinical Outcomes Assessment Task Force. Mult Scler 1999; 5: 244–250.
    1. Benedict RHB, Krupp L, Francis G, et al. NINDS common data elements, multiple sclerosis, neuropsychology/cognition recommendations (ed MCW Group). Washington, DC: National Institute for Neurological Diseases and Stroke, 2012.
    1. Erlanger DM, Kaushik T, Caruso LS, et al. Reliability of a cognitive endpoint for use in a multiple sclerosis pharmaceutical trial. J Neurol Sci 2014; 340: 123–129.
    1. Benedict RHB, Amato MP, Boringa J, et al. Brief International Cognitive Assessment for MS (BICAMS): International standards for validation. BMC Neurol 2012; 12: 55.
    1. Langdon DW, Amato MP, Boringa J, et al. Recommendations for a Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS). Mult Scler 2012; 18: 891–898.
    1. Cohen JA, Reingold SC, Polman CH, et al. Disability outcome measures in multiple sclerosis clinical trials: Current status and future prospects. Lancet 2012; 11(5): 467–476.
    1. Benedict RHB. Effects of using same vs. alternate form memory tests in short-interval, repeated assessment in multiple sclerosis. J Int Neuropsychol Soc 2005; 11: 727–736.
    1. Benedict RHB, Duquin JA, Jurgensen S, et al. Repeated assessment of neuropsychological deficits in multiple sclerosis using the Symbol Digit Modalities Test and the MS Neuropsychological Screening Questionnaire. Mult Scler 2008; 940–946.
    1. Drake AS, Weinstock-Guttman B, Morrow SA, et al. Psychometrics and normative data for the Multiple Sclerosis Functional Composite: Replacing the PASAT with the Symbol Digit Modalities Test. Mult Scler 2010; 16: 228–237.
    1. Eshaghi A, Riyahi-Alam S, Roostaei T, et al. Validity and reliability of a Persian translation of the minimal assessment of cognitive function in multiple sclerosis (MACFIMS). Clin Neuropsychol 2012; 26: 975–984.
    1. Spedo CT, Frndak SE, Marques VD, et al. Cross-cultural adaptation, reliability, and validity of the BICAMS in Brazil. Clin Neuropsychol 2015; 29: 836–846.
    1. Vanotti S, Smerbeck A, Benedict RHB, et al. A new assessment tool for patients with multiple sclerosis from Spanish speaking countries: Validation of the Brief International Cognitive Assessment for MS (BICAMS) in Argentina. Clin Neuropsychol 2016; 30(7): 1023–1031.
    1. Boringa JB, Lazeron RH, Reuling IE, et al. The brief repeatable battery of neuropsychological tests: Normative values allow application in multiple sclerosis clinical practice. Mult Scler 2001; 7: 263–267.
    1. Benedict RH, Smerbeck A, Parikh R, et al. Reliability and equivalence of alternate forms for the Symbol Digit Modalities Test: Implications for multiple sclerosis clinical trials. Mult Scler 2012; 18(9): 1320–1325.
    1. Benedict RHB, Cookfair D, Gavett R, et al. Validity of the Minimal Assessment of Cognitive Function in Multiple Sclerosis (MACFIMS). J Int Neuropsychol Soc 2006; 12: 549–558.
    1. Wechsler D. WAIS-R manual. New York: Psychological Corporation, 1981.
    1. Amato MP, Portaccio E, Goretti B, et al. Relevance of cognitive deterioration in early relapsing-remitting MS: A 3-year follow-up study. Mult Scler 2010; 16: 1474–1482.
    1. Strober L, Englert J, Munschauer F, et al. Sensitivity of conventional memory tests in multiple sclerosis: Comparing the Rao Brief Repeatable Neuropsychological Battery and the Minimal Assessment of Cognitive Function in MS. Mult Scler 2009; 15: 1077–1084.
    1. Parmenter BA, Weinstock-Guttman B, Garg N, et al. Screening for cognitive impairment in MS using the Symbol Digit Modalities Test. Mult Scler 2007; 13: 52–57.
    1. Benedict RHB, Cox D, Thompson LL, et al. Reliable screening for neuropsychological impairment in MS. Mult Scler 2004; 10: 675–678.
    1. Benedict RHB, Weinstock-Guttman B, Fishman I, et al. Prediction of neuropsychological impairment in multiple sclerosis: Comparison of conventional magnetic resonance imaging measures of atrophy and lesion burden. Arch Neurol 2004; 61: 226–230.
    1. Nocentini U, Pasqualetti P, Bonavita S, et al. Cognitive dysfunction in patients with relapsing-remitting multiple sclerosis. Mult Scler 2006; 12: 77–87.
    1. Brochet B, Deloire MS, Bonnet M, et al. Should SDMT substitute for PASAT in MSFC? A 5-year longitudinal study. Mult Scler 2008; 14: 1242–1249.
    1. Deloire MS, Salort E, Bonnet M, et al. Cognitive impairment as marker of diffuse brain abnormalities in early relapsing remitting multiple sclerosis. J Neurol Neurosurg Psychiatry 2005; 76: 519–526.
    1. Huijbregts SC, Kalkers NF, de Sonneville LM, et al. Cognitive impairment and decline in different MS subtypes. J Neurol Sci 2006; 245: 187–194.
    1. Huijbregts SC, Kalkers NF, de Sonneville LM, et al. Differences in cognitive impairment of relapsing remitting, secondary, and primary progressive MS. Neurology 2004; 63: 335–339.
    1. Solari A, Mancuso L, Motta A, et al. Comparison of two brief neuropsychological batteries in people with multiple sclerosis. Mult Scler 2002; 8: 169–176.
    1. Benedict RHB, Bruce JM, Dwyer MG, et al. Neocortical atrophy, third ventricular width, and cognitive dysfunciton in multiple sclerosis. Arch Neurol 2006; 63: 1301–1306.
    1. Sepulcre J, Vanotti S, Hernandez R, et al. Cognitive impairment in patients with multiple sclerosis using the Brief Repeatable Battery-Neuropsychology test. Mult Scler 2006; 12: 187–195.
    1. Parmenter BA, Testa SM, Schretlen DJ, et al. The utility of regression-based norms in interpreting the minimal assessment of cognitive function in multiple sclerosis (MACFIMS). J Int Neuropsychol Soc 2010; 16: 6–16.
    1. Zivadinov R, Marr K, Cutter G, et al. Prevalence, sensitivity, and specificity of chronic cerebrospinal venous insufficiency in MS. Neurology 2011; 77(2):138–144.
    1. Batista S, Zivadinov R, Hoogs M, et al. Basal ganglia, thalamus and neocortical atrophy predicting slowed cognitive processing in multiple sclerosis. J Neurol 2012; 259: 139–146.
    1. Dusankova JB, Kalincik T, Havrdova E, et al. Cross cultural validation of the Minimal Assessment of Cognitive Function in Multiple Sclerosis (MACFIMS) and the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS). Clin Neuropsychol 2012; 26: 1186–1200.
    1. Caceres F, Vanotti S, Benedict RH, et al. Cognitive and neuropsychiatric disorders among multiple sclerosis patients from Latin America: Results of the RELACCEM study. Mult Scler Related Dis 2014; 3: 335–340.
    1. Rao SM, Glatt S, Hammeke TA, et al. Chronic progressive multiple sclerosis: Relationship between cerebral ventricular size and neuropsychological impairment. Arch Neurol 1985; 42: 678–682.
    1. Rao SM, Leo GJ, Haughton VM, et al. Correlation of magnetic resonance imaging with neuropsychological testing in multiple sclerosis. Neurology 1989; 39: 161–166.
    1. Christodoulou C, Krupp LB, Liang Z, et al. Cognitive performance and MR markers of cerebral injury in cognitively impaired MS patients. Neurology 2003; 60: 1793–1798.
    1. Sanfilipo MP, Benedict RH, Weinstock-Guttman B, et al. Gray and white matter brain atrophy and neuropsychological impairment in multiple sclerosis. Neurology 2006; 66: 685–692.
    1. Benedict RHB, Bruce J, Dwyer MG, et al. Diffusion-weighted imaging predicts cognitive impairment in multiple sclerosis. Mult Scler 2007; 13: 722–730.
    1. Stankiewicz JM, Glanz BI, Healy BC, et al. Brain MRI lesion load at 1.5T and 3T versus clinical status in multiple sclerosis. J Neuroimaging 2011; 21: e50–e56.
    1. Schoonheim MM, Popescu V, Rueda Lopes FC, et al. Subcortical atrophy and cognition: Sex effects in multiple sclerosis. Neurology 2012; 79: 1754–1761.
    1. Schoonheim MM, Hulst HE, Brandt RB, et al. Thalamus structure and function determine severity of cognitive impairment in multiple sclerosis. Neurology 2015; 84(8): 776–783.
    1. Benedict RH, Hulst HE, Bergsland N, et al. Clinical significance of atrophy and white matter mean diffusivity within the thalamus of multiple sclerosis patients. Mult Scler 2013; 19: 1478–1484.
    1. Bisecco A, Rocca MA, Pagani E, et al. Connectivity-based parcellation of the thalamus in multiple sclerosis and its implications for cognitive impairment: A multicenter study. Hum Brain Mapp 2015; 36(7): 2809–2825.
    1. Rao SM, Martin AL, Huelin R, et al. Correlations between MRI and information processing speed in MS: A meta-analysis. Mult Scler Int 2014; 2014: Article 975803. DOI: 10.1155/2014/975803.
    1. Benedict RHB, Wahlig E, Bakshi R, et al. Predicting quality of life in multiple sclerosis: Accounting for physical disability, fatigue, cognition, mood disorder, personality, and behavior change. J Neurol Sci 2005; 231(1–2): 29–34.
    1. Benedict RHB, Drake AS, Irwin LN, et al. Benchmarks of meaningful impairment on the MSFC and BICAMS. Mult Scler 2016; 22(14): 1874–1882.
    1. Strober LB, Christodoulou C, Benedict RH, et al. Unemployment in multiple sclerosis: The contribution of personality and disease. Mult Scler 2012; 18: 647–653.
    1. Strober L, Chiaravalloti N, Moore N, et al. Unemployment in multiple sclerosis (MS): Utility of the MS Functional Composite and cognitive testing. Mult Scler 2014; 20: 112–115.
    1. Honan CA, Brown RF, Batchelor J. Perceived cognitive difficulties and cognitive test performance as predictors of employment outcomes in people with multiple sclerosis. J Int Neuropsychol Soc 2015; 21: 156–168.
    1. Goverover Y, Chiaravalloti N, DeLuca J. Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) and performance of everyday life tasks: Actual reality. Mult Scler 2016; 22: 544–550.
    1. Benedict RHB. Brief visuospatial memory test—Revised: Professional manual. Odessa, FL: Psychological Assessment Resources, Inc, 1997.
    1. Goverover Y, Strober L, Chiaravalloti N, et al. Factors that moderate activity limitation and participation restriction in people with multiple sclerosis. Am J Occup Ther 2015; 69: 6902260020p1-9.
    1. Goverover Y, Haas S, Deluca J. Money management activities in persons with multiple sclerosis. Arch Phys Med Rehabil 2016; 97(11): 1901–1907.
    1. Goverover Y, Chiaravalloti N, DeLuca J. The relationship between self-awareness of neurobehavioral symptoms, cognitive functioning, and emotional symptoms in multiple sclerosis. Mult Scler 2005; 11: 203–212.
    1. Kalmar JH, Gaudino EA, Moore NB, et al. The relationship between cognitive deficits and everyday functional activities in multiple sclerosis. Neuropsychology 2008; 22: 442–449.
    1. Benedict RHB, Zivadinov R. Predicting neuropsychological abnormalities in multiple sclerosis. J Neurol Sci 2006; 245: 67–72.
    1. Carone D, Benedict RHB, Munschauer FE, III, et al. Interpreting patient/informant discrepancies of reported cognitive symptoms in MS. J Int Neuropsychol Soc 2005; 11: 574–583.
    1. Bruce JM, Arnett PA. Self-reported everyday memory and depression in patients with multiple sclerosis. J Clin Exp Neuropsychol 2004; 26: 200–214.
    1. Goverover Y, O’Brien AR, Moore NB, et al. Actual reality: A new approach to functional assessment in persons with multiple sclerosis. Arch Phys Med Rehabil 2010; 91: 252–260.
    1. Goldman MD, Motl RW, Scagnelli J, et al. Clinically meaningful performance benchmarks in MS: Timed 25-foot walk and the real world. Neurology 2013; 81: 1856–1863.
    1. Morrow SA, Drake A, Zivadinov R, et al. Predicting loss of employment over three years in multiple sclerosis: Clinically meaningful cognitive decline. Clin Neuropsychol 2010; 24: 1131–1145.
    1. Morrow SA, O’Connor PW, Polman CH, et al. Evaluation of the symbol digit modalities test (SDMT) and MS neuropsychological screening questionnaire (MSNQ) in natalizumab-treated MS patients over 48 weeks. Mult Scler 2010; 16: 1385–1392.
    1. Beck AT, Steer RA, Brown GK. BDI-fast screen for medical patients: Manual. San Antonio, TX: Psychological Corporation, 2000.
    1. Morrow SA, Jurgensen S, Forrestal F, et al. Effects of acute relapses on neuropsychological status in multiple sclerosis patients. J Neurol 2011; 258(9): 1603–1608.
    1. Benedict RH, Morrow S, Rodgers J, et al. Characterizing cognitive function during relapse in multiple sclerosis. Mult Scler 2014; 20(13): 1745–1752.
    1. Pardini M, Uccelli A, Grafman J, et al. Isolated cognitive relapses in multiple sclerosis. J Neurol Neurosurg Psychiatry 2014; 85(9): 1035–1037.
    1. Damasceno A, Damasceno BP, Cendes F. No evidence of disease activity in multiple sclerosis: Implications on cognition and brain atrophy. Mult Scler 2016; 22: 64–72.
    1. Langdon D. A useful annual review of cognition in relapsing MS is beyond most neurologists—NO. Mult Scler 2016; 22: 728–730.
    1. Lengenfelder J, Bryant D, Diamond BJ, et al. Processing speed interacts with working memory efficiency in multiple sclerosis. Arch Clin Neuropsychol 2006; 21: 229–238.
    1. Leavitt VM, Lengenfelder J, Moore NB, et al. The relative contributions of processing speed and cognitive load to working memory accuracy in multiple sclerosis. J Clin Exp Neuropsychol 2011; 33: 580–586.
    1. Genova HM, Lengenfelder J, Chiaravalloti ND, et al. Processing speed versus working memory: Contributions to an information processing task in multiple sclerosis. Appl Neuropsychol Adult 2012; 19: 132–140.
    1. Buchanan RW, Davis M, Goff D, et al. A summary of the FDA-NIMH-MATRICS workshop on clinical trial design for neurocognitive drugs for schizophrenia. Schizophr Bull 2005; 31: 5–19.
    1. Kern RS, Green MF, Nuechterlein KH, et al. NIMH-MATRICS survey on assessment of neurocognition in schizophrenia. Schizophr Res 2004; 72: 11–19.
    1. Green MF, Nuechterlein KH. The MATRICS initiative: Developing a consensus cognitive battery for clinical trials. Schizophr Res 2004; 72: 1–3.
    1. Lovell M, Collins M, Bradley J. Return to play following sports-related concussion. Clin Sports Med 2004; 23: 421–441.
    1. Iverson GL, Lovell MR, Collins MW. Interpreting change on ImPACT following sport concussion. Clin Neuropsychol 2003; 17: 460–467.
    1. Rudick RA, Miller D, Bethoux F, et al. The Multiple Sclerosis Performance Test (MSPT): an iPad-based disability assessment tool. J Vis Exp 2014. June 30; (88): e51318.
    1. Bergsland N, Zivadinov R, Dwyer MG, et al. Localized atrophy of the thalamus and slowed cognitive processing speed in MS patients. Mult Scler 2016; 22: 1327–1336.
    1. Modica CM, Bergsland N, Dwyer MG, et al. Cognitive reserve moderates the impact of subcortical gray matter atrophy on neuropsychological status in multiple sclerosis. Mult Scler 2015; 22(1): 36–42.
    1. Roy S, Rodgers J, Drake AS, et al. Stable neuropsychiatric status in multiple sclerosis: A 3-year study. Mult Scler 2015; 22(4): 569–574.
    1. Bruce JM, Bruce AS, Arnett PA. Mild visual acuity disturbances are associated with performance on tests of complex visual attention in MS. J Int Neuropsychol Soc 2007; 13: 544–548.
    1. Benedict RH, Smerbeck A, Parikh R, et al. Reliability and equivalence of alternate forms for the Symbol Digit Modalities Test: Implications for multiple sclerosis clinical trials. Mult Scler 2012; 18: 1320–1325.
    1. Denney DR, Lynch SG. The impact of multiple sclerosis on patient’s performance on the Stroop Test: Processing speed versus interference. J Int Neuropsychol Soc 2009; 15: 451–458.
    1. Drew MA, Starkey NJ, Isler RB. Examining the link between information processing speed and executive functioning in multiple sclerosis. Arch Clin Neuropsychol 2009; 24: 47–58.
    1. Owens EM, Denney DR, Lynch SG. Difficulties in planning among patients with multiple sclerosis: A relative consequence of deficits in information processing speed. J Int Neuropsychol Soc 2013; 19: 613–620.
    1. Genova HM, DeLuca J, Chiaravalloti N, et al. The relationship between executive functioning, processing speed, and white matter integrity in multiple sclerosis. J Clin Exp Neuropsychol 2013; 35: 631–641.
    1. Chiaravalloti ND, Stojanovic-Radic J, DeLuca J. The role of speed versus working memory in predicting learning new information in multiple sclerosis. J Clin Exp Neuropsychol 2013; 35: 180–191.
    1. Benedict RH, Walton MK. Evaluating cognitive outcome measures for MS clinical trials: What is a clinically meaningful change? Mult Scler 2012; 18(12): 1673–1679.
    1. Vanotti S, Benedict RHB, Acion L, et al. Validation of the Multiple Sclerosis Neuropsychological Screening Questionnaire in Argentina. Multiple Sclerosis 2009; 15: 244–250.
    1. O’Brien A, Gaudino-Goering E, Shawaryn M, et al. Relationship of the Multiple Sclerosis Neuropsychological Questionnaire (MSNQ) to functional, emotional, and neuropsychological outcomes. Arch Clin Neuropsychol 2007; 22: 933–948.
    1. Benedict RHB, Cohan S, Lynch SG, et al. Improved cognitive outcomes in relapsing-remitting multiple sclerosis with daclizumab HYP in the phase 3 DECIDE study. Am Acad Neurol 2016.
    1. Foong J, Rozewicz L, Quaghebeur G, et al. Neuropsychological deficits in multiple sclerosis after acute relapse. J Neurol Neurosurg Psychiatry 1998; 64: 529–532.
    1. Prado FM, Kosac VA, Dib JG. Cognitive relapse in multiple sclerosis: Report of 3 cases. Mult Scler J 2012; 18: 1830–1831.
    1. Patzold T, Schwengelbeck M, Ossege LM, et al. Changes of the MS functional composite and EDSS during and after treatment of relapses with methylprednisolone in patients with multiple sclerosis. Acta Neurol Scand 2002; 105: 164–168.
    1. Kieseier BC, Stuve O. A critical appraisal of treatment decisions in multiple sclerosis—Old versus new. Nat Rev Neurol 2011; 7: 255–262.
    1. Rotstein DL, Healy BC, Malik MT, et al. Evaluation of no evidence of disease activity in a 7-year longitudinal multiple sclerosis cohort. JAMA Neurol 2015; 72: 152–158.
    1. Rudick RA, Miller D, Bethoux F, et al. The Multiple Sclerosis Performance Test (MSPT): An iPad-based disability assessment tool. J Vis Exp 2014; 88: e51318.

Source: PubMed

3
Prenumerera