How to Capitalize on the Retest Effect in Future Trials on Huntington's Disease

Abstract

The retest effect-improvement of performance on second exposure to a task-may impede the detection of cognitive decline in clinical trials for neurodegenerative diseases. We assessed the impact of the retest effect in Huntington's disease trials, and investigated its possible neutralization. We enrolled 54 patients in the Multicentric Intracerebral Grafting in Huntington's Disease (MIG-HD) trial and 39 in the placebo arm of the Riluzole trial in Huntington's Disease (RIL-HD). All were assessed with the Unified Huntington's Disease Rating Scale (UHDRS) plus additional cognitive tasks at baseline (A1), shortly after baseline (A2) and one year later (A3). We used paired t-tests to analyze the retest effect between A1 and A2. For each task of the MIG-HD study, we used a stepwise algorithm to design models predictive of patient performance at A3, which we applied to the RIL-HD trial for external validation. We observed a retest effect in most cognitive tasks. A decline in performance at one year was detected in 3 of the 15 cognitive tasks with A1 as the baseline, and 9 of the 15 cognitive tasks with A2 as the baseline. We also included the retest effect in performance modeling and showed that it facilitated performance prediction one year later for 14 of the 15 cognitive tasks. The retest effect may mask cognitive decline in patients with neurodegenerative diseases. The dual baseline can improve clinical trial design, and better prediction should homogenize patient groups, resulting in smaller numbers of participants being required.

Trial registration: ClinicalTrials.gov NCT00190450 NCT00277602.

Conflict of interest statement

Competing Interests: CS was successively supported by the NeuroStemcell Consortium (European Community Seventh Framework Program grant agreement no. 222943) and by “Investments for the future” (ANR11INBS0011 NeurATRIS: Infrastructure de recherche translationnelle pour les biothérapies en Neurosciences). SK: no financial disclosures. KY: no financial disclosures. JFD has received financial support from Eli Lilly, Lundbeck, Novartis, Schwabe and Vifor Pharma over the Rebuttal letter past 2 years as a member of scientific boards and speaker at sponsored sessions. This financial support was completely unrelated to the work reported here. PK: no financial disclosures. FS: no financial disclosures. CV: no financial disclosures. LCL: no financial disclosures. CBL acted as a consultant for Teva, once, in 2014. She received grants from the Ministry of Health supporting the National Reference Center for Huntington’s Disease and several grants for academic trials provided by the Direction de la Recherche Clinique (APHP). She is a partner in several investments for the future projects (Labex IEC, Neuratris) and in an EU FP7 project (RepairHD). This does not alter the authors’ adherence to PLOS ONE policies on sharing data and materials.

Figures

Fig 1. Impact of the retest effect in the MIG-HD cohort.

SDMT: Symbol Digit Modalities Test; Stroop C, W and C/W: Stroop color, word and color/word interference; MDRS: Mattis Dementia Rating Scale; TMT A, B: Trail-Making Test A and B; TFC: Total Functional Capacity; IS: Independence Scale; FAS: Functional Assessment Scale. The red curve represents the baseline (reference score A1) and the blue curve shows the mean relative score one month later (A2). The portion of the blue curve beyond the red curve indicates performance improvement between A1 and A2. Paired t-tests, significance: * P<0.05, ** P<0.01, *** P<0.001.

Fig 2. Observed performance at one year (A3), with A1 or A2 used as the baseline, in the MIG-HD cohort.

SDMT: Symbol Digit Modalities Test; Stroop C, W and C/W: Stroop color, word and color/word interference; MDRS: Mattis Dementia Rating Scale; TMT A, B: Trail-Making Test A and B; TFC: Total Functional Capacity; IS: Independence Scale; FAS: Functional Assessment Scale. The red curve represents the baseline (reference score). The blue (or green) curve corresponds to the mean relative score one year later (A3), with A1 (or A2 for the green curve) used as the baseline. A green curve within the blue curve indicates that the decline was easier to detect if A2 was used as the baseline, rather than A1. Paired t-tests, significance: * P<0.05, ** P<0.01, *** P<0.001.

Fig 3. External validation of models in the RIL-HD cohort, based on R e 2 and ICC.

SDMT: Symbol Digit Modalities Test; Stroop C, W and C/W: Stroop color, word and color/word interference; MDRS: Mattis Dementia Rating Scale; TMT A, B: Trail-Making Test A and B; HVLT: Hopkins Verbal Learning Task; TFC: Total Functional Capacity; IS: Independence Scale; FAS: Functional Assessment Scale. N: number of patients in the RIL-HD cohort for whom all the data required for the predictive model were available. Re2: coefficient of determination for external validation. ICC: intraclass correlation coefficient. 95% CI: 95% confidence interval. a: Re2 = -0.7. The red line represents the limit for a high-quality model (Re2 > 50% of the observed variance explained by the model).