Evaluating the relationship between change in performance on training tasks and on untrained outcomes

Elizabeth M Zelinski, Kelly D Peters, Shoshana Hindin, Kevin T Petway 2nd, Robert F Kennison, Elizabeth M Zelinski, Kelly D Peters, Shoshana Hindin, Kevin T Petway 2nd, Robert F Kennison

Abstract

Training interventions for older adults are designed to remediate performance on trained tasks and to generalize, or transfer, to untrained tasks. Evidence for transfer is typically based on the trained group showing greater improvement than controls on untrained tasks, or on a correlation between gains in training and in transfer tasks. However, this ignores potential correlational relationships between trained and untrained tasks that exist before training. By accounting for crossed (trained and untrained) and lagged (pre-training and post-training) and cross-lagged relationships between trained and untrained scores in structural equation models, the training-transfer gain relationship can be independently estimated. Transfer is confirmed if only the trained but not control participants' gain correlation is significant. Modeling data from the Improvement in Memory with Plasticity-based Adaptive Cognitive Training (IMPACT) study (Smith et al., 2009), transfer from speeded auditory discrimination and syllable span to list and text memory and to working memory was demonstrated in 487 adults aged 65-93. Evaluation of age, sex, and education on pretest scores and on change did not alter this. The overlap of the training with transfer measures was also investigated to evaluate the hypothesis that performance gains in a non-verbal speeded auditory discrimination task may be associated with gains on fewer tasks than gains in a verbal working memory task. Gains in speeded processing were associated with gains on one list memory measure. Syllable span gains were associated with improvement in difficult list recall, story recall, and working memory factor scores. Findings confirmed that more overlap with task demands was associated with gains to more of the tasks assessed, suggesting that transfer effects are related to task overlap in multimodal training.

Keywords: aging; cognitive training; multimodal training; untrained outcomes.

Figures

Figure 1
Figure 1
Structural Equation Model to test for Transfer between Trained and Untrained Scores. Improvement in speeded discrimination after training is associated with RBANS list recall factor score improvement. Values for the experimental group/control group. Unstandardized values are shown.

References

    1. Anderson S., White-Schwoch T., Parbery-Clark A., Kraus N. (2013). Reversal of age-related timing delays with training. Proc. Natl. Acad. Sci. U.S.A. 110, 4357–4362 10.1073/pnas.1213555110
    1. Anguera J. A., Boccanfuso J., Rintoul J. L., Al-Hashimi O., Faraji F., Janowich J., et al. (2013). Video game training enhances cognitive control in older adults. Nature 501, 97–101 10.1038/nature12486
    1. Ball K., Berch D. B., Helmers K. F., Jobe J. B., Leveck M. D., Marsiske M., et al. (2002). Effects of cognitive training interventions with older adults: a randomized controlled trial. J. Am. Med. Assoc. 288, 2271–2281 10.1001/jama.288.18.2271
    1. Basak C., Boot W. R., Voss M. W., Kramer A. F. (2008). Can training in a real-time strategy videogame attenuate cognitive decline in older adults? Psychol. Aging 23, 765–777 10.1037/a0013494
    1. Bentler P. M. (1990). Comparative fit indexes in structural models. Psychol. Bull. 107, 238–246 10.1037/0033-2909.107.2.238
    1. Boot W. R., Simons D. J., Stothart C., Stutts C. (2013). The pervasive problem with placebos in psychology: why active control groups are not sufficient to rule out placebo effects. Perspect. Psychol. Sci. 8, 445–454 10.1177/1745691613491271
    1. Browne M. W., Cudeck R. (1992). Alternative ways of assessing model fit. Soc. Methods Res. 21, 230–258 10.1177/0049124192021002005
    1. Buschkuehl M., Jaeggi S. M., Hutchison S., Perrig-Chiello P., Däpp C., Müller M., et al. (2008). Impact of working memory training on memory performance in old-old adults. Psychol. Aging 23, 743–753 10.1037/a0014342
    1. Buschkuehl M., Jaeggi S. M., Jonides J. (2012). Neuronal effects following working memory training. Dev. Cogn. Neurosci. 25, S167–S179 10.1016/j.dcn.2011.10.001
    1. Carmines E. G., McIver J. P. (1981). Analyzing models with unobserved variables: analysis of covariance structures, in Social Measurement: Current Issues eds Bohrnstedt G. W., Borgatta E. F. (Beverly Hills, CA: Sage Publications; ), 65–115
    1. Dahlin E., Neely A. S., Larsson A., Bäckman L., Nyberg L. (2008). Transfer of learning after updating training mediated by the striatum. Science 320, 1510–1512 10.1126/science.1155466
    1. Hertzog C., Kramer A. F., Wilson R. S., Lindenberger U. (2009). Enrichment effects on adult cognitive development: can the functional capacity of older adults be preserved or enhanced? Psychol. Sci. Public Interest 9, 1–65 10.1111/j.1539-6053.2009.01034.x
    1. Hertzog C., Touron D. R., Hines J. C. (2007). Does a time-monitoring deficit influence older adults' delayed retrieval shift during skill acquisition? Psychol. Aging 22, 607–624 10.1037/0882-7974.22.3.607
    1. Hindin S., Zelinski E. M. (2012). Extended practice and aerobic exercise interventions benefit untrained cognitive outcomes in older adults: a meta-analysis. J. Am. Geriatr. Soc. 60, 136–141 10.1111/j.1532-5415.2011.03761.x
    1. Horn J. L., McArdle J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Exp. Aging Res. 18, 117–144 10.1080/03610739208253916
    1. Hu L. T., Bentler P. M. (1999). Cut-off criteria for fit indexes in covariance structure analysis. Conventional criteria versus new alternatives. Struct. Equ. Modeling 6, 1–55 10.1080/10705519909540118
    1. Jaeggi S. M., Buschkeul M., Jonides J., Shah P. (2011). Short-and long-term benefits of cognitive training. Proc. Natl. Acad. Sci. U.S.A. 108, 10081–10086 10.1073/pnas.1103228108
    1. Jobe J. B., Smith D. M., Ball K., Tennstedt S. L., Marsiske M., Willis S. L., et al. (2001). ACTIVE: a cognitive intervention trial to promote independence in older adults. Control. Clin. Trials 22, 453–479 10.1016/S0197-2456(01)00139-8
    1. Joreskog K. G., Sorbom D. (1988). LISREL 7 – A Guide to the Program and Applications, 2nd Edn. Chicago, IL: SPSS
    1. Karbach J., Kray J. (2009). How useful is executive control training? Age differences in near and far transfer of task-switching training. Dev. Sci. 12, 978–990 10.1111/j.1467-7687.2009.00846.x
    1. Lewis K. L., Zelinski E. M. (2010). List and text recall differ in their predictors: Replication over samples and time. J. Gerontol. Psychol. Sci. 65B, 449–458 10.1093/geronb/gbq034
    1. Li S., Schmiedek F., Huxhold O., Rocke C., Smith J., Lindenberger U. (2008). Working memory plasticity in old age: practice gain, transfer, and maintenance. Psychol. Aging 23, 731–742 10.1037/a0014343
    1. Lövdén M., Bäckman L., Lindenberger U., Schaefer S., Schmiedek F. (2010). A theoretical framework for the study of adult cognitive plasticity. Psychol. Bull. 136, 659–676 10.1037/a0020080
    1. Mahncke H. W., Bronstone A., Merzenich M. M. (2006). Brain plasticity and functional losses in the aged: scientific bases for a novel intervention. Prog. Brain Res. 157, 81–109 10.1016/S0079-6123(06)57006-2
    1. Marsh H. W., Balla J., McDonald R. P. (1988). Goodness of fit indexes in confirmatory factor analysis: the effect of sample size. Psychol. Bull. 103, 391–410 10.1037/0033-2909.103.3.391
    1. McArdle J. J., Prindle J. J. (2008). A latent change score analysis of a randomized clinical trial in reasoning training. Psychol. Aging 23, 702–719 10.1037/a0014349
    1. Melby-Lervag M., Hulme C. (2013). Is working memory effective? A meta-analytic review. Dev. Psychol. 49, 270–291 10.1037/a0028228
    1. Meyer G. J., Finn S. E., Eyde L. D., Kay G. G., Moreland K. L., Dies R. R., et al. (2001). Psychological testing and psychological assessment: a review of evidence and issues. Am. Psychol. 56, 128–165 10.1037/0003-066X.56.2.128
    1. Moreau D., Conway A. R. A. (2014). The case for an ecological approach to cognitive training. Trends Cogn. Sci. 18, 1364–1366 10.1016/j.tics.2014.03.009
    1. Novick J. M., Hussey E., Teubner-Rhodes S., Harbison J. I., Bunting M. F. (2014). Clearing the garden-path: improving sentence processing though cognitive control training. Lang. Cogn. Neurosci. 29, 186–217 10.1080/01690965.2012.758297
    1. Park D. C., Gutchess A. H., Meade M. L., Stine-Morrow E. A. L. (2007). Improving cognitive function in older adults: nontraditional approaches. J. Gerontol. B 62B, 45–52 10.1093/geronb/62.special_issue_1.45
    1. Persson J., Welsh K. M., Jonides J., Reuter-Lorenz P. A. (2007). Cognitive fatigue of executive processes: interaction between interference resolution tasks. Neuropsychologia 45, 1571–1579 10.1016/j.neuropsychologia.2006.12.007
    1. Randolph C. (1998). Repeatable Battery for the Assessment of Neuropsychological Status. San Antonio, TX: Psychological Corporation
    1. Rebok G. W., Ball K., Guey L. T., Jones R. N., Kim H.-Y., King J. W., et al. (2014). Ten-year effects of he advanced cognitive training for independent and vital elderly cognitive training trial on cognition and everyday functioning in older adults. J. Am. Geriatr. Soc. 62, 16–24 10.1111/jgs.12607
    1. Redick T. S., Shipstead Z., Harrison T. L., Hicks K. L., Fried D. E., Hambrick D. Z., et al. (2013). No evidence of intelligence improvement after working memory training: a randomized, placebo-controlled study. J. Exp. Psychol. Gen. 142, 359–379 10.1037/a0029082
    1. R Project Homepage :
    1. Salthouse T. A. (1996). The processing-speed theory of adult agedifferences in cognition. Psychol. Rev. 103, 403–428 10.1037/0033-295X.103.3.403
    1. Schmidt M. (1996). Rey Auditory and Verbal Learning Test: A Handbook. Los Angeles, CA: Western Psychological Services
    1. Schmiedek F., Lövden M., Lindenberger U. (2010). Hundred days of cognitive training enhance broad cognitive abilities in adulthood: findins from the COGITO study. Front. Aging Neurosci. 2:27 10.3389/fnagi.2010.00027
    1. Schwarz G. E. (1978). Estimating the dimension of a model. Ann. Stat. 6, 461–464 10.1214/aos/1176344136
    1. Shipstead Z., Redick T. S., Engle R. W. (2010). Does working memory training generalize? Psychol. Belg. 50, 245–276 10.5334/pb-50-3-4-245
    1. Smith G. E., Housen P., Yaffe K., Ruff R., Kennison R. F., Mahncke H. W., et al. (2009). A cognitive training program based on principles of brain plasticity: results from the Improvement in Memory with Plasticity-based Adaptive Cognitive Training (IMPACT) study. J. Am. Geriatr. Soc. 57, 594–603 10.1111/j.1532-5415.2008.02167.x
    1. Sprenger A. M., Atkins S. M., Bolger D. J., Harbison J. I., Novick J. M., Chrabaszcz J. S., et al. (2013). Training working memory: limits of transfer. Intelligence 41, 638–663 10.1016/j.intell.2013.07.013
    1. Steiger J. H. (1990). Structural model evaluation and modification. Multivar. Behav. Res. 25, 214–212 10.1207/s15327906mbr2502_4
    1. Stepankova H., Lukavsky J., Buschkuehl M., Kopecek M., Ripova D., Jaeggi S. M. (2014). The malleability of working memory and visuospatial skills: a randomized controlled study in older adults. Dev. Psychol. 50, 1049–1059 10.1037/a0034913
    1. Tidwell J. W., Dougherty M. R., Chrabaszcz J. R., Thomas R. P., Mendoza J. L. (2014). What counts as evidence for working memory training? Problems with correlated gains and dichotomization. Psychon. Bull. Rev. 21, 620–628 10.3758/s13423-013-0560-7
    1. Tucker L. R., Lewis C. (1973). The reliability coefficient for maximum likelihood factor analysis. Psychometrika 38, 1–10 10.1007/BF02291170
    1. von Bastian C., Langer N., Jäncke L., Oberauer K. (2013). Effects of working memory training in young and old adults. Mem. Cognit. 41, 611–624 10.3758/s13421-012-0280-7
    1. Wechsler D. (1997). Wechsler Memory Scale-3rd. San Antonio, TX: Psychological Corporation
    1. West R. L., Bagwell D. K., Dark-Freudeman A. (2008). Self-efficacy and memory aging: the impact of a memory intervention based on self-efficacy. Aging Neuropsychol. Cogn. 15, 302–329 10.1080/13825580701440510
    1. Wheaton B., Muthén B., Alwin D., Summers G. (1977). Assessing reliability and stability in panel models, in Sociological Methodology ed Heise D. R. (San Francisco CA: Jossey-Bass, Inc; ). 84–136
    1. Whitlock L. A., McLaughlin A. C., Allaire J. C. (2012). Individual differences in response to cognitive training: using a multi-modal, attentionally demanding game-based intervention for older adults. Comput. Hum. Behav. 28, 1091–1096 10.1016/j.chb.2012.01.012
    1. Wilson B., Cockburn J., Baddeley A. (2003). The Rivermead Behavioral Memory Test - 2nd Supplement Two. San Antonio, TX: Harcourt Assessment
    1. Zelinski E. M. (2009). Far transfer in cognitive training of older adults. Restor. Neurol. Neurosci. 27, 455–471 10.3233/RNN-2009-0495
    1. Zelinski E. M., Dalton S. E., Hindin S. (2011a). Cognitive changes in healthy older adults. Generations 35, 13–20
    1. Zelinski E. M., Gilewski M. J. (2003). Effects of demographic and health variables on Rasch scaled cognitive scores. J. Aging Health 15, 435–464 10.1177/0898264303253499
    1. Zelinski E. M., Spina L. M., Yaffe K., Ruff R., Kennison R. F., Mahncke H. W., et al. (2011b). Improvement in memory with plasticity-based adaptive cognitive training (impact): results of the 3-month follow-up. J. Am. Geriatr. Soc. 59, 258–265 10.1111/j.1532-5415.2010.03277.x

Source: PubMed

Sponsors en medewerkers

Medische omstandigheden

Geneesmiddelinterventies

3
Abonneren