Working Memory, Reasoning, and Task Switching Training: Transfer Effects, Limitations, and Great Expectations?

Pauline L Baniqued, Courtney M Allen, Michael B Kranz, Kathryn Johnson, Aldis Sipolins, Charles Dickens, Nathan Ward, Alexandra Geyer, Arthur F Kramer, Pauline L Baniqued, Courtney M Allen, Michael B Kranz, Kathryn Johnson, Aldis Sipolins, Charles Dickens, Nathan Ward, Alexandra Geyer, Arthur F Kramer

Abstract

Although some studies have shown that cognitive training can produce improvements to untrained cognitive domains (far transfer), many others fail to show these effects, especially when it comes to improving fluid intelligence. The current study was designed to overcome several limitations of previous training studies by incorporating training expectancy assessments, an active control group, and "Mind Frontiers," a video game-based mobile program comprised of six adaptive, cognitively demanding training tasks that have been found to lead to increased scores in fluid intelligence (Gf) tests. We hypothesize that such integrated training may lead to broad improvements in cognitive abilities by targeting aspects of working memory, executive function, reasoning, and problem solving. Ninety participants completed 20 hour-and-a-half long training sessions over four to five weeks, 45 of whom played Mind Frontiers and 45 of whom completed visual search and change detection tasks (active control). After training, the Mind Frontiers group improved in working memory n-back tests, a composite measure of perceptual speed, and a composite measure of reaction time in reasoning tests. No training-related improvements were found in reasoning accuracy or other working memory tests, nor in composite measures of episodic memory, selective attention, divided attention, and multi-tasking. Perceived self-improvement in the tested abilities did not differ between groups. A general expectancy difference in problem-solving was observed between groups, but this perceived benefit did not correlate with training-related improvement. In summary, although these findings provide modest evidence regarding the efficacy of an integrated cognitive training program, more research is needed to determine the utility of Mind Frontiers as a cognitive training tool.

Conflict of interest statement

Competing Interests: Charles Dickens is employed by Aptima, Inc., which developed the Mind Frontiers game in collaboration with University of Illinois researchers Arthur Kramer and Pauline Baniqued. A version of Mind Frontiers is currently in use in studies at the University of Illinois and Florida State University. Alexandra Geyer was employed by Aptima, Inc. during the development and implementation of the current study. She is no longer affiliated with the company. There are no patents, further products in development or marketed products to declare. This does not alter the authors’ adherence to all the PLOS ONE policies on sharing data and materials.

Figures

Fig 1. Mind Frontiers tasks.
Fig 1. Mind Frontiers tasks.
Screenshots of Mind Frontiers games: Top to bottom, left to right: Supply Run, Riding Shotgun, Sentry Duty, Safe Cracker, Irrigator, Pen ‘Em Up.
Fig 2. Active control tasks.
Fig 2. Active control tasks.
Left: Screenshots of three versions of the change detection task, from top to bottom: colored shapes, cars, letters. Right: Screenshots of three versions of the visual search tasks, from top to bottom: original visual search in Redick et al. [32], colored Ps, Ls. For publication purposes, stimuli are not drawn to scale (enlarged).
Fig 3. Practice effects.
Fig 3. Practice effects.
Panel 1: Average level across sessions for each Mind Frontiers task. Panels 2–3. Average level across sessions for each active control task. Panel 2: Change detection average maximum duration according to session and set size. Panel 3: Visual search average level according to session and task (color). Error bars are SEM.
Fig 4. Transfer effects.
Fig 4. Transfer effects.
Displayed are means from the MANOVA (N = 42 for Mind Frontiers, N = 45 for Active Control). Error bars are SEM.

References

    1. Boot WR, Kramer AF. The brain-games conundrum: Does cognitive training really sharpen the mind? Cerebrum. 2014; 2014: 15
    1. Schubert T, Strobach T, Karbach J. New directions in cognitive training: on methods, transfer, and application. Psychol Res. 2014; 78(6): 749–755. 10.1007/s00426-014-0619-8
    1. Jolles DD, Crone EA. Training the developing brain: a neurocognitive perspective. Front Hum Neurosci. 2012; 6: 76 10.3389/fnhum.2012.00076
    1. Hertzog C, Kramer AF, Wilson RS, Lindenberger U. Enrichment effects on adult cognitive development can the functional capacity of older adults be preserved and enhanced? Psychol Sci Public Interest. 2008; 9(1): 1–65. 10.1111/j.1539-6053.2009.01034.x
    1. Gray JR, Thompson PM. Neurobiology of intelligence: science and ethics. Nat Rev Neurosci. 2004; 5(6): 471–482. 10.1038/nrn1405
    1. Gottfredson LS. Why g matters: The complexity of everyday life. Intelligence. 1997; 24: 79–132. 10.1016/S0160-2896(97)90014-3
    1. Colom R, Escorial S, Shih PC, Privado J. Fluid intelligence, memory span, and temperament difficulties predict academic performance of young adolescents. Pers Individ Dif. 2007; 42(8): 1503–1514. 10.1016/j.paid.2006.10.023
    1. Rueda MR, Rothbart MK, McCandliss BD, Saccomanno L, Posner MI. Training, maturation, and genetic influences on the development of executive attention. Proc Natl Acad Sci U S A. 2005; 102(41): 14931–14936. 10.1073/pnas.0506897102
    1. Thorell LB, Lindqvist S, Bergman Nutley S, Bohlin G, Klingberg T. Training and transfer effects of executive functions in preschool children. Dev Sci. 2009; 12(1): 106–113. 10.1111/j.1467-7687.2008.00745.x
    1. Rueda MR, Checa P, Cómbita LM. Enhanced efficiency of the executive attention network after training in preschool children: immediate changes and effects after two months. Dev Cogn Neurosci. 2012; 2: S192–S204. 10.1016/j.dcn.2011.09.004
    1. Bergman Nutley S, Söderqvist S, Bryde S, Thorell LB, Humphreys K, Klingberg T. Gains in fluid intelligence after training non-verbal reasoning in 4-year-old children: a controlled, randomized study. Dev Sci. 2011; 14(3): 591–601. 10.1111/j.1467-7687.2010.01022.x
    1. Jaeggi SM, Buschkuehl M, Jonides J, Shah P. Short- and long-term benefits of cognitive training. Proc Natl Acad Sci U S A. 2011; 108(25): 10081–10086. 10.1073/pnas.1103228108
    1. Loosli SV, Buschkuehl M, Perrig WJ, Jaeggi SM. Working memory training improves reading processes in typically developing children. Child Neuropsychol. 2012; 18(1): 62–78. 10.1080/09297049.2011.575772
    1. Mackey AP, Hill SS, Stone SI, Bunge SA. Differential effects of reasoning and speed training in children. Dev Sci. 2011; 14(3): 582–590. 10.1111/j.1467-7687.2010.01005.x
    1. Kirk H, Gray K, Riby D, Cornish K. Cognitive training as a resolution for early executive function difficulties in children with intellectual disabilities. Res Dev Disabil. 2015; 38: 145–160. 10.1016/j.ridd.2014.12.026
    1. Klingberg T, Fernell E, Olesen PJ, Johnson M, Gustafsson P, Dahlström K, et al. Computerized training of working memory in children with ADHD-a randomized, controlled trial. J Am Acad Child Adolesc Psychiatry. 2005; 44(2): 177–186. 10.1097/00004583-200502000-00010
    1. Holmes J, Gathercole SE, Dunning DL. Adaptive training leads to sustained enhancement of poor working memory in children. Dev Sci. 2009; 12(4): F9–F15. 10.1111/j.1467-7687.2009.00848.x
    1. Dunning DL, Holmes J, Gathercole SE. Does working memory training lead to generalized improvements in children with low working memory? A randomized controlled trial. Dev Sci. 2013; 16(6): 915–925. 10.1111/desc.12068
    1. Klingberg T, Forssberg H, Westerberg H. Training of working memory in children with ADHD. J Clin Exp Neuropsychol. 2002; 24(6): 781–791. 10.1076/jcen.24.6.781.8395
    1. Olesen PJ, Westerberg H, Klingberg T. Increased prefrontal and parietal activity after training of working memory. Nat Neurosci. 2004; 7(1): 75–79. 10.1038/nn1165
    1. Jaeggi SM, Buschkuehl M, Jonides J, Perrig WJ. Improving fluid intelligence with training on working memory. Proc Natl Acad Sci U S A. 2008; 105(19): 6829–6833. 10.1073/pnas.0801268105
    1. Karbach J, Kray J. How useful is executive control training? Age differences in near and far transfer of task-switching training. Dev Sci. 2009; 12(6): 978–990. 10.1111/j.1467-7687.2009.00846.x
    1. Willis SL, Schaie KW. Training the elderly on the ability factors of spatial orientation and inductive reasoning. Psychol Aging. 1986; 1(3): 239–247.
    1. Dahlin E, Neely AS, Larsson A, Bäckman L, Nyberg L. Transfer of learning after updating training mediated by the striatum. Science. 2008; 320(5882): 1510–1512. 10.1126/science.1155466
    1. Dahlin E, Nyberg L, Bäckman L, Neely AS. Plasticity of executive functioning in young and older adults: immediate training gains, transfer, and long-term maintenance. Psychol Aging. 2008; 23(4): 720–730. 10.1037/a0014296
    1. Klingberg T. Training and plasticity of working memory. Trends Cogn Sci. 2010; 14(7): 317–324. 10.1016/j.tics.2010.05.002
    1. Morrison AB, Chein JM. Does working memory training work? The promise and challenges of enhancing cognition by training working memory. Psychon Bull Rev. 2011; 18(1): 46–60. 10.3758/s13423-010-0034-0
    1. Harrison TL, Shipstead Z, Hicks KL, Hambrick DZ, Redick TS, Engle RW. Working memory training may increase working memory capacity but not fluid intelligence. Psychol Sci. 2013; 24(12): 2409–2419. 10.1177/0956797613492984
    1. Boot WR, Blakely DP, Simons DJ. Do action video games improve perception and cognition? Front Psychol. 2011; 2: 226 10.3389/fpsyg.2011.00226
    1. Boot WR, Simons DJ, Stothart C, Stutts C. The pervasive problem with placebos in psychology: why active control groups are not sufficient to rule out placebo effects. Perspect Psychol Sci. 2013; 8(4): 445–454. 10.1177/1745691613491271
    1. Shipstead Z, Redick TS, Engle RW. Is working memory training effective? Psychol Bull. 2012; 138(4): 628–654. 10.1037/a0027473
    1. Redick TS, Shipstead Z, Harrison TL, Hicks KL, Fried DE, Hambrick DZ, et al. No evidence of intelligence improvement after working memory training: a randomized, placebo-controlled study. J Exp Psychol Gen. 2013; 142(2): 359–379. 10.1037/a0029082
    1. Kundu B, Sutterer DW, Emrich SM, Postle BR. Strengthened effective connectivity underlies transfer of working memory training to tests of short-term memory and attention. J Neurosci. 2013; 33(20): 8705–8715. 10.1523/JNEUROSCI.5565-12.2013
    1. Thompson TW, Waskom ML, Garel KA, Cardenas-Iniguez C, Reynolds GO, Winter R, et al. Failure of working memory training to enhance cognition or intelligence. PLoS One. 2013; 8(5): e63614 10.1371/journal.pone.0063614
    1. Sprenger AM, Atkins SM, Bolger DJ, Harbison JI, Novick JM, Chrabaszcz JS, et al. Training working memory: limits of transfer. Intelligence. 2013; 41(5): 638–663. 10.1016/j.intell.2013.07.013
    1. Schweizer S, Hampshire A, Dalgleish T. Extending brain-training to the affective domain: increasing cognitive and affective executive control through emotional working memory training. PLoS One. 2011; 6(9): e24372 10.1371/journal.pone.0024372
    1. Stephenson CL, Halpern DF. Improved matrix reasoning is limited to training on tasks with a visuospatial component. Intelligence. 2013; 41(5): 341–357. 10.1016/j.intell.2013.05.006
    1. Au J, Sheehan E, Tsai N, Duncan GJ, Buschkuehl M, Jaeggi SM. Improving fluid intelligence with training on working memory: a meta-analysis. Psychon Bull Rev. 2014; 22(2): 366–377. 10.3758/s13423-014-0699-x
    1. Karbach J, Verhaeghen P. Making working memory work: a meta-analysis of executive-control and working memory training in older adults. Psychol Sci. 2014; 25(11): 2027–2037. 10.1177/0956797614548725
    1. Lampit A, Hallock H, Valenzuela M. Computerized cognitive training in cognitively healthy older adults: a systematic review and meta-analysis of effect modifiers. PLoS Med. 2014; 11(11): e1001756 10.1371/journal.pmed.1001756
    1. Dougherty MR, Hamovitz T, Tidwell JW. Reevaluating the effectiveness of n-back training on transfer through the Bayesian lens: Support for the null. Psychon Bull Rev. 2015; In press.
    1. Melby-Lervåg M, Hulme C. There is no convincing evidence that working memory training is effective: a reply to Au et al. (2014) and Karbach and Verhaeghen (2014). Psychon Bull Rev. 2015; In press.
    1. Ball K, Berch DB, Helmers KF, Jobe JB, Leveck MD, Marsiske M, et al. Effects of cognitive training interventions with older adults: a randomized controlled trial. JAMA. 2002; 288(18): 2271–2281. 10.1001/jama.288.18.2271
    1. Willis SL, Tennstedt SL, Marsiske M, Ball K, Elias J, Koepke KM, et al. Long-term effects of cognitive training on everyday functional outcomes in older adults. JAMA. 2006; 296(23): 2805–2814. 10.1001/jama.296.23.2805
    1. Green CS, Bavelier D. Exercising your brain: a review of human brain plasticity and training-induced learning. Psychol Aging. 2008; 23(4): 692–701. 10.1037/a0014345
    1. Ackerman PL, Kanfer R, Calderwood C. Use it or lose it? Wii brain exercise practice and reading for domain knowledge. Psychol Aging. 2010; 25(4): 753–766. 10.1037/a0019277
    1. Boot WR, Basak C, Erickson KI, Neider M, Simons DJ, Fabiani M, et al. Transfer of skill engendered by complex task training under conditions of variable priority. Acta Psychol (Amst). 2010; 135(3): 349–357. 10.1016/j.actpsy.2010.09.005
    1. Owen AM, Hampshire A, Grahn JA, Stenton R, Dajani S, Burns AS, et al. Putting brain training to the test. Nature. 2010; 465(7299): 775–778. 10.1038/nature09042
    1. Lee H, Boot WR, Basak C, Voss MW, Prakash RS, Neider M, et al. Performance gains from directed training do not transfer to untrained tasks. Acta Psychol (Amst). 2012; 139(1): 146–158. 10.1016/j.actpsy.2011.11.003
    1. Schubert T, Finke K, Redel P, Kluckow S, Müller H, Strobach T. Video game experience and its influence on visual attention parameters: an investigation using the framework of the Theory of Visual Attention (TVA). Acta Psychol (Amst). 2015; 157: 200–214. 10.1016/j.actpsy.2015.03.005
    1. Schmiedek F, Lovden M, Lindenberger U. Hundred days of cognitive training enhance broad cognitive abilities in adulthood: findings from the COGITO study. Front Aging Neurosci. 2010; 2: 27 10.3389/fnagi.2010.00027
    1. Bavelier D, Green CS, Pouget A, Schrater P. Brain plasticity through the life span: learning to learn and action video games. Annu Rev Neurosci. 2012; 35: 391–416. 10.1146/annurev-neuro-060909-152832
    1. Oei AC, Patterson MD. Enhancing cognition with video games: a multiple game training study. PLoS One. 2013; 8(3): e58546 10.1371/journal.pone.0058546
    1. Baniqued PL, Kranz MB, Voss MW, Lee H, Cosman JD, Severson J, et al. Cognitive training with casual video games: points to consider. Front Psychol. 2014; 4: 1010 10.3389/fpsyg.2013.01010
    1. Lampit A, Ebster C, Valenzuela M. Multi-domain computerized cognitive training program improves performance of bookkeeping tasks: a matched-sampling active-controlled trial. Front Psychol. 2014; 5: 794 10.3389/fpsyg.2014.00794
    1. van Muijden J, Band GP, Hommel B. Online games training aging brains: limited transfer to cognitive control functions. Front Hum Neurosci. 2012; 6: 221 10.3389/fnhum.2012.00221
    1. von Bastian CC, Langer N, Jäncke L, Oberauer K. Effects of working memory training in young and old adults. Mem Cognit. 2013; 41(4): 611–624. 10.3758/s13421-012-0280-7
    1. Gaspar JG, Neider MB, Simons DJ, McCarley JS, Kramer AF. Change detection: training and transfer. PLoS One. 2013; 8(6): e67781 10.1371/journal.pone.0067781
    1. Salthouse TA. Relations between cognitive abilities and measures of executive functioning. Neuropsychology. 2005; 19(4): 532–545. 10.1037/0894-4105.19.4.532
    1. Redick TS, Unsworth N, Kelly AJ, Engle RW. Faster, smarter? Working memory capacity and perceptual speed in relation to fluid intelligence. J Cogn Psychol (Hove). 2012; 24(7): 844–854.
    1. Salthouse TA, Ferrer-Caja E. What needs to be explained to account for age-related effects on multiple cognitive variables? Psychol Aging. 2003; 18(1): 91–110.
    1. Shipstead Z, Harrison TL, Engle RW. Working memory capacity and visual attention: top-down and bottom-up guidance. Q J Exp Psychol (Hove). 2012; 65(3): 401–407. 10.1080/17470218.2012.655698
    1. Jensen AR. How much can we boost IQ and scholastic achievement? Harv Educ Rev. 1969; 39(1): 1–123.
    1. Schaie KW. What can we learn from longitudinal studies of adult development? Res Hum Dev. 2005; 2(3): 133–158. 10.1207/s15427617rhd0203_4
    1. Salthouse TA. When does age-related cognitive decline begin? Neurobiol Aging. 2009; 30(4): 507–514. 10.1016/j.neurobiolaging.2008.09.023
    1. Godin G, Shephard R. Godin leisure-time exercise questionnaire. Med Sci Sports Exerc. 1997; 29(6s): S36–S38.
    1. Kane MJ, Poole BJ, Tuholski SW, Engle RW. Working memory capacity and the top-down control of visual search: exploring the boundaries of "executive attention". J Exp Psychol Learn Mem Cogn. 2006; 32(4): 749–777. 10.1037/0278-7393.32.4.749
    1. Poole BJ, Kane MJ. Working-memory capacity predicts the executive control of visual search among distractors: the influences of sustained and selective attention. Q J Exp Psychol (Hove). 2009; 62(7): 1430–1454. 10.1080/17470210802479329
    1. Schneider W, Eschman A, Zuccolotto A. E-Prime user’s guide. Pittsburgh: Psychology Software Tools Inc; 2002.
    1. Brainard DH. The psychophysics toolbox. Spat Vis. 1997; 10: 433–436. 10.1163/156856897X00357
    1. Pelli DG. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis. 1997; 10: 437–442. 10.1163/156856897X00366
    1. Zachary RA. Shipley institute of living scale: revised manual. Los Angeles: Western Psychological Services; 1986.
    1. Ravens J. Advanced progressive matrices: Set II. London: H.K. Lewis; 1962.
    1. Crone EA, Wendelken C, van Leijenhorst L, Honomichl RD, Christoff K, Bunge SA. Neurocognitive development of relational reasoning. Dev Sci. 2009; 12(1): 55–66. 10.1111/j.1467-7687.2008.00743.x
    1. Ekstrom RB, French JW, Harman HH, Dermen D. Manual for kit of factor referenced cognitive tests. Princeton: Educational Testing Service; 1976.
    1. Bennett GK, Seashore HG, Wesman AG. Differential aptitude tests. San Antonio: The Psychological Corporation; 1947.
    1. Wechsler D. WAIS-III: Wechsler adult intelligence scale. San Antonio: The Psychological Corporation; 1997.
    1. Salthouse TA, Babcock RL. Decomposing adult age differences in working memory. Dev Psychol. 1991; 27(5): 763–776. 10.1037/0012-1649.27.5.763
    1. Wechsler D. Wechsler memory scale (WMS-III). San Antonio: The Psychological Corporation; 1997.
    1. Salthouse TA, Fristoe N, Rhee SH. How localized are age-related effects on neuropsychological measures? Neuropsychology. 1996; 10(2): 272–285. 10.1037/0894-4105.10.2.272
    1. Watson PD, Voss JL, Warren DE, Tranel D, Cohen NJ. Spatial reconstruction by patients with hippocampal damage is dominated by relational memory errors. Hippocampus. 2013; 23(7): 570–580. 10.1002/hipo.22115
    1. Monti JM, Cooke GE, Watson PD, Voss MW, Kramer AF, Cohen NJ. Relating hippocampus to relational memory processing across domains and delays. J Cogn Neurosci. 2015; 27(2): 234–245. 10.1162/jocn_a_00717
    1. Broadway JM, Engle RW. Validating running memory span: Measurement of working memory capacity and links with fluid intelligence. Behav Res Methods. 2010; 42(2): 563–570. 10.3758/BRM.42.2.563
    1. Turner ML, Engle RW. Is working memory capacity task dependent? J Mem Lang. 1989; 28(2): 127–154. 10.1016/0749-596X(89)90040-5
    1. Unsworth N, Heitz RP, Schrock JC, Engle RW. An automated version of the operation span task. Behav Res Methods. 2005; 37(3): 498–505. 10.3758/BF03192720
    1. Redick TS, Broadway JM, Meier ME, Kuriakose PS, Unsworth N, Kane MJ, et al. Measuring working memory capacity with automated complex span tasks. Eur J Psychol Assess. 2012; 28(3): 164–171. 10.1027/1015-5759/a000123
    1. Keshvari S, van den Berg R, Ma WJ. No evidence for an item limit in change detection. PLoS Comput Biol. 2013; 9(2): e1002927 10.1371/journal.pcbi.1002927
    1. Luck SJ, Vogel EK. The capacity of visual working memory for features and conjunctions. Nature. 1997; 390(6657): 279–281. 10.1038/36846
    1. Kirchner WK. Age differences in short-term retention of rapidly changing information. J Exp Psychol. 1958; 55(4): 352–358. 10.1037/h0043688
    1. Kane MJ, Conway AR, Miura TK, Colflesh GJ. Working memory, attention control, and the N-back task: a question of construct validity. J Exp Psychol Learn Mem Cogn. 2007; 33(3): 615–622. 10.1037/0278-7393.33.3.615
    1. Jaeggi SM, Seewer R, Nirkko AC, Eckstein D, Schroth G, Groner R, et al. Does excessive memory load attenuate activation in the prefrontal cortex? Load-dependent processing in single and dual tasks: functional magnetic resonance imaging study. Neuroimage. 2003; 19(2): 210–225. 10.1016/S1053-8119(03)00098-3
    1. Jaeggi SM, Buschkuehl M, Etienne A, Ozdoba C, Perrig WJ, Nirkko AC. On how high performers keep cool brains in situations of cognitive overload. Cogn Affect Behav Neurosci. 2007; 7(2): 75–89. 10.3758/CABN.7.2.75
    1. Reitan RM. Validity of the trail making test as an indicator of organic brain damage. Percept Mot Skills. 1958; 8(3): 271–276. 10.2466/pms.1958.8.3.271
    1. Raymond JE, Shapiro KL, Arnell KM. Temporary suppression of visual processing in an RSVP task: an attentional blink? J Exp Psychol Hum Percept Perform. 1992; 18(3): 849–860. 10.1037/0096-1523.18.3.849
    1. Armor Games [Internet]. [Place Unknown]: Armor Games; 2005–2015. Available: . Accessed 2015 Oct 25.
    1. Unsworth N, Spillers GJ. Working memory capacity: attention control, secondary memory, or both? A direct test of the dual-component model. J Mem Lang. 2010; 62(4): 392–406. 10.1016/j.jml.2010.02.001
    1. Eriksen BA, Eriksen CW. Effects of noise letters upon the identification of a target letter in a nonsearch task. Percept Psychophys. 1974; 16(1): 143–149. 10.3758/BF03203267
    1. Kane MJ, Bleckley MK, Conway AR, Engle RW. A controlled-attention view of working-memory capacity. J Exp Psychol Gen. 2001; 130(2): 169–183. 10.1037/0096-3445.130.2.169
    1. Hallett P. Primary and secondary saccades to goals defined by instructions. Vision Res. 1978; 18(10): 1279–1296. 10.1016/0042-6989(78)90218-3
    1. Dinges DF, Powell JW. Microcomputer analyses of performance on a portable, simple visual RT task during sustained operations. Behav Res Methods Instrum Comput. 1985; 17(6): 652–655. 10.3758/BF03200977
    1. Fitzgerald KD, Perkins SC, Angstadt M, Johnson T, Stern ER, Welsh RC, et al. The development of performance-monitoring function in the posterior medial frontal cortex. Neuroimage. 2010; 49(4): 3463–3473. 10.1016/j.neuroimage.2009.11.004
    1. Bush G, Shin L, Holmes J, Rosen B, Vogt B. The multi-source interference task: validation study with fMRI in individual subjects. Mol Psychiatry. 2003; 8(1): 60–70. 10.1038/sj.mp.4001217
    1. Platina Games [Internet]. [Place Unknown]: ; 2010. Available: . Accessed 2015 Oct 25.
    1. Costa R, Medeiros-Ward N, Halper N, Helm L, Maloney A. The shifting and dividing of attention between visual and auditory tasks. J Vis. 2012; 12(9): 1032 10.1167/12.9.1032
    1. Cowan N. Metatheory of storage capacity limits. Behav Brain Sci. 2001; 24(01): 154–176.
    1. John OP, Donahue EM, Kentle RL. The big five inventory—versions 4a and 54. Berkeley: University of California, Berkeley, Institute of Personality and Social Research; 1991.
    1. Duckworth AL, Peterson C, Matthews MD, Kelly DR. Grit: perseverance and passion for long-term goals. J Pers Soc Psychol. 2007; 92(6): 1087–1101. 10.1037/0022-3514.92.6.1087
    1. Kecklund G, Åkerstedt T. The psychometric properties of the Karolinska Sleep Questionnaire. J Sleep Res. 1992; 1(Suppl 1): 113.
    1. Buysse DJ, Reynolds CF, Monk TH, Berman SR, Kupfer DJ. The Pittsburgh Sleep Quality Index: A new instrument for psychiatric practice and research. Psychiatry Res. 1989; 28(2): 193–213. 10.1016/0165-1781(89)90047-4
    1. Jurca R, Jackson AS, LaMonte MJ, Morrow JR, Blair SN, Wareham NJ, et al. Assessing cardiorespiratory fitness without performing exercise testing. Am J Prev Med. 2005; 29(3): 185–193. 10.1016/j.amepre.2005.06.004
    1. Ophir E, Nass C, Wagner AD. Cognitive control in media multitaskers. Proc Natl Acad Sci U S A. 2009; 106(37): 15583–15587. 10.1073/pnas.0903620106
    1. Chein JM, Morrison AB. Expanding the mind’s workspace: training and transfer effects with a complex working memory span task. Psychon Bull Rev. 2010; 17(2): 193–199. 10.3758/PBR.17.2.193
    1. Novick JM, Hussey E, Teubner-Rhodes S, Harbison JI, Bunting MF. Clearing the garden-path: improving sentence processing through cognitive control training. Lang Cogn and Neurosci. 2014; 29(2): 186–217. 10.1080/01690965.2012.758297
    1. Gray JR, Chabris CF, Braver TS. Neural mechanisms of general fluid intelligence. Nat Neurosci. 2003; 6(3): 316–322. 10.1038/nn1014
    1. Coderre EL, van Heuven WJ. The effect of script similarity on executive control in bilinguals. Front Psychol. 2014; 5: 1070 10.3389/fpsyg.2014.01070
    1. von Bastian CC, Eschen A. Does working memory training have to be adaptive? Psychol Res. 2015; In press.
    1. Baayen RH, Davidson DJ, Bates DM. Mixed-effects modeling with crossed random effects for subjects and items. J Mem Lang. 2008; 59(4): 390–412. 10.1016/j.jml.2007.12.005
    1. Bates D, Maechler M, Bolker BM, Walker S. Fitting linear mixed-effects models using lme4. J Stat Softw. 2015; 67(1): 1–48. 10.18637/jss.v067.i01
    1. Halekoh U, Højsgaard S. A Kenward-Roger approximation and parametric bootstrap methods for tests in linear mixed models—the R package pbkrtest. J Stat Softw. 2014; 59(9): 1–32. 10.18637/jss.v059.i09
    1. Rouder JN, Speckman PL, Sun D, Morey RD, Iverson G. Bayesian t tests for accepting and rejecting the null hypothesis. Psychon Bull Rev. 2009; 16(2): 225–237. 10.3758/PBR.16.2.225
    1. Efron B. Better bootstrap confidence intervals. J Am Stat Assoc. 1987; 82(397): 171–185. 10.1080/01621459.1987.10478410
    1. Lovden M, Brehmer Y, Li SC, Lindenberger U. Training-induced compensation versus magnification of individual differences in memory performance. Front Hum Neurosci. 2012; 6: 141 10.3389/fnhum.2012.00141
    1. Brehmer Y, Westerberg H, Bäckman L. Working-memory training in younger and older adults: training gains, transfer, and maintenance. Front Hum Neurosci. 2012; 6: 63 10.3389/fnhum.2012.00063
    1. Stothart CR, Simons DJ, Boot WR, Kramer AF. Is the effect of aerobic exercise on cognition a placebo effect? PLoS One. 2014; 9(10): e109557 10.1371/journal.pone.0109557
    1. Horn JL, Cattell RB. Age differences in fluid and crystallized intelligence. Acta Psychol (Amst). 1967; 26: 107–129. 10.1016/0001-6918(67)90011-X
    1. Raven J, Raven J, Court J. Manual for Raven’s Progressive Matrices and Vocabulary Scales. Oxford: Oxford Psychologists Press; 1998.
    1. Salthouse TA, Pink JE, Tucker-Drob EM. Contextual analysis of fluid intelligence. Intelligence. 2008; 36(5): 464–486. 10.1016/j.intell.2007.10.003
    1. Jaeggi SM, Studer-Luethi B, Buschkuehl M, Su Y, Jonides J, Perrig WJ. The relationship between n-back performance and matrix reasoning—implications for training and transfer. Intelligence. 2010; 38(6): 625–635. 10.1016/j.intell.2010.09.001
    1. Moody DE. Can intelligence be increased by training on a task of working memory? Intelligence. 2009; 37(4): 327–328.
    1. Kramer AF, Hahn S, Cohen NJ, Banich MT, McAuley E, Harrison CR, et al. Ageing, fitness and neurocognitive function. Nature. 1999; 400(6743): 418–419. 10.1038/22682
    1. Hillman CH, Erickson KI, Kramer AF. Be smart, exercise your heart: Exercise effects on brain and cognition. Nat Rev Neurosci. 2008; 9(1): 58–65. 10.1038/nrn2298
    1. Jaeggi SM, Buschkuehl M, Shah P, Jonides J. The role of individual differences in cognitive training and transfer. Mem Cognit. 2014; 42(3): 464–480. 10.3758/s13421-013-0364-z
    1. Studer-Luethi B, Jaeggi SM, Buschkuehl M, Perrig WJ. Influence of neuroticism and conscientiousness on working memory training outcome. Pers Individ Dif. 2012; 53(1): 44–49. 10.1016/j.paid.2012.02.012
    1. Basak C, Voss MW, Erickson KI, Boot WR, Kramer AF. Regional differences in brain volume predict the acquisition of skill in a complex real-time strategy videogame. Brain Cogn. 2011; 76(3): 407–414. 10.1016/j.bandc.2011.03.017
    1. Erickson KI, Boot WR, Basak C, Neider MB, Prakash RS, Voss MW, et al. Striatal volume predicts level of video game skill acquisition. Cereb Cortex. 2010; 20(11): 2522–2530. 10.1093/cercor/bhp293

Source: PubMed

3
Tilaa