Ventrolateral Prefrontal Cortex Contributes to Human Motor Learning

Neeraj Kumar, Ananda Sidarta, Chelsea Smith, David J Ostry, Neeraj Kumar, Ananda Sidarta, Chelsea Smith, David J Ostry

Abstract

This study assesses the involvement in human motor learning, of the ventrolateral prefrontal cortex (BA 9/46v), a somatic region in the middle frontal gyrus. The potential involvement of this cortical area in motor learning is suggested by studies in nonhuman primates which have found anatomic connections between this area and sensorimotor regions in frontal and parietal cortex, and also with basal ganglia output zones. It is likewise suggested by electrophysiological studies which have shown that activity in this region is implicated in somatic sensory memory and is also influenced by reward. We directly tested the hypothesis that area 9/46v is involved in reinforcement-based motor learning in humans. Participants performed reaching movements to a hidden target and received positive feedback when successful. Before the learning task, we applied continuous theta burst stimulation (cTBS) to disrupt activity in 9/46v in the left or right hemisphere. A control group received sham cTBS. The data showed that cTBS to left 9/46v almost entirely eliminated motor learning, whereas learning was not different from sham stimulation when cTBS was applied to the same zone in the right hemisphere. Additional analyses showed that the basic reward-history-dependent pattern of movements was preserved but more variable following left hemisphere stimulation, which suggests an overall deficit in somatic memory for target location or target directed movement rather than reward processing per se. The results indicate that area 9/46v is part of the human motor learning circuit.

Keywords: TMS; motor learning; reinforcement.

Copyright © 2022 Kumar et al.

Figures

Figure 1.
Figure 1.
Participants learned to make movements to a hidden target, and positive feedback was provided for successful movements. A, Participants made movements holding a robotic manipulandum. B, Schematic of the task. Participants made outward movements. If the movement direction fell within the hidden target zone, positive feedback was provided to indicate success. No feedback was given in the case of an unsuccessful movement. C, Experimental sequence. MEPs were elicited from the motor hot-spot in the left or right hemisphere before stimulation (cTBS to right or left 9/46v or sham stimulation). MEPs were again recorded 10 min after stimulation followed by the motor learning trials. In the no-feedback session at the end, participants were not provided with feedback on the success of the movement. D, Location of the stimulation site in representative participants from the left 9/46v and right 9/46v condition, shown in the sagittal (right panel) and coronal (middle panel) planes. The average location of the stimulation site (red circle) across participants in the MNI brain.
Figure 2.
Figure 2.
Suppression of left 9/46v using cTBS disrupts motor learning. A, Hand paths of a representative participant from each group at the start (block 1) and end of training (block 4). Hand paths shown in red are for unsuccessful movements, and those in blue are for successful movements. B, Mean absolute deviation from the center of the target zone over the course of training. The linear fit is shown across learning trials and no-feedback trials separately. The shaded region represents ±SEM. The rate of learning was less in participants who received stimulation over left 9/46v than those who received sham stimulation. C, Mean absolute deviation in the first and last block of the training. Participants in the sham stimulation condition showed a greater reduction in |AD| than participants in the left 9/46v condition.
Figure 3.
Figure 3.
Suppression of left 9/46v using cTBS leaves reinforcement learning intact. A, Mean percentage of rewarded trials over the course of training. A linear fit is shown across learning trials. The shaded region represents ±SEM. B, Mean percent of rewarded movements in the first and last block of the training. Participants in the sham stimulation condition received more rewards as learning progressed, whereas participants who received stimulation to left 9/46v showed no improvement at all. C, Mean absolute change in movement direction between the current trial (nth trial) and the subsequent trial (n + 1th trial) as a function of the history of rewarded movements. Reward history included three most recent movements (n, n–1, and n–2 trial), where at least one of these movements was rewarded. The left 9/46v group showed the same basic reward-history-dependent pattern as the other conditions but with greater change in direction overall. This suggests that the learning deficit after left 9/46v suppression is not because of inability to process reward but likely because of a deficit in memory for target direction.
Figure 4.
Figure 4.
cTBS over left or right 9/46v did not alter the excitability of motor cortex or basic movement parameters. A, Mean time series of MEPs recorded from the FDI muscle pre-cTBS (blue) and post-cTBS (red) from a representative participant in each experimental condition. The TMS pulse occurs at time = 0 ms. The shaded regions are ±SEM across 20 MEPs. B, Mean change in amplitude of MEPs measured 10 min after cTBS (computed as a percentage of pre-cTBS MEPs). Error bars give the SE across participants. C, Mean movement duration, peak velocity, and movement amplitude across experimental conditions. cTBS to either left or right 9/46v did not modify the movement parameters.

References

    1. Anguera JA, Reuter-Lorenz PA, Willingham DT, Seidler RD (2010) Contributions of spatial working memory to visuomotor learning. J Cogn Neurosci 22:1917–1930. 10.1162/jocn.2009.21351
    1. Barbas H, Pandya DN (1989) Architecture and intrinsic connections of the prefrontal cortex in the rhesus monkey. J Comp Neurol 286:353–375. 10.1002/cne.902860306
    1. Barbeau EB, Descoteaux M, Petrides M (2020) Dissociating the white matter tracts connecting the temporo-parietal cortical region with frontal cortex using diffusion tractography. Sci Rep 10:8186. 10.1038/s41598-020-64124-y
    1. Bernardi NF, Darainy M, Ostry DJ (2015) Somatosensory contribution to the initial stages of human motor learning. J Neurosci 35:14316–14326. 10.1523/JNEUROSCI.1344-15.2015
    1. Bo J, Seidler RD (2009) Visuospatial working memory capacity predicts the organization of acquired explicit motor sequences. J Neurophysiol 101:3116–3125. 10.1152/jn.00006.2009
    1. Bo J, Borza V, Seidler RD (2009) Age-related declines in visuospatial working memory correlate with deficits in explicit motor sequence learning. J Neurophysiol 102:2744–2754. 10.1152/jn.00393.2009
    1. Bostan AC, Strick PL (2018) The basal ganglia and the cerebellum: nodes in an integrated network. Nat Rev Neurosci 19:338–350. 10.1038/s41583-018-0002-7
    1. Catani M, Dell’Acqua F, Vergani F, Malik F, Hodge H, Roy P, Valabregue R, de Schotten MT (2012) Short frontal lobe connections of the human brain. Cortex 48:273–291. 10.1016/j.cortex.2011.12.001
    1. Codol O, Holland PJ, Manohar SG, Galea JM (2020) Reward-based improvements in motor control are driven by multiple error-reducing mechanisms. J Neurosci 40:3604–3620. 10.1523/JNEUROSCI.2646-19.2020
    1. Dayan E, Herszage J, Laor‐Maayany R, Sharon H, Censor N (2018) Neuromodulation of reinforced skill learning reveals the causal function of prefrontal cortex. Hum Brain Mapp 39:4724–4732. 10.1002/hbm.24317
    1. D’Esposito M, Aguirre GK, Zarahn E, Ballard D, Shin RK, Lease J (1998) Functional MRI studies of spatial and nonspatial working memory. Cogn Brain Res 7:1–13. 10.1016/S0926-6410(98)00004-4
    1. Dum RP, Strick PL (2005) Frontal lobe inputs to the digit representations of the motor areas on the lateral surface of the hemisphere. J Neurosci 25:1375–1386. 10.1523/JNEUROSCI.3902-04.2005
    1. Fermin ASR, Yoshida T, Yoshimoto J, Ito M, Tanaka SC, Doya K (2016) Model-based action planning involves cortico-cerebellar and basal ganglia networks. Sci Rep 6:31378. 10.1038/srep31378
    1. Frankle WG, Laruelle M, Haber SN (2006) Prefrontal cortical projections to the midbrain in primates: evidence for a sparse connection. Neuropsychopharmacology 31:1627–1636. 10.1038/sj.npp.1300990
    1. Gerbella M, Borra E, Tonelli S, Rozzi S, Luppino G (2013) Connectional heterogeneity of the ventral part of the macaque area 46. Cereb Cortex 23:967–987. 10.1093/cercor/bhs096
    1. Goldsworthy MR, Pitcher JB, Ridding MC (2012) The application of spaced theta burst protocols induces long-lasting neuroplastic changes in the human motor cortex: the application of spaced theta burst protocols. Eur J Neurosci 35:125–134. 10.1111/j.1460-9568.2011.07924.x
    1. Hikosaka K, Watanabe M (2000) Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. Cereb Cortex 10:263–271. 10.1093/cercor/10.3.263
    1. Middleton FA, Strick PL (2002) Basal-ganglia ‘projections’ to the prefrontal cortex of the primate. Cereb Cortex 12:926–935. 10.1093/cercor/12.9.926
    1. Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24:167–202. 10.1146/annurev.neuro.24.1.167
    1. Oldfield RC (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9:97–113. 10.1016/0028-3932(71)90067-4
    1. Owen AM, McMillan KM, Laird AR, Bullmore E (2005) N‐back working memory paradigm: a meta‐analysis of normative functional neuroimaging studies. Hum Brain Mapp 25:46–59. 10.1002/hbm.20131
    1. Petrides M (2012) The human cerebral cortex: an MRI atlas of the sulci and gyri in MNI stereotaxic space. San Diego: Elsevier/Academic Press.
    1. Petrides M, Pandya DN (2002) Comparative cytoarchitectonic analysis of the human and the macaque ventrolateral prefrontal cortex and corticocortical connection patterns in the monkey. Eur J Neurosci 16:291–310. 10.1046/j.1460-9568.2001.02090.x
    1. Preuss TM, Goldman‐Rakic PS (1989) Connections of the ventral granular frontal cortex of macaques with perisylvian premotor and somatosensory areas: anatomical evidence for somatic representation in primate frontal association cortex. J Comp Neurol 282:293–316. 10.1002/cne.902820210
    1. Rizzolatti G, Luppino G (2001) The cortical motor system. Neuron 31:889–901. 10.1016/s0896-6273(01)00423-8
    1. Romo R, Brody CD, Hernández A, Lemus L (1999) Neuronal correlates of parametric working memory in the prefrontal cortex. Nature 399:470–473. 10.1038/20939
    1. Romo R, Lemus L, de Lafuente V (2012) Sense, memory, and decision-making in the somatosensory cortical network. Curr Opin Neurobiol 22:914–919. 10.1016/j.conb.2012.08.002
    1. Sidarta A, Vahdat S, Bernardi NF, Ostry DJ (2016) Somatic and reinforcement-based plasticity in the initial stages of human motor learning. J Neurosci 36:11682–11692. 10.1523/JNEUROSCI.1767-16.2016
    1. Sidarta A, van Vugt FT, Ostry DJ (2018) Somatosensory working memory in human reinforcement-based motor learning. J Neurophysiol 120:3275–3286. 10.1152/jn.00442.2018
    1. Vahdat S, Darainy M, Milner TE, Ostry DJ (2011) Functionally specific changes in resting-state sensorimotor networks after motor learning. J Neurosci 31:16907–16915. 10.1523/JNEUROSCI.2737-11.2011
    1. Voineskos AN, Farzan F, Barr MS, Lobaugh NJ, Mulsant BH, Chen R, Fitzgerald PB, Daskalakis ZJ (2010) The role of the corpus callosum in transcranial magnetic stimulation induced interhemispheric signal propagation. Biol Psychiatry 68:825–831. 10.1016/j.biopsych.2010.06.021
    1. Wallis JD, Miller EK (2003) From rule to response: neuronal processes in the premotor and prefrontal cortex. J Neurophysiol 90:1790–1806. 10.1152/jn.00086.2003
    1. Williams SM, Goldman-Rakic PS (1998) Widespread origin of the primate mesofrontal dopamine system. Cereb Cortex 8:321–345. 10.1093/cercor/8.4.321
    1. Yeterian EH, Pandya DN, Tomaiuolo F, Petrides M (2012) The cortical connectivity of the prefrontal cortex in the monkey brain. Cortex 48:58–81. 10.1016/j.cortex.2011.03.004
    1. Zarei M, Johansen‐Berg H, Smith S, Ciccarelli O, Thompson AJ, Matthews PM (2006) Functional anatomy of interhemispheric cortical connections in the human brain. J Anat 209:311–320. 10.1111/j.1469-7580.2006.00615.x

Source: PubMed

3
Prenumerera