The dimensionality of neural representations for control
David Badre, Apoorva Bhandari, Haley Keglovits, Atsushi Kikumoto, David Badre, Apoorva Bhandari, Haley Keglovits, Atsushi Kikumoto
Abstract
Cognitive control allows us to think and behave flexibly based on our context and goals. At the heart of theories of cognitive control is a control representation that enables the same input to produce different outputs contingent on contextual factors. In this review, we focus on an important property of the control representation's neural code: its representational dimensionality. Dimensionality of a neural representation balances a basic separability/generalizability trade-off in neural computation. We will discuss the implications of this trade-off for cognitive control. We will then briefly review current neuroscience findings regarding the dimensionality of control representations in the brain, particularly the prefrontal cortex. We conclude by highlighting open questions and crucial directions for future research.
Keywords: cognitive control; executive function; frontal lobes; neural computation; neural representation.
Conflict of interest statement
Conflict of Interest statement for: The dimensionality of neural representations for control ‘Declaration of interest: none’.
Figures
References
- Cohen JD et al. (1990) On the control of automatic processes: A parallel distributed processing account of the Stroop effect. Psychological Review 97, 332–361.
- Cohen JD (2017) Cognitive control: core constructs and current considerations In The Wiley Handbook of Cognitive Control (Egner T. ed), pp. 1–28, Wiley.
- Fusi S et al. (2016) Why neurons mix: high dimensionality for higher cognition. Curr Opin Neurobiol 37, 66–74.
This review discusses recent theoretical developments on representational dimensionality and empirical findings in animals. They introduce the compelling computational link between mixed selectivity of neurons and dimensionality, and its implications for the separability/generalizability trade-off.
- Frank MJ and Badre D (2012) Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis. Cereb Cortex 22 (3), 509–26.
- Miller EK and Cohen JD (2001) An integrative theory of prefrontal cortex function. Annual Review of Neuroscience 24, 167–202.
- O’Reilly RC and Frank MJ (2006) Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput 18 (2), 283–328.
- Duncan J (2013) The structure of cognition: attentional episodes in mind and brain. Neuron 80 (1), 35–50.
- Hommel B (2004) Event files: feature binding in and across perception and action. Trends Cogn Sci 8 (11), 494–500.
- Schumacher EH and Hazeltine E (2016) Hierarchical task representation: Task files and response selection. Current Directions in Psychological Science 25 (6), 449–54.
- Kikumoto A and Mayr U (in press) Conjunctive representations that integrate stimuli, responses, and rules are critical for action selection. Proc Natl Acad Sci U S A.
This EEG study in humans shows that action selection engages a conjunctive representation that integrates multiple task relevant features, consistent with an event (task) file. It highlights the significance of a transmissive control representation in action selection.
- Rainer G et al. (1998) Selective representation of relevant information by neurons in the primate prefrontal cortex. Nature 393 (6685), 577–9.
- Stokes MG et al. (2013) Dynamic coding for cognitive control in prefrontal cortex. Neuron 78 (2), 364–75.
- Pischedda D et al. (2017) Neural Representations of Hierarchical Rule Sets: The Human Control System Represents Rules Irrespective of the Hierarchical Level to Which They Belong. J Neurosci 37 (50), 12281–12296.
- Woolgar A et al. (2016) Coding of Visual, Auditory, Rule, and Response Information in the Brain: 10 Years of Multivoxel Pattern Analysis. J Cogn Neurosci 28 (10), 1433–54.
- Rigotti M et al. (2013) The importance of mixed selectivity in complex cognitive tasks. Nature 497 (7451), 585–90.
The first experimental study to directly estimate dimensionality of control representations in macaque PFC during a working memory task. The authors measured maximal dimensionality for the task, which collapsed when the monkeys made errors. The study defines and validates methods for estimating dimensionality from neural recordings.
- Maass W (2016) Searching for principles of brain computation. Curr Opin Behav Sci 11, 81–92.
A broad review of computational models and empirical research across domains. Four key principles governing the operation of neural circuits are identified. A key theme developed is the importance of a diversity of computational elements in representations, and the stable emergence of computational function from complex, highly dynamic and varying neural circuits.
- Panzeri S et al. (2017) Cracking the neural code for sensory perception by combining statistics, intervention, and behavior. Neuron 93 (3), 491–507.
- Cohen U et al. (2020) Separability and geometry of object manifolds in deep neural networks. Nat Commun 11 (1), 746.
- Ganguli S and Sompolinsky H (2012) Compressed sensing, sparsity, and dimensionality in neuronal information processing and data analysis. Annu Rev Neurosci 35, 485–508.
- Boser BE et al., A training algorithm for optimal margin classifiers, Proceedings of the fifth annual workshop on Computational learning theory, 1992, pp. 144–152.
- Jun JK et al. (2010) Heterogenous population coding of a short-term memory and decision task. J Neurosci 30 (3), 916–29.
- Mante V et al. (2013) Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 503 (7474), 78–84.
- Bernardi S et al. (2019) The geometry of abstraction in hippocampus and prefrontal cortex. bioRxiv, 1–22.
This study investigates the neural representations of abstract control representations during reversal learning, when hidden contextual information is used across trials. Representations in the ACC, PFC, and hippocampus generalize to multiple contexts, a form of abstraction. Further, across epochs of a trial, the dimensionality and degree of abstraction of the representation changes between and within trials.
- Stringer C et al. (2019) High-dimensional geometry of population responses in visual cortex. Nature 571 (7765), 361–365.
The first study to provide a realistic estimate of representational dimensionality using a complex, naturalistic task space and simultaneous recording of over 10,000 neurons using two-photon calcium imaging in mice visual cortex. They find high-dimensional, but smooth representations, which would offer high separability with robustness to noise.
- Farrell M et al. (2019) Recurrent neural networks learn robust representations by dynamically balancing compression and expansion. bioRxiv, 564476.
- Badre D et al. (2010) Frontal cortex and the discovery of abstract action rules. Neuron 66 (2), 315–26.
- Collins AG and Frank MJ (2013) Cognitive control over learning: creating, clustering, and generalizing task-set structure. Psychol Rev 120 (1), 190–229.
- Duncan J et al. (2017) Complexity and compositionality in fluid intelligence. Proceedings of the National Academy of Sciences 114 (20), 5295–5299.
- Chatham CH and Badre D (2015) Multiple gates on working memory. Curr Opin Behav Sci 1, 23–31.
- Musslick S et al., Multitasking capability versus learning efficiency in neural network architectures, Cognitive Science Society, London, 2017, pp. 829–34.
Using formal analysis and neural network simulations, this study shows that the use of shared low-dimensional representations trades off the ability to simultaneously process two tasks for improved learning efficiency of novel tasks.
- Musslick S and Cohen JD, A mechanistic account of constraints on control-dependent processing: Shared representation, conflict and persistence, 41st Annual Meeting of the Cognitive Science Society, 2019.
- Sagiv Y et al., Effiency of learning vs. processing: Towards a normative theory of multitasking, 40th Annual Meeting of the Cognitive Science Society, 2018.
- Bartolo R et al. (2020) Dimensionality, information and learning in prefrontal cortex. PLoS Comput Biol 16 (4), e1007514.
- Machens CK et al. (2010) Functional, but not anatomical, separation of “what” and “when” in prefrontal cortex. J Neurosci 30 (1), 350–60.
- Brincat SL et al. (2018) Gradual progression from sensory to task-related processing in cerebral cortex. Proc Natl Acad Sci U S A 115 (30), E7202–E7211.
- Parthasarathy A et al. (2017) Mixed selectivity morphs population codes in prefrontal cortex. Nat Neurosci 20 (12), 1770–1779.
- Parthasarathy A et al. (2019) Time-invariant working memory representations in the presence of code-morphing in the lateral prefrontal cortex. Nat Commun 10 (1), 4995.
This study reports that a population of mixed-selective neurons drastically changes the geometry of firing patterns (i.e., morphing) against a distractor during a working memory task. Yet, it preserves a temporally stable subspace that allows readout of a memory encoded prior to the onset of a distractor.
- Tang C et al. (2019) Independent activity subspaces for working memory and motor preparation in the lateral prefrontal cortex. . bioRxiv, 756072.
- Murray JD et al. (2017) Stable population coding for working memory coexists with heterogeneous neural dynamics in prefrontal cortex. Proc Natl Acad Sci U S A 114 (2), 394–399.
- Broadbent DE (1977) Levels, hierarchies, and the locus of control. Quarterly Journal of Experimental Psychology 29, 181–201.
- Tang E et al. (2019) Effective learning is accompanied by high-dimensional and efficient representations of neural activity. Nat Neurosci 22 (6), 1000–1009.
- Mack ML et al. (2020) Ventromedial prefrontal cortex compression during concept learning. Nat Commun 11 (1), 46.
- Brody BA et al. (1987) Sequence of central nervous system myelination in human infancy. I. An autopsy study of myelination. J Neuropathol Exp Neurol 46 (3), 283–301.
- Ahlheim C and Love BC (2018) Estimating the functional dimensionality of neural representations. Neuroimage 179, 51–62.
- Diedrichsen J et al. (2013) A multivariate method to determine the dimensionality of neural representation from population activity. Neuroimage 76, 225–35.
- Kriegeskorte N and Kievit RA (2013) Representational geometry: integrating cognition, computation, and the brain. Trends Cogn Sci 17 (8), 401–12.
- Bhandari A et al. (2018) Just above Chance: Is It Harder to Decode Information from Human Prefrontal Cortex Blood Oxygenation Level-dependent Signals? J Cogn Neurosci, 1–26.
- Bhandari A et al., Measuring prefrontal representational geometry: fMRI adaptation vs pattern analysis, Cognitive Computational Neuroscience conference proceedings, Berlin, Germany, 2019.
- Rigotti M and Fusi S (2016) Estimating the dimensionality of neural responses with fMRI Repetition Suppression. arXiv preprint arXiv:1605.03952.
- Barron HC et al. (2016) Repetition suppression: a means to index neural representations using BOLD? Philos Trans R Soc Lond B Biol Sci 371 (1705).
Source: PubMed