Tracking prototype and exemplar representations in the brain across learning

Caitlin R Bowman, Takako Iwashita, Dagmar Zeithamova, Caitlin R Bowman, Takako Iwashita, Dagmar Zeithamova

Abstract

There is a long-standing debate about whether categories are represented by individual category members (exemplars) or by the central tendency abstracted from individual members (prototypes). Neuroimaging studies have shown neural evidence for either exemplar representations or prototype representations, but not both. Presently, we asked whether it is possible for multiple types of category representations to exist within a single task. We designed a categorization task to promote both exemplar and prototype representations and tracked their formation across learning. We found only prototype correlates during the final test. However, interim tests interspersed throughout learning showed prototype and exemplar representations across distinct brain regions that aligned with previous studies: prototypes in ventromedial prefrontal cortex and anterior hippocampus and exemplars in inferior frontal gyrus and lateral parietal cortex. These findings indicate that, under the right circumstances, individuals may form representations at multiple levels of specificity, potentially facilitating a broad range of future decisions.

Keywords: category learning; fmri; generalization; hippocampus; human; long term memory; neuroscience.

Conflict of interest statement

CB, TI, DZ No competing interests declared

© 2020, Bowman et al.

Figures

Figure 1.. Category-learning task.
Figure 1.. Category-learning task.
Conceptual depiction of (A) exemplar and (B) prototype models. Exemplar: categories are represented as individual exemplars. New items are classified into the category with the most similar exemplars. Prototype: categories are represented by their central tendencies (prototypes). New items are classified into the category with the most similar prototype. (C) Example stimuli. The leftmost stimulus is the prototype of category A and the rightmost stimulus is the prototype of category B, which shares no features with prototype A. Members of category A share more features with prototype A than prototype B, and vice versa. (D) During the learning phase, participants completed four study-test cycles while undergoing fMRI. In each cycle, there were two runs of observational study followed by one run of an interim generalization test. During observational study runs, participants saw training examples with their species labels without making any responses. During interim test runs, participants classified training items as well as new items at varying distances. (E) After all study-test cycles were complete, participants completed a final generalization test that was divided across four runs. Participants classified training items as well as new items at varying distances.
Figure 2.. Regions of interest from a…
Figure 2.. Regions of interest from a representative subject.
Regions were defined in the native space of each subject using automated segmentation in Freesurfer.
Figure 3.. Behavioral accuracy for interim and…
Figure 3.. Behavioral accuracy for interim and final tests.
(A) Mean generalization accuracy across each of four interim tests completed during the learning phase. Source data can be found in Figure 3—source data 1. (B) Mean categorization accuracy in the final test. Source data can be found in Figure 3—source data 2. In both cases, accuracies are separated by distance from category prototypes (0–3) and old vs. new (applicable to distance two items only). Error bars represent the standard error of the mean.
Figure 4.. Behavioral model fits.
Figure 4.. Behavioral model fits.
Scatter plots indicate the relative exemplar vs. prototype model fits for each subject. Fits are given in terms of negative log likelihood (i.e., model error) such that lower values reflect better model fit. Each dot represents a single subject and the trendline represents equal prototype and exemplar fit. Dots above the line have better exemplar relative to prototype model fit. Dots below the line have better prototype relative to exemplar model fit. Pie charts indicate the percentage of individual subjects classified as best fit by the prototype model (in blue), the exemplar model (in red), and those similarly fit by the two models (in grey). Model fits were computed separately for the 1st half of the learning phase (interim tests 1–2, A,D), the 2nd half of the learning phase (interim tests 3–4, B,E), and the final test (C,F). Source data for all phases can be found in Figure 4—source data 1.
Figure 5.. Neural prototype and exemplar model…
Figure 5.. Neural prototype and exemplar model fits.
Neural model fits for each region of interest for (A) the first half of the learning phase, (B) the second half of the learning phase, (C) the overall learning phase (averaged across the first and second half of learning), and (D) the final test. Prototype fits are in blue, exemplar fits in red. Neural model fit is the effect size: the mean/SD of ß-values within each ROI, averaged across appropriate runs. VMPFC = ventromedial prefrontal cortex, ahip = anterior hippocampus, phip = posterior hippocampus, LO = lateral occipital cortex, IFG = inferior frontal gyrus, and Lat. Par. = lateral parietal cortex. Source data for interim tests is in Figure 5—source data 1 and Figure 5—source data 2 for the final test.
Author response image 1.
Author response image 1.
Author response image 2.
Author response image 2.
Author response image 3.
Author response image 3.
Author response image 4.
Author response image 4.
Author response image 5.
Author response image 5.

References

    1. Aizenstein HJ, MacDonald AW, Stenger VA, Nebes RD, Larson JK, Ursu S, Carter CS. Complementary category learning systems identified using event-related functional MRI. Journal of Cognitive Neuroscience. 2000;12:977–987. doi: 10.1162/08989290051137512.
    1. Ashby FG, Alfonso-Reese LA, Turken AU, Waldron EM. A neuropsychological theory of multiple systems in category learning. Psychological Review. 1998;105:442–481. doi: 10.1037/0033-295X.105.3.442.
    1. Ashby SR, Bowman CR, Zeithamova D. Perceived similarity ratings predict generalization success after traditional category learning and a new paired-associate learning task. Psychonomic Bulletin & Review. 2020;27:791–800. doi: 10.3758/s13423-020-01754-3.
    1. Badre D, Wagner AD. Frontal lobe mechanisms that resolve proactive interference. Cerebral Cortex. 2005;15:2003–2012. doi: 10.1093/cercor/bhi075.
    1. Bowman CR, Dennis NA. The neural basis of recollection rejection: increases in Hippocampal–Prefrontal Connectivity in the Absence of a Shared Recall-to-Reject and Target Recollection Network. Journal of Cognitive Neuroscience. 2016;28:1194–1209. doi: 10.1162/jocn_a_00961.
    1. Bowman CR, Zeithamova D. Abstract memory representations in the ventromedial prefrontal cortex and Hippocampus support concept generalization. The Journal of Neuroscience. 2018;38:2605–2614. doi: 10.1523/JNEUROSCI.2811-17.2018.
    1. Bowman CR, Zeithamova D. Training set coherence and set size effects on concept generalization and recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2020;46:1442–1464. doi: 10.1037/xlm0000824.
    1. Bozoki A, Grossman M, Smith EE. Can patients with Alzheimer's disease learn a category implicitly? Neuropsychologia. 2006;44:816–827. doi: 10.1016/j.neuropsychologia.2005.08.001.
    1. Bransford JD, Johnson MK. Contextual prerequisites for understanding: some investigations of comprehension and recall. Journal of Verbal Learning and Verbal Behavior. 1972;11:717–726. doi: 10.1016/S0022-5371(72)80006-9.
    1. Brunec IK, Bellana B, Ozubko JD, Man V, Robin J, Liu ZX, Grady C, Rosenbaum RS, Winocur G, Barense MD, Moscovitch M. Multiple scales of representation along the hippocampal anteroposterior Axis in humans. Current Biology. 2018;28:2129–2135. doi: 10.1016/j.cub.2018.05.016.
    1. Cincotta CM, Seger CA. Dissociation between striatal regions while learning to categorize via feedback and via observation. Journal of Cognitive Neuroscience. 2007;19:249–265. doi: 10.1162/jocn.2007.19.2.249.
    1. Collin SH, Milivojevic B, Doeller CF. Memory hierarchies map onto the hippocampal long Axis in humans. Nature Neuroscience. 2015;18:1562–1564. doi: 10.1038/nn.4138.
    1. Davis T, Love BC, Preston AR. Learning the exception to the rule: model-based fMRI reveals specialized representations for surprising category members. Cerebral Cortex. 2012;22:260–273. doi: 10.1093/cercor/bhr036.
    1. Davis T, Poldrack RA. Quantifying the internal structure of categories using a neural typicality measure. Cerebral Cortex. 2014;24:1720–1737. doi: 10.1093/cercor/bht014.
    1. Desimone R. Neural mechanisms for visual memory and their role in attention. PNAS. 1996;93:13494–13499. doi: 10.1073/pnas.93.24.13494.
    1. Dubé C. Central tendency representation and exemplar matching in visual short-term memory. Memory & Cognition. 2019;47:589–602. doi: 10.3758/s13421-019-00900-0.
    1. Ell SW, Weinstein A, Ivry RB. Rule-based categorization deficits in focal basal ganglia lesion and Parkinson's disease patients. Neuropsychologia. 2010;48:2974–2986. doi: 10.1016/j.neuropsychologia.2010.06.006.
    1. Folstein JR, Palmeri TJ, Gauthier I. Category learning increases discriminability of relevant object dimensions in visual cortex. Cerebral Cortex. 2013;23:814–823. doi: 10.1093/cercor/bhs067.
    1. Frank LE, Bowman CR, Zeithamova D. Differential functional connectivity along the long Axis of the Hippocampus aligns with differential role in memory specificity and generalization. Journal of Cognitive Neuroscience. 2019;31:1958–1975. doi: 10.1162/jocn_a_01457.
    1. Freedman DJ, Riesenhuber M, Poggio T, Miller EK. Categorical representation of visual stimuli in the primate prefrontal cortex. Science. 2001;291:312–316. doi: 10.1126/science.291.5502.312.
    1. Goldstone RL, Steyvers M. The sensitization and differentiation of dimensions during category learning. Journal of Experimental Psychology: General. 2001;130:116–139. doi: 10.1037/0096-3445.130.1.116.
    1. Gonsalves BD, Kahn I, Curran T, Norman KA, Wagner AD. Memory strength and repetition suppression: multimodal imaging of medial temporal cortical contributions to recognition. Neuron. 2005;47:751–761. doi: 10.1016/j.neuron.2005.07.013.
    1. Heindel WC, Festa EK, Ott BR, Landy KM, Salmon DP. Prototype learning and dissociable categorization systems in Alzheimer's disease. Neuropsychologia. 2013;51:1699–1708. doi: 10.1016/j.neuropsychologia.2013.06.001.
    1. Henson RN, Shallice T, Gorno-Tempini ML, Dolan RJ. Face repetition effects in implicit and explicit memory tests as measured by fMRI. Cerebral Cortex. 2002;12:178–186. doi: 10.1093/cercor/12.2.178.
    1. Hintzman DL. "Schema abstraction" in a multiple-trace memory model. Psychological Review. 1986;93:411–428. doi: 10.1037/0033-295X.93.4.411.
    1. Homa D. Prototype abstraction and classification of new instances as a function of number of instances defining the prototype. Journal of Experimental Psychology. 1973;101:116–122. doi: 10.1037/h0035772.
    1. Johansen MK, Palmeri TJ. Are there representational shifts during category learning? Cognitive Psychology. 2002;45:482–553. doi: 10.1016/S0010-0285(02)00505-4.
    1. Jonides J, Smith EE, Marshuetz C, Koeppe RA, Reuter-Lorenz PA. Inhibition in verbal working memory revealed by brain activation. PNAS. 1998;95:8410–8413. doi: 10.1073/pnas.95.14.8410.
    1. Kéri S, Kelemen O, Benedek G, Janka Z. Intact prototype learning in schizophrenia. Schizophrenia Research. 2001;52:261–264. doi: 10.1016/S0920-9964(00)00092-X.
    1. Koenig P, Smith EE, Troiani V, Anderson C, Moore P, Grossman M. Medial temporal lobe involvement in an implicit memory task: evidence of collaborating implicit and explicit memory systems from FMRI and Alzheimer's disease. Cerebral Cortex. 2008;18:2831–2843. doi: 10.1093/cercor/bhn043.
    1. Koster R, Chadwick MJ, Chen Y, Berron D, Banino A, Düzel E, Hassabis D, Kumaran D. Big-Loop recurrence within the hippocampal system supports integration of information across episodes. Neuron. 2018;99:1342–1354. doi: 10.1016/j.neuron.2018.08.009.
    1. Kruschke JK. ALCOVE: an exemplar-based connectionist model of category learning. Psychological Review. 1992;99:22–44. doi: 10.1037/0033-295X.99.1.22.
    1. Kuhl BA, Dudukovic NM, Kahn I, Wagner AD. Decreased demands on cognitive control reveal the neural processing benefits of forgetting. Nature Neuroscience. 2007;10:908–914. doi: 10.1038/nn1918.
    1. Kuhl BA, Chun MM. Successful remembering elicits event-specific activity patterns in lateral parietal cortex. Journal of Neuroscience. 2014;34:8051–8060. doi: 10.1523/JNEUROSCI.4328-13.2014.
    1. Lech RK, Güntürkün O, Suchan B. An interplay of fusiform gyrus and Hippocampus enables prototype- and exemplar-based category learning. Behavioural Brain Research. 2016;311:239–246. doi: 10.1016/j.bbr.2016.05.049.
    1. Mack ML, Preston AR, Love BC. Decoding the brain's algorithm for categorization from its neural implementation. Current Biology. 2013;23:2023–2027. doi: 10.1016/j.cub.2013.08.035.
    1. Maddox WT, Glass BD, Zeithamova D, Savarie ZR, Bowen C, Matthews MD, Schnyer DM. The effects of sleep deprivation on dissociable prototype learning systems. Sleep. 2011;34:253–260. doi: 10.1093/sleep/34.3.253.
    1. McClelland JL, McNaughton BL, O'Reilly RC. Why there are complementary learning systems in the Hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychological Review. 1995;102:419–457. doi: 10.1037/0033-295X.102.3.419.
    1. Medin DL, Schaffer MM. Context theory of classification learning. Psychological Review. 1978;85:207–238. doi: 10.1037/0033-295X.85.3.207.
    1. Minda JP, Smith JD. Prototypes in category learning: the effects of category size, category structure, and stimulus complexity. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2001;27:775–799. doi: 10.1037/0278-7393.27.3.775.
    1. Moscovitch M, Cabeza R, Winocur G, Nadel L. Episodic memory and beyond: the Hippocampus and neocortex in transformation. Annual Review of Psychology. 2016;67:105–134. doi: 10.1146/annurev-psych-113011-143733.
    1. Myers EB, Swan K. Effects of category learning on neural sensitivity to non-native phonetic categories. Journal of Cognitive Neuroscience. 2012;24:1695–1708. doi: 10.1162/jocn_a_00243.
    1. Nomura EM, Maddox WT, Filoteo JV, Ing AD, Gitelman DR, Parrish TB, Mesulam MM, Reber PJ. Neural correlates of rule-based and information-integration visual category learning. Cerebral Cortex. 2007;17:37–43. doi: 10.1093/cercor/bhj122.
    1. Nosofsky RM. Attention, similarity, and the identification–categorization relationship. Journal of Experimental Psychology: General. 1986;115:39–57. doi: 10.1037/0096-3445.115.1.39.
    1. Nosofsky RM. Attention and learning processes in the identification and categorization of integral stimuli. Journal of Experimental Psychology: Learning, Memory, and Cognition. 1987;13:87–108. doi: 10.1037/0278-7393.13.1.87.
    1. Nosofsky RM. Exemplar-based accounts of relations between classification, recognition, and typicality. Journal of Experimental Psychology: Learning, Memory, and Cognition. 1988;14:700–708. doi: 10.1037/0278-7393.14.4.700.
    1. Nosofsky RM, Palmeri TJ, McKinley SC. Rule-plus-exception model of classification learning. Psychological Review. 1994;101:53–79. doi: 10.1037/0033-295X.101.1.53.
    1. Nosofsky RM, Little DR, James TW. Activation in the neural network responsible for categorization and recognition reflects parameter changes. PNAS. 2012;109:333–338. doi: 10.1073/pnas.1111304109.
    1. Nosofsky RM, Stanton RD. Speeded classification in a probabilistic category structure: contrasting exemplar-retrieval, decision-boundary, and prototype models. Journal of Experimental Psychology: Human Perception and Performance. 2005;31:608–629. doi: 10.1037/0096-1523.31.3.608.
    1. Palmeri TJ, Gauthier I. Visual object understanding. Nature Reviews Neuroscience. 2004;5:291–303. doi: 10.1038/nrn1364.
    1. Paniukov D, Davis T. The evaluative role of rostrolateral prefrontal cortex in rule-based category learning. NeuroImage. 2018;166:19–31. doi: 10.1016/j.neuroimage.2017.10.057.
    1. Payne JD, Schacter DL, Propper RE, Huang LW, Wamsley EJ, Tucker MA, Walker MP, Stickgold R. The role of sleep in false memory formation. Neurobiology of Learning and Memory. 2009;92:327–334. doi: 10.1016/j.nlm.2009.03.007.
    1. Poldrack RA, Clark J, Paré-Blagoev EJ, Shohamy D, Creso Moyano J, Myers C, Gluck MA. Interactive memory systems in the human brain. Nature. 2001;414:546–550. doi: 10.1038/35107080.
    1. Poldrack RA, Packard MG. Competition among multiple memory systems: converging evidence from animal and human brain studies. Neuropsychologia. 2003;41:245–251. doi: 10.1016/S0028-3932(02)00157-4.
    1. Poppenk J, Evensmoen HR, Moscovitch M, Nadel L. Long-axis specialization of the human Hippocampus. Trends in Cognitive Sciences. 2013;17:230–240. doi: 10.1016/j.tics.2013.03.005.
    1. Posner MI, Keele SW. On the genesis of abstract ideas. Journal of Experimental Psychology. 1968;77:353–363. doi: 10.1037/h0025953.
    1. Posner MI, Keele SW. Retention of abstract ideas. Journal of Experimental Psychology. 1970;83:304–308. doi: 10.1037/h0028558.
    1. Reed SK. Pattern recognition and categorization. Cognitive Psychology. 1972;3:382–407. doi: 10.1016/0010-0285(72)90014-X.
    1. Schapiro AC, McDevitt EA, Chen L, Norman KA, Mednick SC, Rogers TT. Sleep benefits memory for semantic category structure while preserving Exemplar-Specific information. Scientific Reports. 2017;7:5. doi: 10.1038/s41598-017-12884-5.
    1. Schlichting ML, Mumford JA, Preston AR. Learning-related representational changes reveal dissociable integration and separation signatures in the Hippocampus and prefrontal cortex. Nature Communications. 2015;6:8151. doi: 10.1038/ncomms9151.
    1. Schlichting ML, Preston AR. The hippocampus and memory integration: Building knowledge to navigate future decisions. In: Duff M. C, Hannula D. E, editors. The Hippocampus From Cells to System: Structure, Connectivity, and Functional Contributions to Memory and Flexible Cognition. Springer; 2017. pp. 405–437.
    1. Seger CA. The roles of the caudate nucleus in human classification learning. Journal of Neuroscience. 2005;25:2941–2951. doi: 10.1523/JNEUROSCI.3401-04.2005.
    1. Shepard RN. Stimulus and response generalization: a stochastic model relating generalization to distance in psychological space. Psychometrika. 1957;22:325–345. doi: 10.1007/BF02288967.
    1. Shohamy D, Wagner AD. Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events. Neuron. 2008;60:378–389. doi: 10.1016/j.neuron.2008.09.023.
    1. Smith SM, Jenkinson M, Woolrich MW, Beckmann CF, Behrens TE, Johansen-Berg H, Bannister PR, De Luca M, Drobnjak I, Flitney DE, Niazy RK, Saunders J, Vickers J, Zhang Y, De Stefano N, Brady JM, Matthews PM. Advances in functional and structural MR image analysis and implementation as FSL. NeuroImage. 2004;23 Suppl 1:S208–S219. doi: 10.1016/j.neuroimage.2004.07.051.
    1. Smith JD, Redford JS, Haas SM. Prototype abstraction by monkeys (Macaca mulatta) Journal of Experimental Psychology: General. 2008;137:390–401. doi: 10.1037/0096-3445.137.2.390.
    1. Smith JD, Minda JP. Thirty categorization results in search of a model. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2000;26:3–27. doi: 10.1037/0278-7393.26.1.3.
    1. Smith JD, Minda JP. Distinguishing prototype-based and exemplar-based processes in dot-pattern category learning. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2002;28:800–811. doi: 10.1037/0278-7393.28.4.800.
    1. Thibaut JP, Gelaes S, Murphy GL. Does practice in category learning increase rule use or exemplar use-or both? Memory & Cognition. 2018;46:530–543. doi: 10.3758/s13421-017-0782-4.
    1. Tse D, Langston RF, Kakeyama M, Bethus I, Spooner PA, Wood ER, Witter MP, Morris RG. Schemas and memory consolidation. Science. 2007;316:76–82. doi: 10.1126/science.1135935.
    1. van Kesteren MT, Ruiter DJ, Fernández G, Henson RN. How schema and novelty augment memory formation. Trends in Neurosciences. 2012;35:211–219. doi: 10.1016/j.tins.2012.02.001.
    1. Vilberg KL, Rugg MD. Memory retrieval and the parietal cortex: a review of evidence from a dual-process perspective. Neuropsychologia. 2008;46:1787–1799. doi: 10.1016/j.neuropsychologia.2008.01.004.
    1. Xiao X, Dong Q, Gao J, Men W, Poldrack RA, Xue G. Transformed neural pattern reinstatement during episodic memory retrieval. The Journal of Neuroscience. 2017;37:2986–2998. doi: 10.1523/JNEUROSCI.2324-16.2017.
    1. Zaki SR, Nosofsky RM, Stanton RD, Cohen AL. Prototype and exemplar accounts of category learning and attentional allocation: a reassessment. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2003;29:1160–1173. doi: 10.1037/0278-7393.29.6.1160.
    1. Zeithamova D, Maddox WT, Schnyer DM. Dissociable prototype learning systems: evidence from brain imaging and behavior. Journal of Neuroscience. 2008;28:13194–13201. doi: 10.1523/JNEUROSCI.2915-08.2008.
    1. Zeithamova D, Dominick AL, Preston AR. Hippocampal and ventral medial prefrontal activation during retrieval-mediated learning supports novel inference. Neuron. 2012;75:168–179. doi: 10.1016/j.neuron.2012.05.010.
    1. Zeithamova D, Bowman CR. Generalization and the Hippocampus: more than one story? Neurobiology of Learning and Memory. 2020;175:107317. doi: 10.1016/j.nlm.2020.107317.

Source: PubMed

3
Sottoscrivi