Learning face perception without vision: Rebound learning effect and hemispheric differences in congenital vs late-onset blindness

Lora T Likova, Ming Mei, Kris N Mineff, Spero C Nicholas, Lora T Likova, Ming Mei, Kris N Mineff, Spero C Nicholas

Abstract

To address the longstanding questions of whether the blind-from-birth have an innate face-schema, what plasticity mechanisms underlie non-visual face learning, and whether there are interhemispheric face processing differences in face processing in the blind, we used a unique non-visual drawing-based training in congenitally blind (CB), late-blind (LB) and blindfolded-sighted (BF) groups of adults. This Cognitive-Kinesthetic Drawing approach previously developed by Likova (e.g., 2010, 2012, 2013) enabled us to rapidly train and study training-driven neuroplasticity in both the blind and sighted groups. The five-day two-hour training taught participants to haptically explore, recognize, memorize raised-line images, and draw them free-hand from memory, in detail, including the fine facial characteristics of the face stimuli. Such drawings represent an externalization of the formed memory. Functional MRI was run before and after the training. Tactile-face perception activated the occipito-temporal cortex in all groups. However, the training led to a strong, predominantly left-hemispheric reorganization in the two blind groups, in contrast to right-hemispheric in blindfolded-sighted, i.e., the post-training response-change was stronger in the left hemisphere in the blind, but in the right in the blindfolded. This is the first study to discover interhemispheric differences in non-visual face processing. Remarkably, for face perception this learning-based change was positive in the CB and BF groups, but negative in the LB-group. Both the lateralization and inversed-sign learning effects were specific to face perception, but absent for the control nonface categories of small objects and houses. The unexpected inversed-sign training effect in CB vs LB suggests different stages of brain plasticity in the ventral pathway specific to the face category. Importantly, the fact that only after a very few days of our training, the totally-blind-from-birth CB manifested a very good (haptic) face perception, and even developed strong empathy to the explored faces, implies a preexisting face schema that can be "unmasked" and "tuned up" by a proper learning procedure. The Likova Cognitive-Kinesthetic Training is a powerful tool for driving brain plasticity, and providing deeper insights into non-visual learning, including emergence of perceptual categories. A rebound learning model and a neuro-Bayesian economy principle are proposed to explain the multidimensional learning effects. The results provide new insights into the Nature-vs-Nurture interplay in rapid brain plasticity and neurorehabilitation.

Keywords: blindness; drawing training; face learning; lateralization; non-visual learning; plasticity; spatial cognition; tactile memory; training.

Figures

FIG. 1.
FIG. 1.
Left panel. The fMRI experimental design includes a sequence of five tasks, separated by rest periods. This paper focusses on the “Explore and Memorize” task only (white dashed outline).Right Panel. Examples of the raised-line face images. Initially, the congenitally blind usually had no interest in faces and their structural understanding of face images was quite limited -many were not even able to relate the organization of facial parts to their own faces. Some were wondering how the sighted can enjoy any drawings, as drawings are “flat” images. Thus, it was remarkable when after only the few days of the Cognitive-Kinesthetic Training, they became able to easily recognize and fully understand faces, their appearance, and even facial expressions. Furthermore, some CB developed such strong empathy that refused to work with the ‘unhappy’ face (right, red cross) but liked the ‘happy’, smiling face and didn’t at all mind his boldness (left, green checkmark).
FIG. 2.
FIG. 2.
To measure the large-scale effect, a large-scale ROI was defined at the occipito-temporal cortex (LSOT; blue outline). The upper panels show the location of the LSOT in the left (A) and right (B) hemispheres. The lower panels show the LSOT on the inflated and rotated to the ventral side surfaces of the left (C) and the right (D) hemispheres. LSOT ~1000 voxels per hemisphere.
FIG. 3.
FIG. 3.
Average activation maps of the two groups of blindness (CB and LB) and of blindfolded (BF) in the LSOT area of the visual ventral pathway. LSOT region in the left (LH) and right (RH) hemispheres (blue) were defined to measure the large-scale effects. The grey bars represent the pre-training BOLD response bilaterally; the checkerboard bars - the post-training BOLD response. The training effect is measured by the difference between the post-training and pre-training responses. Increased training effects are shown by red bars, and reduced training effects are shown by blue bars. Note the opposite sign effect in the acquired, or late-onset, blindness. The training effect was stronger in the left hemispheres of the blind groups, but in the right hemisphere of the blindfolded-sighted.
FIG. 4.
FIG. 4.
Sub-divisions of the LSOT are outlined in different colors. Four ROIs are blilaterally symmetrical: LOC (yellow), LOV (white), VT (cyan), and MTV (magenta). The MTas (green) is unique for left hemisphere, and the MTVa (violet) - for the right hemisphere.
FIG. 5.
FIG. 5.
For each sub-divisional ROI within LSOT, a triplet of bars is shown, representing the BOLD responses (i) pre-training, (ii) post-training and (iii) the change from pre-to-post. The pre-training responses (the first bar in each group) are shown in filled colors, corresponding to the color coding of the respective ROI (see Fig. 4). The post-training signals (second bar) are shown in checkerboard bars. The training-caused change is shown in either red (positive change, enhancement) or in blue (negative change, reduction). LH - Left hemisphere; RH – Right hemisphere.
FIG. 6.
FIG. 6.
Non-visual training effect in each hemisphere as function of stimulus category (objects, faces and houses) and visual-status group (congenitally blind, CB; late-onset blind, LB; and blindfolded, BF). As above, the triplet of bars represents the BOLD responses: (i) pre-training (gray), (ii) post-training (checkerboard), (iii) change from pre-to-post (color). The training-caused change is shown in either red (positive change, enhancement) or in blue (negative change, reduction). LH - Left hemisphere; RH – Right hemisphere. Note that the inverse learning response for LB vs CB is present only in the face category (second row).
FIG. 7.
FIG. 7.
We propose a Rebound Learning Model to explain the observed inverted-U curve for learning-driven activation of non-visual face perception. It clearly manifests when comparing (i) a case in which at least one of the variables is new and has not been learned before starting training – e.g., either the perceptual category (as faces in the case of CB) or the use of particular sensory modality (as the use of tactile modality for face perception in the BF), vs. (ii) a case in which all these variables have been already learned and used to some degree, so as they have become “overlearned” after training. This model is inspired by our data on brain activation changes driven by the Cognitive-Kinesthetic face learning (see Figs. 5, 6; Table 1).

References

    1. Barton JJ, Cherkasova M (2003) Face imagery and its relation to perception and covert recognition in prosopagnosia. Neurology. 61 (2): 220–5. doi:10.1212/01.WNL.0000071229.11658.F8.
    1. Carbon CC, Gruter T, Weber JE, Lueschow A (2007) Faces as objects of non-expertise: processing of thatcherised faces in congenital prosopagnosia. Perception. 36(11):1635–45.
    1. Carbon CC, Gruter T, Gruter M, Weber JE, Lueschow A (2010) Dissociation of facial attractiveness and distinctiveness processing in congenital prosopagnosia. Visual Cognition. 18(5):641–54. doi: 10.1080/13506280903462471.
    1. Casey SM (1978). Cognitive mapping by the blind. Journal of Visual Impairment & Blindness. ????
    1. de Gelder B & Rouw R (2001) Beyond localisation: a dynamical dual route account of face recognition. Acta Psychol. (Amst) 1–3, 183–207.
    1. De Renzi E (1986). Prosopagnosia in two patients with CT scan evidence of damage confined to the right hemisphere. Neuropsychologia. 24 (3): 385–389. doi:10.1016/0028-3932(86)90023-0.
    1. De Renzi E, Perani D, Carlesimo GA, Silveri MC, Fazio. (1994) Prosopagnosia can be associated with damage confined to the right hemisphere--an MRI and PET study and a review of the literature. Neuropsychologia. 32 (8): 893–902. doi:10.1016/0028-3932(94)90041-8.
    1. Deibert E, Kraut M, Kremen S, Hart J (1999) Neural pathways in tactile object recognition. Neurology 52:1413–1417.
    1. Dial JG, Chan F, Mezger C, & Parker HJ (1991). Comprehensive vocational evaluation system for visually impaired and blind persons. Journal of Visual Impairment & Blindness. ???
    1. Gaunet F, & Thinus-Blanc C (1996). Early-blind subjects’ spatial abilities in the locomotor space: Exploratory strategies and reaction-to-change performance. Perception, 25(8), 967–981.
    1. Gazzaniga MS & Smylie CS (1983) Facial recognition and brain asymmetries: clues to underlying mechanisms. Ann. Neurol 5, 536–540.
    1. Goyal MS, Hansen PJ, Blakemore CB (2006) Tactile perception recruits functionally related visual areas in the late-blind. NeuroReport 17:1381–1384.
    1. Haxby JV, Gobbini MI, Furey ML, Ishai A, Schouten JL, Pietrini P (2001) Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293, 2425–2430.
    1. Jenkins IH, Brooks DJ, Nixon PD, Frackowiak RS, Passingham RE (1994) Motor sequence learning: a study with positron emission tomography. J Neurosci. 14(6):3775–90.
    1. Kanwisher N, McDermott J, Chun MM (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception. Journal of Neuroscience. 17(11):4302–11.
    1. Likova LT, Cacciamani L , Nicholas S, Mineff K (2017) Top-down working memory reorganization of the primary visual cortex: Granger Causality analysis. Journal of Vision 17 (10), 594.
    1. Likova LT (2010) Drawing in the blind and the sighted as a probe of cortical reorganization In IS&T/SPIE Electronic Imaging (pp. 752708–752720). International Society for Optics and Photonics.
    1. Likova LT (2012) Drawing enhances cross-modal memory plasticity in the human brain: a case study in a totally blind adult. Frontiers in Human Neuroscience, 6, 3389. doi: 10.3389/fnhum.2012.00044.
    1. Likova LT (2013) A cross-modal perspective on the relationships between imagery and working memory. Frontiers in Psychology, 3:561.
    1. Likova LT (2014) Learning-based cross-modal plasticity in the human brain: insights from visual deprivation fMRI. Advanced Brain Neuroimaging Topics in Health and Disease-Methods and Applications, 327–358.
    1. Likova LT (2015) Temporal evolution of brain reorganization under cross-modal training: insights into the functional architecture of encoding and retrieval networks In IS&T/SPIE Electronic Imaging (pp. 939417–939432).
    1. Likova LT, Cacciamani L, Mineff KN, & Nicholas SC (2016). The cortical network for Braille writing in the blind. Electronic Imaging, 2016, 1–6.
    1. Likova LT (2017) Addressing long-standing controversies in conceptual knowledge representation in the temporal pole: A cross-modal paradigm. Human Vision and Electronic Imaging 2017, 268–272(5) doi: 10.2352/ISSN.2470-1173.2017.14.HVEI-155.
    1. Likova LT (2018) Brain reorganization in adulthood underlying a rapid switch in handedness induced by training in memory-guided drawing In Open Access Peer-Reviewed Chapter In “Neuroplasticity”. Ed. Chaban V. Neuroplasticity. 10.5772/intechopen.76317.
    1. Lueschow A, Weber JE, Carbon CC, Deffke I, Sander T, Grüter T, Grüter M, Trahms L, Curio G (2015) The 170ms response to faces as measured by MEG (M170) is consistently altered in congenital prosopagnosia. PLOS One. 1–22. 1080/13506280903462471.
    1. Mattson AJ, Levin HS, Grafman J; Levin; Grafman (February 2000). A case of prosopagnosia following moderate closed head injury with left hemisphere focal lesion. Cortex. 36 (1): 125–37. doi:10.1016/S0010-9452(08)70841-4.
    1. McCarthy G, Puce A, Gore JC & Allison T (1997) Face-specific processing in the human fusiform gyrus. J. Cogn. Neurosci 5, 605–610.
    1. Miller MB, Kingstone A & Gazzaniga MS (2002) Hemispheric encoding asymmetry is more apparent than real. J. Cogn. Neurosci 5, 702–708.
    1. Joyce A, Dial J, Nelson P, & Hupp G (2000). Neuropsychological predictors of adaptive living and work behaviors. Archives of Clinical Neuropsychology, 15(8), 665–665.
    1. Passini R, Proulx G, & Rainville C (1990) The spatio-cognitive abilities of the visually impaired population. Environment and Behavior, 22(1), 91–118.
    1. Pietrini P, Furey ML, Ricciardi E, Ida Gobbini M, Carolyn Wu W-H, Cohen L, et al. (2004) Beyond sensory images: object-based representation in the human ventral pathway. Proc Natl Acad Sci USA 101: 5658–5663.
    1. Rieser JJ, Guth DA, & Hill EW (1986) Sensitivity to perspective structure while walking without vision. Perception, 15(2), 173–188.
    1. Rossion B, Dricot L, Devolder A, Bodart JM, Crommelinck M, De Gelder B & Zoontjes R (2000) Hemispheric asymmetries for whole-based and part based face processing in the human fusiform gyrus. J. Cogn. Neurosci 5, 793–802.
    1. Spiridon M, Kanwisher N, 2002. How distributed is visual category information in human occipital –temporal cortex? An fMRI study. Neuron 35, 1157–1165.
    1. Sprengelmeyer R, Rausch M, Eysel UT, Przuntek H; (1998) Neural structures associated with recognition of facial expressions of basic emotions. Proc. Biol. Sci 265 (1409): 1927–31. doi:10.1098/rspb.1998.0522.
    1. Tarr MJ, Gauthier I. (2000) FFA: a flexible fusiform area for subordinate-level visual processing automatized by expertise. Nat Neurosci. 3(8):764–9.. doi: 10.1038/77666
    1. Tinti C, Adenzato M, Tamietto M, & Cornoldi C (2006). Visual experience is not necessary for efficient survey spatial cognition: evidence from blindness. The Quarterly Journal of Experimental Psychology, 59(7), 1306–1328.
    1. Verstichel P (2001). [Impaired recognition of faces: implicit recognition, feeling of familiarity, role of each hemisphere]. Bull. Acad. Natl. Med (in French). 185 (3): 537–49, discussion 550–3.
    1. Wolford G, Miller MB & Gazzaniga MS (2004) Split decisions In The Cognitive Neurosciences III (ed. Gazzaniga MS), pp. 1189–1199. Cambridge, MA:MIT Press.
    1. Yerkes RM, Dodson JD (1908) The relation of strength of stimulus to rapidity of habit-formation. Journal of Comparative Neurology, 18:5, 459–48.

Source: PubMed

3
订阅