Identification of memory reactivation during sleep by EEG classification

Suliman Belal, James Cousins, Wael El-Deredy, Laura Parkes, Jules Schneider, Hikaru Tsujimura, Alexia Zoumpoulaki, Marta Perapoch, Lorena Santamaria, Penelope Lewis, Suliman Belal, James Cousins, Wael El-Deredy, Laura Parkes, Jules Schneider, Hikaru Tsujimura, Alexia Zoumpoulaki, Marta Perapoch, Lorena Santamaria, Penelope Lewis

Abstract

Memory reactivation during sleep is critical for consolidation, but also extremely difficult to measure as it is subtle, distributed and temporally unpredictable. This article reports a novel method for detecting such reactivation in standard sleep recordings. During learning, participants produced a complex sequence of finger presses, with each finger cued by a distinct audio-visual stimulus. Auditory cues were then re-played during subsequent sleep to trigger neural reactivation through a method known as targeted memory reactivation (TMR). Next, we used electroencephalography data from the learning session to train a machine learning classifier, and then applied this classifier to sleep data to determine how successfully each tone had elicited memory reactivation. Neural reactivation was classified above chance in all participants when TMR was applied in SWS, and in 5 of the 14 participants to whom TMR was applied in N2. Classification success reduced across numerous repetitions of the tone cue, suggesting either a gradually reducing responsiveness to such cues or a plasticity-related change in the neural signature as a result of cueing. We believe this method will be valuable for future investigations of memory consolidation.

Keywords: Consolidation; Machine learning; Memory reactivation; Pattern recognition; Sleep.

Copyright © 2018 Elsevier Inc. All rights reserved.

Figures

Fig. 1
Fig. 1
A schematic illustration of the design of the experiment and the classifier. (A) In the Motor task, participants performed the SRTT task with finger presses. In the Imagery task they were instructed to remain motionless and imagine performing the task while experiencing the same audio-visual cues that were used in the Motor task. During subsequent SWS and N2, the sequence was repeatedly reactivated in blocks of 1.5 min on, 2 min off. (B) The visual cues used in the experiment. Visual cues were objects or faces (1 = face #1, 2 = lamp, 3 = face #2, 4 = water tap). Note that these 4 cues were always the same (e.g. each finger was paired with just one image, and that image was repeated every time the cue was repeated). (C) Mean learning curve showing performance (CS = RT/accuracy) for each block before and after sleep. Error bars indicate one standard deviation.
Fig. 2
Fig. 2
Flow diagram of the classifier pipeline. We trained the classifier with EEG data from the wakeful imagery task (bluish colours), next we used EEG data from sleep (orange colours) to feed the trained algorithm and calculate the final accuracy results (purple colours). From the imagery data we extracted 3 types of features (temporal, spectral and wavelet-based features) that divided into training and testing sets were used to train the classifier after a selection process to reduce the number of features. The ranking and selection of features was done using join mutual information (JMI) algorithm and a wrapping methodology. Once the classifier (LDC) was trained we extracted the same type of features from the sleep dataset and used them to feed the trained classifier. An additional control step (permutation of labels) was added to be sure that the classification rates were not due merely to the chance probability.
Fig. 3
Fig. 3
Behavioural results. (A) Correct classification rate (CCR) in the Motor and Imagery experiments shown as mean and standard error (SE). (B) Correct classification rate for SWS, N2 and Control and their corresponding random classifiers, shown as mean and SE.
Fig. 4
Fig. 4
Frequency of selecting each family of features. After the feature extraction stage, a feature selection process determines which features were most suitable for classification. The X-axis (# Times Selected) represents the number of times each feature family appeared across participants. Y-axis (% participants) shows the proportion of participants in whom that particular number of features was selected.
Fig. 5
Fig. 5
Electrode selection. (A) A plot of the frequency of selecting each of the 16 electrodes for the Imagery classifier. This was determined by accounting for each time a feature belonging to a particular electrode was selected by the classifier. The more often an electrode was selected (# Times Selected) across a large proportion of the participants (Proportion of Participants is indicated by the colour bar), the more important the electrode was deemed. This was objectively determined using hierarchical clustering (B).

References

    1. Andrade K.C., Spoormaker V.I., Dresler M., Wehrle R., Holsboer F., Sämann P.G., Czisch M. Sleep spindles and hippocampal functional connectivity in human NREM sleep. J. Neurosci. 2011;31:10331–10339.
    1. Antony J.W., Gobel E.W., O'Hare J.K., Reber P.J., Paller K.A. Cued memory reactivation during sleep influences skill learning. Nat. Neurosci. 2012;15(8):1114–1116.
    1. Bendor D., Wilson M.A. Biasing the content of hippocampal replay during sleep. Nat. Neurosci. 2012;15:1439–1444.
    1. Born J., Rasch B., Gais S. Sleep to remember. Neuroscientist. 2006;12:410–424.
    1. Brown G., Pocock A., Zhao M.J., Lujan M. Conditional likelihood maximisation: a unifying framework for information theoretic feature selection. J. Mach. Learn. Res. 2012;13:27–66.
    1. Bruyer R., Brysbaert M. Combining speed and accuracy in cognitive psychology: is the inverse efficiency score (IES) a better dependent variable than the mean reaction time (RT) Psychol. Belg. 2011;51:5–13.
    1. Cairney S.A., Guttesen .A. á V., El Marj N., Staresina B.P. Memory consolidation is linked to spindle-mediated information processing during sleep. Curr. Biol. 2018:948–954.
    1. Calder A.J., Rhodes G., Johnson M.H., Haxby J.V. The oxford handbook of face perception. Perception. 2010
    1. Carr M.F., Jadhav S.P., Frank L.M. Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval. Nat. Neurosci. 2011;14:147–153.
    1. Cousins J.N., El-Deredy W., Parkes L.M., Hennies N., Lewis P.A. Cued reactivation of motor learning during sleep leads to overnight changes in functional brain activity and connectivity. PLoS Biol. 2016;14 e1002451.
    1. Cousins J.N., El-Deredy W., Parkes L.M., Hennies N., Lewis P.A. Cued memory reactivation during slow-wave sleep promotes explicit knowledge of a motor sequence. J. Neurosci. 2014;34:15870–15876.
    1. Daubechies I. Orthonormal bases of compactly supported wavelets. Commun. Pure Appl. Math. 1988;41:909–996.
    1. Deuker L., Olligs J., Fell J., Kranz T.A., Mormann F., Montag C., Reuter M., Elger C.E., Axmacher N. Memory consolidation by replay of stimulus-specific neural activity. J. Neurosci. 2013;33:19373–19383.
    1. Diekelmann S., Born J. The memory function of sleep. Nat. Rev. Neurosci. 2010;11:114–126.
    1. Diekelmann S., Buchel C., Born J., Rasch B. Labile or stable: opposing consequences for memory when reactivated during waking and sleep. Nat. Neurosci. 2011;14:381–386.
    1. Durrant S.J., Cairney S.A., Lewis P.A. Overnight consolidation aids the transfer of statistical knowledge from the medial temporal lobe to the striatum. Cereb. Cortex Jun. 2012;25(6):1565–1575.
    1. Ego-Stengel V., Wilson M.A. Disruption of ripple-associated hippocampal activity during rest impairs spatial learning in the rat. Hippocampus. 2010;20:1–10.
    1. Ego-Stengel V., Wilson M.A. Spatial selectivity and theta phase precession in CA1 interneurons. Hippocampus. 2007;17:161–174.
    1. Eimer M. The face-sensitivity of the N170 component. Front. Hum. Neurosci. 2011;5(119)
    1. Fuentemilla L., Miro J., Ripolles P., Vila-Ballo A., Juncadella M., Castaner S., Salord N., Monasterio C., Falip M., Rodriguez-Fornells A. Hippocampus-dependent strengthening of targeted memories via reactivation during sleep in humans. Curr. Biol. 2013;23:1769–1775.
    1. Fuentemilla L., Penny W.D., Cashdollar N., Bunzeck N., Duzel E., Düzel E. Theta-coupled periodic replay in working memory. Curr. Biol. 2010;20:606–612.
    1. Gais S., Albouy G., Boly M., ng-Vu T.T., Darsaud A., Desseilles M., Rauchs G., Schabus M., Sterpenich V., Vandewalle G., Maquet P., Peigneux P. Sleep transforms the cerebral trace of declarative memories. Proc. Natl. Acad. Sci. U.S.A. 2007;104:18778–18783.
    1. Graps A. Introduction to wavelets. IEEE Comput. Sci. Eng. 1995;2:50–61.
    1. Heijden F., Duin R., Ridder D., Tax D. Classification, parameter estimation and state estimation. John Willey Sons. 2004;423 2004.–434 p 399.
    1. Herman P., Prasad G., McGinnity T.M., Coyle D. Comparative analysis of spectral approaches to feature extraction for EEG-based motor imagery classification. Ieee Trans. Neural Syst. Rehabil. Eng. 2008;16:317–326.
    1. Hesterberg T., Moore D.S., Monaghan S., Clipson A., Epstein R. Introduction to the Practice of Statistics. 5th ed. W.H. Freeman & Company; New York: 2010. Bootstrap methods and permutation tests.
    1. Hoddes E., Dement W., Zarcone V. The development and use of the Stanford sleepiness scale (SSS) Psychophysiology. 1972;9(150)
    1. Jackson R.L., Lambon Ralph M.A., Pobric G. The timing of anterior temporal lobe involvement in semantic processing. J. Cogn. Neurosci. 2015;27:1388–1396.
    1. Jones M.W., Wilson M.A. Theta rhythms coordinate hippocampal-prefrontal interactions in a spatial memory task. PLoS.Biol. 2005;3 e402.
    1. Jung T., Makeig S., Humphries C., Lee T., McKeown M.J., Iragui I., Sejnowski T.J. Removing Electroencephalographic aretfacts by blind source separation. Psychophysiology. 2000;37:163–178.
    1. Kohavi R. Proceedings of the 14th International Joint Conference on Artificial Intelligence. Morgan Kaufmann Publishers Inc.; San Francisco, CA, USA: 1995. A study of cross-validation and bootstrap for accuracy estimation and model selection; pp. 1137–1143.
    1. Krystal a D., Prado R., West M. New methods of time series analysis of non-stationary EEG data: eigenstructure decompositions of time varying autoregressions. Clin. Neurophysiol. 1999;110:2197–2206.
    1. Laventure S., Fogel S., Lungu O., Albouy G., Sévigny-Dupont P., Vien C., Sayour C., Carrier J., Benali H., Doyon J. NREM2 and sleep spindles are instrumental to the consolidation of motor sequence memories. PLoS Biol. 2016;14
    1. Lee A.K., Wilson M.A. Memory of sequential experience in the hippocampus during slow wave sleep. Neuron. 2002;36:1183–1194.
    1. Lehmann E.L., Romano J.P. Testing statistical hypotheses, 3ed, igarss 2014. 2014.
    1. Lewis P.A., Durrant S.J. Overlapping memory replay during sleep builds cognitive schemata. Trends Cogn. Sci. 2011;15:343–351.
    1. Maquet P., Laureys S., Peigneux P., Fuchs S., Petiau C., Phillips C., Aerts J., Del F.G., Degueldre C., Meulemans T., Luxen A., Franck G., Van der L.M., Smith C., Cleeremans A. Experience-dependent changes in cerebral activation during human REM sleep. Nat. Neurosci. 2000;3:831–836.
    1. Nádasdy Z., Hirase H., Czurkó A., Csicsvari J., Buzsáki G. Replay and time compression of recurring spike sequences in the hippocampus. J. Neurosci. 1999;19:9497–9507.
    1. Nissen M.J., Bullemer P. Attentional requirements of learning - evidence from performance-measures. Cogn. Psychol. 1987;19:1–32.
    1. Ólafsdóttir H.F., Carpenter F., Barry C. Vol. 19. 2016. pp. 1–6. (Coordinated Grid and Place Cell Replay During Rest).
    1. Oudiette D., Paller K.A. Upgrading the sleeping brain with targeted memory reactivation. Trends Cogn. Sci. 2013
    1. Peigneux P., Laureys S., Fuchs S., Collette F., Perrin F., Reggers J., Phillips C., Degueldre C., Del Fiore G., Aerts J., Luxen A., Maquet P., Del F.G. Are spatial memories strengthened in the human hippocampus during slow wave sleep? Neuron. 2004;44:535–545.
    1. Rasch B., Born J. About sleep's role in memory. Physiol. Rev. 2013;93:681–766.
    1. Rasch B., Buchel C., Gais S., Born J. Odor cues during slow-wave sleep prompt declarative memory consolidation. Sci. (80-. ) 2007;315:1426–1429.
    1. Rudoy J.D., Voss J.L., Westerberg C.E., Paller K.A. Strengthening individual memories by reactivating them during sleep. Sci. (80-. ) 2009;326:1079.
    1. Schönauer M., Alizadeh S., Jamalabadi H., Abraham A., Pawlizki A., Gais S. Decoding material-specific memory reprocessing during sleep in humans. Nat. Commun. 2017;8(15404)
    1. Schönauer M., Geisler T., Gais S. Strengthening procedural memories by reactivation in sleep. J. Cogn. Neurosci. 2014;26:143–153.
    1. Schreiner T., Rasch B. Boosting vocabulary learning by verbal cueing during sleep. Cereb. Cortex. 2014:1–11.
    1. Staresina B.P., Alink A., Kriegeskorte N., Henson R.N. Awake reactivation predicts memory in humans. Proc. Natl. Acad. Sci. U. S. A. 2013;110:21159–21164.
    1. Sterpenich V., Albouy G., Boly M., Vandewalle G., Darsaud A., Balteau E., Dang-Vu T.T., Desseilles M., D'Argembeau A., Gais S., Rauchs G., Schabus M., Degueldre C., Luxen A., Collette F., Maquet P. Sleep-related hippocampo-cortical interplay during emotional memory recollection. PLoS.Biol. 2007;5:e282.
    1. Stickgold R., Walker M.P. Sleep-dependent memory triage: evolving generalization through selective processing. Nat. Neurosci. 2013;16:139–145.
    1. Takashima A., Petersson K.M., Rutters F., Tendolkar I., Jensen O., Zwarts M.J., McNaughton B.L., Fernandez G. Declarative memory consolidation in humans: a prospective functional magnetic resonance imaging study. Proc. Natl. Acad. Sci. U.S.A. 2006;103:756–761.
    1. Tatsuno M., Lipa P., McNaughton B.L. Methodological considerations on the use of template matching to study long-lasting memory trace replay. J. Neurosci. 2006;26:10727–10742.
    1. Tononi G., Cirelli C. Sleep and the price of plasticity: from synaptic and cellular homeostasis to memory consolidation and integration. Neuron. 2014;81:12–34.
    1. Tononi G., Cirelli C. Sleep function and synaptic homeostasis. Sleep. Med.Rev. 2006;10:49–62.
    1. Vahdat S., Fogel S., Benali H., Doyon J. Network-wide reorganization of procedural memory during NREM sleep revealed by fMRI. Elife. 2017:6.
    1. van Dongen E.V., Takashima A., Barth M., Zapp J., Schad L.R., Paller K.A., Fernandez G. Memory stabilization with targeted reactivation during human slow-wave sleep. Proc. Natl. Acad. Sci. U.S.A. 2012;109:10575–10580.
    1. Vyazovskiy V.V., Delogu A. NREM and REM sleep: complementary roles in recovery after wakefulness. Neuroscientist. 2014;20:203–219.
    1. Walker M.P., Brakefield T., Morgan A., Hobson J.A., Stickgold R. Practice with sleep makes perfect: sleep-dependent motor skill learning. Neuron. 2002;35:205–211.
    1. Walker M.P., Stickgold R., Jolesz F.A., Yoo S.S. The functional anatomy of sleep-dependent visual skill learning. Cereb. Cortex. 2005;15:1666–1675.
    1. Welch P.D. The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. Audio Electroacoust. IEEE Trans. 1967;15:70–73.
    1. Wilson M.A., McNaughton B.L. Reactivation of hippocampal ensemble memories during sleep. Sci. (80-. ) 1994;265:676–679.
    1. Yang H., Moody J. Feature selection based on joint mutual information. Proc. Int. ICSC Symp. 1999:22–25.
    1. Yotsumoto Y., Sasaki Y., Chan P., Vasios C.E., Bonmassar G., Ito N., Náñez J.E., Shimojo S., Watanabe T., Nanez J.E., Sr. Location-specific cortical activation changes during sleep after training for perceptual learning. Curr. Biol. 2009;19:1278–1282.

Source: PubMed

Подписаться