Chronic, wireless recordings of large-scale brain activity in freely moving rhesus monkeys

David A Schwarz, Mikhail A Lebedev, Timothy L Hanson, Dragan F Dimitrov, Gary Lehew, Jim Meloy, Sankaranarayani Rajangam, Vivek Subramanian, Peter J Ifft, Zheng Li, Arjun Ramakrishnan, Andrew Tate, Katie Z Zhuang, Miguel A L Nicolelis, David A Schwarz, Mikhail A Lebedev, Timothy L Hanson, Dragan F Dimitrov, Gary Lehew, Jim Meloy, Sankaranarayani Rajangam, Vivek Subramanian, Peter J Ifft, Zheng Li, Arjun Ramakrishnan, Andrew Tate, Katie Z Zhuang, Miguel A L Nicolelis

Abstract

Advances in techniques for recording large-scale brain activity contribute to both the elucidation of neurophysiological principles and the development of brain-machine interfaces (BMIs). Here we describe a neurophysiological paradigm for performing tethered and wireless large-scale recordings based on movable volumetric three-dimensional (3D) multielectrode implants. This approach allowed us to isolate up to 1,800 neurons (units) per animal and simultaneously record the extracellular activity of close to 500 cortical neurons, distributed across multiple cortical areas, in freely behaving rhesus monkeys. The method is expandable, in principle, to thousands of simultaneously recorded channels. It also allows increased recording longevity (5 consecutive years) and recording of a broad range of behaviors, such as social interactions, and BMI paradigms in freely moving primates. We propose that wireless large-scale recordings could have a profound impact on basic primate neurophysiology research while providing a framework for the development and testing of clinically relevant neuroprostheses.

Figures

Figure 1. Recording Cubes and Primate Headcap
Figure 1. Recording Cubes and Primate Headcap
(a) Schematic drawings and photographs of actual microwire cubes, showing the wire density and adjustment mechanisms. The 3rd generation is a 10×10 array that is fitted with bundled microwires (right panel). (b) Photographs of final arrangements of connectors, showing a view from the top of the headcap of a monkey implanted with 2nd gen cubes (left) and a similar view of the VLSBA module on monkey implanted with 3rd gen cubes (middle). The right panel shows the wireless module mounted on the headcap. (c) Layered schematic drawing showing the modular headcap assembly, with the VLSBA connector organizer as the active module. (d) Schematic drawing showing the modular headcap wireless assembly on the right panel. Both headcaps are 3D printed.
Figure 2. Large-scale activity Recordings
Figure 2. Large-scale activity Recordings
(a) Representative mean waveforms for 1,874 neurons over a center-out task. Intermittently colored to indicate array of origin. Green highlight: neurons from left hemisphere M1. Orange highlight: left hemisphere S1. Blue highlight: right hemisphere M1. Yellow highlight: right hemisphere S1. (b) Population raster plot depicts 1 second window of neuronal spiking activity for a single recording session (556 neurons). The vertical color key identifies the recorded areas. 128-channel Plexon system was used for each recorded area. (c) This panel shows unit isolation clustering using the first two principal components of a subset (50) of channels ) from Monkey O.
Figure 3. Recording Longevity
Figure 3. Recording Longevity
Neuronal recording yield over time measured by quantifying the average number of single units recorded per connector (32 channels). All the data from the 5 monkeys used in these experiments, and three other monkeys (T, I, and Cl), were used. Four-year sample waveforms, identified by date, from Monkey M’s left hemisphere M1 connector surround the figure showing mean sample waveforms. Highlighted area corresponds to the waveform’s standard deviation.
Figure 4. Large Scale Wireless System
Figure 4. Large Scale Wireless System
Schematic diagram showing the information flow of the wireless recording system, beginning with spike waveforms to spikes transmitted across ISM radio band to the client. (a) Exploded diagram of wireless transceivers located inside the headcap. (b) Wireless bridges showing the main components of bidirectional communication and the connections to the client computer. (c) Photograph of the radio transceiver with scale. (d) Photograph of the wireless bridge, with scale. (e) Screenshot of the wireless client with four channels visible, demonstrating the PCA sorting method and graphical user interface.
Figure 5. Wireless Brain Machine Interface
Figure 5. Wireless Brain Machine Interface
(a) Screenshot of monkey with wireless system performing a task using pure brain control. See Supplementary Video 1. (b) Performance metric increase in a single week of training. (c) Example average traces the y-coordinate of the cursor for trials with target at 0 degrees (North) of orientation, showing average constant movements despite variable postures during task interaction, as well as time-to-target. Peaks indicate reached target. (d) Peri-event time histograms centered on target onset for 212 units, grouped at each column with cursor control paradigms of basic hand control (HC) with joystick, brain control with joystick (BCWH), and sole brain control (BCWOH), respectively. Color key shows unit groupings per area, and include LS1, LM1, LSMA, RM1, and RSMA. Each unit was normalized per condition using z-score method.
Figure 6. Freely Behaving Recordings and Future…
Figure 6. Freely Behaving Recordings and Future Arrays
(a) Screenshots of videos used for coding of behaviors. Two frames for three sample behaviors are shown. See Supplementary Video 3. (b) Plot of the first three principal components of neural activity for 6 different behaviors, color coded per behavior, shown as filled in circles. PCA data was used for SVM classification (see Table 5). (c) PETHs for behaviors from a single monkey, calculated from 107 M1 neurons centered around behavior onset. Legend for spectrograms placed on the bottom right corner to reduce figure clutter. Each unit was normalized for the entire session (all behaviors shown) using the z-score method. (d) 864 channel array assembly modules. Left panel shows the bottom view with guiding tube density. Right panel shows the top view with a depiction of the movable assemblies. (e) Photograph of fully assembled array with guiding tubes. Note the high density connector attached. (f) Connector and cap design. Left panel shows schematic for high density connectors. Right panel shows a redesign of the cap which should allow for the management of 10,000 channels without increasing the cap footprint. (g) Panel shows photograph of plastic cap mounted with a single connector. The fully assembled cap will host 12 connectors, each with 864 channel capacity.

References

    1. Evarts EV. Pyramidal tract activity associated with a conditioned hand movement in the monkey. J. Neurophysiol. 1966;29:1011–1027.
    1. Nicolelis M, Lin R, Woodward D, Chapin J. Induction of immediate spatiotemporal changes in thalamic networks by peripheral block of ascending cutaneous information. Nature. 1993;361:533–536.
    1. Supèr H, Roelfsema PR. Chronic multiunit recordings in behaving animals: advantages and limitations. Prog. Brain Res. 2005;147:263–282.
    1. Nicolelis MA, Ghazanfar AA, Faggin BM, Votaw S, Oliveira LM. Reconstructing the engram: simultaneous, multisite, many single neuron recordings. Neuron. 1997;18:529–537.
    1. Nicolelis M. Actions from thoughts. Nature. 2001;409:403–407.
    1. Nicolelis MAL, et al. Chronic, multisite, multielectrode recordings in macaque monkeys. Proc. Natl. Acad. Sci. U.S.A. 2003;100:11041–11046.
    1. Wessberg J, et al. Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature. 2000;408:361–365.
    1. Chapin JK, Moxon KA, Markowitz RS, Nicolelis MA. Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat. Neurosci. 1999;2:664–670.
    1. Nicolelis MAL, Lebedev MA. Principles of neural ensemble physiology underlying the operation of brain-machine interfaces. Nat. Rev. Neurosci. 2009;10:530–540.
    1. Azevedo FAC, et al. Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled-up primate brain. J. Comp. Neurol. 2009;513:532–541.
    1. Marblestone AH, et al. Physical principles for scalable neural recording. Front. Comput. Neurosci. 2013;7:137.
    1. Lebedev MA, Nicolelis MAL. Brain-machine interfaces: past, present and future. Trends Neurosci. 2006;29:536–546.
    1. Lebedev MA, et al. Future developments in brain-machine interface research. Clinics (Sao Paulo) 2011;1(66 Suppl):25–32.
    1. Lebedev MA, Nicolelis MAL. Toward a whole-body neuroprosthetic. Prog. Brain Res. 2011;194:47–60.
    1. Chestek CA, et al. HermesC: low-power wireless neural recording system for freely moving primates. IEEE Trans. Neural Syst. Rehabil. Eng. 2009;17:330–338.
    1. Bonfanti A, et al. A multi-channel low-power system-on-chip for single-unit recording and narrowband wireless transmission of neural signal. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2010;2010:1555–1560.
    1. Rizk M, et al. A fully implantable 96-channel neural data acquisition system. J. Neural Eng. 2009;6:026002.
    1. Borton D, Yin M, Aceros J, Nurmikko A. An implantable wireless neural interface for recording cortical circuit dynamics in moving primates. J.Neural Eng. 2013;10:026010.
    1. Lebedev MA, et al. Cortical ensemble adaptation to represent velocity of an artificial actuator controlled by a brain-machine interface. J. Neurosci. 2005;25:4681–4693.
    1. Lebedev MA, O'Doherty JE, Nicolelis MAL. Decoding of temporal intervals from cortical ensemble activity. J. Neurophysiol. 2008;99:166–186.
    1. Zacksenhouse M, Nemets S. Strategies for Neural Ensemble Data Analysis for Brain–Machine Interface (BMI) Applications. In: Nicolelis MAL, editor. Methods for Neural Ensemble Recordings. 2nd edition. Boca Raton: CRC Press; 2008.
    1. O’Doherty JE, et al. Active tactile exploration enabled by a brain-machine-brain interface. Nature. 2011;479:228–231.
    1. Shokur S, et al. Expanding the primate body schema in sensorimotor cortex by virtual touches of an avatar. Proc. Natl. Acad. Sci .USA. 2013;110:15121–15126.
    1. Ifft PJ, Shokur S, Li Z, Lebedev MA, Nicolelis MAL. A brain-machine interface enables bimanual arm movements in monkeys. Sci. Transl. Med. 2013;5 210ra154.
    1. Lu CW, Patil PG, Chestek CA. Current challenges to the clinical translation of brain machine interface technology. Int. Rev. Neurobiol. 2012;107:137–160.
    1. Patil PG, Carmena JM, Nicolelis MAL, Turner DA. Ensemble recordings of human subcortical neurons as a source of motor control signals for a brain-machine interface. Neurosurgery. 2004;55:27–35. discussion 35–8.
    1. Hanson T, Fuller A, Lebedev M, Turner D, Nicolelis M. Subcortical neuronal ensembles: an analysis of motor task association, tremor, oscillations, and synchrony in human patients. J. Neurosci. 2012;32:8620–8632.
    1. Carmena JM, et al. Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol. 2003;1:E42.
    1. Li Z, et al. Unscented Kalman filter for brain-machine interfaces. PLoS ONE. 2009;4:e6243.
    1. Nicolelis MAL. Brain-machine interfaces to restore motor function and probe neural circuits. Nat. Rev. Neurosci. 2003;4:417–422.
    1. Nicolelis MAL, Lehew GC, Krupa DJ. Miniaturized high-density multichannel electrode array for long-term neuronal recordings. No. 6,993,392. Patent. 2006 Jan 31;
    1. Maynard EM, Nordhausen CT, Normann RA. The Utah Intracortical Electrode Array: A recording structure for potential brain-computer interfaces. Electroencephalogr. Clin. Neurophysiol. 1997;102:228–239.
    1. Freire MAM, et al. Comprehensive analysis of tissue preservation and recording quality from chronic multielectrode implants. PLoS ONE. 2011;6:e27554.
    1. Ochsner KN, Lieberman MD. The emergence of social cognitive neuroscience. Am. Psychol. 2001;56:717–734.
    1. Mattout J. Brain-computer interfaces: a neuroscience paradigm of social interaction? A matter of perspective. Front. Hum. Neurosci. 2012;6:114.
    1. Pais-Vieira M, Lebedev M, Kunicki C, Wang J, Nicolelis MAL. A Brain-to-Brain Interface for Real-Time Sharing of Sensorimotor Information. Sci. Rep. 2013;3
    1. O'Doherty JE, Lebedev MA, Li Z, Nicolelis MAL. Virtual active touch using randomly patterned intracortical microstimulation. IEEE Trans. Neural Syst. Rehabil. Eng. 2012;20:85–93.
    1. Ifft PJ, Lebedev MA, Nicolelis MAL. Cortical correlates of fitts' law. Front. Integr. Neurosci. 2011;5:85.
    1. Fitzsimmons NA. Extracting kinematic parameters for monkey bipedal walking from cortical neuronal ensemble activity. Front. Integr. Neurosci. 2009;3:1–19.
    1. O’Doherty JE, Lebedev MA, Hanson TL, Fitzsimmons NA, Nicolelis MAL. A brain-machine interface instructed by direct intracortical microstimulation. Front. Integr. Neurosci. 2009;3:20.
    1. Rizk M, Obeid I, Callender SH, Wolf PD. A single-chip signal processing and telemetry engine for an implantable 96-channel neural data acquisition system. J. Neural Eng. 2007;4:309–321.
    1. Sodagar AM, Perlin GE, Yao Y, Najafi K, Wise KD. An implantable 64-channel wireless microsystem for single-unit neural recording. IEEE J Solid-St. Circ. 2009;44:2591–2604.
    1. Roy S, Wang X. Wireless multi-channel single unit recording in freely moving and vocalizing primates. J. Neurosci. Methods. 2012;203:28–40.
    1. Miranda H, Gilja V, Chestek CA, Shenoy KV, Meng TH. HermesD: A High-Rate Long-Range Wireless Transmission System for Simultaneous Multichannel Neural Recording Applications. IEEE Trans. Biomed. Circuits Syst. 2010;4:181–191.
    1. Lewicki MS. A review of methods for spike sorting: the detection and classification of neural action potentials. Network. 1998;9:R53–R78.

Source: PubMed

3
購読する