Independent Mobility Achieved through a Wireless Brain-Machine Interface
Camilo Libedinsky, Rosa So, Zhiming Xu, Toe K Kyar, Duncun Ho, Clement Lim, Louiza Chan, Yuanwei Chua, Lei Yao, Jia Hao Cheong, Jung Hyup Lee, Kulkarni Vinayak Vishal, Yongxin Guo, Zhi Ning Chen, Lay K Lim, Peng Li, Lei Liu, Xiaodan Zou, Kai K Ang, Yuan Gao, Wai Hoe Ng, Boon Siew Han, Keefe Chng, Cuntai Guan, Minkyu Je, Shih-Cheng Yen, Camilo Libedinsky, Rosa So, Zhiming Xu, Toe K Kyar, Duncun Ho, Clement Lim, Louiza Chan, Yuanwei Chua, Lei Yao, Jia Hao Cheong, Jung Hyup Lee, Kulkarni Vinayak Vishal, Yongxin Guo, Zhi Ning Chen, Lay K Lim, Peng Li, Lei Liu, Xiaodan Zou, Kai K Ang, Yuan Gao, Wai Hoe Ng, Boon Siew Han, Keefe Chng, Cuntai Guan, Minkyu Je, Shih-Cheng Yen
Abstract
Individuals with tetraplegia lack independent mobility, making them highly dependent on others to move from one place to another. Here, we describe how two macaques were able to use a wireless integrated system to control a robotic platform, over which they were sitting, to achieve independent mobility using the neuronal activity in their motor cortices. The activity of populations of single neurons was recorded using multiple electrode arrays implanted in the arm region of primary motor cortex, and decoded to achieve brain control of the platform. We found that free-running brain control of the platform (which was not equipped with any machine intelligence) was fast and accurate, resembling the performance achieved using joystick control. The decoding algorithms can be trained in the absence of joystick movements, as would be required for use by tetraplegic individuals, demonstrating that the non-human primate model is a good pre-clinical model for developing such a cortically-controlled movement prosthetic. Interestingly, we found that the response properties of some neurons differed greatly depending on the mode of control (joystick or brain control), suggesting different roles for these neurons in encoding movement intention and movement execution. These results demonstrate that independent mobility can be achieved without first training on prescribed motor movements, opening the door for the implementation of this technology in persons with tetraplegia.
Conflict of interest statement
The authors have declared that no competing interests exist.
Figures
References
- Collinger JL, Foldes S, Bruns TM, Wodlinger B, Gaunt R, Weber DJ. Neuroprosthetic technology for individuals with spinal cord injury. J Spinal Cord Med. 2013;36(4):258–72. 10.1179/2045772313Y.0000000128
- Rebsamen B, Guan C, Zhang H, Wang C, Teo C, A M.H., et al. A brain controlled wheelchair to navigate in familiar environments. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2010;18:590–98. 10.1109/TNSRE.2010.2049862
- Millan JDR, Galán F, Vanhooydonck D, Lew E, Philips J, Nuttin M, editors. Asynchronous non-invasive brain-actuated control of an intelligent wheelchair. Annual International Conference of the IEEE 2009.
- Iturrate I, Antelis JM, Kübler A, Minguez J. A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation. IEEE Transactions on Robotics. 2009;25:614–27.
- Serruya MD, Hatsopoulos NG, Paninski L, Fellows MR, Donoghue JP. Instant neural control of a movement signal. Nature. 2002;416(6877):141–2. 10.1038/416141a .
- Kim SP, Simeral JD, Hochberg LR, Donoghue JP, Black MJ. Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia. J Neural Eng. 2008;5(4):455–76. 10.1088/1741-2560/5/4/010
- Velliste M, Perel S, Spalding MC, Whitford AS, Schwartz AB. Cortical control of a prosthetic arm for self-feeding. Nature. 2008;453(7198):1098–101. 10.1038/nature06996 .
- Taylor DM, Tillery SI, Schwartz AB. Direct cortical control of 3D neuroprosthetic devices. Science. 2002;296(5574):1829–32. 10.1126/science.1070291 .
- Hochberg LR, Bacher D, Jarosiewicz B, Masse NY, Simeral JD, Vogel J, et al. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature. 2012;485(7398):372–5. 10.1038/nature11076
- Collinger JL, Wodlinger B, Downey JE, Wang W, Tyler-Kabara EC, Weber DJ, et al. High-performance neuroprosthetic control by an individual with tetraplegia. Lancet. 2013;381(9866):557–64. 10.1016/S0140-6736(12)61816-9
- Carmena JM, Lebedev MA, Crist RE, O'Doherty JE, Santucci DM, Dimitrov DF, et al. Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol. 2003;1(2):E42 10.1371/journal.pbio.0000042
- Ethier C, Oby ER, Bauman MJ, Miller LE. Restoration of grasp following paralysis through brain-controlled stimulation of muscles. Nature. 2012;485(7398):368–71. 10.1038/nature10987
- Zou X, Liu L, Cheong JH, Yao L, Li P, Cheng KW, et al. A 100-channel 1-mW implantable neural recording IC. IEEE Transactions on Circuits and Systems I: Regular Papers 2013;60:2584–96.
- Zou X, Cheong JH, Yao L, Je M, inventorsA recording circuit and a method of controlling the same2013.
- Cheng KW, Zou X, Cheong JH, Xue RF, Chen Z, Yao L, et al. 100-channel wireless neural recording system with 54-Mb/s data link and 40%-efficiency power link. IEEE Asian Solid State Circuits Conference (A-SSCC)2012. p. 185–88.
- Quiroga RQ, Nadasdy Z, Ben-Shaul Y. Unsupervised spike detection and sorting with wavelets and superparamagnetic clustering. Neural Comput. 2004;16(8):1661–87. 10.1162/089976604774201631 .
- Gilja V, Nuyujukian P, Chestek CA, Cunningham JP, Yu BM, Fan JM, et al. A high-performance neural prosthesis enabled by control algorithm design. Nat Neurosci. 2012;15(12):1752–7. 10.1038/nn.3265
- Chapin JK, Moxon KA, Markowitz RS, Nicolelis MA. Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat Neurosci. 1999;2(7):664–70. 10.1038/10223 .
- Lebedev MA, Carmena JM, O'Doherty JE, Zacksenhouse M, Henriquez CS, Principe JC, et al. Cortical ensemble adaptation to represent velocity of an artificial actuator controlled by a brain-machine interface. J Neurosci. 2005;25(19):4681–93. 10.1523/JNEUROSCI.4088-04.2005 .
- Ifft PJ, Shokur S, Li Z, Lebedev MA, Nicolelis MA. A brain-machine interface enables bimanual arm movements in monkeys. Sci Transl Med. 2013;5(210):210ra154 10.1126/scitranslmed.3006159
Source: PubMed