Design and Optimization of an EEG-Based Brain Machine Interface (BMI) to an Upper-Limb Exoskeleton for Stroke Survivors
Nikunj A Bhagat, Anusha Venkatakrishnan, Berdakh Abibullaev, Edward J Artz, Nuray Yozbatiran, Amy A Blank, James French, Christof Karmonik, Robert G Grossman, Marcia K O'Malley, Gerard E Francisco, Jose L Contreras-Vidal, Nikunj A Bhagat, Anusha Venkatakrishnan, Berdakh Abibullaev, Edward J Artz, Nuray Yozbatiran, Amy A Blank, James French, Christof Karmonik, Robert G Grossman, Marcia K O'Malley, Gerard E Francisco, Jose L Contreras-Vidal
Abstract
This study demonstrates the feasibility of detecting motor intent from brain activity of chronic stroke patients using an asynchronous electroencephalography (EEG)-based brain machine interface (BMI). Intent was inferred from movement related cortical potentials (MRCPs) measured over an optimized set of EEG electrodes. Successful intent detection triggered the motion of an upper-limb exoskeleton (MAHI Exo-II), to guide movement and to encourage active user participation by providing instantaneous sensory feedback. Several BMI design features were optimized to increase system performance in the presence of single-trial variability of MRCPs in the injured brain: (1) an adaptive time window was used for extracting features during BMI calibration; (2) training data from two consecutive days were pooled for BMI calibration to increase robustness to handle the day-to-day variations typical of EEG, and (3) BMI predictions were gated by residual electromyography (EMG) activity from the impaired arm, to reduce the number of false positives. This patient-specific BMI calibration approach can accommodate a broad spectrum of stroke patients with diverse motor capabilities. Following BMI optimization on day 3, testing of the closed-loop BMI-MAHI exoskeleton, on 4th and 5th days of the study, showed consistent BMI performance with overall mean true positive rate (TPR) = 62.7 ± 21.4% on day 4 and 67.1 ± 14.6% on day 5. The overall false positive rate (FPR) across subjects was 27.74 ± 37.46% on day 4 and 27.5 ± 35.64% on day 5; however for two subjects who had residual motor function and could benefit from the EMG-gated BMI, the mean FPR was quite low (< 10%). On average, motor intent was detected -367 ± 328 ms before movement onset during closed-loop operation. These findings provide evidence that closed-loop EEG-based BMI for stroke patients can be designed and optimized to perform well across multiple days without system recalibration.
Keywords: brain machine interface (BMI); motor intent detection; movement related cortical potentials (MRCPs); robotic exoskeleton; stroke rehabilitation.
Figures
References
- Ang K. K., Chua K. S. G., Phua K. S., Wang C., Chin Z. Y., Kuah C. W. K., et al. . (2015). A randomized controlled trial of eeg-based motor imagery brain-computer interface robotic rehabilitation for stroke. Clin. EEG Neurosci. 46, 310–320. 10.1177/1550059414522229
- Ang K. K., Guan C., Chua K. S. G., Ang B. T., Kuah C. W. K., Wang C., et al. . (2011). A large clinical study on the ability of stroke patients to use an eeg-based motor imagery brain-computer interface. Clin. EEG Neurosci. 42, 253–258. 10.1177/155005941104200411
- Antelis J., Montesano L., Ramos-Murguialday A., Birbaumer N., Minguez J. (2012). Continuous decoding of intention to move from contralesional hemisphere brain oscillations in severely affected chronic stroke patients, in Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE (San Diego, CA: ), 4099–4103. 10.1109/EMBC.2012.6346868
- Bai O., Rathi V., Lin P., Huang D., Battapady H., Fei D.-Y., et al. . (2011). Prediction of human voluntary movement before it occurs. Clin. Neurophysiol. 122, 364–372. 10.1016/j.clinph.2010.07.010
- Basteris A., Nijenhuis S. M., Stienen A. H. A., Buurke J. H., Prange G. B., Amirabdollahian F. (2014). Training modalities in robot-mediated upper limb rehabilitation in stroke: a framework for classification based on a systematic review. J. Neuroeng. Rehabil. 11:111. 10.1186/1743-0003-11-111
- Bengtsson H. (2014). R.matlab: Read and write of MAT files together with R-to-MATLAB connectivity. R package version 3.1.1.
- Bhagat N., French J., Venkatakrishnan A., Yozbatiran N., Francisco G., O'Malley M., et al. (2014). Detecting movement intent from scalp eeg in a novel upper limb robotic rehabilitation system for stroke, in Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE (Chicago, IL: ), 4127–4130.
- Blank A., O'Malley M. K., Francisco G. E., Contreras-Vidal J. L. (2013). A pre-clinical framework for neural control of a therapeutic upper-limb exoskeleton. Int. IEEE EMBS Conf. Neural Eng. 2013, 1159–1162. 10.1109/NER.2013.6696144
- Blank A. A., French J. A., Pehlivan A. U., O'Malley M. K. (2014). Current trends in robot-assisted upper-limb stroke rehabilitation: promoting patient engagement in therapy. Curr. Phys. Med. Rehabil. Rep. 2, 184–195. 10.1007/s40141-014-0056-z
- Blankertz B., Lemm S., Treder M., Haufe S., Müller K.-R. (2011). Single-trial analysis and classification of ERP components–a tutorial. NeuroImage 56, 814–825. 10.1016/j.neuroimage.2010.06.048
- Brauchle D., Vukelić M., Bauer R., Gharabaghi A. (2015). Brain state-dependent robotic reaching movement with a multi-joint arm exoskeleton : combining brain-machine interfacing and robotic rehabilitation. Front. Hum. Neurosci. 9:564. 10.3389/fnhum.2015.00564
- Buch E., Weber C., Cohen L. G., Braun C., Dimyan M. A., Ard T., et al. . (2008). Think to move: a neuromagnetic brain-computer interface (BCI) system for chronic stroke. Stroke 39, 910–917. 10.1161/STROKEAHA.107.505313
- Bulea T. C., Prasad S., Kilicarslan A., Contreras-Vidal J. L. (2014). Sitting and standing intention can be decoded from scalp EEG recorded prior to movement execution. Front. Neurosci. 8:376. 10.3389/fnins.2014.00376
- Chang C.-C., Lin C.-J. (2011). LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2, 27:1–27:27.
- Chase A. (2014). Stroke: improved lesion-symptom mapping in poststroke aphasia. Nat. Rev. Neurol. 10, 674. 10.1038/nrneurol.2014.217
- Cui R., MacKinnon C. (2009). The effect of temporal accuracy constraints on movement-related potentials. Exp. Brain Res. 194, 477–488. 10.1007/s00221-009-1725-5
- Daly J. J., Cheng R., Hrovat K., Rogers J. M., Litinas K., Dohring M. E. (2008). Development and testing of non-invasive BCI + FES/Robot system for use in motor re-learning after stroke, in 13th Annual Conference of the International Functional Electrical Stimulation Society (Freiburg: ).
- Daly J. J., Wolpaw J. R. (2008). Brain-computer interfaces in neurological rehabilitation. Lancet Neurol. 7, 1032–1043. 10.1016/S1474-4422(08)70223-0
- Delorme A., Makeig S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21. 10.1016/j.jneumeth.2003.10.009
- Duda R. O., Hart P. E., Stork D. G. (2012). Pattern Classification. Wiley.
- Farina D., Jensen W., Akay M. (2013). Introduction to Neural Engineering for Motor Rehabilitation IEEE Press Series on Biomedical Engineering. Wiley.
- Fatourechi M., Ward R. K., Birch G. E. (2008). A self-paced brain-computer interface system with a low false positive rate. J. Neural Eng. 5, 9–23. 10.1088/1741-2560/5/1/002
- Fawcett T. (2006). An introduction to ROC analysis. Patt. Recogn. Lett. 27, 861–874. 10.1016/j.patrec.2005.10.010
- Fisher R., Perkins S., Walker A., Wolfart E. (2003). Hypermedia Image Processing Reference. [Online]. Available online at:
- French J. A., Rose C. G., O'Malley M. K. (2014). System characterization of MAHI Exo-II: a robotic exoskeleton for upper extremity rehabilitation, in Proceedings of the ASME Dynamic Systems and Controls Conference, October 22–24 (San Antonio, TX: ). 10.1115/dscc2014-6267
- Frisoli A., Loconsole C., Leonardis D., Banno F., Barsotti M., Chisari C., et al. (2012). A new gaze-BCI-driven control of an upper limb exoskeleton for rehabilitation in real-world tasks. IEEE Trans. Syst. Man Cybern. C Appl. Rev. 42, 1169–1179. 10.1109/TSMCC.2012.2226444
- Garipelli G., Chavarriaga R., Millán J. D. R. (2013). Single trial analysis of slow cortical potentials: a study on anticipation related potentials. J. Neural Eng. 10:036014. 10.1088/1741-2560/10/3/036014
- Goldman R. I., Wei C.-Y., Philiastides M. G., Gerson A. D., Friedman D., Brown T. R., et al. . (2009). Single-trial discrimination for integrating simultaneous EEG and fMRI: identifying cortical areas contributing to trial-to-trial variability in the auditory oddball task. NeuroImage 47, 136–147. 10.1016/j.neuroimage.2009.03.062
- Gomez-Rodriguez M., Peters J., Hill J., Schölkopf B., Gharabaghi A., Grosse-Wentrup M. (2011). Closing the sensorimotor loop: haptic feedback facilitates decoding of motor imagery. J. Neural Eng. 8:036005. 10.1088/1741-2560/8/3/036005
- Goodman R. N., Rietschel J. C., Roy A., Jung B. C., Diaz J., Macko R. F., et al. . (2014). Increased reward in ankle robotics training enhances motor control and cortical efficiency in stroke. J. Rehabil. Res. Dev. 51, 213–228. 10.1682/JRRD.2013.02.0050
- Grosse-Wentrup M., Mattia D., Oweiss K. (2011). Using braincomputer interfaces to induce neural plasticity and restore function. J. Neural Eng. 8:25004. 10.1088/1741-2560/8/2/025004
- Gu Y., Farina D., Murguialday A. R., Dremstrup K., Montoya P., Birbaumer N. (2009). Offline identification of imagined speed of wrist movements in paralyzed ALS patients from single-trial EEG. Front. Neurosci. 3:62. 10.3389/neuro.20.003.2009
- Gupta A., O'Malley M. K., Patoglu V., Burgar C. (2008). Design, control and performance of RiceWrist: a force feedback wrist exoskeleton for rehabilitation and training. Int. J. Robot. Res. 27, 233–251. 10.1177/0278364907084261
- Ho N., Tong K., Hu X., Fung K., Wei X., Rong W., et al. . (2011). An EMG-driven exoskeleton hand robotic training device on chronic stroke subjects: task training system for stroke rehabilitation. IEEE Int. Conf. Rehabil. Robot. 2011:5975340. 10.1109/ICORR.2011.5975340
- Hogan N., Krebs H. I., Rohrer B., Palazzolo J. J., Dipietro L., Fasoli S. E., et al. . (2006). Motions or muscles? Some behavioral factors underlying robotic assistance of motor recovery. J. Rehabil. Res. Dev. 43, 605–618. 10.1682/JRRD.2005.06.0103
- Hu X., Tong K., Wei X., Rong W., Susanto E., Ho S. (2013). The effects of post-stroke upper-limb training with an electromyography (EMG)-driven hand robot. J. Electromyogr. Kinesiol. 23, 1065–1074. 10.1016/j.jelekin.2013.07.007
- Hu X. L., Tong K.-y., Song R., Zheng X. J., Leung W. W. F. (2009). A comparison between electromyography-driven robot and passive motion device on wrist rehabilitation for chronic stroke. Neurorehabil. Neural Repair 23, 837–846. 10.1177/1545968309338191
- Ibáñez J., Serrano J. I., del Castillo M. D., Monge-Pereira E., Molina-Rueda F., Alguacil-Diego I., et al. . (2014). Detection of the onset of upper-limb movements based on the combined analysis of changes in the sensorimotor rhythms and slow cortical potentials. J. Neural Eng. 11:056009. 10.1088/1741-2560/11/5/056009
- Jochumsen M., Niazi I. K., Mrachacz-Kersting N., Farina D., Dremstrup K. (2013). Detection and classification of movement-related cortical potentials associated with task force and speed. J. Neural Eng. 10:056015. 10.1088/1741-2560/10/5/056015
- Kahn L. E., Zygman M. L., Rymer W. Z., Reinkensmeyer D. J. (2006). Robot-assisted reaching exercise promotes arm movement recovery in chronic hemiparetic stroke: a randomized controlled pilot study. J. Neuroeng. Rehabil. 3:12. 10.1186/1743-0003-3-12
- Klamroth-Marganska V., Blanco J., Campen K., Curt A., Dietz V., Ettlin T., et al. . (2014). Three-dimensional, task-specific robot therapy of the arm after stroke: a multicentre, parallel-group randomised trial. Lancet Neurol. 13, 159–166. 10.1016/S1474-4422(13)70305-3
- Klem G. H., Lüders H. O., Jasper H. H., Elger C. (1999). The ten-twenty electrode system of the international federation. The international federation of clinical neurophysiology. Electroencephalogr. Clin. Neurophysiol. Suppl. 52, 3–6.
- Krebs H. I., Palazzolo J. J., Dipietro L., Ferraro M., Krol J., Rannekleiv K., et al. (2003). Rehabilitation robotics: performance-based progressive robot-assisted therapy. Auton. Robots 15, 7–20. 10.1023/A:1024494031121
- Kwakkel G., Kollen B. J., Krebs H. I. (2008). Effects of Robot-assisted therapy on upper limb recovery after stroke: a Systematic Review. Neurorehabil. Neural Repair 22, 111–121. 10.1177/1545968307305457
- Kwakkel G., Meskers C. G. M. (2014). Effects of robotic therapy of the arm after stroke. Lancet Neurol. 13, 132–133. 10.1016/S1474-4422(13)70285-0
- Langhorne P., Coupar F., Pollock A. (2009). Motor recovery after stroke: a systematic review. Lancet Neurol. 8, 741–754. 10.1016/S1474-4422(09)70150-4
- Leamy D. J., Kocijan J., Domijan K., Duffin J., Roche R. A. P., Commins S., et al. . (2014). An exploration of EEG features during recovery following stroke implications for BCI-mediated neurorehabilitation therapy. J. Neuroeng. Rehabil. 11:9. 10.1186/1743-0003-11-9
- Leeb R., Friedman D., Müller-Putz G. R., Scherer R., Slater M., Pfurtscheller G. (2007). Self-paced (Asynchronous) BCI control of a wheelchair in virtual environments: a case study with a tetraplegic. Comput. Intell. Neurosci. 2007, 1–8. 10.1155/2007/79642
- Lenzi T., De Rossi S. M., Vitiello N., Carrozza M. C. (2012). Intention-based emg control for powered exoskeletons. IEEE Trans. Biomed. Eng. 59, 2180–2190. 10.1109/TBME.2012.2198821
- Lew E., Chavarriaga R., Silvoni S., Millán J. D. R. (2012). Detection of self-paced reaching movement intention from EEG signals. Front. Neuroeng. 5:13. 10.3389/fneng.2012.00013
- Lew E. Y. L., Chavarriaga R., Silvoni S., Millán J. D. R. (2014). Single trial prediction of self-paced reaching directions from EEG signals. Front. Neurosci. 8:222. 10.3389/fnins.2014.00222
- Lo A. C., Guarino P. D., Richards L. G., Haselkorn J. K., Wittenberg G. F., Federman D. G., et al. . (2010). Robot-assisted therapy for long-term upper-limb impairment after stroke. New. Engl. Med. 362, 1772–1783. 10.1056/NEJMoa0911341
- Loureiro R., Harwin W. (2007). Reach and grasp therapy: design and control of a 9-dof robotic neuro-rehabilitation system, in Rehabilitation Robotics, 2007. ICORR 2007. IEEE 10th International Conference (Noordwijk: ), 757–763. 10.1109/icorr.2007.4428510
- Marathe A. R., Ries A. J., McDowell K. (2014). Sliding hdca: single-trial eeg classification to overcome and quantify temporal variability. Neural Syst. Rehabil. Eng. IEEE Trans. 22, 201–211. 10.1109/TNSRE.2014.2304884
- MATLAB (2012). Version 7.10.0 (R2012b). Natick, MA: The MathWorks Inc.
- Mattia D., Pichiorri F., Aricò P., Aloise F., Cincotti F. (2013). Hybrid brain-computer interaction for functional motor recovery after stroke, in Converging Clinical and Engineering Research on Neurorehabilitation SE - 213, volume 1 of Biosystems & Biorobotics, eds Pons J. L., Torricelli D., Pajaro M. (Berlin; Heidelberg: Springer; ), 1275–1279.
- McFarland D. J., McCane L. M., David S. V., Wolpaw J. R. (1997). Spatial filter selection for EEG-based communication. Electroencephalogr. Clin. Neurophysiol. 103, 386–394. 10.1016/S0013-4694(97)00022-2
- Mehrholz J., Hädrich A., Platz T., Kugler J., Pohl M. (2012). Electromechanical and robot-assisted arm training for improving generic activities of daily living, arm function, and arm muscle strength after stroke. Cochrane Database Syst. Rev. 6:CD006876. 10.1002/14651858.cd006876.pub3
- Milot M.-H., Spencer S. J., Chan V., Allington J. P., Klein J., Chou C., et al. . (2013). A crossover pilot study evaluating the functional outcomes of two different types of robotic movement training in chronic stroke survivors using the arm exoskeleton BONES. J. Neuroeng. Rehabil. 10:112. 10.1186/1743-0003-10-112
- Muralidharan A., Chae J., Taylor D. M. (2011a). Early detection of hand movements from EEGs for stroke therapy applications. J. Neural Eng. 8:46003 10.1088/1741-2560/8/4/046003
- Muralidharan A., Chae J., Taylor D. M. (2011b). Extracting attempted hand movements from EEGs in people with complete hand paralysis following stroke. Front. Neurosci. 5:39. 10.3389/fnins.2011.00039
- Nakagome S., Luu T. P., He Y., Contreras-vidal J. L., Member I. S. (2015). Brain - computer interfaces to virtual reality environments for rehabilitation of motor function : a review, in Conference Proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Milan: ).
- Naros G., Gharabaghi A. (2015). Reinforcement learning of self-regulated β-oscillations for motor restoration in chronic stroke. Front. Hum. Neurosci. 9:391. 10.3389/fnhum.2015.00391
- Ng A. Y. (1997). Preventing “overfitting” of cross-validation data, in Proceedings of the Fourteenth International Conference on Machine Learning, ICML '97 (San Francisco, CA: Morgan Kaufmann Publishers Inc.), 245–253.
- Niazi I. K., Jiang N., Jochumsen M., Nielsen J. R. F. K., Dremstrup K., Farina D. (2013). Detection of movement-related cortical potentials based on subject-independent training. Med. Biol. Eng. Comput. 51, 507–512. 10.1007/s11517-012-1018-1
- O'Dell M. W., Lin C.-C. D., Harrison V. (2009). Stroke rehabilitation: strategies to enhance motor recovery. Ann. Rev. Med. 60, 55–68. 10.1146/annurev.med.60.042707.104248
- Ojala M., Garriga G. (2009). Permutation tests for studying classifier performance, in ICDM '09. Ninth IEEE International Conference on Data Mining, 2009 (Miami, FL: ), 908–913. 10.1109/icdm.2009.108
- O'Malley M. K., Ro T., Levin H. S. (2006). Assessing and inducing neuroplasticity with transcranial magnetic stimulation and robotics for motor function. Arch. Phys. Med. Rehabil. 87(12 Suppl. 2), S59–S66. 10.1016/j.apmr.2006.08.332
- Orsborn A. L., Carmena J. M. (2013). Creating new functional circuits for action via brain-machine interfaces. Front. Comput. Neurosci. 7:157. 10.3389/fncom.2013.00157
- Platz T., Kim I. H., Pintschovius H., Winter T., Kieselbach A., Villringer K., et al. . (2000). Multimodal EEG analysis in man suggests impairment-specific changes in movement-related electric brain activity after stroke. Brain 123, 2475–2490. 10.1093/brain/123.12.2475
- R Core Team (2014). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.
- Ramos-murguialday A., Broetz D., Rea M., Yilmaz O., Brasil F. L., Liberati G., et al. . (2014). Brain-machine-interface in chronic stroke rehabilitation: a controlled study. Ann. Neurol. 74, 100–108. 10.1002/ana.23879
- Shibasaki H., Hallett M. (2006). What is the bereitschaftspotential? Clin. Neurophysiol. 117, 2341–2356. 10.1016/j.clinph.2006.04.025
- Signal Developers (2013). Signal: Signal Processing. [Online]. Available online at:
- Soekadar S. R., Birbaumer N., Slutzky M. W., Cohen L. G. (2014). Brain-machine interfaces in neurorehabilitation of stroke. Neurobiol. Dis. 83, 172–179. 10.1016/j.nbd.2014.11.025
- Soekadar S. R., Witkowski M., Vitiello N., Birbaumer N. (2015). An EEG/EOG-Based Hybrid Brain-Neural Computer Interaction (BNCI) System to Control an Exoskeleton for the Paralyzed Hand. [online]. Available online at:
- Tong K., Ho S., Pang P., Hu X., Tam W., Fung K., et al. (2010). An intention driven hand functions task training robotic system, in Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE (Piscataway, NJ: ), 3406–3409. 10.1109/IEMBS.2010.5627930
- Vaca Benitez L. M., Tabie M., Will N., Schmidt S., Jordan M., Kirchner E. A. (2013). Exoskeleton technology in rehabilitation: towards an EMG-based orthosis system for upper limb neuromotor rehabilitation. J. Robot. 2013:13 10.1155/2013/610589
- Venkatakrishnan A., Francisco G. E., Contreras-Vidal J. L. (2014). Applications of brain-machine interface systems in stroke recovery and rehabilitation. Curr. Phys. Med. Rehabil. Rep. 2, 93–105. 10.1007/s40141-014-0051-4
- Wang C., Phua K. S., Ang K. K., Guan C., Zhang H., Lin R., et al. (2009). A feasibility study of non-invasive motor-imagery bci-based robotic rehabilitation for stroke patients, in NER '09. 4th International IEEE/EMBS Conference on Neural Engineering 2009 (Antalya: ), 271–274. 10.1109/ner.2009.5109285
- Widmann A., Schröger E., Maess B. (2015). Digital filter design for electrophysiological data a practical approach. J. Neurosci. Methods 250, 34–46. 10.1016/j.jneumeth.2014.08.002
- Witkowski M., Cortese M., Cempini M., Mellinger J., Vitiello N., Soekadar S. R. (2014). Enhancing brain-machine interface (BMI) control of a hand exoskeleton using electrooculography (EOG). J. Neuroeng. Rehabil. 11, 1–6. 10.1186/1743-0003-11-165
- Xu R., Jiang N., Lin C., Mrachacz-Kersting N., Dremstrup K., Farina D. (2014a). Enhanced low-latency detection of motor intention from EEG for closed-loop brain-computer interface applications. IEEE Trans. Biomed. Eng. 61, 288–296. 10.1109/TBME.2013.2294203
- Xu R., Jiang N., Mrachacz-Kersting N., Lin C., Asin Prieto G., Moreno J., et al. . (2014b). A closed-loop brain-computer interface triggering an active ankle-foot orthosis for inducing cortical neural plasticity. IEEE Trans. Biomed. Eng. 61, 2092–2101. 10.1109/TBME.2014.2313867
- Yilmaz O., Birbaumer N., Ramos-Murguialday A. (2015). Movement related slow cortical potentials in severely paralyzed chronic stroke patients. Front. Hum. Neurosci. 8:1033. 10.3389/fnhum.2014.01033
Source: PubMed