A bayesian model for exploiting application constraints to enable unsupervised training of a P300-based BCI

Pieter-Jan Kindermans, David Verstraeten, Benjamin Schrauwen, Pieter-Jan Kindermans, David Verstraeten, Benjamin Schrauwen

Abstract

This work introduces a novel classifier for a P300-based speller, which, contrary to common methods, can be trained entirely unsupervisedly using an Expectation Maximization approach, eliminating the need for costly dataset collection or tedious calibration sessions. We use publicly available datasets for validation of our method and show that our unsupervised classifier performs competitively with supervised state-of-the-art spellers. Finally, we demonstrate the added value of our method in different experimental settings which reflect realistic usage situations of increasing difficulty and which would be difficult or impossible to tackle with existing supervised or adaptive methods.

Conflict of interest statement

Competing Interests: The authors have declared that no competing interests exist.

Figures

Figure 1. Plot showing the average P300…
Figure 1. Plot showing the average P300 response versus the average background EEG.
Figure 2. The speller matrix used in…
Figure 2. The speller matrix used in this work.
Source: BCI Competition II dataset description.
Figure 3. The projection of the EEG…
Figure 3. The projection of the EEG into one dimension produces two Gaussians.
Figure A shows the histogram of the used EEG features projected into one dimension. Figure B shows two Gaussians fitted to this histogram. One Gaussian for the EEG containing the P300 response, one Gaussian for the data without P300 response. The vector that was used in the projection was trained unsupervisedly on the data.
Figure 4. Scatter plots showing the quality…
Figure 4. Scatter plots showing the quality of the classifier.
Quality is measured in either AUC or characters predicted correctly versus the data log likelihood. The data used in this plot is created in the OFF-US experiment on subject B using 5 repetitions.
Figure 5. Bar graph showing the performance,…
Figure 5. Bar graph showing the performance, measured in AUC, on the test.
The classifier OFF-US is trained unsupervisedly on the test set. The BOUND is trained supervisedly on the test set without regularization.
Figure 6. Classifier improvement trough adaptation.
Figure 6. Classifier improvement trough adaptation.
The initial classifier was trained unsupervisedly on the train set with 5 repetitions. The classifier was adapted to the EEG by feeding it the EEG character by character and performing EM on the original training set combined with the new EEG.
Figure 7. Plots showing the performance obtained…
Figure 7. Plots showing the performance obtained by 3 single online initializations on subject B, each using a different number of repetitions to predict a character.
The horizontal axis represents the number of characters processed. The vertical axis represents how many of these characters were predicted correctly. The dashed line shows us how many characters the online classifier has predicted correctly (starting with an initially untrained classifier). The solid line shows how many characters the current classifier can predict correctly if we re-test it on all of the previously processed characters. The dash-dot line represents the upper bound on the performance which equals the number of characters seen.

References

    1. Vidal JJ. Toward direct brain-computer communication. Annual Review of Biophysics and Bioengineering. 1973;2:157–180.
    1. Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM. Brain-computer interfaces for communication and control. Clinical Neurophysiology. 2002;113:767–791.
    1. Farwell L, Donchin E. Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalography and Clinical Neurophysiology. 1988;70:510–523.
    1. Nijboer F, Sellers E, Mellinger J, Jordan M, Matuz T, et al. A P300-based brain-computer interface for people with amyotrophic lateral sclerosis. Clinical Neurophysiology. 2008;119:1909–1916.
    1. Vaughan T, McFarland D, Schalk G, Sarnacki W, Krusienski D, et al. The wadsworth BCI research and development program: at home with BCI. Neural Systems and Rehabilitation Engineering, IEEE Transactions on. 2006;14:229–233.
    1. Krauledat M, Tangermann M, Blankertz B, Müller KR. Towards zero training for braincomputer interfacing. PLoS ONE. 2008;3:e2967.
    1. Cecotti H, Graser A. Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE Trans on Pattern Analysis and Machine Intelligence. 2010;99
    1. Picton TW. The P300 wave of the human event-related potential. J Clin Neurophysiol. 1992;9:456–479.
    1. Donchin E, Spencer K, Wijesinghe R. The mental prosthesis: assessing the speed of a P300-based brain-computer interface. Rehabilitation Engineering, IEEE Transactions on. 2000;8:174–179.
    1. Blankertz B, Muller KR, Curio G, Vaughan T, Schalk G, et al. The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials. IEEE Trans on Biomedical Engineering. 2004;51:1044–1051.
    1. Blankertz B, Muller KR, Krusienski D, Schalk G, Wolpaw J, et al. The BCI competition iii: validating alternative approaches to actual bci problems. IEEE Trans on Neural Systems and Rehabilitation Engineering. 2006;14:153–159.
    1. Yanez-Suarez O, Bougrain L, Saavedra C, Bojorges E, Gentiletti G. 2012. P300-speller publicdomain database.
    1. Hoffmann U, Garcia G, Vesin JM, Diserens K, Ebrahimi T Neural Engineering, 2005. Conference Proceedings. 2nd International IEEE EMBS Conference on; 2005. A boosting approach to P300 detection with application to brain-computer interfaces. pp. 97–100.
    1. Liu Y, Zhou Z, Hu D, Dong G Neural Networks and Brain, 2005. ICNN B ′05. volume 3. International Conference on.; 2005. T-weighted approach for neural information processing in P300 based brain-computer interface. pp. 1535–1539.
    1. Xu N, Gao X, Hong B, Miao X, Gao S, et al. BCI competition 2003-data set iib: enhancing P300 wave detection using ICA-based subspace projections for BCI applications. IEEE Trans on Biomedical Engineering. 2004;51:1067–1072.
    1. Kindermans PJ, Verstraeten D, Buteneers P, Schrauwen B. 5th international Brain-Computer Interface Conference, Proceedings; 2011. How do you like your P300 speller : adaptive, accurate and simple?
    1. Rakotomamonjy A, Guigue V. BCI competition iii: Dataset ii- ensemble of SVMs for BCI P300 speller. IEEE Trans on Biomedical Engineering. 2008;55:1147–1154.
    1. Toh KA. Deterministic neural classification. Neural Computation. 2008;20:1565–1595.
    1. Lu S, Guan C, Zhang H. Unsupervised brain computer interface based on intersubject information and online adaptation. IEEE Trans on Neural Systems and Rehabilitation Engineering. 2009;17:135–145.
    1. Panicker R, Puthusserypady S, Sun Y. Adaptation in P300 brain-computer interfaces: A twoclassifier cotraining approach. IEEE Trans on Biomedical Engineering. 2010;57:2927–2935.
    1. Li Y, Guan C, Li H, Chin Z. A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system. Pattern Recognition Letters. 2008;29:1285–1294.
    1. Dahne S, Hohne J, Tangermann M. 5th international brain-computer interface conference, Proceedings; 2011. Adaptive classification improves control performance in ERP-based bcis.
    1. Fisher RA. The use of multiple measurements in taxonomic problems. Annals of Human Genetics. 1936;7:179–188.
    1. Bishop CM. Pattern Recognition and Machine Learning (Information Science and Statistics). Springer, 1 edition 2007
    1. Hoffmann U, Vesin JM, Ebrahimi T, Diserens K. An efficient P300-based brain–computer interface for disabled subjects. Journal of Neuroscience Methods. 2008;167:115–125.
    1. Dornhege G, del R Millan J, Hinterberger T, McFarland DJ, Mueller KR. Towards Brain- Computer Interfacing. MIT Press; 2007.
    1. Xu P, Yang P, Lei X, Yao D. An enhanced probabilistic LDA for multi-class brain computer interface. PLoS ONE. 2011;6:e14634.
    1. Blankertz B, Lemm S, Treder M, Haufe S, Muller KR. Single-trial analysis and classification of ERP components, a tutorial. NeuroImage. 2011;56:814–825.
    1. Dempster AP, Laird NM, Rubin DB. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society Series B (Methodological) 1977;39:1–38.

Source: PubMed

3
S'abonner