Skip to main content

2021 | OriginalPaper | Buchkapitel

Sinc-Based Convolutional Neural Networks for EEG-BCI-Based Motor Imagery Classification

verfasst von : Alessandro Bria, Claudio Marrocco, Francesco Tortorella

Erschienen in: Pattern Recognition. ICPR International Workshops and Challenges

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Brain-Computer Interfaces (BCI) based on motor imagery translate mental motor images recognized from the electroencephalogram (EEG) to control commands. EEG patterns of different imagination tasks, e.g. hand and foot movements, are effectively classified with machine learning techniques using band power features. Recently, also Convolutional Neural Networks (CNNs) that learn both effective features and classifiers simultaneously from raw EEG data have been applied. However, CNNs have two major drawbacks: (i) they have a very large number of parameters, which thus requires a very large number of training examples; and (ii) they are not designed to explicitly learn features in the frequency domain. To overcome these limitations, in this work we introduce Sinc-EEGNet, a lightweight CNN architecture that combines learnable band-pass and depthwise convolutional filters. Experimental results obtained on the publicly available BCI Competition IV Dataset 2a show that our approach outperforms reference methods in terms of classification accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ang, K.K., Chin, Z.Y., Wang, C., Guan, C., Zhang, H.: Filter bank common spatial pattern algorithm on BCI competition iv datasets 2a and 2b. Front. Neurosci. 6, 39 (2012)CrossRef Ang, K.K., Chin, Z.Y., Wang, C., Guan, C., Zhang, H.: Filter bank common spatial pattern algorithm on BCI competition iv datasets 2a and 2b. Front. Neurosci. 6, 39 (2012)CrossRef
3.
Zurück zum Zitat Barron, J.T.: Continuously differentiable exponential linear units. arXiv pp. arXiv-1704 (2017) Barron, J.T.: Continuously differentiable exponential linear units. arXiv pp. arXiv-1704 (2017)
4.
Zurück zum Zitat Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., Muller, K.R.: Optimizing spatial filters for robust EEG single-trial analysis. IEEE Sig. Process. Mag. 25(1), 41–56 (2007)CrossRef Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., Muller, K.R.: Optimizing spatial filters for robust EEG single-trial analysis. IEEE Sig. Process. Mag. 25(1), 41–56 (2007)CrossRef
5.
Zurück zum Zitat Britton, J.W., et al.: Electroencephalography (EEG): An introductory text and atlas of normal and abnormal findings in adults, children, and infants. American Epilepsy Society, Chicago (2016) Britton, J.W., et al.: Electroencephalography (EEG): An introductory text and atlas of normal and abnormal findings in adults, children, and infants. American Epilepsy Society, Chicago (2016)
6.
Zurück zum Zitat Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017) Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)
7.
Zurück zum Zitat Clevert, D.A., Unterthiner, T., Hochreiter, S.: Fast and accurate deep network learning by exponential linear units (elus). arXiv preprint arXiv:1511.07289 (2015) Clevert, D.A., Unterthiner, T., Hochreiter, S.: Fast and accurate deep network learning by exponential linear units (elus). arXiv preprint arXiv:​1511.​07289 (2015)
8.
Zurück zum Zitat Coyle, D., Principe, J., Lotte, F., Nijholt, A.: Guest editorial: brain/neuronal-computer game interfaces and interaction. IEEE Trans. Comput. Intell. AI games 5(2), 77–81 (2013)CrossRef Coyle, D., Principe, J., Lotte, F., Nijholt, A.: Guest editorial: brain/neuronal-computer game interfaces and interaction. IEEE Trans. Comput. Intell. AI games 5(2), 77–81 (2013)CrossRef
9.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1026–1034 (2015) He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1026–1034 (2015)
10.
Zurück zum Zitat Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015) Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:​1502.​03167 (2015)
12.
Zurück zum Zitat Lawhern, V.J., et al.: Eegnet: a compact convolutional neural network for EEG-based brain-computer interfaces. J. Neural Eng. 15(5), 056013 (2018)CrossRef Lawhern, V.J., et al.: Eegnet: a compact convolutional neural network for EEG-based brain-computer interfaces. J. Neural Eng. 15(5), 056013 (2018)CrossRef
13.
Zurück zum Zitat LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)CrossRef LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)CrossRef
14.
Zurück zum Zitat Liu, T., et al.: Cortical dynamic causality network for auditory-motor tasks. IEEE Trans. Neural Syst. Rehabil. Eng. 25(8), 1092–1099 (2016) Liu, T., et al.: Cortical dynamic causality network for auditory-motor tasks. IEEE Trans. Neural Syst. Rehabil. Eng. 25(8), 1092–1099 (2016)
15.
Zurück zum Zitat Lotte, F., et al.: A review of classification algorithms for EEG-based brain-computer interfaces: a 10 year update. J. Neural Eng. 15(3), 031005 (2018)CrossRef Lotte, F., et al.: A review of classification algorithms for EEG-based brain-computer interfaces: a 10 year update. J. Neural Eng. 15(3), 031005 (2018)CrossRef
16.
Zurück zum Zitat Lotte, F., Guan, C.: Regularizing common spatial patterns to improve BCI designs: unified theory and new algorithms. IEEE Trans. Biomed. Eng. 58(2), 355–362 (2010)CrossRef Lotte, F., Guan, C.: Regularizing common spatial patterns to improve BCI designs: unified theory and new algorithms. IEEE Trans. Biomed. Eng. 58(2), 355–362 (2010)CrossRef
17.
Zurück zum Zitat Lu, N., Li, T., Ren, X., Miao, H.: A deep learning scheme for motor imagery classification based on restricted Boltzmann machines. IEEE Trans. Neural Syst. Rehabil. Eng. 25(6), 566–576 (2016)CrossRef Lu, N., Li, T., Ren, X., Miao, H.: A deep learning scheme for motor imagery classification based on restricted Boltzmann machines. IEEE Trans. Neural Syst. Rehabil. Eng. 25(6), 566–576 (2016)CrossRef
18.
Zurück zum Zitat Mitra, S.K.: Digital Signal Processing. McGraw-Hill Science/Engineering/Math (2005) Mitra, S.K.: Digital Signal Processing. McGraw-Hill Science/Engineering/Math (2005)
19.
Zurück zum Zitat Nair, V., Hinton, G.E.: Rectified linear units improve restricted Boltzmann machines. In: ICML (2010) Nair, V., Hinton, G.E.: Rectified linear units improve restricted Boltzmann machines. In: ICML (2010)
20.
Zurück zum Zitat Nicolas-Alonso, L.F., Gomez-Gil, J.: Brain computer interfaces, a review. Sensors 12(2), 1211–1279 (2012)CrossRef Nicolas-Alonso, L.F., Gomez-Gil, J.: Brain computer interfaces, a review. Sensors 12(2), 1211–1279 (2012)CrossRef
21.
Zurück zum Zitat Pfurtscheller, G., Da Silva, F.L.: Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin. Neurophysiol. 110(11), 1842–1857 (1999)CrossRef Pfurtscheller, G., Da Silva, F.L.: Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin. Neurophysiol. 110(11), 1842–1857 (1999)CrossRef
22.
Zurück zum Zitat Pichiorri, F., et al.: Brain-computer interface boosts motor imagery practice during stroke recovery. Ann. Neurol. 77(5), 851–865 (2015)CrossRef Pichiorri, F., et al.: Brain-computer interface boosts motor imagery practice during stroke recovery. Ann. Neurol. 77(5), 851–865 (2015)CrossRef
23.
Zurück zum Zitat Ramoser, H., Muller-Gerking, J., Pfurtscheller, G.: Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE Trans. Rehabil. Eng. 8(4), 441–446 (2000)CrossRef Ramoser, H., Muller-Gerking, J., Pfurtscheller, G.: Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE Trans. Rehabil. Eng. 8(4), 441–446 (2000)CrossRef
25.
Zurück zum Zitat Rivet, B., Cecotti, H., Phlypo, R., Bertrand, O., Maby, E., Mattout, J.: EEG sensor selection by sparse spatial filtering in p300 speller brain-computer interface. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, pp. 5379–5382. IEEE (2010) Rivet, B., Cecotti, H., Phlypo, R., Bertrand, O., Maby, E., Mattout, J.: EEG sensor selection by sparse spatial filtering in p300 speller brain-computer interface. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, pp. 5379–5382. IEEE (2010)
26.
Zurück zum Zitat Samek, W., Kawanabe, M., Müller, K.R.: Divergence-based framework for common spatial patterns algorithms. IEEE Rev. Biomed. Eng. 7, 50–72 (2013)CrossRef Samek, W., Kawanabe, M., Müller, K.R.: Divergence-based framework for common spatial patterns algorithms. IEEE Rev. Biomed. Eng. 7, 50–72 (2013)CrossRef
27.
Zurück zum Zitat Schirrmeister, R.T., et al.: Deep learning with convolutional neural networks for EEG decoding and visualization. Hum. Brain Map. 38(11), 5391–5420 (2017)CrossRef Schirrmeister, R.T., et al.: Deep learning with convolutional neural networks for EEG decoding and visualization. Hum. Brain Map. 38(11), 5391–5420 (2017)CrossRef
28.
Zurück zum Zitat Schuster, C., et al.: Best practice for motor imagery: a systematic literature review on motor imagery training elements in five different disciplines. BMC Med. 9(1), 75 (2011)CrossRef Schuster, C., et al.: Best practice for motor imagery: a systematic literature review on motor imagery training elements in five different disciplines. BMC Med. 9(1), 75 (2011)CrossRef
29.
Zurück zum Zitat Silver, D., et al.: Mastering the game of go with deep neural networks and tree search. Nature 529(7587), 484 (2016)CrossRef Silver, D., et al.: Mastering the game of go with deep neural networks and tree search. Nature 529(7587), 484 (2016)CrossRef
30.
Zurück zum Zitat Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)MathSciNetMATH Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)MathSciNetMATH
31.
Zurück zum Zitat Sturm, I., Lapuschkin, S., Samek, W., Müller, K.R.: Interpretable deep neural networks for single-trial EEG classification. J. Neurosci. Meth. 274, 141–145 (2016)CrossRef Sturm, I., Lapuschkin, S., Samek, W., Müller, K.R.: Interpretable deep neural networks for single-trial EEG classification. J. Neurosci. Meth. 274, 141–145 (2016)CrossRef
32.
Zurück zum Zitat Tabar, Y.R., Halici, U.: A novel deep learning approach for classification of EEG motor imagery signals. J. Neural Eng. 14(1), 016003 (2016)CrossRef Tabar, Y.R., Halici, U.: A novel deep learning approach for classification of EEG motor imagery signals. J. Neural Eng. 14(1), 016003 (2016)CrossRef
33.
Zurück zum Zitat Tangermann, M., et al.: Review of the BCI competition IV. Front. Neurosci. 6, 55 (2012)CrossRef Tangermann, M., et al.: Review of the BCI competition IV. Front. Neurosci. 6, 55 (2012)CrossRef
34.
Zurück zum Zitat Yger, F., Lotte, F., Sugiyama, M.: Averaging covariance matrices for EEG signal classification based on the CSP: an empirical study. In: 2015 23rd European Signal Processing Conference (EUSIPCO), pp. 2721–2725. IEEE (2015) Yger, F., Lotte, F., Sugiyama, M.: Averaging covariance matrices for EEG signal classification based on the CSP: an empirical study. In: 2015 23rd European Signal Processing Conference (EUSIPCO), pp. 2721–2725. IEEE (2015)
35.
Zurück zum Zitat Zhang, R., et al.: Control of a wheelchair in an indoor environment based on a brain-computer interface and automated navigation. IEEE Trans. Neural Syst. Rehabil. Eng. 24(1), 128–139 (2015)CrossRef Zhang, R., et al.: Control of a wheelchair in an indoor environment based on a brain-computer interface and automated navigation. IEEE Trans. Neural Syst. Rehabil. Eng. 24(1), 128–139 (2015)CrossRef
Metadaten
Titel
Sinc-Based Convolutional Neural Networks for EEG-BCI-Based Motor Imagery Classification
verfasst von
Alessandro Bria
Claudio Marrocco
Francesco Tortorella
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-68763-2_40

Premium Partner