Skip to main content
Erschienen in: Cognitive Neurodynamics 2/2022

28.09.2021 | Research Article

A novel classification method for EEG-based motor imagery with narrow band spatial filters and deep convolutional neural network

verfasst von: Senwei Xu, Li Zhu, Wanzeng Kong, Yong Peng, Hua Hu, Jianting Cao

Erschienen in: Cognitive Neurodynamics | Ausgabe 2/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The Common Spatial Pattern (CSP) algorithm is the most widely used method for decoding Electroencephalography (EEG) signals from motor imagery (MI) paradigm. However, due to the inter-subject variability, the CSP algorithm heavily relies on the selection of filter bands and extensive analytical processing time required to build an effective model, which has been a challenge in current research. In this paper, we propose a narrow filter bank CSP (NFBCSP) algorithm, which automatically determines the optimal narrow band for two-class motor imagery by band search tree, and a high-performance classification model dedicated to each subject can be obtained in a short time for online processing or further offline analysis. The optimal narrow band is combined with the CSP algorithm to extract the dynamic features in the EEG signals. For the multi-class motor imagery task, it is first transformed into multiple One-Versus-Rest (OVR) tasks and determines the corresponding optimal narrow bands. After extracting the features of each optimal narrow band separately, the Deep Convolutional Neural Network (DCNN) is used for the fusion of band features and classification of multi-class motor imagery. Finally, we verified our method using two different motor imagery datasets, the BCI-VR dataset with two classes of motor imagery and the BCI Competition IV dataset 2a with four classes of motor imagery. The experimental results show that the proposed method achieves an average classification accuracy of 86.43% for the two-class motor imagery task, and 76.87% for the four-class motor imagery task, which outperforms other recent methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Aghaei AS, Mahanta MS, Plataniotis KN (2015) Separable common spatio-spectral patterns for motor imagery BCI systems. IEEE Trans Biomed Eng 63(1):15–29CrossRef Aghaei AS, Mahanta MS, Plataniotis KN (2015) Separable common spatio-spectral patterns for motor imagery BCI systems. IEEE Trans Biomed Eng 63(1):15–29CrossRef
Zurück zum Zitat Ang KK, Chin ZY, Zhang H, Guan C (2008) Filter bank common spatial pattern (fbcsp) in brain-computer interface. In 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), pp 2390–2397, IEEE Ang KK, Chin ZY, Zhang H, Guan C (2008) Filter bank common spatial pattern (fbcsp) in brain-computer interface. In 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), pp 2390–2397, IEEE
Zurück zum Zitat Ang KK, Chin ZY, Wang C, Guan C, Zhang H (2012) Filter bank common spatial pattern algorithm on BCI competition iv datasets 2a and 2b. Front Neurosci 6:39CrossRef Ang KK, Chin ZY, Wang C, Guan C, Zhang H (2012) Filter bank common spatial pattern algorithm on BCI competition iv datasets 2a and 2b. Front Neurosci 6:39CrossRef
Zurück zum Zitat Balakrishnama S, Ganapathiraju A (1998) Linear discriminant analysis-a brief tutorial. Inst Signal Inf Process 18:1–8 Balakrishnama S, Ganapathiraju A (1998) Linear discriminant analysis-a brief tutorial. Inst Signal Inf Process 18:1–8
Zurück zum Zitat Barry RJ, Rushby JA, Smith JL, Clarke AR, Croft RJ, Wallace MJ (2007) Brain dynamics in the active vs. passive auditory oddball task: exploration of narrow-band EEG phase effects. Clinical Neurophysiol 118(10):2234–2247CrossRef Barry RJ, Rushby JA, Smith JL, Clarke AR, Croft RJ, Wallace MJ (2007) Brain dynamics in the active vs. passive auditory oddball task: exploration of narrow-band EEG phase effects. Clinical Neurophysiol 118(10):2234–2247CrossRef
Zurück zum Zitat Das AK, Sundaram S, Sundararajan N (2016) A self-regulated interval type-2 neuro-fuzzy inference system for handling nonstationarities in EEG signals for BCI. IEEE Trans Fuzzy Syst 24(6):1565–1577CrossRef Das AK, Sundaram S, Sundararajan N (2016) A self-regulated interval type-2 neuro-fuzzy inference system for handling nonstationarities in EEG signals for BCI. IEEE Trans Fuzzy Syst 24(6):1565–1577CrossRef
Zurück zum Zitat Hara K, Saito D, Shouno H (2015) Analysis of function of rectified linear unit used in deep learning. In: 2015 international joint conference on neural networks (IJCNN), pp 1–8, IEEE Hara K, Saito D, Shouno H (2015) Analysis of function of rectified linear unit used in deep learning. In: 2015 international joint conference on neural networks (IJCNN), pp 1–8, IEEE
Zurück zum Zitat Higashi H, Tanaka T (2012) Simultaneous design of fir filter banks and spatial patterns for EEG signal classification. IEEE Trans Biomed Eng 60(4):1100–1110CrossRef Higashi H, Tanaka T (2012) Simultaneous design of fir filter banks and spatial patterns for EEG signal classification. IEEE Trans Biomed Eng 60(4):1100–1110CrossRef
Zurück zum Zitat Homan RW, Herman J, Purdy P (1987) Cerebral location of international 10–20 system electrode placement. Electroencephalogr Clinical Neurophysiol 66(4):376–382CrossRef Homan RW, Herman J, Purdy P (1987) Cerebral location of international 10–20 system electrode placement. Electroencephalogr Clinical Neurophysiol 66(4):376–382CrossRef
Zurück zum Zitat Jin J, Xiao R, Daly I, Miao Y, Wang X, Cichocki A (2020) Internal feature selection method of csp based on l1-norm and dempster-shafer theory. IEEE Trans Neural Netw Learn Syst Jin J, Xiao R, Daly I, Miao Y, Wang X, Cichocki A (2020) Internal feature selection method of csp based on l1-norm and dempster-shafer theory. IEEE Trans Neural Netw Learn Syst
Zurück zum Zitat Kumar S, Sharma R, Sharma A, Tsunoda T (2016) Decimation filter with common spatial pattern and fishers discriminant analysis for motor imagery classification. In: 2016 international joint conference on neural networks (IJCNN), pp 2090–2095, IEEE Kumar S, Sharma R, Sharma A, Tsunoda T (2016) Decimation filter with common spatial pattern and fishers discriminant analysis for motor imagery classification. In: 2016 international joint conference on neural networks (IJCNN), pp 2090–2095, IEEE
Zurück zum Zitat Lawhern VJ, Solon AJ, Waytowich NR, Gordon SM, Hung CP, Lance BJ (2018) Eegnet: a compact convolutional neural network for EEG-based brain-computer interfaces. J Neural Eng 15(5):056013CrossRef Lawhern VJ, Solon AJ, Waytowich NR, Gordon SM, Hung CP, Lance BJ (2018) Eegnet: a compact convolutional neural network for EEG-based brain-computer interfaces. J Neural Eng 15(5):056013CrossRef
Zurück zum Zitat Lazarou I, Nikolopoulos S, Petrantonakis PC, Kompatsiaris I, Tsolaki M (2018) Eeg-based brain-computer interfaces for communication and rehabilitation of people with motor impairment: A novel approach of the 21st century. Front Human Neurosc 12:14CrossRef Lazarou I, Nikolopoulos S, Petrantonakis PC, Kompatsiaris I, Tsolaki M (2018) Eeg-based brain-computer interfaces for communication and rehabilitation of people with motor impairment: A novel approach of the 21st century. Front Human Neurosc 12:14CrossRef
Zurück zum Zitat Liao JJ, Luo JJ, Yang T, So RQY, Chua MCH (2020) Effects of local and global spatial patterns in EEG motor-imagery classification using convolutional neural network. Brain-Computer Interfaces, pp 1–10 Liao JJ, Luo JJ, Yang T, So RQY, Chua MCH (2020) Effects of local and global spatial patterns in EEG motor-imagery classification using convolutional neural network. Brain-Computer Interfaces, pp 1–10
Zurück zum Zitat Lo C-C, Chien T-Y, Chen Y-C, Tsai S-H, Fang W-C, Lin B-S (2016) A wearable channel selection-based brain-computer interface for motor imagery detection. Sensors 16(2):213CrossRef Lo C-C, Chien T-Y, Chen Y-C, Tsai S-H, Fang W-C, Lin B-S (2016) A wearable channel selection-based brain-computer interface for motor imagery detection. Sensors 16(2):213CrossRef
Zurück zum Zitat McHugh ML (2012) Interrater reliability: the kappa statistic. Biochemia Medica: Biochemia Medica 22(3):276–282CrossRef McHugh ML (2012) Interrater reliability: the kappa statistic. Biochemia Medica: Biochemia Medica 22(3):276–282CrossRef
Zurück zum Zitat Olivas-Padilla BE, Chacon-Murguia MI (2019) Classification of multiple motor imagery using deep convolutional neural networks and spatial filters. Appl Soft Comput 75:461–472CrossRef Olivas-Padilla BE, Chacon-Murguia MI (2019) Classification of multiple motor imagery using deep convolutional neural networks and spatial filters. Appl Soft Comput 75:461–472CrossRef
Zurück zum Zitat Ortner R, Irimia D-C, Scharinger J, Guger C (2012) A motor imagery based brain-computer interface for stroke rehabilitation. Ann Rev Cyber Telemed 181:319–323 Ortner R, Irimia D-C, Scharinger J, Guger C (2012) A motor imagery based brain-computer interface for stroke rehabilitation. Ann Rev Cyber Telemed 181:319–323
Zurück zum Zitat Pfurtscheller G, Neuper C (2001) Motor imagery and direct brain-computer communication. Proc IEEE 89(7):1123–1134CrossRef Pfurtscheller G, Neuper C (2001) Motor imagery and direct brain-computer communication. Proc IEEE 89(7):1123–1134CrossRef
Zurück zum Zitat Pfurtscheller G, Brunner C, Schlögl A, Da Silva FL (2006) Mu rhythm (de) synchronization and EEG single-trial classification of different motor imagery tasks. NeuroImage 31(1):153–159CrossRef Pfurtscheller G, Brunner C, Schlögl A, Da Silva FL (2006) Mu rhythm (de) synchronization and EEG single-trial classification of different motor imagery tasks. NeuroImage 31(1):153–159CrossRef
Zurück zum Zitat Raza H, Cecotti H, Prasad G (2016) A combination of transductive and inductive learning for handling non-stationarities in motor imagery classification. In: 2016 International Joint Conference on Neural Networks (IJCNN), pp 763–770, IEEE Raza H, Cecotti H, Prasad G (2016) A combination of transductive and inductive learning for handling non-stationarities in motor imagery classification. In: 2016 International Joint Conference on Neural Networks (IJCNN), pp 763–770, IEEE
Zurück zum Zitat Sakhavi S, Guan C, Yan S (2018) Learning temporal information for brain-computer interface using convolutional neural networks. IEEE Trans Neural Netw Learn Syst 29(11):5619–5629CrossRef Sakhavi S, Guan C, Yan S (2018) Learning temporal information for brain-computer interface using convolutional neural networks. IEEE Trans Neural Netw Learn Syst 29(11):5619–5629CrossRef
Zurück zum Zitat Sakhavi S, Guan C, Yan S (2015) Parallel convolutional-linear neural network for motor imagery classification. In: 2015 23rd European Signal Processing Conference (EUSIPCO), pp 2736–2740, IEEE Sakhavi S, Guan C, Yan S (2015) Parallel convolutional-linear neural network for motor imagery classification. In: 2015 23rd European Signal Processing Conference (EUSIPCO), pp 2736–2740, IEEE
Zurück zum Zitat Schirrmeister RT, Springenberg JT, Fiederer LDJ, Glasstetter M, Eggensperger K, Tangermann M, Hutter F, Burgard W, Ball T (2017) Deep learning with convolutional neural networks for EEG decoding and visualization. Human Brain Mapping 38(11):5391–5420CrossRef Schirrmeister RT, Springenberg JT, Fiederer LDJ, Glasstetter M, Eggensperger K, Tangermann M, Hutter F, Burgard W, Ball T (2017) Deep learning with convolutional neural networks for EEG decoding and visualization. Human Brain Mapping 38(11):5391–5420CrossRef
Zurück zum Zitat Sharbaf M. E, Fallah A, Rashidi S (2017) Shrinkage estimator based common spatial pattern for multi-class motor imagery classification by hybrid classifier. In: 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA), pp 26–31, IEEE Sharbaf M. E, Fallah A, Rashidi S (2017) Shrinkage estimator based common spatial pattern for multi-class motor imagery classification by hybrid classifier. In: 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA), pp 26–31, IEEE
Zurück zum Zitat Sun H, Jin J, Kong W, Zuo C, Li S, Wang X (2021) Novel channel selection method based on position priori weighted permutation entropy and binary gravity search algorithm. Cognitive Neurodyn 15(1):141–156CrossRef Sun H, Jin J, Kong W, Zuo C, Li S, Wang X (2021) Novel channel selection method based on position priori weighted permutation entropy and binary gravity search algorithm. Cognitive Neurodyn 15(1):141–156CrossRef
Zurück zum Zitat Suykens JA, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300CrossRef Suykens JA, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300CrossRef
Zurück zum Zitat Tam W-K, Tong K-Y, Meng F, Gao S (2011) A minimal set of electrodes for motor imagery BCI to control an assistive device in chronic stroke subjects: a multi-session study. IEEE Trans Neural Syst Rehabil Eng 19(6):617–627CrossRef Tam W-K, Tong K-Y, Meng F, Gao S (2011) A minimal set of electrodes for motor imagery BCI to control an assistive device in chronic stroke subjects: a multi-session study. IEEE Trans Neural Syst Rehabil Eng 19(6):617–627CrossRef
Zurück zum Zitat Tangermann M, Müller K-R, Aertsen A, Birbaumer N, Braun C, Brunner C, Leeb R, Mehring C, Miller KJ, Mueller-Putz G et al (2012) Review of the BCI competition IV. Front Neurosci 6:55CrossRef Tangermann M, Müller K-R, Aertsen A, Birbaumer N, Braun C, Brunner C, Leeb R, Mehring C, Miller KJ, Mueller-Putz G et al (2012) Review of the BCI competition IV. Front Neurosci 6:55CrossRef
Zurück zum Zitat Thomas KP, Guan C, Lau CT, Vinod AP, Ang KK (2009) A new discriminative common spatial pattern method for motor imagery brain-computer interfaces. IEEE Trans Biomed Eng 56(11):2730–2733CrossRef Thomas KP, Guan C, Lau CT, Vinod AP, Ang KK (2009) A new discriminative common spatial pattern method for motor imagery brain-computer interfaces. IEEE Trans Biomed Eng 56(11):2730–2733CrossRef
Zurück zum Zitat Wang K, Wang Z, Guo Y, He F, Qi H, Xu M, Ming D (2017) A brain-computer interface driven by imagining different force loads on a single hand: an online feasibility study. J Neuroeng Rehabil 14(1):1–10CrossRef Wang K, Wang Z, Guo Y, He F, Qi H, Xu M, Ming D (2017) A brain-computer interface driven by imagining different force loads on a single hand: an online feasibility study. J Neuroeng Rehabil 14(1):1–10CrossRef
Zurück zum Zitat Wang K, Zhai D-H, Xia Y (2019) Motor imagination eeg recognition algorithm based on dwt, CSP and extreme learning machine. In: 2019 Chinese Control Conference (CCC), pp 4590–4595, IEEE Wang K, Zhai D-H, Xia Y (2019) Motor imagination eeg recognition algorithm based on dwt, CSP and extreme learning machine. In: 2019 Chinese Control Conference (CCC), pp 4590–4595, IEEE
Zurück zum Zitat Wu H, Li F, Li Y, Fu B, Shi G, Dong M, Niu Y (2019) A parallel multiscale filter bank convolutional neural networks for motor imagery EEG classification. Front Neurosci 13:1275CrossRef Wu H, Li F, Li Y, Fu B, Shi G, Dong M, Niu Y (2019) A parallel multiscale filter bank convolutional neural networks for motor imagery EEG classification. Front Neurosci 13:1275CrossRef
Zurück zum Zitat Yang H, Sakhavi S, Ang KK, Guan C (2015) On the use of convolutional neural networks and augmented CSP features for multi-class motor imagery of EEG signals classification. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp 2620–2623, IEEE Yang H, Sakhavi S, Ang KK, Guan C (2015) On the use of convolutional neural networks and augmented CSP features for multi-class motor imagery of EEG signals classification. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp 2620–2623, IEEE
Metadaten
Titel
A novel classification method for EEG-based motor imagery with narrow band spatial filters and deep convolutional neural network
verfasst von
Senwei Xu
Li Zhu
Wanzeng Kong
Yong Peng
Hua Hu
Jianting Cao
Publikationsdatum
28.09.2021
Verlag
Springer Netherlands
Erschienen in
Cognitive Neurodynamics / Ausgabe 2/2022
Print ISSN: 1871-4080
Elektronische ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-021-09721-x

Weitere Artikel der Ausgabe 2/2022

Cognitive Neurodynamics 2/2022 Zur Ausgabe

Neuer Inhalt