Skip to main content
Erschienen in: Medical & Biological Engineering & Computing 3/2024

20.11.2023 | Original Article

EEGNet-based multi-source domain filter for BCI transfer learning

verfasst von: Mengfan Li, Jundi Li, Zhiyong Song, Haodong Deng, Jiaming Xu, Guizhi Xu, Wenzhe Liao

Erschienen in: Medical & Biological Engineering & Computing | Ausgabe 3/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract   

Deep learning has great potential on decoding EEG in brain-computer interface. While common deep learning algorithms cannot directly train models with data from multiple individuals because of the inter-individual differences in EEG. Collecting enough data for each subject to satisfy the training of deep learning would result in an increase in training cost. This study proposes a novel transfer learning, EEGNet-based multi-source domain filter for transfer learning (EEGNet-MDFTL), to reduce the amount of training data and improve the performance of BCI. The EEGNet-MDFTL uses bagging ensemble learning to learn domain-invariant features from the multi-source domain and utilizes model loss value to filter the multi-source domain. Compared with baseline methods, the accuracy of the EEGNet-MDFTL reaches 91.96%, higher than two state-of-the-art methods, which demonstrates source domain filter can select similar source domains to improve the accuracy of the model, and remains a high level even when the data amount is reduced to 1/8, proving that ensemble learning learns enough domain invariant features from the multi-source domain to make the model insensitive to data amount. The proposed EEGNet-MDFTL is effective in improving the decoding performance with a small amount of data, which is helpful to save the BCI training cost.

Graphical Abstract

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Allison BZ, Kübler A, Jin J (2020) 30+ years of P300 brain–computer interfaces. Psychophysiology 57(7):e13569CrossRefPubMed Allison BZ, Kübler A, Jin J (2020) 30+ years of P300 brain–computer interfaces. Psychophysiology 57(7):e13569CrossRefPubMed
2.
Zurück zum Zitat Li W, Li M, Zhou H et al (2018) A dual stimuli approach combined with convolutional neural network to improve information transfer rate of event-related potential-based brain-computer interface. Int J Neural Syst 28(10):1850034CrossRefPubMed Li W, Li M, Zhou H et al (2018) A dual stimuli approach combined with convolutional neural network to improve information transfer rate of event-related potential-based brain-computer interface. Int J Neural Syst 28(10):1850034CrossRefPubMed
3.
Zurück zum Zitat Zhang R, Wang Q, Li K et al (2017) A BCI-based environmental control system for patients with severe spinal cord injuries. IEEE Trans Biomed Eng 64(8):1959–1971CrossRefPubMed Zhang R, Wang Q, Li K et al (2017) A BCI-based environmental control system for patients with severe spinal cord injuries. IEEE Trans Biomed Eng 64(8):1959–1971CrossRefPubMed
4.
Zurück zum Zitat Duan F, Lin D, Li W et al (2015) Design of a multimodal EEG-based hybrid BCI system with visual servo module. IEEE Trans Auton Ment Dev 7(4):332–341CrossRef Duan F, Lin D, Li W et al (2015) Design of a multimodal EEG-based hybrid BCI system with visual servo module. IEEE Trans Auton Ment Dev 7(4):332–341CrossRef
5.
Zurück zum Zitat Bian Z, Zhang X (2000) Pattern recognition. Tsinghua University Press, China Bian Z, Zhang X (2000) Pattern recognition. Tsinghua University Press, China
6.
8.
Zurück zum Zitat Alkan A, Akben SB (2011) Use of k-means clustering in migraine detection by using EEG records under flash stimulation. Int J Phys Sci 6(4):641–650 Alkan A, Akben SB (2011) Use of k-means clustering in migraine detection by using EEG records under flash stimulation. Int J Phys Sci 6(4):641–650
11.
Zurück zum Zitat Li M, Han J, Yang J (2021) Automatic feature extraction and fusion recognition of motor imagery EEG using multilevel multiscale CNN. Med Biol Eng Compu 59(10):2037–2050CrossRef Li M, Han J, Yang J (2021) Automatic feature extraction and fusion recognition of motor imagery EEG using multilevel multiscale CNN. Med Biol Eng Compu 59(10):2037–2050CrossRef
12.
Zurück zum Zitat Borhade R, Nagmode MS (2020) Modified atom search optimization-based deep recurrent neural network for epileptic seizure prediction using electroencephalogram signals. Biocybernetics Biomed Eng 40(4):1638–1653CrossRef Borhade R, Nagmode MS (2020) Modified atom search optimization-based deep recurrent neural network for epileptic seizure prediction using electroencephalogram signals. Biocybernetics Biomed Eng 40(4):1638–1653CrossRef
13.
Zurück zum Zitat She Q, Zou J, Luo Z et al (2020) Multi-class motor imagery EEG classification using collaborative representation-based semi-supervised extreme learning machine. Med Biol Eng Compu 58:2119–2130CrossRef She Q, Zou J, Luo Z et al (2020) Multi-class motor imagery EEG classification using collaborative representation-based semi-supervised extreme learning machine. Med Biol Eng Compu 58:2119–2130CrossRef
14.
Zurück zum Zitat Mishuhina V, Jiang X (2018) Feature weighting and regularization of common spatial patterns in EEG-based motor imagery BCI. IEEE Signal Process Lett 25(6):783–787CrossRefADS Mishuhina V, Jiang X (2018) Feature weighting and regularization of common spatial patterns in EEG-based motor imagery BCI. IEEE Signal Process Lett 25(6):783–787CrossRefADS
15.
Zurück zum Zitat Abibullaev B, Zollanvari A (2021) A systematic deep learning model selection for P300-based brain–computer interfaces. IEEE Trans Syst Man Cybernet: Syst 52(5):2744–2756CrossRef Abibullaev B, Zollanvari A (2021) A systematic deep learning model selection for P300-based brain–computer interfaces. IEEE Trans Syst Man Cybernet: Syst 52(5):2744–2756CrossRef
16.
Zurück zum Zitat Amin SU, Alsulaiman M, Muhammad G et al (2019) Deep learning for EEG motor imagery classification based on multi-layer CNNs feature fusion. Futur Gener Comput Syst 101:542–554CrossRef Amin SU, Alsulaiman M, Muhammad G et al (2019) Deep learning for EEG motor imagery classification based on multi-layer CNNs feature fusion. Futur Gener Comput Syst 101:542–554CrossRef
17.
Zurück zum Zitat Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef
18.
Zurück zum Zitat Kindermans PJ, Tangermann M, Müller KR et al (2014) Integrating dynamic stopping, transfer learning and language models in an adaptive zero-training ERP speller. J Neural Eng 11(3):035005CrossRefPubMed Kindermans PJ, Tangermann M, Müller KR et al (2014) Integrating dynamic stopping, transfer learning and language models in an adaptive zero-training ERP speller. J Neural Eng 11(3):035005CrossRefPubMed
19.
Zurück zum Zitat Fahimi F, Zhang Z, Goh WB et al (2019) Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI. J Neural Eng 16(2):026007CrossRefPubMed Fahimi F, Zhang Z, Goh WB et al (2019) Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI. J Neural Eng 16(2):026007CrossRefPubMed
20.
Zurück zum Zitat Zhang D, Yao L, Zhang X et al (2018) Cascade and parallel convolutional recurrent neural networks on EEG-based intention recognition for brain computer interface. Proc AAAI Conf Artif Intell 32:1MathSciNet Zhang D, Yao L, Zhang X et al (2018) Cascade and parallel convolutional recurrent neural networks on EEG-based intention recognition for brain computer interface. Proc AAAI Conf Artif Intell 32:1MathSciNet
21.
Zurück zum Zitat Jin J, Li S, Daly I et al (2020) The study of generic model set for reducing calibration time in P300-based brain–computer interface. IEEE Trans Neural Syst Rehabil Eng 28(1):3–12CrossRefPubMed Jin J, Li S, Daly I et al (2020) The study of generic model set for reducing calibration time in P300-based brain–computer interface. IEEE Trans Neural Syst Rehabil Eng 28(1):3–12CrossRefPubMed
22.
Zurück zum Zitat Raza H, Cecotti H, Li Y et al (2016) Adaptive learning with covariate shift-detection for motor imagery-based brain–computer interface. Soft Comput 20:3085–3096CrossRef Raza H, Cecotti H, Li Y et al (2016) Adaptive learning with covariate shift-detection for motor imagery-based brain–computer interface. Soft Comput 20:3085–3096CrossRef
23.
Zurück zum Zitat Li M, Lin F, Xu G (2020) A TrAdaBoost method for detecting multiple subjects’ N200 and P300 potentials based on cross-validation and an adaptive threshold. Int J Neural Syst 30(3):2050009CrossRefPubMed Li M, Lin F, Xu G (2020) A TrAdaBoost method for detecting multiple subjects’ N200 and P300 potentials based on cross-validation and an adaptive threshold. Int J Neural Syst 30(3):2050009CrossRefPubMed
24.
Zurück zum Zitat Roy AM (2022) Adaptive transfer learning-based multiscale feature fused deep convolutional neural network for EEG MI multiclassification in brain–computer interface. Eng Appl Artif Intell 116:105347CrossRef Roy AM (2022) Adaptive transfer learning-based multiscale feature fused deep convolutional neural network for EEG MI multiclassification in brain–computer interface. Eng Appl Artif Intell 116:105347CrossRef
25.
Zurück zum Zitat Kang H, Nam Y, Choi S (2009) Composite common spatial pattern for subject-to-subject transfer. IEEE Signal process Lett 16(8):683–686CrossRefADS Kang H, Nam Y, Choi S (2009) Composite common spatial pattern for subject-to-subject transfer. IEEE Signal process Lett 16(8):683–686CrossRefADS
26.
Zurück zum Zitat Lees S (2018) A review of rapid serial visual presentation-based brain–computer interfaces. J Neural Eng 15(2):1–24CrossRef Lees S (2018) A review of rapid serial visual presentation-based brain–computer interfaces. J Neural Eng 15(2):1–24CrossRef
27.
Zurück zum Zitat Azab AM, Mihaylova L, Ang KK et al (2019) Weighted transfer learning for improving motor imagery-based brain–computer interface. IEEE Trans Neural Syst Rehabil Eng 27(7):1352–1359CrossRefPubMed Azab AM, Mihaylova L, Ang KK et al (2019) Weighted transfer learning for improving motor imagery-based brain–computer interface. IEEE Trans Neural Syst Rehabil Eng 27(7):1352–1359CrossRefPubMed
28.
Zurück zum Zitat He H, Wu D (2020) Transfer learning for brain–computer interfaces: a Euclidean space data alignment approach. IEEE Trans Biomed Eng 67(2):399–410CrossRefPubMedADS He H, Wu D (2020) Transfer learning for brain–computer interfaces: a Euclidean space data alignment approach. IEEE Trans Biomed Eng 67(2):399–410CrossRefPubMedADS
29.
Zurück zum Zitat Zhao X, Zhao J, Liu C et al (2020) Deep neural network with joint distribution matching for cross-subject motor imagery brain-computer interfaces. Biomed Res Int 2020:1–15 Zhao X, Zhao J, Liu C et al (2020) Deep neural network with joint distribution matching for cross-subject motor imagery brain-computer interfaces. Biomed Res Int 2020:1–15
30.
Zurück zum Zitat Lawhern VJ, Solon AJ, Waytowich NR et al (2018) EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces. J Neural Eng 15(5):1–17CrossRef Lawhern VJ, Solon AJ, Waytowich NR et al (2018) EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces. J Neural Eng 15(5):1–17CrossRef
31.
Zurück zum Zitat Sun B, Zhao X, Zhang H et al (2020) EEG motor imagery classification with sparse spectrotemporal decomposition and deep learning. IEEE Trans Automat Sci Eng 18(2):541–551CrossRef Sun B, Zhao X, Zhang H et al (2020) EEG motor imagery classification with sparse spectrotemporal decomposition and deep learning. IEEE Trans Automat Sci Eng 18(2):541–551CrossRef
32.
Zurück zum Zitat Schirrmeister R, Springenberg J, Fiederer L et al (2017) Deep learning with convolutional neural networks for EEG decoding and visualization. Hum Brain Mapp 38(11):5391–5420CrossRefPubMedPubMedCentral Schirrmeister R, Springenberg J, Fiederer L et al (2017) Deep learning with convolutional neural networks for EEG decoding and visualization. Hum Brain Mapp 38(11):5391–5420CrossRefPubMedPubMedCentral
33.
Zurück zum Zitat Ni Z, Xu J, Wu Y et al (2022) Improving cross-state and cross-subject visual ERP-based BCI with temporal modeling and adversarial training. IEEE Trans Neural Syst Rehabil Eng 30:369–379CrossRefPubMed Ni Z, Xu J, Wu Y et al (2022) Improving cross-state and cross-subject visual ERP-based BCI with temporal modeling and adversarial training. IEEE Trans Neural Syst Rehabil Eng 30:369–379CrossRefPubMed
35.
Zurück zum Zitat Lotte F, Bougrain L, Cichocki A et al (2018) A review of classification algorithms for EEG-based braincomputer interfaces: a 10 year update. J Neural Eng 15(3):031005CrossRefPubMed Lotte F, Bougrain L, Cichocki A et al (2018) A review of classification algorithms for EEG-based braincomputer interfaces: a 10 year update. J Neural Eng 15(3):031005CrossRefPubMed
36.
Zurück zum Zitat Kalaganis F, Laskaris N, Chatzilari E et al (2020) A Riemannian geometry approach to reduced and discriminative covariance estimation in brain computer interfaces. IEEE Trans Biomed Eng 67(1):245–255CrossRefPubMed Kalaganis F, Laskaris N, Chatzilari E et al (2020) A Riemannian geometry approach to reduced and discriminative covariance estimation in brain computer interfaces. IEEE Trans Biomed Eng 67(1):245–255CrossRefPubMed
37.
Zurück zum Zitat Hussein R, Palangi H, Ward R et al (2019) Optimized deep neural network architecture for robust detection of epileptic seizures using EEG signals. Clin Neuriophysiol 130:25–37CrossRef Hussein R, Palangi H, Ward R et al (2019) Optimized deep neural network architecture for robust detection of epileptic seizures using EEG signals. Clin Neuriophysiol 130:25–37CrossRef
38.
Zurück zum Zitat Li F, Xia Y, Wang F et al (2020) Transfer learning algorithm of P300-EEG signal based on XDAWN spatial filter and Riemannian geometry classifier. Appl Sci 10(5):1804CrossRef Li F, Xia Y, Wang F et al (2020) Transfer learning algorithm of P300-EEG signal based on XDAWN spatial filter and Riemannian geometry classifier. Appl Sci 10(5):1804CrossRef
39.
Zurück zum Zitat Kilani S, Aghili SN, Hulea M (2023) Enhancing P300-based brain-computer interfaces with hybrid transfer learning: a data alignment and fine-tuning approach. Appl Sci 13(10):6283CrossRef Kilani S, Aghili SN, Hulea M (2023) Enhancing P300-based brain-computer interfaces with hybrid transfer learning: a data alignment and fine-tuning approach. Appl Sci 13(10):6283CrossRef
40.
Zurück zum Zitat Huang Z, Guo J, Zheng W et al (2022) A calibration-free approach to implementing P300-based brain–computer interface. Cogn Comput 14(2):887–899CrossRef Huang Z, Guo J, Zheng W et al (2022) A calibration-free approach to implementing P300-based brain–computer interface. Cogn Comput 14(2):887–899CrossRef
41.
Zurück zum Zitat Wu Z, She Q, Hou Z et al (2023) Multi-source online transfer algorithm based on source domain selection for EEG classification. Math Biosci Eng 20(3):4560–4573CrossRefPubMed Wu Z, She Q, Hou Z et al (2023) Multi-source online transfer algorithm based on source domain selection for EEG classification. Math Biosci Eng 20(3):4560–4573CrossRefPubMed
Metadaten
Titel
EEGNet-based multi-source domain filter for BCI transfer learning
verfasst von
Mengfan Li
Jundi Li
Zhiyong Song
Haodong Deng
Jiaming Xu
Guizhi Xu
Wenzhe Liao
Publikationsdatum
20.11.2023
Verlag
Springer Berlin Heidelberg
Erschienen in
Medical & Biological Engineering & Computing / Ausgabe 3/2024
Print ISSN: 0140-0118
Elektronische ISSN: 1741-0444
DOI
https://doi.org/10.1007/s11517-023-02967-z

Weitere Artikel der Ausgabe 3/2024

Medical & Biological Engineering & Computing 3/2024 Zur Ausgabe

Premium Partner