Top

Neural Processing Letters

Published in:

25-05-2021

Deep Learning with ConvNet Predicts Imagery Tasks Through EEG

Authors: Gokhan Altan, Apdullah Yayık, Yakup Kutlu

Published in: Neural Processing Letters | Issue 4/2021

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Deep learning with convolutional neural networks (ConvNets) has dramatically improved the learning capabilities of computer vision applications just through considering raw data without any prior feature extraction. Nowadays, there is a rising curiosity in interpreting and analyzing electroencephalography (EEG) dynamics with ConvNets. Our study focused on ConvNets of different structures, the efficiency of multiple machine learning algorithms with optimization on ConvNets, constructing for predicting imagined left and right movements on a subject-independent basis through raw EEG data. We adapted novel lower-upper triangularization based extreme learning machines (LuELM) to the ConvNet architecture. Results showed that recently advanced methods in machine learning field, i.e. adaptive moments and batch normalization together with dropout strategy, improved ConvNets predicting ability, outperforming that of conventional fully-connected neural networks with widely-used spectral features. The proposed prediction model achieved improvements in classification performances with the rates of 90.33%, 91.00%, and 89.67% for accuracy, recall, and specificity, respectively.

previous article A Hybrid Multi-gene Genetic Programming with Capuchin Search Algorithm for Modeling a Nonlinear Challenge Problem: Modeling Industrial Winding Process, Case Study

next article Why Does Regularization Help with Mitigating Poisoning Attacks?

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Acharya UR, Oh SL, Hagiwara Y, Tan JH, Adeli H (2018) Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals. Comp Biol Med. https://doi.org/10.1016/j.compbiomed.2017.09.017CrossRef

Alomari MH, Baniyounes AM, Awada EA (2014) EEG-based classification of imagined fists movements using machine learning and wavelet transform analysis. Int J Adv Electron Electr Eng 23:83–87

Altan G, Kutlu Y, Allahverdi N (2016) Deep Belief Networks Based Brain Activity Classification Using EEG from Slow Cortical Potentials in Stroke. Int J Appl Mathemat Electron Comput 4:205–205CrossRef

Bai L, Yu T, Li Y (2015) A brain computer interface-based explorer. J Neurosci Methods 244:2–7CrossRef

Carlson T, Millan JDR (2013) Brain-controlled wheelchairs: a robotic architecture. IEEE Robotics Automat Magazine 20(1):65–73CrossRef

Cecotti H, Gräser A (2011) Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE Transact Pattern Anal Machine Intell. https://doi.org/10.1109/TPAMI.2010.125CrossRef

Cohen MX (2014) Analyzing neural time series data: theory and practice. MIT press, CambridgeCrossRef

Dos Santos, C., Gatti, M.: Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pp. 69–78 (2014)

Filho CA, Attux R, Castellano G (2017) EEG sensorimotor rhythms’ variation and functional connectivity measures during motor imagery: Linear relations and classification approaches. PeerJ. https://doi.org/10.7717/peerj.3983CrossRef

10.

Fukushima K, Miyake S. (1982) Neocognitron: A self-organizing neural network model for a mechanism of visual pattern recognition. In: Competition and cooperation in neural nets, pp. 267–285. Springer

11.

Goldberger AL, Amaral LA, Glass L, Hausdorff JM, Ivanov PC, Mark RG, Mietus JE, Moody GB, Peng CK, Stanley HE (2000) PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation 101(23):e215–e220CrossRef

12.

Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT press, NewyorkMATH

13.

Gregory, K., George, K., George, H.: An EEG pre-processing technique for the fast recognition of motor imagery movements. In: 2016 IEEE Biomedical Circuits and Systems Conference (BioCAS), pp. 90–94. IEEE (2016)

14.

Alamori H, M., AbuBaker, A., Turani, A., M., A. (2014) EEG Mouse: A Machine Learning-Based Brain Computer Interface. Int J Adv Comput Sci Appl. doi.org/10.14569/ijacsa.2014.050428

15.

H., M., Samaha, A., AlKamha, K. (2013) Automated Classification of L/R Hand Movement EEG Signals using Advanced Feature Extraction and Machine Learning. International Journal of Advanced Computer Science and Applications

16.

Hinton G, Deng L, Yu D, Dahl GE, Mohamed AR, Jaitly N, Senior A, Vanhoucke V, Nguyen P, Sainath TN, Kingsbury B (2012) Deep Neural Networks for Acoustic Modeling in Speech Recognition. Ieee Sig Process Magazine 29(6):82–97. https://doi.org/10.1109/MSP.2012.2205597CrossRef

17.

Hinton G, Srivastava N, Swersky K (2012) Neural networks for machine learning lecture 6a overview of mini-batch gradient descent. Cited on 14

18.

Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: Theory and applications. Neurocomputing. https://doi.org/10.1016/j.neucom.2005.12.126CrossRef

19.

Ioffe, S., Szegedy, C.: Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)

20.

Kim J, Kim J, Jang GJ, Lee M (2017) Fast learning method for convolutional neural networks using extreme learning machine and its application to lane detection. Neural Netw. https://doi.org/10.1016/j.neunet.2016.12.002CrossRef

21.

Kim Y, Ryu J, Kim KK, Took CC, Mandic DP, Park C (2016) Motor Imagery Classification Using Mu and Beta Rhythms of EEG with Strong Uncorrelating Transform Based Complex Common Spatial Patterns. Computat Intell Neurosci. https://doi.org/10.1155/2016/1489692CrossRef

22.

Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

23.

Kolsch, A., Afzal, M.Z., Ebbecke, M., Liwicki, M.: Real-Time Document Image Classification Using Deep CNN and Extreme Learning Machines. In: Proceedings of the International Conference on Document Analysis and Recognition, ICDAR (2018). https://doi.org/10.1109/ICDAR.2017.217

24.

Kutlu Y, Yayık A, Yildirim E, Yildirim S (2019) LU triangularization extreme learning machine in EEG cognitive task classification. Neural Comput Appl. https://doi.org/10.1007/s00521-017-3142-1CrossRef

25.

LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Others: Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef

26.

Li J, Yu ZL, Gu Z, Wu W, Li Y, Jin L (2018) A hybrid network for ERP detection and analysis based on restricted boltzmann machine. IEEE Transact Neural Syst Rehabilit Eng. https://doi.org/10.1109/TNSRE.2018.2803066CrossRef

27.

Liu M, Wu W, Gu Z, Yu Z, Qi FF, Li Y (2018) Deep learning based on Batch Normalization for P300 signal detection. Neurocomputing. https://doi.org/10.1016/j.neucom.2017.08.039CrossRef

28.

Ma, X., Qiu, S., Du, C., Xing, J., He, H.: Improving EEG-Based Motor Imagery Classification via Spatial and Temporal Recurrent Neural Networks. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS (2018). https://doi.org/10.1109/EMBC.2018.8512590

29.

Major TC, Conrad JM (2017) The effects of pre-filtering and individualizing components for electroencephalography neural network classification. Conf Proc IEEE SOUTHEASTCON. https://doi.org/10.1109/SECON.2017.7925289CrossRef

30.

Meisheri, H., Ramrao, N., Mitra, S.: Multiclass common spatial pattern for EEG based brain computer interface with adaptive learning classifier. arXiv preprint arXiv:1802.09046 (2018)

31.

Mousavi Z, Yousefi Rezaii T, Sheykhivand S, Farzamnia A, Razavi SN (2019) Deep convolutional neural network for classification of sleep stages from single-channel EEG signals. J Neurosci Methods. https://doi.org/10.1016/j.jneumeth.2019.108312CrossRef

32.

Pang S, Yang X (2016) Deep Convolutional Extreme Learning Machine and Its Application in Handwritten Digit Classification. Comput Intell Neurosci. https://doi.org/10.1155/2016/3049632CrossRef

33.

Pinheiro, O.R., Alves, L.R., Romero, M.F., De Souza, J.R.: Wheelchair simulator game for training people with severe disabilities. In: TISHW 2016 - 1st International Conference on Technology and Innovation in Sports, Health and Wellbeing, Proceedings (2016). https://doi.org/10.1109/TISHW.2016.7847792

34.

Qi F, Li Y, Wu W (2015) RSTFC: A novel algorithm for spatio-temporal filtering and classification of single-trial EEG. IEEE Transact Neural Netw Learning Syst. https://doi.org/10.1109/TNNLS.2015.2402694MathSciNetCrossRef

35.

Raghu S, Sriraam N, Temel Y, Rao SV, Kubben PL (2020) EEG based multi-class seizure type classification using convolutional neural network and transfer learning. Neural Netw. https://doi.org/10.1016/j.neunet.2020.01.017CrossRef

36.

San-Segundo R, Gil-Martín M, D’Haro-Enríquez LF, Pardo JM (2019) Classification of epileptic EEG recordings using signal transforms and convolutional neural networks. Comput Biol Med. https://doi.org/10.1016/j.compbiomed.2019.04.031CrossRef

37.

Schalk G, McFarland DJ, Hinterberger T, Birbaumer N, Wolpaw JR (2004) BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Transact Biomed Eng 51(6):1034–1043CrossRef

38.

Schirrmeister RT, Springenberg JT, Fiederer LDJ, Glasstetter M, Eggensperger K, Tangermann M, Hutter F, Burgard W, Ball T (2017) Deep learning with convolutional neural networks for EEG decoding and visualization. Human Brain Mapp. https://doi.org/10.1002/hbm.23730CrossRef

39.

Shenoy, H.V., Vinod, A.P., Guan, C.: Shrinkage estimator based regularization for EEG motor imagery classification. In: 2015 10th International Conference on Information, Communications and Signal Processing, ICICS 2015 (2016). https://doi.org/10.1109/ICICS.2015.7459836

40.

Sita, J., Nair, G.J.: Feature extraction and classification of EEG signals for mapping motor area of the brain. In: 2013 International Conference on Control Communication and Computing, ICCC 2013 (2013). https://doi.org/10.1109/ICCC.2013.6731699

41.

Sleight J, Pillai P, Mohan S (2009) Classification of executed and imagined motor movement EEG signals. University of Michigan, Ann Arbor Michigan, pp 1–10

42.

Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Machine Learn Res 15(1):1929–1958MathSciNetMATH

43.

Sun Y, Lo FP, Lo B (2019) EEG-based user identification system using 1D-convolutional long short-term memory neural networks. Expert Syst Appl. https://doi.org/10.1016/j.eswa.2019.01.080CrossRef

44.

Wang YT, Wang Y, Jung TP (2011) A cell-phone-based brain-computer interface for communication in daily life. Journal of neural engineering 8(2):25,018

45.

Welch P (1967) The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Transact Audio Electroacoustics 15(2):70–73CrossRef

46.

Wu W, Chen Z, Gao X, Li Y, Brown EN, Gao S (2015) Probabilistic common spatial patterns for multichannel EEG analysis. IEEE Transact Pattern Anal Machine Intell. https://doi.org/10.1109/TPAMI.2014.2330598CrossRef

47.

Yu W, Zhuang F, He Q, Shi Z (2015) Learning deep representations via extreme learning machines. Neurocomputing. https://doi.org/10.1016/j.neucom.2014.03.077CrossRef

48.

Zakaria, M.H.F., Mansor, W., Lee, K.Y.: Time-frequency analysis of executed and imagined motor movement EEG signals for neuro-based home appliance system. In: TENCON 2017-2017 IEEE Region 10 Conference, pp. 1657–1660. IEEE (2017)

49.

Zeng, Y., Xu, X., Fang, Y., Zhao, K.: Traffic sign recognition using extreme learning classifier with deep convolutional features. The 2015 international conference on intelligence science and big data engineering (IScIDE 2015), Suzhou, China (2015). https://doi.org/10.1007/978-3-319-23989-7_28

50.

Zhang, D., Yao, L., Zhang, X., Wang, S., Chen, W., Boots, R.: EEG-based intention recognition from spatio-temporal representations via cascade and parallel convolutional recurrent neural networks. arXiv preprint arXiv:1708.06578 (2017)

51.

Zhang J, Yao R, Ge W, Gao J (2020) Orthogonal convolutional neural networks for automatic sleep stage classification based on single-channel EEG. Comp Methods Programs Biomed. https://doi.org/10.1016/j.cmpb.2019.105089CrossRef

Title: Deep Learning with ConvNet Predicts Imagery Tasks Through EEG
Authors: Gokhan Altan
Apdullah Yayık
Yakup Kutlu
Publication date: 25-05-2021
Publisher: Springer US
Published in: Neural Processing Letters / Issue 4/2021
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI: https://doi.org/10.1007/s11063-021-10533-7

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 4/2021

Finite-Time Synchronization for a Coupled Fuzzy Neutral-Type Rayleigh System

Cerebrum Tumor Segmentation of High Resolution Magnetic Resonance Images Using 2D-Convolutional Network with Skull Stripping

An Efficient Mammogram Image Retrieval System Using an Optimized Classifier

Fault Diagnosis of Fuel System Based on Improved Extreme Learning Machine

Intelligent Crime Prevention and Control Big Data Analysis System Based on Imaging and Capsule Network Model

Event-Based Projective Synchronization for Different Dimensional Complex Dynamical Networks with Unknown Dynamics by Using Data-Driven Scheme