Skip to main content
Top
Published in: Neural Computing and Applications 11/2021

10-10-2020 | Original Article

Mental imagery classification using one-dimensional convolutional neural network for target selection in single-channel BCI-controlled mobile robot

Authors: Tarmizi Ahmad Izzuddin, Norlaili Mat Safri, Mohd Afzan Othman

Published in: Neural Computing and Applications | Issue 11/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper introduces the use of the one-dimensional convolutional neural network (1D-CNN) for end-to-end EEG decoding with application towards a BCI system with a shared control scheme. In general, subjects wearing a single-channel EEG electrode located at F8 (10–20 international standards) were required to perform mental tasks by mentally visualising the rotation of a star and mind relaxation at a specific time and by robot orientation. The visualisation of a rotating star suggests that the mobile robot is currently oriented towards a target, thus enabling target selection. We showed that proposed classifier obtained the best accuracy of 92.09% in classifying the subject’s performing mental rotation task or mental relaxation when compared with conventional classification methods such as support vector machine—75.69%, Kth-nearest neighbour—65.50% and linear discriminant analysis—65.20%. Furthermore, different from conventional methods, the use of 1D-CNN enables end-to-end learning, that is the automatic decoding of EEG signals without requiring feature selection or extraction. To validate that the proposed classifier performs better than conventional methods, the extracted kernel weights of proposed 1D-CNN filters were visualised as a temporal plot, and spectral analysis was performed on the extracted weights. The obtained results confirmed that the proposed 1D-CNN was able to generate filters that resemble the EEG wave patterns of different frequencies and spectral analysis confirmed that the filters exploited information from multiple frequency bands (such as alpha band and beta band) that are often associated with a heightened mental state when performing mental tasks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
4.
go back to reference Millán JDR (2002) Brain–computer interfaces. In: The handbook of brain theory and neural networks, 2nd edn. MIT Press Millán JDR (2002) Brain–computer interfaces. In: The handbook of brain theory and neural networks, 2nd edn. MIT Press
8.
go back to reference Barbosa AOG, Achanccaray DR, Meggiolaro MA (2010) Activation of a mobile robot through a brain computer interface. In: 2010 IEEE international conference on robotics and automation. IEEE, pp 4815–4821 Barbosa AOG, Achanccaray DR, Meggiolaro MA (2010) Activation of a mobile robot through a brain computer interface. In: 2010 IEEE international conference on robotics and automation. IEEE, pp 4815–4821
11.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 770–778
18.
go back to reference Burget F, Fiederer LDJ, Kuhner D et al (2017) Acting thoughts: towards a mobile robotic service assistant for users with limited communication skills. In: 2017 European conference on mobile robots (ECMR). IEEE, pp 1–6 Burget F, Fiederer LDJ, Kuhner D et al (2017) Acting thoughts: towards a mobile robotic service assistant for users with limited communication skills. In: 2017 European conference on mobile robots (ECMR). IEEE, pp 1–6
22.
go back to reference JeunetC, N’Kaoua B, Lotte F (2017) Towards a cognitive model of MI-BCI user training. In: International Graz BCI conference. p hal-01519476 JeunetC, N’Kaoua B, Lotte F (2017) Towards a cognitive model of MI-BCI user training. In: International Graz BCI conference. p hal-01519476
24.
go back to reference Mousavi M, de Sa VR (2019) Temporally adaptive common spatial patterns with deep convolutional neural networks. In: 2019 41st Annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 4533–4536 Mousavi M, de Sa VR (2019) Temporally adaptive common spatial patterns with deep convolutional neural networks. In: 2019 41st Annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 4533–4536
25.
go back to reference Izzuddin TA, Ariffin MA, Bohari ZH et al (2015) Movement intention detection using neural network for quadriplegic assistive machine. In: 2015 IEEE international conference on control system, computing and engineering (ICCSCE). IEEE, pp 275–280 Izzuddin TA, Ariffin MA, Bohari ZH et al (2015) Movement intention detection using neural network for quadriplegic assistive machine. In: 2015 IEEE international conference on control system, computing and engineering (ICCSCE). IEEE, pp 275–280
26.
go back to reference Rashid M, Sulaiman N, Mustafa M et al (2020) Investigating the possibility of brain actuated mobile robot through single-channel EEG headset. In: Lecture notes in electrical engineering, vol 632. Springer, Singapore, pp 579–590 Rashid M, Sulaiman N, Mustafa M et al (2020) Investigating the possibility of brain actuated mobile robot through single-channel EEG headset. In: Lecture notes in electrical engineering, vol 632. Springer, Singapore, pp 579–590
27.
go back to reference Stephygraph LR, Arunkumar N, Venkatraman V (2015) Wireless mobile robot control through human machine interface using brain signals. In: 2015 International conference on smart technologies and management for computing, communication, controls, energy and materials (ICSTM). IEEE, pp 596–603 Stephygraph LR, Arunkumar N, Venkatraman V (2015) Wireless mobile robot control through human machine interface using brain signals. In: 2015 International conference on smart technologies and management for computing, communication, controls, energy and materials (ICSTM). IEEE, pp 596–603
28.
go back to reference Ullah K, Ali M, Rizwan M, Imran M (2011) Low-cost single-channel EEG based communication system for people with lock-in syndrome. In: 2011 IEEE 14th international multitopic conference. IEEE, pp 120–125 Ullah K, Ali M, Rizwan M, Imran M (2011) Low-cost single-channel EEG based communication system for people with lock-in syndrome. In: 2011 IEEE 14th international multitopic conference. IEEE, pp 120–125
31.
go back to reference Adha MS, Safri NM, Othman MA (2015) Real-time target selection based on electroencephalogram (EEG) signal. ARPN J Eng Appl Sci 10:8757–8761 Adha MS, Safri NM, Othman MA (2015) Real-time target selection based on electroencephalogram (EEG) signal. ARPN J Eng Appl Sci 10:8757–8761
32.
33.
go back to reference Kim Y (2014) Convolutional neural networks for sentence classification. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Stroudsburg, pp 1746–1751 Kim Y (2014) Convolutional neural networks for sentence classification. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Stroudsburg, pp 1746–1751
34.
go back to reference Abdel-Hamid O, Mohamed A, Jiang H, Penn G (2012) Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition. In: 2012 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 4277–4280 Abdel-Hamid O, Mohamed A, Jiang H, Penn G (2012) Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition. In: 2012 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 4277–4280
37.
go back to reference Nair V, Hinton GE (2010) Rectified linear units improve Restricted Boltzmann machines. In: ICML 2010-Proceedings, 27th international conference on machine learning Nair V, Hinton GE (2010) Rectified linear units improve Restricted Boltzmann machines. In: ICML 2010-Proceedings, 27th international conference on machine learning
38.
go back to reference Merrill N, Maillart T, Johnson B, Chuang J (2015) Improving physiological signal classification using logarithmic quantization and a progressive calibration technique. In: Proceedings of the 2nd international conference on physiological computing systems. SCITEPRESS-Science and Technology Publications, pp 44–51 Merrill N, Maillart T, Johnson B, Chuang J (2015) Improving physiological signal classification using logarithmic quantization and a progressive calibration technique. In: Proceedings of the 2nd international conference on physiological computing systems. SCITEPRESS-Science and Technology Publications, pp 44–51
41.
go back to reference Merrill N, Curran MT, Yang J-K, Chuang J (2016) Classifying mental gestures with in-ear EEG. In: 2016 IEEE 13th international conference on wearable and implantable body sensor networks (BSN). IEEE, pp 130–135 Merrill N, Curran MT, Yang J-K, Chuang J (2016) Classifying mental gestures with in-ear EEG. In: 2016 IEEE 13th international conference on wearable and implantable body sensor networks (BSN). IEEE, pp 130–135
42.
go back to reference Ling CX, Huang J, Zhang H (2003) AUC: a statistically consistent and more discriminating measure than accuracy. In: IJCAI international joint conference on artificial intelligence Ling CX, Huang J, Zhang H (2003) AUC: a statistically consistent and more discriminating measure than accuracy. In: IJCAI international joint conference on artificial intelligence
44.
go back to reference Srivastava N, Hinton G, Krizhevsky A et al (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958MathSciNetMATH Srivastava N, Hinton G, Krizhevsky A et al (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958MathSciNetMATH
45.
go back to reference Bernard JB, Nicholas MG (2013) The brain is conscious. In: Fundamentals of cognitive neuroscience. Elsevier, pp 211–252 Bernard JB, Nicholas MG (2013) The brain is conscious. In: Fundamentals of cognitive neuroscience. Elsevier, pp 211–252
47.
go back to reference Saidi P, Atia GK, Paris A, Vosoughi A (2015) Motor imagery classification using multiresolution analysis and sparse representation of EEG signals. In: 2015 IEEE global conference on signal and information processing (GlobalSIP). IEEE, pp 815–819 Saidi P, Atia GK, Paris A, Vosoughi A (2015) Motor imagery classification using multiresolution analysis and sparse representation of EEG signals. In: 2015 IEEE global conference on signal and information processing (GlobalSIP). IEEE, pp 815–819
50.
go back to reference Nishifuji S, Sato M, Maino D, Tanaka S (2010) Effect of acoustic stimuli and mental task on alpha, beta and gamma rhythms in brain wave. In: Proceedings of the SICE annual conference Nishifuji S, Sato M, Maino D, Tanaka S (2010) Effect of acoustic stimuli and mental task on alpha, beta and gamma rhythms in brain wave. In: Proceedings of the SICE annual conference
Metadata
Title
Mental imagery classification using one-dimensional convolutional neural network for target selection in single-channel BCI-controlled mobile robot
Authors
Tarmizi Ahmad Izzuddin
Norlaili Mat Safri
Mohd Afzan Othman
Publication date
10-10-2020
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 11/2021
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05393-6

Other articles of this Issue 11/2021

Neural Computing and Applications 11/2021 Go to the issue

Premium Partner