Skip to main content

2018 | OriginalPaper | Buchkapitel

Recognizing Motor Imagery Tasks Using Deep Multi-Layer Perceptrons

verfasst von : Fernando Arce, Erik Zamora, Gerardo Hernández, Javier M. Antelis, Humberto Sossa

Erschienen in: Machine Learning and Data Mining in Pattern Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A brain-computer interface provides individuals with a way to control a computer. However, most of these interfaces remain mostly utilized in research laboratories due to the absence of certainty and accuracy in the proposed systems. In this work, we acquired our own dataset from seven able-bodied subjects and used Deep Multi-Layer Perceptrons to classify motor imagery encephalography signals into binary (Rest vs Imagined and Left vs Right) and ternary classes (Rest vs Left vs Right). These Deep Multi-Layer Perceptrons were fed with power spectral features computed with the Welch’s averaged modified periodogram method. The proposed architectures outperformed the accuracy achieved by the state-of-the-art for classifying motor imagery bioelectrical brain signals obtaining 88.03%, 85.92% and 79.82%, respectively, and an enhancement of 11.68% on average over the commonly used Support Vector Machines.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Birbaumer, N.: Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. Psychophysiology 43(6), 517–532 (2006)CrossRef Birbaumer, N.: Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. Psychophysiology 43(6), 517–532 (2006)CrossRef
2.
Zurück zum Zitat Shih, J.J., Krusienski, D.J., Wolpaw, J.R.: Brain-computer interfaces in medicine. Mayo Clin. Proc. 87(3), 268–279 (2012)CrossRef Shih, J.J., Krusienski, D.J., Wolpaw, J.R.: Brain-computer interfaces in medicine. Mayo Clin. Proc. 87(3), 268–279 (2012)CrossRef
3.
Zurück zum Zitat Lebedev, M.A., Nicolelis, M.A.: Brain-machine interfaces: past, present and future. Trends Neurosci. 29(9), 536–546 (2006)CrossRef Lebedev, M.A., Nicolelis, M.A.: Brain-machine interfaces: past, present and future. Trends Neurosci. 29(9), 536–546 (2006)CrossRef
4.
Zurück zum Zitat Becedas, J.: Brain-machine interfaces: basis and advances. IEEE Trans. Syst., Man, Cybern. Part C (Appl. Rev.) 42(6), 825–836 (2012)CrossRef Becedas, J.: Brain-machine interfaces: basis and advances. IEEE Trans. Syst., Man, Cybern. Part C (Appl. Rev.) 42(6), 825–836 (2012)CrossRef
5.
Zurück zum Zitat Vega, R., Sajed, T., Mathewson, K.W., Khare, K., Pilarski, P., Greiner, R., Sanchez-Ante, G., Antelis, J.M.: Assessment of feature selection and classification methods for recognizing motor imagery tasks from electroencephalographic signals. Artif. Intell. Res. 6(1) (2016) Vega, R., Sajed, T., Mathewson, K.W., Khare, K., Pilarski, P., Greiner, R., Sanchez-Ante, G., Antelis, J.M.: Assessment of feature selection and classification methods for recognizing motor imagery tasks from electroencephalographic signals. Artif. Intell. Res. 6(1) (2016)
6.
Zurück zum Zitat Middendorf, M., McMillan, G., Calhoun, G., Jones, K.S.: Brain-computer interfaces based on the steady-state visual-evoked response. IEEE Trans. Rehabil. Eng. 8(2), 211–214 (2000)CrossRef Middendorf, M., McMillan, G., Calhoun, G., Jones, K.S.: Brain-computer interfaces based on the steady-state visual-evoked response. IEEE Trans. Rehabil. Eng. 8(2), 211–214 (2000)CrossRef
7.
Zurück zum Zitat Wolpaw, J.R., McFarland, D.J., Neat, G.W., Forneris, C.A.: An EEG-based brain-computer interface for cursor control. Electroencephalogr. Clin. Neurophysiol. 78(3), 252–259 (1991)CrossRef Wolpaw, J.R., McFarland, D.J., Neat, G.W., Forneris, C.A.: An EEG-based brain-computer interface for cursor control. Electroencephalogr. Clin. Neurophysiol. 78(3), 252–259 (1991)CrossRef
8.
Zurück zum Zitat Farwell, L.: Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin. Neurophysiol. 70(6), 510–523 (1988)CrossRef Farwell, L.: Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin. Neurophysiol. 70(6), 510–523 (1988)CrossRef
9.
Zurück zum Zitat Millán, J.R., Rupp, R., Müeller-Putz, G., Murray-Smith, R., Giugliemma, C., Tangermann, M., Vidaurre, C., Cincotti, F., Kübler, A., Leeb, R., Neuper, C., Müeller, K., Mattia, D.: Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges. Front. Neurosci. 4, 1–61 (2010) Millán, J.R., Rupp, R., Müeller-Putz, G., Murray-Smith, R., Giugliemma, C., Tangermann, M., Vidaurre, C., Cincotti, F., Kübler, A., Leeb, R., Neuper, C., Müeller, K., Mattia, D.: Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges. Front. Neurosci. 4, 1–61 (2010)
10.
Zurück zum Zitat Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G., Vaughan, T.M.: Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113(6), 767–791 (2002)CrossRef Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G., Vaughan, T.M.: Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113(6), 767–791 (2002)CrossRef
11.
Zurück zum Zitat Schalk, G., McFarland, D.J., Hinterberger, T., Birbaumer, N., Wolpaw, J.R.: BCI 2000: a general-purpose brain-computer interface (BCI) system. IEEE Trans. Biomed. Eng. 51(6), 1034–1043 (2004)CrossRef Schalk, G., McFarland, D.J., Hinterberger, T., Birbaumer, N., Wolpaw, J.R.: BCI 2000: a general-purpose brain-computer interface (BCI) system. IEEE Trans. Biomed. Eng. 51(6), 1034–1043 (2004)CrossRef
14.
Zurück zum Zitat Wolpaw, J., Wolpaw, E.W. (eds.): Brain-Computer Interfaces: Principles and Practice. Oxford University Press, New York (2012) Wolpaw, J., Wolpaw, E.W. (eds.): Brain-Computer Interfaces: Principles and Practice. Oxford University Press, New York (2012)
15.
Zurück zum Zitat van Erp, J., Lotte, F., Tangermann, M.: Brain-computer interfaces: beyond medical applications. Computer 45(4), 26–34 (2012)CrossRef van Erp, J., Lotte, F., Tangermann, M.: Brain-computer interfaces: beyond medical applications. Computer 45(4), 26–34 (2012)CrossRef
16.
Zurück zum Zitat World Medical Association: World medical association declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA 310(20), 2191–2194 (2013) World Medical Association: World medical association declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA 310(20), 2191–2194 (2013)
17.
Zurück zum Zitat Mellinger, J., Schalk, G.: Number NIPS workshop series. In: BCI2000: A General-Purpose Software Platform for BCI Research. MIT Press (2007) Mellinger, J., Schalk, G.: Number NIPS workshop series. In: BCI2000: A General-Purpose Software Platform for BCI Research. MIT Press (2007)
18.
Zurück zum Zitat Lotze, M., Montoya, P., Erb, M., Hülsmann, E., Flor, H., Klose, U., Birbaumer, N., Grodd, W.: Activation of cortical and cerebellar motor areas during executed and imagined hand movements: an fMRI study. J. Cogn. Neurosci. 11(5), 491–501 (1999)CrossRef Lotze, M., Montoya, P., Erb, M., Hülsmann, E., Flor, H., Klose, U., Birbaumer, N., Grodd, W.: Activation of cortical and cerebellar motor areas during executed and imagined hand movements: an fMRI study. J. Cogn. Neurosci. 11(5), 491–501 (1999)CrossRef
19.
Zurück zum Zitat Welch, P.D.: The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. 15, 70–73 (1967)CrossRef Welch, P.D.: The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. 15, 70–73 (1967)CrossRef
21.
Zurück zum Zitat Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–1958 (2014)MathSciNetMATH Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–1958 (2014)MathSciNetMATH
22.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 25, pp. 1097–1105. Curran Associates, Inc., New York (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 25, pp. 1097–1105. Curran Associates, Inc., New York (2012)
23.
Zurück zum Zitat Clevert, D., Unterthiner, T., Hochreiter, S.: Fast and accurate deep network learning by exponential linear units (ELUS). CoRR abs/1511.07289 (2015) Clevert, D., Unterthiner, T., Hochreiter, S.: Fast and accurate deep network learning by exponential linear units (ELUS). CoRR abs/1511.07289 (2015)
24.
Zurück zum Zitat Lotte, F., Congedo, M., Lécuyer, A., Fabrice, L., Arnaldi, B.: A review of classification algorithms for EEG-based brain-computer interfaces 4 (2007) Lotte, F., Congedo, M., Lécuyer, A., Fabrice, L., Arnaldi, B.: A review of classification algorithms for EEG-based brain-computer interfaces 4 (2007)
25.
Zurück zum Zitat Ali, A.B.M.S., Abraham, A.: An empirical comparison of kernel selection for support vector machines. In: Soft computing Systems: Design, Management and Applications, pp. 321–330 (2002) Ali, A.B.M.S., Abraham, A.: An empirical comparison of kernel selection for support vector machines. In: Soft computing Systems: Design, Management and Applications, pp. 321–330 (2002)
26.
Zurück zum Zitat Blankertz, B., Curio, G., Müller, K.R.: Classifying single trial EEG: towards brain computer interfacing. In: Dietterich, T.G., Becker, S., Ghahramani, Z. (eds.) Advances in Neural Information Processing Systems 14, pp. 157–164. MIT Press (2002) Blankertz, B., Curio, G., Müller, K.R.: Classifying single trial EEG: towards brain computer interfacing. In: Dietterich, T.G., Becker, S., Ghahramani, Z. (eds.) Advances in Neural Information Processing Systems 14, pp. 157–164. MIT Press (2002)
27.
Zurück zum Zitat Schlögl, A., Lee, F., Bischof, H., Pfurtscheller, G.: Characterization of four-class motor imagery EEG data for the BCI-competition 2005. J. Neural Eng. 2(4), L14 (2005)CrossRef Schlögl, A., Lee, F., Bischof, H., Pfurtscheller, G.: Characterization of four-class motor imagery EEG data for the BCI-competition 2005. J. Neural Eng. 2(4), L14 (2005)CrossRef
28.
Zurück zum Zitat Morash, V., Bai, O., Furlani, S., Lin, P., Hallett, M.: Classifying EEG signals preceding right hand, left hand, tongue, and right foot movements and motor imageries. Clin. Neurophysiol. 119(11), 2570–2578 (2008)CrossRef Morash, V., Bai, O., Furlani, S., Lin, P., Hallett, M.: Classifying EEG signals preceding right hand, left hand, tongue, and right foot movements and motor imageries. Clin. Neurophysiol. 119(11), 2570–2578 (2008)CrossRef
29.
Zurück zum Zitat Ge, S., Wang, R., Yu, D.: Classification of four-class motor imagery employing single-channel electroencephalography. PLoS ONE 9(6), 1–7 (2014) Ge, S., Wang, R., Yu, D.: Classification of four-class motor imagery employing single-channel electroencephalography. PLoS ONE 9(6), 1–7 (2014)
30.
Zurück zum Zitat Gudiño-Mendoza, B., Sossa, H., Sanchez-Ante, G., Antelis, J.M.: Classification of motor states from brain rhythms using lattice neural networks. In: Martínez-Trinidad, J.F., Carrasco-Ochoa, J.A., Ayala-Ramírez, V., Olvera-López, J.A., Jiang, X. (eds.) MCPR 2016. LNCS, vol. 9703, pp. 303–312. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-39393-3_30CrossRef Gudiño-Mendoza, B., Sossa, H., Sanchez-Ante, G., Antelis, J.M.: Classification of motor states from brain rhythms using lattice neural networks. In: Martínez-Trinidad, J.F., Carrasco-Ochoa, J.A., Ayala-Ramírez, V., Olvera-López, J.A., Jiang, X. (eds.) MCPR 2016. LNCS, vol. 9703, pp. 303–312. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-39393-3_​30CrossRef
31.
Zurück zum Zitat Antelis, J.M., Gudiño-Mendoza, B., Falcón, L.E., Sanchez-Ante, G., Sossa, H.: Dendrite morphological neural networks for motor task recognition from electroencephalographic signals. Biomed. Signal Process. Control 44, 12–24 (2018)CrossRef Antelis, J.M., Gudiño-Mendoza, B., Falcón, L.E., Sanchez-Ante, G., Sossa, H.: Dendrite morphological neural networks for motor task recognition from electroencephalographic signals. Biomed. Signal Process. Control 44, 12–24 (2018)CrossRef
32.
Zurück zum Zitat Ojeda, L., et al.: Classification of hand movements from non-invasive brain signals using lattice neural networks with dendritic processing. In: Carrasco-Ochoa, J.A., Martínez-Trinidad, J.F., Sossa-Azuela, J.H., Olvera López, J.A., Famili, F. (eds.) MCPR 2015. LNCS, vol. 9116, pp. 23–32. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19264-2_3CrossRef Ojeda, L., et al.: Classification of hand movements from non-invasive brain signals using lattice neural networks with dendritic processing. In: Carrasco-Ochoa, J.A., Martínez-Trinidad, J.F., Sossa-Azuela, J.H., Olvera López, J.A., Famili, F. (eds.) MCPR 2015. LNCS, vol. 9116, pp. 23–32. Springer, Cham (2015). https://​doi.​org/​10.​1007/​978-3-319-19264-2_​3CrossRef
33.
Zurück zum Zitat Hinton, G., Deng, L., Yu, D., Dahl, G.E., Mohamed, A.R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T.N., Kingsbury, B.: Deep neural networks for acoustic modeling in speech recognition the shared views of four research groups. IEEE Sig. Process. Mag. 29(6), 82–97 (2012)CrossRef Hinton, G., Deng, L., Yu, D., Dahl, G.E., Mohamed, A.R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T.N., Kingsbury, B.: Deep neural networks for acoustic modeling in speech recognition the shared views of four research groups. IEEE Sig. Process. Mag. 29(6), 82–97 (2012)CrossRef
34.
Zurück zum Zitat Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, Montreal, Quebec, Canada, 8–13 December 2014, pp. 3104–3112 (2014) Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, Montreal, Quebec, Canada, 8–13 December 2014, pp. 3104–3112 (2014)
35.
Zurück zum Zitat Bojarski, M., Testa, D.D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L.D., Monfort, M., Muller, U., Zhang, J., Zhang, X., Zhao, J., Zieba, K.: End to end learning for self-driving cars. CoRR abs/1604.07316 (2016) Bojarski, M., Testa, D.D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L.D., Monfort, M., Muller, U., Zhang, J., Zhang, X., Zhao, J., Zieba, K.: End to end learning for self-driving cars. CoRR abs/1604.07316 (2016)
36.
Zurück zum Zitat Cecotti, H., Graeser, A.: Convolutional neural network with embedded Fourier transform for EEG classification. In: 2008 19th International Conference on Pattern Recognition, pp. 1–4, December 2008 Cecotti, H., Graeser, A.: Convolutional neural network with embedded Fourier transform for EEG classification. In: 2008 19th International Conference on Pattern Recognition, pp. 1–4, December 2008
37.
Zurück zum Zitat Cecotti, H., Graser, A.: Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 433–445 (2011)CrossRef Cecotti, H., Graser, A.: Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 433–445 (2011)CrossRef
38.
Zurück zum Zitat Jingwei, L., Yin, C., Weidong, Z.: Deep learning EEG response representation for brain computer interface. In: 2015 34th Chinese Control Conference (CCC), pp. 3518–3523, July 2015 Jingwei, L., Yin, C., Weidong, Z.: Deep learning EEG response representation for brain computer interface. In: 2015 34th Chinese Control Conference (CCC), pp. 3518–3523, July 2015
39.
Zurück zum Zitat Nurse, E., Mashford, B.S., Jimeno-Yepes, A., Kiral-Kornek, I., Harrer, S., Freestone, D.R.: Decoding EEG and LFP signals using deep learning: heading truenorth. In: Conference on Computing Frontiers, pp. 259–266. ACM (2016) Nurse, E., Mashford, B.S., Jimeno-Yepes, A., Kiral-Kornek, I., Harrer, S., Freestone, D.R.: Decoding EEG and LFP signals using deep learning: heading truenorth. In: Conference on Computing Frontiers, pp. 259–266. ACM (2016)
40.
Zurück zum Zitat Bashivan, P., Rish, I., Yeasin, M., Codella, N.: Learning representations from EEG with deep recurrent-convolutional neural networks. CoRR abs/1511.06448 (2015) Bashivan, P., Rish, I., Yeasin, M., Codella, N.: Learning representations from EEG with deep recurrent-convolutional neural networks. CoRR abs/1511.06448 (2015)
42.
Zurück zum Zitat Jirayucharoensak, S., Pan-ngum, S., Israsena, P.: EEG-based emotion recognition using deep learning network with principal component based covariate shift adaptation, 2014, Article ID 627892 (2014) Jirayucharoensak, S., Pan-ngum, S., Israsena, P.: EEG-based emotion recognition using deep learning network with principal component based covariate shift adaptation, 2014, Article ID 627892 (2014)
43.
Zurück zum Zitat Zheng, W.L., Zhu, J.Y., Peng, Y., Lu, B.L.: EEG-based emotion classification using deep belief networks. In: 2014 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6, July 2014 Zheng, W.L., Zhu, J.Y., Peng, Y., Lu, B.L.: EEG-based emotion classification using deep belief networks. In: 2014 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6, July 2014
44.
Zurück zum Zitat Stober, S., Cameron, D.J., Grahn, J.A.: Using convolutional neural networks to recognize rhythm stimuli from electroencephalography recordings. In: Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 27, pp. 1449–1457. Curran Associates, Inc., New York (2014) Stober, S., Cameron, D.J., Grahn, J.A.: Using convolutional neural networks to recognize rhythm stimuli from electroencephalography recordings. In: Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 27, pp. 1449–1457. Curran Associates, Inc., New York (2014)
45.
Zurück zum Zitat Tabar, Y.R., Halici, U.: A novel deep learning approach for classification of eeg motor imagery signals. J. Neural Eng. 14(1), 016003 (2017)CrossRef Tabar, Y.R., Halici, U.: A novel deep learning approach for classification of eeg motor imagery signals. J. Neural Eng. 14(1), 016003 (2017)CrossRef
Metadaten
Titel
Recognizing Motor Imagery Tasks Using Deep Multi-Layer Perceptrons
verfasst von
Fernando Arce
Erik Zamora
Gerardo Hernández
Javier M. Antelis
Humberto Sossa
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-96133-0_35