Skip to main content
Erschienen in: Neural Computing and Applications 12/2020

20.11.2018 | Soft Computing Techniques: Applications and Challenges

EEG data analysis with stacked differentiable neural computers

verfasst von: Yurui Ming, Danilo Pelusi, Chieh-Ning Fang, Mukesh Prasad, Yu-Kai Wang, Dongrui Wu, Chin-Teng Lin

Erschienen in: Neural Computing and Applications | Ausgabe 12/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Differentiable neural computer (DNC) has demonstrated remarkable capabilities in solving complex problems. In this paper, we propose to stack an enhanced version of differentiable neural computer together to extend its learning capabilities. Firstly, we give an intuitive interpretation of DNC to explain the architectural essence and demonstrate the stacking feasibility by contrasting it with the conventional recurrent neural network. Secondly, the architecture of stacked DNCs is proposed and modified for electroencephalogram (EEG) data analysis. We substitute the original Long Short-Term Memory network controller by a recurrent convolutional network controller and adjust the memory accessing structures for processing EEG topographic data. Thirdly, the practicability of our proposed model is verified by an open-sourced EEG dataset with the highest average accuracy achieved; then after fine-tuning the parameters, we show the minimal mean error obtained on a proprietary EEG dataset. Finally, by analyzing the behavioral characteristics of the trained stacked DNCs model, we highlight the suitableness and potential of utilizing stacked DNCs in EEG signal processing.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Graves A, Wayne G et al (2016) Hybrid computing using a neural network with dynamic external memory. Nature 538:471–476CrossRef Graves A, Wayne G et al (2016) Hybrid computing using a neural network with dynamic external memory. Nature 538:471–476CrossRef
2.
Zurück zum Zitat Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, CambridgeMATH Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, CambridgeMATH
3.
Zurück zum Zitat Lin C-T, Wu R-C, Jung T-P, Liang S-F, Huang T-Y (2005) Estimating driving performance based on EEG spectrum analysis. EURASIP J Appl Signal Process 19:3165–3174MATH Lin C-T, Wu R-C, Jung T-P, Liang S-F, Huang T-Y (2005) Estimating driving performance based on EEG spectrum analysis. EURASIP J Appl Signal Process 19:3165–3174MATH
5.
7.
Zurück zum Zitat Graves A, Mohamed A, Hinton G (2013) Speech recognition with deep recurrent neural networks. In: IEEE international conference on acoustics, speech and signal processing, pp 6645–6649 Graves A, Mohamed A, Hinton G (2013) Speech recognition with deep recurrent neural networks. In: IEEE international conference on acoustics, speech and signal processing, pp 6645–6649
8.
Zurück zum Zitat Gregor K, Danihelka I, Alex G, Rezende DJ, Wierstra D (2015) DRAW: a recurrent neural network for image generation. arXiv:1502.04623v2 Gregor K, Danihelka I, Alex G, Rezende DJ, Wierstra D (2015) DRAW: a recurrent neural network for image generation. arXiv:​1502.​04623v2
9.
Zurück zum Zitat Cho K, van Merrienboer B et al. (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. arXiv:1406.1078 Cho K, van Merrienboer B et al. (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. arXiv:​1406.​1078
11.
Zurück zum Zitat LeCun Y, Bengio Y, Hinton G (2015) Deep learning 521:436–444 LeCun Y, Bengio Y, Hinton G (2015) Deep learning 521:436–444
12.
Zurück zum Zitat Mizrahi EM (2014) Atlas of neonatal electroencephalography. Lippincott Williams & Wilkins, Philadelphia Mizrahi EM (2014) Atlas of neonatal electroencephalography. Lippincott Williams & Wilkins, Philadelphia
13.
Zurück zum Zitat Lawhern VJ, Solon AJ, Waytowich NR, Gordon SM, Hung CP, Lance BJ (2017) EEGNet: a compact convolutional network for EEG-based brain–computer interfaces. arXiv:1611.08024v2 Lawhern VJ, Solon AJ, Waytowich NR, Gordon SM, Hung CP, Lance BJ (2017) EEGNet: a compact convolutional network for EEG-based brain–computer interfaces. arXiv:​1611.​08024v2
14.
Zurück zum Zitat Konareva I (2005) Modifications of the EEG frequency pattern in humans related to a single neurofeedback session. Neurophysiology 37:388–395CrossRef Konareva I (2005) Modifications of the EEG frequency pattern in humans related to a single neurofeedback session. Neurophysiology 37:388–395CrossRef
15.
Zurück zum Zitat Roach BJ, Mathalon DH (2008) Event-related EEG time–frequency analysis: an overview of measures and an analysis of early gamma band phase locking in schizophrenia. Schizophr Bull 34:907–926CrossRef Roach BJ, Mathalon DH (2008) Event-related EEG time–frequency analysis: an overview of measures and an analysis of early gamma band phase locking in schizophrenia. Schizophr Bull 34:907–926CrossRef
17.
Zurück zum Zitat Britz J, Van De Ville D, Michel CM (2010) BOLD correlates of EEG topography reveal rapid resting-state network dynamics. NeuroImage 52:1162–1170CrossRef Britz J, Van De Ville D, Michel CM (2010) BOLD correlates of EEG topography reveal rapid resting-state network dynamics. NeuroImage 52:1162–1170CrossRef
18.
Zurück zum Zitat Bersagliere A, Pascual-Marqui RD, Tarokh L, Achermann P (2018) Mapping slow waves by EEG topography and source localization: effects of sleep deprivation. Brain Topol 31:257–269CrossRef Bersagliere A, Pascual-Marqui RD, Tarokh L, Achermann P (2018) Mapping slow waves by EEG topography and source localization: effects of sleep deprivation. Brain Topol 31:257–269CrossRef
19.
Zurück zum Zitat Bashivan P, Rish I, Yeasin M, Codella N (2016) Learning representations from EEG with deep recurrent-convolutional neural networks. In: International conference on learning representation (ICLR). arXiv:1511.06448v3 Bashivan P, Rish I, Yeasin M, Codella N (2016) Learning representations from EEG with deep recurrent-convolutional neural networks. In: International conference on learning representation (ICLR). arXiv:​1511.​06448v3
20.
Zurück zum Zitat Finn C, Goodfellow I, Levine S (2016) Unsupervised learning for physical interaction through video prediction. In: Neural information processing systems (NIPS). arXiv:1605.07157v4 Finn C, Goodfellow I, Levine S (2016) Unsupervised learning for physical interaction through video prediction. In: Neural information processing systems (NIPS). arXiv:​1605.​07157v4
21.
Zurück zum Zitat Chuang C-H, Ko L-W, Jung T-P, Lin C-T (2014) Kinesthesia in a sustained-attention driving task. NeuroImage 91:187–202CrossRef Chuang C-H, Ko L-W, Jung T-P, Lin C-T (2014) Kinesthesia in a sustained-attention driving task. NeuroImage 91:187–202CrossRef
23.
Zurück zum Zitat Bear MF, Connors BW, Paradiso MA (2016) Neuroscience: exploring the brain, 4th edn. Wolters Kluwer, Alphen aan den Rijn Bear MF, Connors BW, Paradiso MA (2016) Neuroscience: exploring the brain, 4th edn. Wolters Kluwer, Alphen aan den Rijn
24.
Zurück zum Zitat Bekhtereva V, Sander C, Forschack N, Olbrich S, Hegerl U, Müller MM (2014) Effects of EEG-vigilance regulation patterns on early perceptual processes in human visual cortex. Clin Neurophysiol 125:98–107CrossRef Bekhtereva V, Sander C, Forschack N, Olbrich S, Hegerl U, Müller MM (2014) Effects of EEG-vigilance regulation patterns on early perceptual processes in human visual cortex. Clin Neurophysiol 125:98–107CrossRef
25.
Zurück zum Zitat Foucher JR, Otzenberger H, Gounot D (2004) Where arousal meets attention: a simultaneous fMRI and EEG recording study. Neuroimage 22:688–697CrossRef Foucher JR, Otzenberger H, Gounot D (2004) Where arousal meets attention: a simultaneous fMRI and EEG recording study. Neuroimage 22:688–697CrossRef
26.
Zurück zum Zitat Olbrich S, Mulert C et al (2009) EEG-vigilance and BOLD effect during simultaneous EEG/fMRI measurement. NeuroImage 45:319–332CrossRef Olbrich S, Mulert C et al (2009) EEG-vigilance and BOLD effect during simultaneous EEG/fMRI measurement. NeuroImage 45:319–332CrossRef
27.
Zurück zum Zitat Kim J-H, Kim D-W, Im C-H (2017) Brain areas responsible for vigilance: an EEG source imaging study. Brain Topogr 30:343–351CrossRef Kim J-H, Kim D-W, Im C-H (2017) Brain areas responsible for vigilance: an EEG source imaging study. Brain Topogr 30:343–351CrossRef
Metadaten
Titel
EEG data analysis with stacked differentiable neural computers
verfasst von
Yurui Ming
Danilo Pelusi
Chieh-Ning Fang
Mukesh Prasad
Yu-Kai Wang
Dongrui Wu
Chin-Teng Lin
Publikationsdatum
20.11.2018
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 12/2020
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-018-3879-1

Weitere Artikel der Ausgabe 12/2020

Neural Computing and Applications 12/2020 Zur Ausgabe

Premium Partner