Skip to main content

2016 | OriginalPaper | Buchkapitel

Analysis of Similarity and Differences in Brain Activities Between Perception and Production of Facial Expressions Using EEG Data and the NeuCube Spiking Neural Network Architecture

verfasst von : Hideaki Kawano, Akinori Seo, Zohreh Gholami Doborjeh, Nikola Kasabov, Maryam Gholami Doborjeh

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper is a feasibility study of using the NeuCube spiking neural network (SNN) architecture for modeling EEG brain data related to perceiving versus mimicking facial expressions. It is demonstrated that the proposed model can be used to study the similarity and differences between corresponding brain activities as complex spatio-temporal patterns. Two SNN models are created for each of the 7 basic emotions for a group of Japanese subjects, one when subjects are perceiving an emotional face and another, when the same subjects are mimicking this emotion. The evolved connectivity in the two models are then subtracted to study the differences. Analysis of the models trained on the collected EEG data shows greatest similarity in sadness, and least similarity in happiness and fear, where differences in the T6 EEG channel area were observed. The study, being based on the well-known mirror neuron concept in the brain, is the first to analyze and visualize similarity and differences as evolved spatio-temporal patterns in a brain-like SNN model.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Gallese, V., Fadiga, L., Fogassi, L., Rizzolatti, G.: Action recognition in the premotor cortex. Brain 119, 593–609 (1996)CrossRef Gallese, V., Fadiga, L., Fogassi, L., Rizzolatti, G.: Action recognition in the premotor cortex. Brain 119, 593–609 (1996)CrossRef
2.
Zurück zum Zitat Iacoboni, M., Woods, R.P., Brass, M., Bekkering, H., Mazziotta, J.C., Rizzolatti, G.: Cortical mechanisms of human imitation. Science 286(5449), 2526–2528 (1999)CrossRef Iacoboni, M., Woods, R.P., Brass, M., Bekkering, H., Mazziotta, J.C., Rizzolatti, G.: Cortical mechanisms of human imitation. Science 286(5449), 2526–2528 (1999)CrossRef
3.
Zurück zum Zitat Binkofski, F., Buccino, G., Posse, S., Seitz, R.J., Rizzolatti, G., Freund, H.-J.: A fronto-parietal circuit for object manipulation in man: evidence from an fMRI-study. Eur. J. Neurosci. 11, 3276–3286 (1999)CrossRef Binkofski, F., Buccino, G., Posse, S., Seitz, R.J., Rizzolatti, G., Freund, H.-J.: A fronto-parietal circuit for object manipulation in man: evidence from an fMRI-study. Eur. J. Neurosci. 11, 3276–3286 (1999)CrossRef
4.
Zurück zum Zitat Kasabov, N.: NeuCube: a spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data. Neural Netw. 52, 62–76 (2014)CrossRef Kasabov, N.: NeuCube: a spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data. Neural Netw. 52, 62–76 (2014)CrossRef
5.
Zurück zum Zitat Tu, E., Kasabov, N., Yang, J.: Mapping temporal variables Into the NeuCube for improved pattern recognition, predictive modelling and understanding of stream data. IEEE Trans. Neural Netw. Learn. Syst, 1–13 (2016) Tu, E., Kasabov, N., Yang, J.: Mapping temporal variables Into the NeuCube for improved pattern recognition, predictive modelling and understanding of stream data. IEEE Trans. Neural Netw. Learn. Syst, 1–13 (2016)
6.
Zurück zum Zitat Kasabov, N., Scott, N., Tu, E., Marks, S., Sengupta, N., Capecci, E.: Evolving spatio-temporal data machines based on the NeuCube neuromorphic framework: design methodology and selected applications, Neural Netw. (2016, to appear) Kasabov, N., Scott, N., Tu, E., Marks, S., Sengupta, N., Capecci, E.: Evolving spatio-temporal data machines based on the NeuCube neuromorphic framework: design methodology and selected applications, Neural Netw. (2016, to appear)
7.
Zurück zum Zitat Doborjeh, M.G., Capecci, E., Kasabov, N.: Classification and segmentation of fMRI spatio-temporal brain data with a Neucube evolving spiking neural network model. In: IEEE SSCI, U.S.A, Orlando (2014) Doborjeh, M.G., Capecci, E., Kasabov, N.: Classification and segmentation of fMRI spatio-temporal brain data with a Neucube evolving spiking neural network model. In: IEEE SSCI, U.S.A, Orlando (2014)
8.
Zurück zum Zitat Doborjeh, M.G., Wang, G., Kasabov, N., Kydd, R., Russell, B.R.: A Neucube spiking neural network model for the study of dynamic brain activities during a GO/NO_GO task: a case study on using EEG data of healthy Vs addiction vs treated subjects. IEEE Trans. Biomed. Eng. (2016, to appear) Doborjeh, M.G., Wang, G., Kasabov, N., Kydd, R., Russell, B.R.: A Neucube spiking neural network model for the study of dynamic brain activities during a GO/NO_GO task: a case study on using EEG data of healthy Vs addiction vs treated subjects. IEEE Trans. Biomed. Eng. (2016, to appear)
9.
Zurück zum Zitat Maryam Gholami, D., Nikola, K.: Dynamic 3D clustering of spatio-temporal brain data in the NeuCube spiking neural network architecture on a case study of fMRI data. In: Neural Information Processing, Istanbul (2015) Maryam Gholami, D., Nikola, K.: Dynamic 3D clustering of spatio-temporal brain data in the NeuCube spiking neural network architecture on a case study of fMRI data. In: Neural Information Processing, Istanbul (2015)
10.
Zurück zum Zitat Song, S., Miller, K.D., Abbott, L.F.: Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neurosci. 3(9), 919–926 (2000)CrossRef Song, S., Miller, K.D., Abbott, L.F.: Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neurosci. 3(9), 919–926 (2000)CrossRef
11.
Zurück zum Zitat Kasabov, N., Dhoble, K., Nuntalid, N., Indiveri, G.: Dynamic evolving spiking neural networks for on-line spatio-and spectro-temporal pattern recognition. Neural Netw. 41, 188–201 (2013)CrossRef Kasabov, N., Dhoble, K., Nuntalid, N., Indiveri, G.: Dynamic evolving spiking neural networks for on-line spatio-and spectro-temporal pattern recognition. Neural Netw. 41, 188–201 (2013)CrossRef
12.
Zurück zum Zitat Matsumoto, D., Ekman, P.: Japanese, Caucasian facial expressions of emotion (JACFEE) [Slides]. Intercultural and Emotion Research Laboratory, Department of Psychology, San Francisco State University, San Francisco (1988) Matsumoto, D., Ekman, P.: Japanese, Caucasian facial expressions of emotion (JACFEE) [Slides]. Intercultural and Emotion Research Laboratory, Department of Psychology, San Francisco State University, San Francisco (1988)
13.
Zurück zum Zitat Talairach, J., Tournoux, P.: Co-planar Stereotaxic Atlas of the Human Brain. 3-Dimensional Proportional System: An Approach to Cerebral Imaging. Thieme Medical Publishers, New York (1988) Talairach, J., Tournoux, P.: Co-planar Stereotaxic Atlas of the Human Brain. 3-Dimensional Proportional System: An Approach to Cerebral Imaging. Thieme Medical Publishers, New York (1988)
14.
Zurück zum Zitat Koessler, L., Maillard, L., Benhadid, A., Vignal, J.P., Felblinger, J., Vespignani, H., Braun, M.: Automated cortical projection of EEG sensors: anatomical correlation via the international 10–10 system. Neuroimage 46(1), 64–72 (2009)CrossRef Koessler, L., Maillard, L., Benhadid, A., Vignal, J.P., Felblinger, J., Vespignani, H., Braun, M.: Automated cortical projection of EEG sensors: anatomical correlation via the international 10–10 system. Neuroimage 46(1), 64–72 (2009)CrossRef
15.
Zurück zum Zitat Alfano, K.M., Cimino, C.R.: Alteration of expected hemispheric asymmetries: valence and arousal effects in neuropsychological models of emotion. Brain Cogn. 66, 213–220 (2008)CrossRef Alfano, K.M., Cimino, C.R.: Alteration of expected hemispheric asymmetries: valence and arousal effects in neuropsychological models of emotion. Brain Cogn. 66, 213–220 (2008)CrossRef
Metadaten
Titel
Analysis of Similarity and Differences in Brain Activities Between Perception and Production of Facial Expressions Using EEG Data and the NeuCube Spiking Neural Network Architecture
verfasst von
Hideaki Kawano
Akinori Seo
Zohreh Gholami Doborjeh
Nikola Kasabov
Maryam Gholami Doborjeh
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46681-1_27