Skip to main content
Erschienen in: Cognitive Neurodynamics 4/2013

01.08.2013 | Research Article

Coherent activity between auditory and visual modalities during the induction of peacefulness

verfasst von: Chia-Yen Yang, Ching-Po Lin

Erschienen in: Cognitive Neurodynamics | Ausgabe 4/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multisensory integration involves combining information from different senses to create a perception. The diverse characteristics of different sensory systems make it interesting to determine how cooperation and competition contribute to emotional experiences. Therefore, the aim of this study were to estimate the bias from the match attributes of the auditory and visual modalities and to depict specific brain activity frequency (theta, alpha, beta, and gamma) patterns related to a peaceful mood by using magnetoencephalography. The present study provides evidence of auditory domination in perceptual bias during multimodality processing of peaceful consciousness. Coherence analysis suggested that the theta oscillations are a transmitter of emotion signals, with the left and right brains being active in peaceful and fearful moods, respectively. Notably, hemispheric lateralization was also apparent in the alpha and beta oscillations, which might govern simple or pure information (e.g. from single modality) in the right brain but complex or mixed information (e.g. from multiple modalities) in the left brain.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Adachi Y, Shimogawara M, Higuchi M, Haruta Y, Ochiai M (2001) Reduction of non-periodic environmental magnetic noise in MEG measurement by continuously adjusted least squares method. IEEE Trans Appl Supercon 11:669–672CrossRef Adachi Y, Shimogawara M, Higuchi M, Haruta Y, Ochiai M (2001) Reduction of non-periodic environmental magnetic noise in MEG measurement by continuously adjusted least squares method. IEEE Trans Appl Supercon 11:669–672CrossRef
Zurück zum Zitat Baumgartner T, Esslen M, Jancke L (2006) From emotion perception to emotion experience: emotions evoked by pictures and classical music. Int J Psychophysiol 60:34–43PubMedCrossRef Baumgartner T, Esslen M, Jancke L (2006) From emotion perception to emotion experience: emotions evoked by pictures and classical music. Int J Psychophysiol 60:34–43PubMedCrossRef
Zurück zum Zitat Campanella S, Belin P (2007) Integrating face and voice in person perception. Trends Cogn Sci 11:535–543PubMedCrossRef Campanella S, Belin P (2007) Integrating face and voice in person perception. Trends Cogn Sci 11:535–543PubMedCrossRef
Zurück zum Zitat Chen YH, Edgar JC, Holroyd T, Dammers J, Thonnessen H, Roberts TP, Mathiak K (2010) Neuromagnetic oscillations to emotional faces and prosody. Eur J Neurosci 31:1818–1827PubMedCrossRef Chen YH, Edgar JC, Holroyd T, Dammers J, Thonnessen H, Roberts TP, Mathiak K (2010) Neuromagnetic oscillations to emotional faces and prosody. Eur J Neurosci 31:1818–1827PubMedCrossRef
Zurück zum Zitat Collignon O, Girard S, Gosselin F, Roy S, Saint-Amour D, Lassonde M, Lepore F (2008) Audio-visual integration of emotion expression. Brain Res 1242:126–135PubMedCrossRef Collignon O, Girard S, Gosselin F, Roy S, Saint-Amour D, Lassonde M, Lepore F (2008) Audio-visual integration of emotion expression. Brain Res 1242:126–135PubMedCrossRef
Zurück zum Zitat Doehrmann O, Weigelt S, Altmann CF, Kaiser J, Naumer MJ (2010) Audiovisual functional magnetic resonance imaging adaptation reveals multisensory integration effects in object-related sensory cortices. J Neurosci 30:3370–3379PubMedCrossRef Doehrmann O, Weigelt S, Altmann CF, Kaiser J, Naumer MJ (2010) Audiovisual functional magnetic resonance imaging adaptation reveals multisensory integration effects in object-related sensory cortices. J Neurosci 30:3370–3379PubMedCrossRef
Zurück zum Zitat Dolan RJ, Morris JS, de Gelder B (2001) Crossmodal binding of fear in voice and face. Proc Natl Acad Sci USA 98:10006–10010PubMedCrossRef Dolan RJ, Morris JS, de Gelder B (2001) Crossmodal binding of fear in voice and face. Proc Natl Acad Sci USA 98:10006–10010PubMedCrossRef
Zurück zum Zitat Esposito A (2009) The perceptual and cognitive role of visual and auditory channels in conveying emotional information. Cognit Comput 1:268–278CrossRef Esposito A (2009) The perceptual and cognitive role of visual and auditory channels in conveying emotional information. Cognit Comput 1:268–278CrossRef
Zurück zum Zitat Fenko A, Schifferstein HN, Hekkert P (2010) Shifts in sensory dominance between various stages of user-product interactions. Appl Ergon 41:34–40PubMedCrossRef Fenko A, Schifferstein HN, Hekkert P (2010) Shifts in sensory dominance between various stages of user-product interactions. Appl Ergon 41:34–40PubMedCrossRef
Zurück zum Zitat Fort A, Delpuech C, Pernier J, Giard MH (2002) Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans. Cereb Cortex 12:1031–1039PubMedCrossRef Fort A, Delpuech C, Pernier J, Giard MH (2002) Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans. Cereb Cortex 12:1031–1039PubMedCrossRef
Zurück zum Zitat Hyvärinen A, Särelä J, Vigário R (1999) Spikes and bumps: artefacts generated by independent component analysis with insufficient sample size. In: Proceedings of international workshop on independent component analysis and signal separation (ICA’99), pp 425–429 Hyvärinen A, Särelä J, Vigário R (1999) Spikes and bumps: artefacts generated by independent component analysis with insufficient sample size. In: Proceedings of international workshop on independent component analysis and signal separation (ICA’99), pp 425–429
Zurück zum Zitat Koelewijn T, Bronkhorst A, Theeuwes J (2010) Attention and the multiple stages of multisensory integration: a review of audiovisual studies. Acta Psychol 134:372–384CrossRef Koelewijn T, Bronkhorst A, Theeuwes J (2010) Attention and the multiple stages of multisensory integration: a review of audiovisual studies. Acta Psychol 134:372–384CrossRef
Zurück zum Zitat Latinus M, VanRullen R, Taylor MJ (2010) Top-down and bottom-up modulation in processing bimodal face/voice stimuli. BMC Neurosci 11:36PubMedCrossRef Latinus M, VanRullen R, Taylor MJ (2010) Top-down and bottom-up modulation in processing bimodal face/voice stimuli. BMC Neurosci 11:36PubMedCrossRef
Zurück zum Zitat Logeswaran N, Bhattacharya J (2009) Crossmodal transfer of emotion by music. Neurosci Lett 455:129–133PubMedCrossRef Logeswaran N, Bhattacharya J (2009) Crossmodal transfer of emotion by music. Neurosci Lett 455:129–133PubMedCrossRef
Zurück zum Zitat Luo H, Liu Z, Poeppel D (2010) Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation. PLoS Biol 8:e1000445PubMedCrossRef Luo H, Liu Z, Poeppel D (2010) Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation. PLoS Biol 8:e1000445PubMedCrossRef
Zurück zum Zitat Massaro DW, Egan PB (1996) Perceiving affect from the voice and the face. Psychon Bull Rev 3:215–221CrossRef Massaro DW, Egan PB (1996) Perceiving affect from the voice and the face. Psychon Bull Rev 3:215–221CrossRef
Zurück zum Zitat Mishra J, Martinez A, Sejnowski TJ, Hillyard SA (2007) Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J Neurosci 27:4120–4131PubMedCrossRef Mishra J, Martinez A, Sejnowski TJ, Hillyard SA (2007) Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J Neurosci 27:4120–4131PubMedCrossRef
Zurück zum Zitat Most T, Michaelis H (2012) Auditory, Visual, and auditory-visual perception of emotions by young children with hearing loss vs. children with normal hearing. J Speech Lang Hear Res. doi:10.1044/1092-4388(2011/11-0060) Most T, Michaelis H (2012) Auditory, Visual, and auditory-visual perception of emotions by young children with hearing loss vs. children with normal hearing. J Speech Lang Hear Res. doi:10.​1044/​1092-4388(2011/​11-0060)
Zurück zum Zitat Pelli DG (1997) The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10:437–442PubMedCrossRef Pelli DG (1997) The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10:437–442PubMedCrossRef
Zurück zum Zitat Pourtois G, Debatisse D, Despland PA, de Gelder B (2002) Facial expressions modulate the time course of long latency auditory brain potentials. Brain Res Cogn Brain Res 14:99–105PubMedCrossRef Pourtois G, Debatisse D, Despland PA, de Gelder B (2002) Facial expressions modulate the time course of long latency auditory brain potentials. Brain Res Cogn Brain Res 14:99–105PubMedCrossRef
Zurück zum Zitat Pourtois G, de Gelder B, Bol A, Crommelinck M (2005) Perception of facial expressions and voices and of their combination in the human brain. Cortex 41:49–59PubMedCrossRef Pourtois G, de Gelder B, Bol A, Crommelinck M (2005) Perception of facial expressions and voices and of their combination in the human brain. Cortex 41:49–59PubMedCrossRef
Zurück zum Zitat Schifferstein HNJ, Otten JJ, Thoolen F, Hekkert P (2010) The experimental assessment of sensory dominance in a product development context. J Design Res 8:119–144CrossRef Schifferstein HNJ, Otten JJ, Thoolen F, Hekkert P (2010) The experimental assessment of sensory dominance in a product development context. J Design Res 8:119–144CrossRef
Zurück zum Zitat Senkowski D, Schneider TR, Tandler F, Engel AK (2009) Gamma-band activity reflects multisensory matching in working memory. Exp Brain Res 198:363–372PubMedCrossRef Senkowski D, Schneider TR, Tandler F, Engel AK (2009) Gamma-band activity reflects multisensory matching in working memory. Exp Brain Res 198:363–372PubMedCrossRef
Zurück zum Zitat Stekelenburg JJ, Vroomen J (2009) Neural correlates of audiovisual motion capture. Exp Brain Res 198:383–390PubMedCrossRef Stekelenburg JJ, Vroomen J (2009) Neural correlates of audiovisual motion capture. Exp Brain Res 198:383–390PubMedCrossRef
Zurück zum Zitat Tanaka E, Kida T, Inui K, Kakigi R (2009) Change-driven cortical activation in multisensory environments: an MEG study. Neuroimage 48:464–474PubMedCrossRef Tanaka E, Kida T, Inui K, Kakigi R (2009) Change-driven cortical activation in multisensory environments: an MEG study. Neuroimage 48:464–474PubMedCrossRef
Zurück zum Zitat Wu L, Eichele T, Calhoun VD (2010) Reactivity of hemodynamic responses and functional connectivity to different states of alpha synchrony: a concurrent EEG-fMRI study. Neuroimage 52:1252–1260PubMedCrossRef Wu L, Eichele T, Calhoun VD (2010) Reactivity of hemodynamic responses and functional connectivity to different states of alpha synchrony: a concurrent EEG-fMRI study. Neuroimage 52:1252–1260PubMedCrossRef
Zurück zum Zitat Yang CY, Hsieh JC, Chang Y (2008) Foveal evoked magneto-encephalography features related to parvocellular pathway. Vis Neurosci 25:179–185PubMedCrossRef Yang CY, Hsieh JC, Chang Y (2008) Foveal evoked magneto-encephalography features related to parvocellular pathway. Vis Neurosci 25:179–185PubMedCrossRef
Zurück zum Zitat Zhao H, Chen ACN (2009) Both happy and sad melodies modulate tonic human heat pain. J Pain 10:953–960PubMedCrossRef Zhao H, Chen ACN (2009) Both happy and sad melodies modulate tonic human heat pain. J Pain 10:953–960PubMedCrossRef
Metadaten
Titel
Coherent activity between auditory and visual modalities during the induction of peacefulness
verfasst von
Chia-Yen Yang
Ching-Po Lin
Publikationsdatum
01.08.2013
Verlag
Springer Netherlands
Erschienen in
Cognitive Neurodynamics / Ausgabe 4/2013
Print ISSN: 1871-4080
Elektronische ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-012-9234-9

Weitere Artikel der Ausgabe 4/2013

Cognitive Neurodynamics 4/2013 Zur Ausgabe

Neuer Inhalt