Top

Cognitive Neurodynamics

Published in:

01-08-2015 | Research Article

EEG gamma-band activity during audiovisual speech comprehension in different noise environments

Authors: Yanfei Lin, Baolin Liu, Zhiwen Liu, Xiaorong Gao

Published in: Cognitive Neurodynamics | Issue 4/2015

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The presence of cross-modal stochastic resonance in different noise environments has been proved in previous behavioral and event-related potential studies, while it was still unclear whether the gamma-band oscillation study was another evidence of cross-modal stochastic resonance. The multisensory gain of gamma-band activity between the audiovisual (AV) and auditory-only conditions in different noise environments was analyzed. Videos of face motion articulating words concordant with different levels of pink noise were used as stimuli. Signal-to-noise ratios (SNRs) of 0, −4, −8, −12 and −16 dB were selected to measure the speech recognition accuracy and EEG activity for 20 healthy subjects. The power and phase of EEG gamma-band oscillations increased in a time window of 50–90 ms. The multisensory gains of evoked and total activity, as well as phase-locking factor, were greatest at the −12 dB SNR, which were consistent with the behavioral result. The multisensory gain of gamma-band activity showed an inverted U-shaped curve as a function of SNR. This finding confirmed the presence of cross-modal stochastic resonance. In addition, there was a significant correlation between evoked activity and phase-locking factor of gamma-band at five different SNRs. Gamma-band oscillation was believed to play a role in the rapid processing and information linkage strengthening of AV modalities in the early stage of cognitive processes.

previous article Transition dynamics of EEG-based network microstates during mental arithmetic and resting wakefulness reflects task-related modulations and developmental changes

next article The electrocortical modulation effects of different emotion regulation strategies

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Basşar-Eroglu C, Strüber D, Schürmann M, Stadler M, Basşar E (1996) Gamma band responses in the brain: a short review of psychophysiological correlates and functional significance. Int J Psychophysiol 24:101–112CrossRef

Bastiaansen M, Hagoort P (2006) Oscillatory neuronal dynamics during language comprehension. Prog Brain Res 159:179–196PubMedCrossRef

Bauer M, Oostenveld R, Peeters M, Fries P (2006) Tactile spatial attention enhances gamma-band activity in somatosensory cortex and reduces low-frequency activity in parieto-occipital areas. J Neurosci 26:490–501PubMedCrossRef

Bishop CW, Miller LM (2009) A multisensory cortical network for understanding speech in noise. J Cogn Neurosci 21:1790–1805PubMedCentralPubMedCrossRef

Busch NA, Groh-Bordin C, Zimmer HD, Herrmann CS (2008) Modes of memory: early electrophysiological markers of repetition suppression and recognition enhancement predict behavioral performance. Psychophysiology 45:25–35PubMed

Buzsáki G, Draguhn A (2004) Neuronal oscillations in cortical networks. Science 304:1926–1929PubMedCrossRef

Callan DE, Callan AM, Kroos C, Vatikiotis-Bateson E (2001) Multimodal contribution to speech perception revealed by independent component analysis: a single-sweep EEG case study. Cogn Brain Res 10:349–353CrossRef

Callan DE, Jones JA, Munhall K, Callan AM, Kroos C, Vatikiotis-Bateson E (2003) Neural processes underlying perceptual enhancement by visual speech gestures. Neuro Report 14:2213–2218

Demiralp T, Bayraktaroglu Z, Lenz D, Junge S, Busch N, Maess B, Ergen M, Herrmann C (2007) Gamma amplitudes are coupled to theta phase in human EEG during visual perception. Int J Psychophysiol 64:24–30PubMedCrossRef

Duch W, Dobosz K (2011) Visualization for understanding of neurodynamical systems. Cogn Neurodyn 5:145–160PubMedCentralPubMedCrossRef

Engel AK, Fries P, Singer W (2001) Dynamic predictions: oscillations and synchrony in top-down processing. Nat Rev Neurosci 2:704–716PubMedCrossRef

Fries P, Nikolić D, Singer W (2007) The gamma cycle. Trends Neurosci 30:309–316PubMedCrossRef

Fründ I, Schadow J, Busch NA, Körner U, Herrmann CS (2007a) Evoked gamma oscillations in human scalp EEG are test-retest reliable. Clin Neurophysiol 118:221–227PubMedCrossRef

Fründ I, Busch NA, Körner U, Schadow J, Herrmann CS (2007b) EEG oscillations in the gamma and alpha range respond differently to spatial frequency. Vision Res 47:2086–2098PubMedCrossRef

Herrmann CS, Munk MH, Engel AK (2004) Cognitive functions of gamma-band activity: memory match and utilization. Trends Cogn Sci 8:347–355PubMedCrossRef

Herrmann CS, Fründ I, Lenz D (2010) Human gamma-band activity: a review on cognitive and behavioral correlates and network models. Neurosci Biobehav Rev 34:981–992PubMedCrossRef

Jensen O, Kaiser J, Lachaux JP (2007) Human gamma-frequency oscillations associated with attention and memory. Trends Neurosci 30:317–324PubMedCrossRef

Kaiser J, Lutzenberger W (2005) Cortical oscillatory activity and the dynamics of auditory memory processing. Rev Neurosci 16:239–254PubMedCrossRef

Kaiser J, Heidegger T, Wibral M, Altmann CF, Lutzenberger W (2008) Distinct gamma-band components reflect the short-term memory maintenance of different sound lateralization angles. Cereb Cortex 18:2286–2295PubMedCentralPubMedCrossRef

Kayser C, Petkov CI, Logothetis NK (2008) Visual modulation of neurons in auditory cortex. Cereb Cortex 18:1560–1574PubMedCrossRef

Kazantsev VB, Nekorkin VI, Makarenko VI, Llinás R (2004) Self-referential phase reset based on inferior olive oscillator dynamics. Proc Natl Acad Sci USA 101:18183–18188PubMedCentralPubMedCrossRef

Krain AL, Castellanos FX (2006) Brain development and ADHD. Clin Psychol Rev 26:433–444PubMedCrossRef

Lin Y, Wu W, Wu C, Liu B, Gao X (2013) Extraction of mismatch negativity using a resampling-based spatial filtering method. J Neural Eng 10:026015PubMedCrossRef

Liu BL, Lin YF, Gao XR, Dang JW (2013) Correlation between audio-visual enhancement of speech in different noise environments and SNR: a combined behavioral and electrophysiological study. Neuroscience 247:145–151PubMedCrossRef

Lugo JE, Doti R, Faubert J (2008a) Ubiquitous crossmodal stochastic resonance in humans: auditory noise facilitates tactile, visual and proprioceptive sensations. PLoS ONE 3:e2860PubMedCentralPubMedCrossRef

Lugo JE, Doti R, Wittich W, Faubert J (2008b) Multisensory integration central processing modifies peripheral systems. Psychol Sci 19:989–997PubMedCrossRef

MacLeod A, Summerfield Q (1987) Quantifying the contribution of vision to speech perception in noise. Br J Audiol 21:131–141PubMedCrossRef

Manjarrez E, Mendez I, Martinez L, Flores A, Mirasso CR (2007) Effects of auditory noise on the psychophysical detection of visual signals: cross-modal stochastic resonance. Neurosci Lett 415:231–236PubMedCrossRef

Matsuura H, Tateno K, Aou SJ (2008) Dynamical properties of the two-process model for sleep-wake cycles in infantile autism. Cogn Neurodyn 2:221–228PubMedCentralPubMedCrossRef

Mirman D, Irwin JR, Stephen DG (2012) Eye movement dynamics and cognitive self-organization in typical and atypical development. Cogn Neurodyn 6:61–73PubMedCentralPubMedCrossRef

Murias M, Webb SJ, Greenson J, Dawson G (2007) Resting state cortical connectivity reflected in EEG coherence in individuals with autism. Biol Psychiatry 62:270–273PubMedCentralPubMedCrossRef

Naue N, Rach S, Strüber D, Huster RJ, Zaehle T, Körner U, Herrmann CS (2011) Auditory event-related response in visual cortex modulates subsequent visual responses in humans. J Neurosci 31:7729–7736PubMedCrossRef

Nozaki D, Mar D, Grigg P, Collins J (1999) Effects of colored noise on stochastic resonance in sensory neurons. Phys Rev Lett 82:2402–2405CrossRef

Ohl FW, Scheich H (2005) Learning-induced plasticity in animal and human auditory cortex. Curr Opin Neurobiol 15:470–477PubMedCrossRef

Paik S, Kumar T, Glaser D (2009) Spontaneous local gamma oscillation selectively enhances neural network responsiveness. PLoS Comput Biol 5:e1000342PubMedCentralPubMedCrossRef

Ramos-Estebanez C, Merabet LB, Machii K, Fregni F, Thut G, Wagner TA, Romei V, Amedi A, Pascual-Leone A (2007) Visual phosphene perception modulated by subthreshold crossmodal sensory stimulation. J Neurosci 27:4178–4181PubMedCrossRef

Ross LA, Saint-Amour D, Leavitt VM, Javitt DC, Foxe JJ (2007a) Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb Cortex 17:1147–1153PubMedCrossRef

Ross LA, Saint-Amour D, Leavitt VM, Molholm S, Javitt DC, Foxe JJ (2007b) Impaired multisensory processing in schizophrenia: deficits in the visual enhancement of speech comprehension under noisy environmental conditions. Schizophr Res 97:173–183PubMedCrossRef

Schneider TR, Debener S, Oostenveld R, Engel AK (2008) Enhanced EEG gamma-band activity reflects multisensory semantic matching in visual-to-auditory object priming. NeuroImage 42:1244–1254PubMedCrossRef

Senkowski D, Talsma D, Grigutsch M, Herrmann CS, Woldorff MG (2007) Good times for multisensory integration: effects of the precision of temporal synchrony as revealed by gamma-band oscillations. Neuropsychologia 45:561–571PubMedCrossRef

Senkowski D, Schneider TR, Foxe JJ, Engel AK (2008) Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci 31:401–409PubMedCrossRef

Spencer KM, Nestor PG, Niznikiewicz MA, Salisbury DF, Shenton ME, McCarley RW (2003) Abnormal neural synchrony in schizophrenia. J Neurosci 23:7407–7411PubMedCentralPubMed

Spencer KM, Nestor PG, Perlmutter R, Niznikiewicz MA, Klump MC, Frumin M, Shenton ME, McCarley RW (2004) Neural synchrony indexes disordered perception and cognition in schizophrenia. Proc Natl Acad Sci USA 101:17288–17293PubMedCentralPubMedCrossRef

Stevenson RA, Bushmakin M, Kim S, Wallace MT, Puce A, James TW (2012) Inverse effectiveness and multisensory interactions in visual event-related potentials with audiovisual speech. Brain Topogr 25:308–326PubMedCentralPubMedCrossRef

Sumby WH, Pollack I (1954) Visual contribution to speech intelligibility in noise. J Acoust Soc Am 26:212–215CrossRef

Tallon-Baudry C, Bertrand O, Delpuech C, Pernier J (1996) Stimulus specificity of phase-locked and non-phase-locked 40 Hz visual responses in human. J Neurosci 16:4240–4249PubMed

Tallon-Baudry C, Bertrand O, Peronnet F, Pernier J (1998) Induced gamma-band activity during the delay of a visual short-term memory task in humans. J Neurosci 18:4244–4254PubMed

Trenado C, Mikulic A, Manjarrez E, Mendez-Balbuena I, Schulte-Monting J, Huethe F, Hepp-Reymond MC, Kristeva R (2014) Broad-band Gaussian noise is most effective in improving motor performance and is most pleasant. Front Hum Neurosci 8:22PubMedCentralPubMed

Wespatat V, Tennigkeit F, Singer W (2004) Phase sensitivity of synaptic modifications in oscillating cells of rat visual cortex. J Neurosci 24:9067–9075PubMedCrossRef

Winneke AH, Phillips NA (2011) Does audiovisual speech offer a fountain of youth for old ears? An event-related brain potential study of age differences in audiovisual speech perception. Psychol Aging 26:427–438PubMedCrossRef

Wyart V, Tallon-Baudry C (2008) Neutral dissociation between visual awareness and spatial attention. J Neurosci 28:2667–2679PubMedCrossRef

Yuval-Greenberg S, Deouell Y (2007) What you see is not (always) what you hear: induced gamma band responses reflect cross-modal interactions in familiar object recognition. J Neurosci 27:1090–1096PubMedCrossRef

Title: EEG gamma-band activity during audiovisual speech comprehension in different noise environments
Authors: Yanfei Lin
Baolin Liu
Zhiwen Liu
Xiaorong Gao
Publication date: 01-08-2015
Publisher: Springer Netherlands
Published in: Cognitive Neurodynamics / Issue 4/2015
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI: https://doi.org/10.1007/s11571-015-9333-5

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 4/2015

Frequency-domain order parameters for the burst and spike synchronization transitions of bursting neurons

The electrocortical modulation effects of different emotion regulation strategies

The necessity of connection structures in neural models of variable binding

Transition dynamics of EEG-based network microstates during mental arithmetic and resting wakefulness reflects task-related modulations and developmental changes

Exponential synchronization for fuzzy cellular neural networks with time-varying delays and nonlinear impulsive effects

Sufficient and necessary conditions for Lyapunov stability of genetic networks with SUM regulatory logic