Skip to main content
Erschienen in: Cognitive Neurodynamics 5/2012

01.10.2012 | Research Article

Dynamic characteristics of multisensory facilitation and inhibition

verfasst von: W. Y. Wang, L. Hu, E. Valentini, X. B. Xie, H. Y. Cui, Y. Hu

Erschienen in: Cognitive Neurodynamics | Ausgabe 5/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multimodal integration, which mainly refers to multisensory facilitation and multisensory inhibition, is the process of merging multisensory information in the human brain. However, the neural mechanisms underlying the dynamic characteristics of multimodal integration are not fully understood. The objective of this study is to investigate the basic mechanisms of multimodal integration by assessing the intermodal influences of vision, audition, and somatosensory sensations (the influence of multisensory background events to the target event). We used a timed target detection task, and measured both behavioral and electroencephalographic responses to visual target events (green solid circle), auditory target events (2 kHz pure tone) and somatosensory target events (1.5 ± 0.1 mA square wave pulse) from 20 normal participants. There were significant differences in both behavior performance and ERP components when comparing the unimodal target stimuli with multimodal (bimodal and trimodal) target stimuli for all target groups. Significant correlation among reaction time and P3 latency was observed across all target conditions. The perceptual processing of auditory target events (A) was inhibited by the background events, while the perceptual processing of somatosensory target events (S) was facilitated by the background events. In contrast, the perceptual processing of visual target events (V) remained impervious to multisensory background events.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Arabzadeh E, Clifford CW, Harris JA (2008) Vision merges with touch in a purely tactile discrimination. Psychol Sci 19(7):635–641PubMedCrossRef Arabzadeh E, Clifford CW, Harris JA (2008) Vision merges with touch in a purely tactile discrimination. Psychol Sci 19(7):635–641PubMedCrossRef
Zurück zum Zitat Beim Graben P, Gerth S, Vasishth S (2008) Towards dynamical system models of language-related brain potentials. Cogn Neurodyn 2(3):229–255 Beim Graben P, Gerth S, Vasishth S (2008) Towards dynamical system models of language-related brain potentials. Cogn Neurodyn 2(3):229–255
Zurück zum Zitat Bidet-Caulet A, Mikyska C, Knight RT (2010) Load effects in auditory selective attention: evidence for distinct facilitation and inhibition mechanisms. Neuroimage 50(1):277–284PubMedCrossRef Bidet-Caulet A, Mikyska C, Knight RT (2010) Load effects in auditory selective attention: evidence for distinct facilitation and inhibition mechanisms. Neuroimage 50(1):277–284PubMedCrossRef
Zurück zum Zitat Bresciani JP, Dammeier F, Ernst MO (2008) Tri-modal integration of visual, tactile and auditory signals for the perception of sequences of events. Brain Res Bull 75(6):753–760PubMedCrossRef Bresciani JP, Dammeier F, Ernst MO (2008) Tri-modal integration of visual, tactile and auditory signals for the perception of sequences of events. Brain Res Bull 75(6):753–760PubMedCrossRef
Zurück zum Zitat Chen YC, Yeh SL (2009) Catch the moment: multisensory enhancement of rapid visual events by sound. Exp Brain Res 198(2–3):209–219PubMedCrossRef Chen YC, Yeh SL (2009) Catch the moment: multisensory enhancement of rapid visual events by sound. Exp Brain Res 198(2–3):209–219PubMedCrossRef
Zurück zum Zitat Colavita FB (1974) Human sensory dominance. Percept Psychophys 16(2):409–412CrossRef Colavita FB (1974) Human sensory dominance. Percept Psychophys 16(2):409–412CrossRef
Zurück zum Zitat Desimone R, Duncan J (1995) Neural mechanisms of selective visual attention. Annu Rev Neurosci 18:193–222PubMedCrossRef Desimone R, Duncan J (1995) Neural mechanisms of selective visual attention. Annu Rev Neurosci 18:193–222PubMedCrossRef
Zurück zum Zitat Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments. Neuron 57(1):11–23PubMedCrossRef Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments. Neuron 57(1):11–23PubMedCrossRef
Zurück zum Zitat Driver J, Spence C (1998) Cross-modal links in spatial attention. Philos Trans R Soc Lond B Biol Sci 353(1373):1319–1331PubMedCrossRef Driver J, Spence C (1998) Cross-modal links in spatial attention. Philos Trans R Soc Lond B Biol Sci 353(1373):1319–1331PubMedCrossRef
Zurück zum Zitat Engel AK, Fries P, Singer W (2001) Dynamic predictions: oscillations and synchrony in top-down processing. Nat Rev Neurosci 2(10):704–716PubMedCrossRef Engel AK, Fries P, Singer W (2001) Dynamic predictions: oscillations and synchrony in top-down processing. Nat Rev Neurosci 2(10):704–716PubMedCrossRef
Zurück zum Zitat Fallah M, Stoner GR, Reynolds JH (2007) Stimulus-specific competitive selection in macaque extrastriate visual area V4. P Natl Acad Sci USA 104(10):4165–4169CrossRef Fallah M, Stoner GR, Reynolds JH (2007) Stimulus-specific competitive selection in macaque extrastriate visual area V4. P Natl Acad Sci USA 104(10):4165–4169CrossRef
Zurück zum Zitat Feng T, Qiu Y, Zhu Y, Tong S (2008) Attention rivalry under irrelevant audiovisual stimulation. Neurosci Lett 438(1):6–9PubMedCrossRef Feng T, Qiu Y, Zhu Y, Tong S (2008) Attention rivalry under irrelevant audiovisual stimulation. Neurosci Lett 438(1):6–9PubMedCrossRef
Zurück zum Zitat Guntekin B, Basar E (2010) A new interpretation of P300 responses upon analysis of coherences. Cogn Neurodyn 4(2):107–118PubMedCrossRef Guntekin B, Basar E (2010) A new interpretation of P300 responses upon analysis of coherences. Cogn Neurodyn 4(2):107–118PubMedCrossRef
Zurück zum Zitat Han JH, Kushner SA, Yiu AP, Cole CJ, Matynia A, Brown RA, Neve RL, Guzowski JF, Silva AJ, Josselyn SA (2007) Neuronal competition and selection during memory formation. Science 316(5823):457–460PubMedCrossRef Han JH, Kushner SA, Yiu AP, Cole CJ, Matynia A, Brown RA, Neve RL, Guzowski JF, Silva AJ, Josselyn SA (2007) Neuronal competition and selection during memory formation. Science 316(5823):457–460PubMedCrossRef
Zurück zum Zitat Hartcher-O’Brien J, Gallace A, Krings B, Koppen C, Spence C (2008) When vision ‘extinguishes’ touch in neurologically-normal people: extending the Colavita visual dominance effect. Exp Brain Res 186(4):643–658PubMedCrossRef Hartcher-O’Brien J, Gallace A, Krings B, Koppen C, Spence C (2008) When vision ‘extinguishes’ touch in neurologically-normal people: extending the Colavita visual dominance effect. Exp Brain Res 186(4):643–658PubMedCrossRef
Zurück zum Zitat Hecht D, Reiner M (2009) Sensory dominance in combinations of audio, visual and haptic stimuli. Exp Brain Res 193(2):307–314PubMedCrossRef Hecht D, Reiner M (2009) Sensory dominance in combinations of audio, visual and haptic stimuli. Exp Brain Res 193(2):307–314PubMedCrossRef
Zurück zum Zitat Hikita M, Fuke S, Ogino M, Minato T, Asada M (2008) Visual attention by saliency leads cross-modal body representation. Int C Devel Learn 1:157–162 Hikita M, Fuke S, Ogino M, Minato T, Asada M (2008) Visual attention by saliency leads cross-modal body representation. Int C Devel Learn 1:157–162
Zurück zum Zitat Isreal JB, Chesney GL, Wickens CD, Donchin E (1980) P300 and tracking difficulty: evidence for multiple resources in dual-task performance. Psychophysiology 17(3):259–273PubMedCrossRef Isreal JB, Chesney GL, Wickens CD, Donchin E (1980) P300 and tracking difficulty: evidence for multiple resources in dual-task performance. Psychophysiology 17(3):259–273PubMedCrossRef
Zurück zum Zitat Jiang W, Jiang H, Stein BE (2002) Two corticotectal areas facilitate multisensory orientation behavior. J Cogn Neurosci 14(8):1240–1255PubMedCrossRef Jiang W, Jiang H, Stein BE (2002) Two corticotectal areas facilitate multisensory orientation behavior. J Cogn Neurosci 14(8):1240–1255PubMedCrossRef
Zurück zum Zitat Johnson R Jr (1984) P300: a model of the variables controlling its amplitude. Ann NY Acad Sci 425:223–229PubMedCrossRef Johnson R Jr (1984) P300: a model of the variables controlling its amplitude. Ann NY Acad Sci 425:223–229PubMedCrossRef
Zurück zum Zitat Koppen C, Spence C (2007) Seeing the light: exploring the Colavita visual dominance effect. Exp Brain Res 180(4):737–754PubMedCrossRef Koppen C, Spence C (2007) Seeing the light: exploring the Colavita visual dominance effect. Exp Brain Res 180(4):737–754PubMedCrossRef
Zurück zum Zitat Koppen C, Levitan CA, Spence C (2009) A signal detection study of the Colavita visual dominance effect. Exp Brain Res 196(3):353–360PubMedCrossRef Koppen C, Levitan CA, Spence C (2009) A signal detection study of the Colavita visual dominance effect. Exp Brain Res 196(3):353–360PubMedCrossRef
Zurück zum Zitat Kording KP, Wolpert DM (2006) Bayesian decision theory in sensorimotor control. Trends Cogn Sci 10(7):319–326PubMedCrossRef Kording KP, Wolpert DM (2006) Bayesian decision theory in sensorimotor control. Trends Cogn Sci 10(7):319–326PubMedCrossRef
Zurück zum Zitat Li Y, Hu Y, Liu T, Wu D (2011) Dipole source analysis of auditory P300 response in depressive and anxiety disorders. Cogn Neurodyn 5(2):221–229PubMedCrossRef Li Y, Hu Y, Liu T, Wu D (2011) Dipole source analysis of auditory P300 response in depressive and anxiety disorders. Cogn Neurodyn 5(2):221–229PubMedCrossRef
Zurück zum Zitat Luck SJ (2005) An introduction to the event-related potential technique. MIT Press, Cambridge, MA Luck SJ (2005) An introduction to the event-related potential technique. MIT Press, Cambridge, MA
Zurück zum Zitat Luck SJ, Hillyard SA (1994) Electrophysiological correlates of feature analysis during visual search. Psychophysiology 31(3):291–308PubMedCrossRef Luck SJ, Hillyard SA (1994) Electrophysiological correlates of feature analysis during visual search. Psychophysiology 31(3):291–308PubMedCrossRef
Zurück zum Zitat Luck SJ, Woodman GF, Vogel EK (2000) Event-related potential studies of attention. Trends Cogn Sci 4(11):432–440PubMedCrossRef Luck SJ, Woodman GF, Vogel EK (2000) Event-related potential studies of attention. Trends Cogn Sci 4(11):432–440PubMedCrossRef
Zurück zum Zitat Lugo JE, Doti R, Wittich W, Faubert J (2008) Multisensory integration: central processing modifies peripheral systems. Psychol Sci 19(10):989–997PubMedCrossRef Lugo JE, Doti R, Wittich W, Faubert J (2008) Multisensory integration: central processing modifies peripheral systems. Psychol Sci 19(10):989–997PubMedCrossRef
Zurück zum Zitat Magosso E (2010) Integrating information from vision and touch: a neural network modeling study. Ieee T Inf Technol B 14(3):598–612CrossRef Magosso E (2010) Integrating information from vision and touch: a neural network modeling study. Ieee T Inf Technol B 14(3):598–612CrossRef
Zurück zum Zitat McDonald JJ, Teder-Salejarvi WA, Di Russo F, Hillyard SA (2003) Neural substrates of perceptual enhancement by cross-modal spatial attention. J Cogn Neurosci 15(1):10–19PubMedCrossRef McDonald JJ, Teder-Salejarvi WA, Di Russo F, Hillyard SA (2003) Neural substrates of perceptual enhancement by cross-modal spatial attention. J Cogn Neurosci 15(1):10–19PubMedCrossRef
Zurück zum Zitat Meredith MA, Stein BE (1986) Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Res 365(2):350–354PubMedCrossRef Meredith MA, Stein BE (1986) Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Res 365(2):350–354PubMedCrossRef
Zurück zum Zitat Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24:167–202PubMedCrossRef Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24:167–202PubMedCrossRef
Zurück zum Zitat Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res 14(1):115–128PubMedCrossRef Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res 14(1):115–128PubMedCrossRef
Zurück zum Zitat Murray MM, Molholm S, Michel CM, Heslenfeld DJ, Ritter W, Javitt DC, Schroeder CE, Foxe JJ (2005) Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb Cortex 15(7):963–974PubMedCrossRef Murray MM, Molholm S, Michel CM, Heslenfeld DJ, Ritter W, Javitt DC, Schroeder CE, Foxe JJ (2005) Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb Cortex 15(7):963–974PubMedCrossRef
Zurück zum Zitat Occelli V, O’Brien JH, Spence C, Zampini M (2010) Assessing the audiotactile Colavita effect in near and rear space. Exp Brain Res 203(3):517–532PubMedCrossRef Occelli V, O’Brien JH, Spence C, Zampini M (2010) Assessing the audiotactile Colavita effect in near and rear space. Exp Brain Res 203(3):517–532PubMedCrossRef
Zurück zum Zitat Odgaard EC, Arieh Y, Marks LE (2004) Brighter noise: sensory enhancement of perceived loudness by concurrent visual stimulation. Cogn Affect Behav Neurosci 4(2):127–132PubMedCrossRef Odgaard EC, Arieh Y, Marks LE (2004) Brighter noise: sensory enhancement of perceived loudness by concurrent visual stimulation. Cogn Affect Behav Neurosci 4(2):127–132PubMedCrossRef
Zurück zum Zitat Reynolds JH, Chelazzi L (2004) Attentional modulation of visual processing. Annu Rev Neurosci 27:611–647PubMedCrossRef Reynolds JH, Chelazzi L (2004) Attentional modulation of visual processing. Annu Rev Neurosci 27:611–647PubMedCrossRef
Zurück zum Zitat Rowland BA, Quessy S, Stanford TR, Stein BE (2007) Multisensory integration shortens physiological response latencies. J Neurosci 27(22):5879–5884PubMedCrossRef Rowland BA, Quessy S, Stanford TR, Stein BE (2007) Multisensory integration shortens physiological response latencies. J Neurosci 27(22):5879–5884PubMedCrossRef
Zurück zum Zitat Rugg MD, Milner AD, Lines CR, Phalp R (1987) Modulation of visual event-related potentials by spatial and non-spatial visual selective attention. Neuropsychologia 25(1A):85–96 Rugg MD, Milner AD, Lines CR, Phalp R (1987) Modulation of visual event-related potentials by spatial and non-spatial visual selective attention. Neuropsychologia 25(1A):85–96
Zurück zum Zitat Schinkel S, Marwan N, Kurths J (2007) Order patterns recurrence plots in the analysis of ERP data. Cogn Neurodyn 1(4):317–325PubMedCrossRef Schinkel S, Marwan N, Kurths J (2007) Order patterns recurrence plots in the analysis of ERP data. Cogn Neurodyn 1(4):317–325PubMedCrossRef
Zurück zum Zitat Sinnett S, Soto-Faraco S, Spence C (2008) The co-occurrence of multisensory competition and facilitation. Acta Psychol (Amst) 128(1):153–161CrossRef Sinnett S, Soto-Faraco S, Spence C (2008) The co-occurrence of multisensory competition and facilitation. Acta Psychol (Amst) 128(1):153–161CrossRef
Zurück zum Zitat Stein BE, Meredith MA (1993) The merging of the senses. MIT Press, Cambridge, MA Stein BE, Meredith MA (1993) The merging of the senses. MIT Press, Cambridge, MA
Zurück zum Zitat Tanaka E, Inui K, Kida T, Miyazaki T, Takeshima Y, Kakigi R (2008) A transition from unimodal to multimodal activations in four sensory modalities in humans: an electrophysiological study. BMC Neurosci 9:116PubMedCrossRef Tanaka E, Inui K, Kida T, Miyazaki T, Takeshima Y, Kakigi R (2008) A transition from unimodal to multimodal activations in four sensory modalities in humans: an electrophysiological study. BMC Neurosci 9:116PubMedCrossRef
Zurück zum Zitat Taylor JG (2007) On the neurodynamics of the creation of consciousness. Cogn Neurodyn 1(2):97–118PubMedCrossRef Taylor JG (2007) On the neurodynamics of the creation of consciousness. Cogn Neurodyn 1(2):97–118PubMedCrossRef
Zurück zum Zitat Teder-Salejarvi WA, Di Russo F, McDonald JJ, Hillyard SA (2005) Effects of spatial congruity on audio-visual multimodal integration. J Cogn Neurosci 17(9):1396–1409PubMedCrossRef Teder-Salejarvi WA, Di Russo F, McDonald JJ, Hillyard SA (2005) Effects of spatial congruity on audio-visual multimodal integration. J Cogn Neurosci 17(9):1396–1409PubMedCrossRef
Zurück zum Zitat Treisman A, Sato S (1990) Conjunction search revisited. J Exp Psychol Hum Percept Perform 16(3):459–478PubMedCrossRef Treisman A, Sato S (1990) Conjunction search revisited. J Exp Psychol Hum Percept Perform 16(3):459–478PubMedCrossRef
Zurück zum Zitat van Atteveldt NM, Formisano E, Goebel R, Blomert L (2007) Top-down task effects overrule automatic multisensory responses to letter-sound pairs in auditory association cortex. Neuroimage 36(4):1345–1360PubMedCrossRef van Atteveldt NM, Formisano E, Goebel R, Blomert L (2007) Top-down task effects overrule automatic multisensory responses to letter-sound pairs in auditory association cortex. Neuroimage 36(4):1345–1360PubMedCrossRef
Zurück zum Zitat Van Damme S, Crombez G, Spence C (2009) Is visual dominance modulated by the threat value of visual and auditory stimuli? Exp Brain Res 193(2):197–204PubMedCrossRef Van Damme S, Crombez G, Spence C (2009) Is visual dominance modulated by the threat value of visual and auditory stimuli? Exp Brain Res 193(2):197–204PubMedCrossRef
Zurück zum Zitat van Wassenhove V, Buonomano DV, Shimojo S, Shams L (2008) Distortions of subjective time perception within and across senses. Plos One 3(1):e1437 van Wassenhove V, Buonomano DV, Shimojo S, Shams L (2008) Distortions of subjective time perception within and across senses. Plos One 3(1):e1437
Zurück zum Zitat Verleger R (1991) Event-related potentials and cognition—a critique of the context updating hypothesis and an alternative interpretation of P3. Behav Brain Sci 14(4):732CrossRef Verleger R (1991) Event-related potentials and cognition—a critique of the context updating hypothesis and an alternative interpretation of P3. Behav Brain Sci 14(4):732CrossRef
Zurück zum Zitat Vogel EK, Luck SJ, Shapiro KL (1998) Electrophysiological evidence for a postperceptual locus of suppression during the attentional blink. J Exp Psychol Hum Percept Perform 24(6):1656–1674PubMedCrossRef Vogel EK, Luck SJ, Shapiro KL (1998) Electrophysiological evidence for a postperceptual locus of suppression during the attentional blink. J Exp Psychol Hum Percept Perform 24(6):1656–1674PubMedCrossRef
Zurück zum Zitat Werkhoven PJ, van Erp JBR, Philippi TG (2009) Counting visual and tactile events: the effect of attention on multisensory integration. Atten Percept Psycho 71(8):1854–1861CrossRef Werkhoven PJ, van Erp JBR, Philippi TG (2009) Counting visual and tactile events: the effect of attention on multisensory integration. Atten Percept Psycho 71(8):1854–1861CrossRef
Metadaten
Titel
Dynamic characteristics of multisensory facilitation and inhibition
verfasst von
W. Y. Wang
L. Hu
E. Valentini
X. B. Xie
H. Y. Cui
Y. Hu
Publikationsdatum
01.10.2012
Verlag
Springer Netherlands
Erschienen in
Cognitive Neurodynamics / Ausgabe 5/2012
Print ISSN: 1871-4080
Elektronische ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-012-9197-x

Weitere Artikel der Ausgabe 5/2012

Cognitive Neurodynamics 5/2012 Zur Ausgabe

Neuer Inhalt