Skip to main content
Erschienen in: Cognitive Neurodynamics 2/2020

09.10.2019 | Research Article

Decoding disparity categories in 3-dimensional images from fMRI data using functional connectivity patterns

verfasst von: Chunyu Liu, Yuan Li, Sutao Song, Jiacai Zhang

Erschienen in: Cognitive Neurodynamics | Ausgabe 2/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Humans use binocular disparity to extract depth information from two-dimensional retinal images in a process called stereopsis. Previous studies usually introduce the standard univariate analysis to describe the correlation between disparity level and brain activity within a given brain region based on functional magnetic resonance imaging (fMRI) data. Recently, multivariate pattern analysis has been developed to extract activity patterns across multiple voxels for deciphering categories of binocular disparity. However, the functional connectivity (FC) of patterns based on regions of interest or voxels and their mapping onto disparity category perception remain unknown. The present study extracted functional connectivity patterns for three disparity conditions (crossed disparity, uncrossed disparity, and zero disparity) at distinct spatial scales to decode the binocular disparity. Results of 27 subjects’ fMRI data demonstrate that FC features are more discriminatory than traditional voxel activity features in binocular disparity classification. The average binary classification of the whole brain and visual areas are respectively 87% and 79% at single subject level, and thus above the chance level (50%). Our research highlights the importance of exploring functional connectivity patterns to achieve a novel understanding of 3D image processing.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Allen EA et al (2014) Tracking whole-brain connectivity dynamics in the resting state. Cereb Cortex 24:663–676CrossRefPubMed Allen EA et al (2014) Tracking whole-brain connectivity dynamics in the resting state. Cereb Cortex 24:663–676CrossRefPubMed
Zurück zum Zitat Backus BT et al (2001) Human cortical activity correlates with stereoscopic depth perception. J Neurophysiol 86:2054–2068CrossRefPubMed Backus BT et al (2001) Human cortical activity correlates with stereoscopic depth perception. J Neurophysiol 86:2054–2068CrossRefPubMed
Zurück zum Zitat Baczkowski BM et al (2017) Sliding-window analysis tracks fluctuations in amygdala functional connectivity associated with physiological arousal and vigilance during fear conditioning. NeuroImage 153:168–178CrossRefPubMed Baczkowski BM et al (2017) Sliding-window analysis tracks fluctuations in amygdala functional connectivity associated with physiological arousal and vigilance during fear conditioning. NeuroImage 153:168–178CrossRefPubMed
Zurück zum Zitat Breiman L (2017) Classification and regression trees. Routledge Breiman L (2017) Classification and regression trees. Routledge
Zurück zum Zitat Bridge H et al (2007) Topographical representation of binocular depth in the human visual cortex using fMRI. J Vis 7(15):1–14PubMed Bridge H et al (2007) Topographical representation of binocular depth in the human visual cortex using fMRI. J Vis 7(15):1–14PubMed
Zurück zum Zitat Chao-Gan Y et al (2016) DPABI: data processing & analysis for (resting-state) brain imaging. Neuroinformatics 14:339–351CrossRef Chao-Gan Y et al (2016) DPABI: data processing & analysis for (resting-state) brain imaging. Neuroinformatics 14:339–351CrossRef
Zurück zum Zitat Dasdemir Y et al (2017) Analysis of functional brain connections for positive–negative emotions using phase locking value. Cogn Neurodyn 11:487–500CrossRefPubMedPubMedCentral Dasdemir Y et al (2017) Analysis of functional brain connections for positive–negative emotions using phase locking value. Cogn Neurodyn 11:487–500CrossRefPubMedPubMedCentral
Zurück zum Zitat DeAngelis GC et al (1998) Cortical area MT and the perception of stereoscopic depth. Nature 394:677CrossRefPubMed DeAngelis GC et al (1998) Cortical area MT and the perception of stereoscopic depth. Nature 394:677CrossRefPubMed
Zurück zum Zitat Fields C et al (2017) Disrupted development and imbalanced function in the global neuronal workspace: a positive-feedback mechanism for the emergence of ASD in early infancy. Cogn Neurodyn 11:1–21CrossRefPubMed Fields C et al (2017) Disrupted development and imbalanced function in the global neuronal workspace: a positive-feedback mechanism for the emergence of ASD in early infancy. Cogn Neurodyn 11:1–21CrossRefPubMed
Zurück zum Zitat Finlayson NJ et al (2017) Differential patterns of 2D location versus depth decoding along the visual hierarchy. NeuroImage 147:507–516CrossRefPubMed Finlayson NJ et al (2017) Differential patterns of 2D location versus depth decoding along the visual hierarchy. NeuroImage 147:507–516CrossRefPubMed
Zurück zum Zitat Goncalves NR et al (2015) 7 Tesla FMRI reveals systematic functional organization for binocular disparity in dorsal visual cortex. J Neurosci 35:3056–3072CrossRefPubMedPubMedCentral Goncalves NR et al (2015) 7 Tesla FMRI reveals systematic functional organization for binocular disparity in dorsal visual cortex. J Neurosci 35:3056–3072CrossRefPubMedPubMedCentral
Zurück zum Zitat Gonzalez-Castillo J et al (2015) Tracking ongoing cognition in individuals using brief, whole-brain functional connectivity patterns. Proc Natl Acad Sci 112:8762–8767CrossRefPubMedPubMedCentral Gonzalez-Castillo J et al (2015) Tracking ongoing cognition in individuals using brief, whole-brain functional connectivity patterns. Proc Natl Acad Sci 112:8762–8767CrossRefPubMedPubMedCentral
Zurück zum Zitat Haxby JV (2012) Multivariate pattern analysis of fMRI: the early beginnings. NeuroImage 62:852–855CrossRefPubMed Haxby JV (2012) Multivariate pattern analysis of fMRI: the early beginnings. NeuroImage 62:852–855CrossRefPubMed
Zurück zum Zitat Haxby JV, Gobbini MI, Furey ML, Ishai A, Schouten JL, Pietrini P (2001) Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293:2425–2430CrossRefPubMed Haxby JV, Gobbini MI, Furey ML, Ishai A, Schouten JL, Pietrini P (2001) Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293:2425–2430CrossRefPubMed
Zurück zum Zitat Haxby JV et al (2014) Decoding neural representational spaces using multivariate pattern analysis. Annu Rev Neurosci 37:435–456CrossRefPubMed Haxby JV et al (2014) Decoding neural representational spaces using multivariate pattern analysis. Annu Rev Neurosci 37:435–456CrossRefPubMed
Zurück zum Zitat Hubel DH et al (2015) Binocular stereoscopy in visual areas V-2, V-3, and V-3A of the macaque monkey. Cereb Cortex 25:959–971CrossRefPubMed Hubel DH et al (2015) Binocular stereoscopy in visual areas V-2, V-3, and V-3A of the macaque monkey. Cereb Cortex 25:959–971CrossRefPubMed
Zurück zum Zitat Hutchison RM et al (2014) Distinct and distributed functional connectivity patterns across cortex reflect the domain-specific constraints of object, face, scene, body, and tool category-selective modules in the ventral visual pathway. NeuroImage 96:216–236CrossRefPubMed Hutchison RM et al (2014) Distinct and distributed functional connectivity patterns across cortex reflect the domain-specific constraints of object, face, scene, body, and tool category-selective modules in the ventral visual pathway. NeuroImage 96:216–236CrossRefPubMed
Zurück zum Zitat Lambooij M et al (2009) Visual discomfort and visual fatigue of stereoscopic displays: a review. J Imaging Sci Technol 53:30201-1–30201-14CrossRef Lambooij M et al (2009) Visual discomfort and visual fatigue of stereoscopic displays: a review. J Imaging Sci Technol 53:30201-1–30201-14CrossRef
Zurück zum Zitat Langs G et al (2011) Detecting stable distributed patterns of brain activation using gini contrast. NeuroImage 56:497–507CrossRefPubMed Langs G et al (2011) Detecting stable distributed patterns of brain activation using gini contrast. NeuroImage 56:497–507CrossRefPubMed
Zurück zum Zitat Liu C et al (2018) Image categorization from functional magnetic resonance imaging using functional connectivity. J Neurosci Meth 309:71–80CrossRef Liu C et al (2018) Image categorization from functional magnetic resonance imaging using functional connectivity. J Neurosci Meth 309:71–80CrossRef
Zurück zum Zitat Mizraji E et al (2017) The feeling of understanding: an exploration with neural models. Cogn Neurodyn 11:135–146CrossRefPubMed Mizraji E et al (2017) The feeling of understanding: an exploration with neural models. Cogn Neurodyn 11:135–146CrossRefPubMed
Zurück zum Zitat Neri P et al (2004) Stereoscopic processing of absolute and relative disparity in human visual cortex. J Neurophysiol 92:1880–1891CrossRefPubMed Neri P et al (2004) Stereoscopic processing of absolute and relative disparity in human visual cortex. J Neurophysiol 92:1880–1891CrossRefPubMed
Zurück zum Zitat Norman KA et al (2006) Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn Sci 10:424–430CrossRefPubMed Norman KA et al (2006) Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn Sci 10:424–430CrossRefPubMed
Zurück zum Zitat Pantazatos SP et al (2012) Decoding unattended fearful faces with whole-brain correlations: an approach to identify condition-dependent large-scale functional connectivity. PLoS Comput Biol 8:e1002441CrossRefPubMedPubMedCentral Pantazatos SP et al (2012) Decoding unattended fearful faces with whole-brain correlations: an approach to identify condition-dependent large-scale functional connectivity. PLoS Comput Biol 8:e1002441CrossRefPubMedPubMedCentral
Zurück zum Zitat Parhizi B et al (2018) Decoding the different states of visual attention using functional and effective connectivity features in fMRI data. Cogn Neurodyn 12:157–170CrossRefPubMed Parhizi B et al (2018) Decoding the different states of visual attention using functional and effective connectivity features in fMRI data. Cogn Neurodyn 12:157–170CrossRefPubMed
Zurück zum Zitat Preston TJ et al (2008) Multivoxel pattern selectivity for perceptually relevant binocular disparities in the human brain. J Neurosci 28:11315–11327CrossRefPubMedPubMedCentral Preston TJ et al (2008) Multivoxel pattern selectivity for perceptually relevant binocular disparities in the human brain. J Neurosci 28:11315–11327CrossRefPubMedPubMedCentral
Zurück zum Zitat Richiardi J et al (2011) Decoding brain states from fMRI connectivity graphs. NeuroImage 56:616–626CrossRefPubMed Richiardi J et al (2011) Decoding brain states from fMRI connectivity graphs. NeuroImage 56:616–626CrossRefPubMed
Zurück zum Zitat Shirer WR et al (2012) Decoding subject-driven cognitive states with whole-brain connectivity patterns. Cereb Cortex 22:158–165CrossRefPubMed Shirer WR et al (2012) Decoding subject-driven cognitive states with whole-brain connectivity patterns. Cereb Cortex 22:158–165CrossRefPubMed
Zurück zum Zitat Stevens WD et al (2015) Functional connectivity constrains the category-related organization of human ventral occipitotemporal cortex. Hum Brain Mapp 36:2187–2206CrossRefPubMedPubMedCentral Stevens WD et al (2015) Functional connectivity constrains the category-related organization of human ventral occipitotemporal cortex. Hum Brain Mapp 36:2187–2206CrossRefPubMedPubMedCentral
Zurück zum Zitat Tagliazucchi E et al (2012) Automatic sleep staging using fMRI functional connectivity data. NeuroImage 63:63–72CrossRefPubMed Tagliazucchi E et al (2012) Automatic sleep staging using fMRI functional connectivity data. NeuroImage 63:63–72CrossRefPubMed
Zurück zum Zitat Wang X et al (2016) Representing object categories by connections: evidence from a mutivariate connectivity pattern classification approach. Hum Brain Mapp 37:3685–3697CrossRefPubMedPubMedCentral Wang X et al (2016) Representing object categories by connections: evidence from a mutivariate connectivity pattern classification approach. Hum Brain Mapp 37:3685–3697CrossRefPubMedPubMedCentral
Zurück zum Zitat Yamashita O et al (2008) Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns. NeuroImage 42:1414–1429CrossRefPubMed Yamashita O et al (2008) Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns. NeuroImage 42:1414–1429CrossRefPubMed
Zurück zum Zitat Yan SM (1985) Digital stereoscopic test charts. People’s Medical Publishing House Yan SM (1985) Digital stereoscopic test charts. People’s Medical Publishing House
Zurück zum Zitat Yang Z et al (2014) Common intrinsic connectivity states among posteromedial cortex subdivisions: insights from analysis of temporal dynamics. NeuroImage 93(Pt 1):124–137CrossRefPubMed Yang Z et al (2014) Common intrinsic connectivity states among posteromedial cortex subdivisions: insights from analysis of temporal dynamics. NeuroImage 93(Pt 1):124–137CrossRefPubMed
Metadaten
Titel
Decoding disparity categories in 3-dimensional images from fMRI data using functional connectivity patterns
verfasst von
Chunyu Liu
Yuan Li
Sutao Song
Jiacai Zhang
Publikationsdatum
09.10.2019
Verlag
Springer Netherlands
Erschienen in
Cognitive Neurodynamics / Ausgabe 2/2020
Print ISSN: 1871-4080
Elektronische ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-019-09557-6

Weitere Artikel der Ausgabe 2/2020

Cognitive Neurodynamics 2/2020 Zur Ausgabe

Neuer Inhalt