Key Points
-
The binding problem is a real problem in human vision. It can be observed under special laboratory conditions in normal healthy populations and under less special conditions in patients with lesions that affect areas of the parietal lobes or areas of the thalamus that are strongly connected to the parietal cortex.
-
Proper binding of certain features of an object in vision (for example, motion, shape, colour and orientation) requires spatial and attentional contributions that are associated with parietal function. This conclusion has received converging support from imaging, electrophysiological and neuropsychological studies in humans. The possible roles of spatial attention and temporal synchrony in binding are discussed.
-
Features that are believed to be encoded in separate cortical feature maps do not require spatial attention for detection, and their detection does not activate parietal areas. Perceptual awareness of a feature does not necessarily require information about its location, but awareness of the co-localization of two different features (such as shape and colour) does. Again, evidence for this idea comes from imaging, electrophysiological and neuropsychological studies.
-
Synaesthesia is a relatively rare condition in which a feature that is not present in the stimulus is bound to a feature that is, and is perceived together with the features that are present. Imaging data have suggested that the synaesthetic phenomenon arises as an interaction between the parietal cortex and areas of the ventral cortex that encode different visual features, similar to evidence for feature binding in non-synaesthetes. This suggests that at least certain forms of synaesthesia require attentional input, and that binding of a feature that is absent involves similar architecture to binding of features that are present.
-
Behavioural evidence supports the conclusion that most (and perhaps all) synaesthetic experience requires attention to and awareness of the stimulus that induces the experience. The visual system does not appear to bind synaesthetic features preattentively in most synaesthetes, which is consistent with results in normal visual binding.
Abstract
The world is experienced as a unified whole, but sensory systems do not deliver it to the brain in this way. Signals from different sensory modalities are initially registered in separate brain areas — even within a modality, features of the sensory mosaic such as colour, size, shape and motion are fragmented and registered in specialized areas of the cortex. How does this information become bound together in experience? Findings from the study of abnormal binding — for example, after stroke — and unusual binding — as in synaesthesia — might help us to understand the cognitive and neural mechanisms that contribute to solving this 'binding problem'.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$189.00 per year
only $15.75 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
Livingstone, M. & Hubel, D. Segregation of form, color, movement & depth: anatomy, physiology and perception. Science 240, 740–749 (1988).
Fellaman, D. J. & Van Essen, D. C. Distributed hierarchical processing in the primate visual cortex. Cereb. Cortex 1, 1–47 (1991).
Tootell, R. B. H., Dale, A. M., Sereno, M. I. & Malach, R. New images from human visual cortex. Trends Neurosci. 19, 481–489 (1998). | PubMed
Newcombe, F. Missile Wounds of the Head (Oxford Univ. Press, Oxford, UK, 1969). This is the first discussion of the result of focal lesions created by bullet wounds in a large population of war veterans. The author was the head of the effort to study and help rehabilitate returning war veterans in Great Britain and reports her extensive work with this population in this book.
Berhmann, M. Handbook of Neuropsychology Vol. 4 Disorders of Visual Behavior (Elsevier, Amsterdam, 2001). This volume contains chapters on many visual disorders that occur within neuropsychology. It includes some of the leading researchers in the area who are studying these disorders and gives a comprehensive view of research, theory and clinical practice.
Damasio, A. R. The brain binds entities and events by multiregional activation from convergence zones. Neural Comput. 1, 123–132 (1989).
Koch, C. & Crick, R. in Large-Scale Neuronal Theories of the Brain (eds Koch, C. & Davis, J. L.) 93–109 (MIT Press, Cambridge, Massachusetts, 1994).
Garson, J. W. (Dis)solving the binding problem. Phil. Psychol. 14, 381–392 (2001).
Shadlen, M. & Movshon, J. Synchrony unbound: a critical evaluation of the temporal binding hypothesis. Neuron 24, 67–77 (1999).
Freidman-Hill, S. R., Robertson, L. C. & Treisman, A. Parietal contributions to visual feature binding: evidence from a patient with bilateral lesions. Science 269, 853–855 (1995) This was the first study to report that feature binding resulted from bilateral parietal damage — lesions that produce a rare neuropsychological condition known as Balint's syndrome. The damage disrupts the ability to perceive the location of features and objects that are clearly seen and accurately named. The binding problem reported was evident in free viewing conditions in the laboratory and in everyday life.
Robertson, L. C., Treisman, A., Friedman-Hill, S. & Grabowecky, M. The interaction of spatial and object pathways: evidence from Balint's syndrome. J. Cogn. Neurosci. 9, 295–317 (1997). Article |
Rich, A. N. & Mattingley, J. B. Anomalous perception in synaesthesia: a cognitive neuroscience perspective. Nature Rev. Neurosci. 3, 43–52 (2001). This paper provides an excellent review of chromatic/graphemic and chromatic/phonemic forms of synaesthesia with a special emphasis on theories of synaesthesia within a genetic, neural and cognitive framework. The authors propose that synaesthesia arises from developmentally abnormal links between modular areas within the brain and is genetically based, and that conscious awareness of the inducing stimulus is required for synaesthesia to occur. | PubMed
Baron-Cohen, S., Harrison, J., Goldstein, L. H. & Wyke, M. Coloured speech perception: is synaesthesia what happens when modularity breaks down? Perception 22, 419–426 (1993).
Treisman, A., Sykes, M. & Gelade, G. in Attention & Performance VI (ed. Dornic, S.) 333–361 (Earlbaum, Hillsdale, New Jersey, 1977).
Treisman, A. M. & Schmidt, H. Illusory conjunctions in perception of objects. Cognit. Psychol. 14, 107–141 (1982).
Prinzmetal, W., Presti, D. & Posner, M. Does attention affect visual feature integration? J. Exp. Psychol. Hum. Percept. Perf. 12, 361–369 (1986). | PubMed
Prinzmetal, W., Diedrichson, J. & Ivry, R. B. Illusory conjunctions are alive and well. J. Exp. Psychol. Hum. Percept. Perform. 27, 538–541 (2001).
Ashby, F. G., Prinzmetal, W., Ivry, R. & Maddox, T. A formal theory of feature binding in object perception. Psychol. Rev. 103, 165–192 (1996).
Treisman, A. & Gelade, G. A feature-integration theory of attention. Cognit. Psychol. 12, 97–136 (1980).
Vallar, G. Spatial hemineglect in humans. Trends Cogn. Sci. 2, 87–97 (1998).
Rafal, R. in Patient-Based Approaches to Cognitive Neuroscience (eds Farah, M. J. & Feinberg, T. E.) (MIT Press, Cambridge, Massachusetts, 2000).
Cohen, A. & Rafal, R. Attention and feature integration: illusory conjunctions in a patient with parietal lobe lesions. Psychol. Sci. 2, 106–110 (1991).
Eglin, M., Robertson, L. C. & Knight, R. T. Visual search performance in the neglect syndrome. J. Cogn. Neurosci. 4, 372–381 (1989).
Estermann, M., McGlinchey-Berroth, R. & Milberg, W. P. Parallel and serial search in hemispatial neglect: evidence for preserved preattentive but impaired attentive processing. Neuropsychology 14, 599–611 (2000).
Bisiach, E. & Vallar, G. in Handbook of Neuropsychology Vol. 1 (2nd edn) (eds Boller, F., Grafman, J. & Rizzolatti, G.) 195–222 (Elsevier, Amsterdam, 2000).
Mesulam, M. -M. Spatial attention and neglect: parietal, frontal and cingulate contributions to the mental representation and attentional targeting of salient extrapersonal events. Phil. Trans. R. Soc. Lond. B 345, 1325–1346 (1999). | PubMed
Rafal, R. in Behavioral Neurology and Neuropsychology (eds Feinberg, T. E. & Farah, M. J.) 319–335 (McGraw-Hill, New York, 1997).
Bernstein, L. J. & Robertson, L. C. Independence between illusory conjunctions of color and motion with shape following bilateral parietal lesions. Psychol. Sci. 9, 167–175 (1998).
Humphreys, G. W., Cinel, C., Wolfe, J., Olseon, A. & Klampen, N. Fractionating the binding process: neuropsychological evidence distinguishing binding of form from binding of surface features. Vision Res. 40, 1569–1596 (2000).
Treisman, A. Solutions to the binding problem: progress through controversy and convergence. Neuron 24, 105–110 (1999).
Treisman, A. Feature binding, attention and object perception. Phil. Trans. R. Soc. Lond. B 353, 1295–1306 (1998). | PubMed
Humphreys, G. W. A multi-stage account of binding in vision: neuropsychological evidence. Visual Cogn. 8, 381–410 (2001).
Humphreys, G. W. & Riddoch, M. J. Attention to within-object and between-object spatial representations: Multiple sites for visual selection. Cogn. Neuropsychol. 11, 207–241 (1994). This paper is the first, to my knowledge, to suggest that within-object spatial analysis is performed by ventral cortical pathways, while between-object spatial analysis is performed by dorsal pathways. An extension of this view is that between-object descriptions require explicit spatial maps associated with parietal lobes while within-object spatial descriptions rely on implicit spatial maps (see reference 11).
Ward, R., Danziger, S., Owen, B. & Rafal, R. Deficits in spatial coding and feature binding following damage to spatiotopic maps in the human pulvinar. Nature Neurosci. 5, 99–100 (2002). The authors present the first reported case of subcortical feature binding deficits as a result of damage to an area of the thalamus that contains many interconnecting fibres that project to the parietal lobes.
Milner, A. D. & Goodale, M. A. The Visual Brain in Action (Oxford Univ. Press, Oxford, UK, 1995).
Ungerleider, L. G. & Mishkin, M. in Analysis of Visual Behavior (eds Ingle, J., Goodale, M. S. & Mansfield, R. J. W.) 549–586 (MIT Press, Cambridge, Massachusetts, 1982).
Treisman, A. Features and objects: the 14th Bartlett memorial lecture. Q. J. Exp. Psychol. A 40, 201–217 (1988).
Desimone, R. & Duncan, J. Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 18, 193–222 (1995).
Duncan, J. & Humphreys, G. Visual search and stimulus similarity. Psychol. Rev. 96, 433–458 (1989).
Nakayama, K. & Silverman, G. H. Serial and parallel processing of visual feature conjunctions. Nature 320, 264–265 (1986).
Kim, M. -S. & Robertson, L. C. Implicit representations of visual space after bilateral parietal damage. J. Cogn. Neurosci. 13, 1080–1087 (2001).
Corbetta, M., Shulman, G., Miezin, F. & Petersen, S. Superior parietal cortex activation during spatial attention shifts and visual feature conjunctions. Science 270, 802–805 (1995).
Walsh, V. & Cowey, A. Magnetic stimulation studies of visual cognition. Trends Cogn. Sci. 2, 202–138 (1998). The use of transcranial magnetic stimulation produces a pulse on the scalp that briefly disrupts brain function in a small area, for a few milliseconds. It has been used extensively with normal perceivers without producing residual problems.
Walsh, V., Ashbridge, E. & Cowoey, A. Cortical plasticity in perceptual learning demonstrated by transcranial magnetic stimulation. Neuropsychologia 36, 363–367 (1998).
Robertson, L. C. Space, Objects, Minds and Brains (Psychology Press, New York, 2003). This book discusses several neuropsychological syndromes in which spatial deficits are a defining factor, with chapters on how spatial maps of the brain support interactions between attention and object perception. It explores some of the multiple spatial maps that have been described in cognition and neuroscience and reviews evidence showing that many act implicitly, but the maps that relate to perceptual awareness require explicit access.
Nobre, A. C., Coull, J. T., Walsh, V. & Mesulam, M. -M. Dissociation of conjunctions and difficulty during visual search. Soc. Neurosci. Abstr. 585.12 (2000).
Donner, T. H. et al. Visual feature and conjunction searches of equal difficulty engage only partially overlapping frontoparietal networks. Neuroimage 15, 16–25 (2002). Although there was a great deal of parietal (and frontal) overlap in this fMRI study, there were also areas adjacent to this overlap that were more activated by one search type than by another. The areas that were more activated by conjunction search than by feature search might reflect a non-spatial attentional mechanism within the dorsal stream that is involved in binding per se . Alternatively, this activation might represent a subsequent processing stage to that of binding.
Wojciulik, E. & Kanwisher, N. The generality of parietal involvement in visual attention. Neuron 23, 747–764 (1999).
Shafritz, K. M., Gore, J. C. & Marois, R. The role of the parietal cortex in visual feature binding. Proc. Natl Acad. Sci. USA 99, 10917–10922 (2002). This study demonstrated that parietal activation in binding was present when stimuli were simultaneously presented in different locations but not when they were sequentially presented in the same location, consistent with findings from the Balint's syndrome patient 'RM' (reference 10) and supporting the role of space in conjunction formation.
Posner, M. I. & Petersen, S. The attention system of the human brain. Annu. Rev. Neurosci. 13, 25–42 (1990).
Desimone, R. & Duncan, J. Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 18, 193–222 (1995).
Singer, W. & Gray, C. M. Visual feature integration and the temporal correlation hypothesis. Annu. Rev. Neurosci. 18, 555–586 (1995).
Fahle, M. Figure–ground discrimination from temporal information. Proc. R. Soc. Lond. B 254, 199–203 (1993).
Usher, M. & Donnelly, N. Visual synchrony affects binding and segmentation in perception. Nature 394, 179–182 (1998).
Robertson, L. C. in Approaches to Cognition: Contrasts and Controversies (eds Knapp, T. J. & Robertson, L. C.) 159–188 (Erlbaum, Hillsdale, New Jersey, 1986).
Gray, C. M., Engel, A. K., Konig, P. & Singer, W. Stimulus-dependent neuronal oscillations in cat visual cortex: receptive field properties and feature dependence. Eur. J. Neurosci. 2, 607–619 (1990). This evidence, for in-phase oscillations, was presented three years earlier at a Society for Neurosciences meeting. It is generally credited as the first public report of temporal correlation between neurons in unit formation and also as the beginning of the study of synchronous neural activity in perception.
Muller, M. M. & Gruber, T. Induced γ-band responses in the human EEG are related to attentional information processing. Visual Cogn. 8, 579–592 (2001). This paper presents a review of recent findings demonstrating variations of γ-band synchronization of the EEG in humans over the posterior cortices that corresponds to the time at which perceptual organization ensues (for example, grouping, figure-ground segmentation, closure). Notably, top-down attentional processes increase γ-band synchronization over occipital–parietal sites.
Engle, A. K., Konig, P., Kreiter, A. K. & Singer, W. Interhemispheric synchronization of oscillatory neuronal responses in cat visual cortex. Science 252, 1177–1179 (1991).
Edelman, G. M. & Tononi, G. in Neural Correlates of Consciousness (ed. Metzinger, T.) 139–151 (MIT Press, Cambridge, Massachusetts, 2000).
Muller, M. M., Gruber, T. & Keil, A. Modulation of induced γ-band activity in the human EEG by attention and visual information processing. Int. J. Psychophysiol. 38, 283–300 (2000).
Tiitinen, H. et al. Selective attention enhances the auditory 40-Hz transient response in humans. Nature 364, 59–60 (1993).
Desmedt, J. E. & Tomberg, C. Transient phase-locking of 40-Hz electrical oscillations in prefrontal and parietal human cortex reflects the process of conscious somatic perception. Neurosci. Lett. 168, 126–129 (1994).
Humphreys, G. W., Riddoch, M. J., Nys, G. & Heinke, D. Transient binding by time: neuropsychological evidence from anti-extinction. Cogn. Neuropsychol. 19, 361–380 (2002).
Srinivasan, R., Russell, D. P., Edelman, G. M. & Tononi, G. Increased synchronization of magnetic responses during conscious perception. J. Neurosci. 19, 5435–5448 (1999).
Cytowic, R. E. The Man who Tasted Shapes (Putnam, New York, 1993). Also see the web site at http://www.ncu.edu.tw/~daysa/synesthesia.htm where demographic information has been compiled.
Smilek, D., Dixon, M. J., Cudahy, C. & Merikle, P. M. Synaesthetic photisms influence visual perception. J. Cogn. Neurosci. 13, 930–936 (2001).
Nunn, J. A. et al. Functional magnetic resonance imaging of synesthesia: activation of V4/V8 by spoken words. Nature Neurosci. 5, 371–375 (2002).
Paulesu, E. et al. The physiology of coloured hearing: a PET activation study of colour-word synaesthesia. Brain 118, 661–676 (1995).
Aleman, A., Rutten, G. M., Sitskoom, M. M., Dautzerberg, G. & Ramsey, N. F. Activation of striate cortex in the absence of visual stimulation: an fMRI study of synesthesia. Neuroreport 12, 2827–2830 (2001).
Gray, J. A., Williams, S. C. R., Nunn, J. & Baron-Cohen, S. in Synaesthesia: Classic and Contemporary Readings (eds Baron-Cohen, S. & Harrison, J. E.) 173–181 (Blackwell, Oxford, UK, 1997).
Maurer, D. in Synaesthesia: Classic and Contemporary Readings (eds Baron-Cohen, S. & Harrison, J. E.) 224–242 (Blackwell, Oxford, UK, 1997). In this chapter, Maurer proposes that all infants are synaesthetic owing to the massive synaptic connections that are present at birth. These connections are pruned extensively throughout early development, with modularity also developing during this period. Adult synaesthesia could be explained by residual connections that escaped this pruning process.
Ramachandran, V. S. & Hubbard, E. M. Psychophysical investigations into the neural basis of synaesthesia. Proc. R. Soc. Lond. B 268, 979–983 (2001).
Palmeri, T. J., Blake, R., Marois, R., Flanery, M. A., & Whetsell, W. Jr. The perceptual reality of synesthetic colors. Proc. Natl Acad. Sci. USA 99, 4127–4131 (2002).
Mattingley, J. B., Rich, A. N., Yelland, G. & Bradshaw, J. L. Unconscious priming eliminates automatic binding of color and alphanumeric form in synaesthesia. Nature 410, 580–582 (2001).
Grossenbacher, P. G. & Lovelace, C. T. Mechanisms of synesthesia: cognitive and physiological constraints. Trends Cogn. Sci. 5, 36–41 (2001).
Treisman, A. M. The binding problem. Curr. Opin. Neurobiol. 6, 171–178 (1996).
Harvey, M. Psychic paralysis of gaze, optic ataxia, and spatial disorder of attention. Cogn. Neuropsychol. 12, 265–281 (1995).
Holmes, G. & Horax, G. Disturbances of spatial orientation and visual attention with loss of stereoscopic vision. Arch. Neurol. Psych. 1, 385–407 (1919).
Hof, P. R., Bouras, C., Constantinidis, J. & Morrison, J. H. Balint's syndrome in Alzheimer's disease: specific disruption of the occipito-parietal visual pathway. Brain Res. 493, 368–375 (1989).
Farah, M. Visual Agnosia (MIT Press, Cambridge, Massachusetts, 1990).
Heilman, K. M., Watson, R. T. & Valenstein, E. in Clinical Neuropsychology (3rd edn) (eds Heilman, K. M. & Valenstein, E.) 461–497 (Oxford Univ. Press, London, UK, 1993).
Rizzo, M. & Vecera, S. P. Psychoanatomical substrates of Balint's syndrome. J. Neurol. Neurosurg. Psychiatry 72, 162–178 (2002).
Vallar, G. Spatial hemineglect in humans. Trends Cogn. Sci. 2, 87–97 (1998).
Meredith, M. A. On the neuronal basis of multisensory convergence: a brief overview. Cogn. Brain Res. 14, 31–40 (2002). | PubMed
Stein, B. E. & Meredith, M. A. Merging of the Senses (MIT Press, Cambridge, Massachusetts, 1993).
Wallace, M. R. & Stein, B. E. Cross-modal synthesis in the midbrain depends on input from cortex. J. Neurophysiol. 71, 429–432 (1994).
Lewkowicz, D. J. Heterogeneity and heterochrony in the development of intersensory perception. Cogn. Brain Res. 14, 41–63 (2002). | PubMed
Acknowledgements
Preparation of this article was supported by a Merit award from the Office of Veterans Affairs and by an NIMH grant.
Author information
Authors and Affiliations
Related links
Related links
FURTHER INFORMATION
Encyclopedia of Life Sciences
MIT Encyclopedia of Cognitive Sciences
electrophysiology, electric and magnetic evoked fields
American Synesthesia Association
Glossary
- ACHROMATOPSIA
-
The inability to perceive colours despite otherwise intact vision.
- NEGLECT
-
A neurological syndrome (often involving damage to the right parietal cortex) in which patients show a marked difficulty in detecting or responding to information in the contralesional field.
- FEATURE MAP
-
A distinct population of specialized detectors that respond to basic perceptual features (for example, colour) yielding immunity to distractors and feature migrations from one object to another.
- EXTINCTION
-
Lack of awareness of stimulation on the side contralateral to brain injury when stimulation is also presented on the ipsilateral side.
- VENTRAL PROCESSING STREAM
-
A stream of processing arising in the parvocellular system and traversing along the occipital–temporal cortex, often referred to as the 'what' system.
- DORSAL PROCESSING STREAM
-
A stream of processing arising in the magnocellular system and traversing along occipital–parietal–frontal cortex, often referred to as the 'where' or 'how' system.
- TRANSCRANIAL MAGNETIC STIMULATION
-
(TMS). A technique that is used to induce a transient interruption of normal activity in a relatively restricted area of the brain. It is based on the generation of a strong magnetic field near the area of interest, which, if changed rapidly enough, will induce an electric field that is sufficient to stimulate neurons.
- γ-BAND ELECTROENCEPHALOGRAM
-
Electrophysiological activity measured in the 30–50 Hz range from scalp electrodes.
- RE-ENTRANT PATHWAYS
-
Feedback from higher levels of hierarchical processing to lower levels, creating reiterative interactions between higher and lower levels of processing.
- PREATTENTIVE
-
Processing that occurs before attention is engaged and is therefore capable of affecting performance without awareness.
Rights and permissions
About this article
Cite this article
Robertson, L. Binding, spatial attention and perceptual awareness. Nat Rev Neurosci 4, 93–102 (2003). https://doi.org/10.1038/nrn1030
Issue Date:
DOI: https://doi.org/10.1038/nrn1030
This article is cited by
-
Consciousness and information integration
Synthese (2021)
-
Christianity and Schizophrenia Redux: An Empirical Study
Journal of Religion and Health (2020)
-
Complex visual analysis of ecologically relevant signals in Siamese fighting fish
Animal Cognition (2020)
-
Scale-free behaviour and metastable brain-state switching driven by human cognition, an empirical approach
Cognitive Neurodynamics (2019)
-
Bálint syndrome caused by bilateral medial occipital infarcts
Neurological Sciences (2018)