Skip to main content
Erschienen in: Cognitive Neurodynamics 3/2010

01.09.2010 | Original Research

Visual saliency: a biologically plausible contourlet-like frequency domain approach

verfasst von: Peng Bian, Liming Zhang

Erschienen in: Cognitive Neurodynamics | Ausgabe 3/2010

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper we propose a fast frequency domain saliency detection method that is also biologically plausible, referred to as frequency domain divisive normalization (FDN). We show that the initial feature extraction stage, common to all spatial domain approaches, can be simplified to a Fourier transform with a contourlet-like grouping of coefficients, and saliency detection can be achieved in frequency domain. Specifically, we show that divisive normalization, a model of cortical surround inhibition, can be conducted in frequency domain. Since Fourier coefficients are global in space, we extend to this model by conducting piecewise FDN (PFDN) using overlapping local patches to provide better biological plausibility. Not only do FDN and PFDN outperform current state-of-the-art methods in eye fixation prediction, they are also faster. Speed and simplicity are advantages of our frequency domain approach, and its biological plausibility is the main contribution of our paper.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Atick JJ, Redlich AN (1992) What does the retina know about natural scenes? Neural Comput 4:196–210CrossRef Atick JJ, Redlich AN (1992) What does the retina know about natural scenes? Neural Comput 4:196–210CrossRef
Zurück zum Zitat Barlow HB (1961) The coding of sensory messages. In: Thorpe WH, Zangwill OL (eds) Current problems in animal behavior. Cambridge University Press, Cambridge, pp 331–360 Barlow HB (1961) The coding of sensory messages. In: Thorpe WH, Zangwill OL (eds) Current problems in animal behavior. Cambridge University Press, Cambridge, pp 331–360
Zurück zum Zitat Bruce ND, Tsotsos JK (2006) Saliency based on information maximization. Adv NIPS 18:155–162 Bruce ND, Tsotsos JK (2006) Saliency based on information maximization. Adv NIPS 18:155–162
Zurück zum Zitat Cavanaugh JR, Bair W, Movshon JA (1997) Orientation-selective setting of contrast gain by the surrounds of macaque striate cortex neurons. Neurosci Abstr 23:227.2 Cavanaugh JR, Bair W, Movshon JA (1997) Orientation-selective setting of contrast gain by the surrounds of macaque striate cortex neurons. Neurosci Abstr 23:227.2
Zurück zum Zitat Cavanaugh JR, Bair W, Movshon JA (2002) Selectivity and spatial distribution of signals from the receptive field surround in macaque V1 neurons. J Neurosci 88:2547–2556 Cavanaugh JR, Bair W, Movshon JA (2002) Selectivity and spatial distribution of signals from the receptive field surround in macaque V1 neurons. J Neurosci 88:2547–2556
Zurück zum Zitat Do MN, Vetterli M (2005) The contourlet transform: an efficient directional multiresolution image representation. Off J Eur Union Inf Not 49:2091–2106 Do MN, Vetterli M (2005) The contourlet transform: an efficient directional multiresolution image representation. Off J Eur Union Inf Not 49:2091–2106
Zurück zum Zitat Field DJ (1987) Relations between the statistics of natural images and the response profiles of cortical cells. J Opt Soc Am 4:2379–2394CrossRef Field DJ (1987) Relations between the statistics of natural images and the response profiles of cortical cells. J Opt Soc Am 4:2379–2394CrossRef
Zurück zum Zitat Gao D, Mahadevan V, Vasconcelos N (2008) The discriminant center-surround hypothesis for bottom-up saliency. Adv NIPS 20:497–504 Gao D, Mahadevan V, Vasconcelos N (2008) The discriminant center-surround hypothesis for bottom-up saliency. Adv NIPS 20:497–504
Zurück zum Zitat Guo CL, Zhang LM (2010) A novel multiresolution spatio temporal saliency detection model and its applications in image and video compression. IEEE Trans IP 19(1):185–198 Guo CL, Zhang LM (2010) A novel multiresolution spatio temporal saliency detection model and its applications in image and video compression. IEEE Trans IP 19(1):185–198
Zurück zum Zitat Guo CL, Ma Q, Zhang LM. (2008). Spatio-temporal saliency detection using phase spectrum of quaternion Fourier transform. In: Proceedings of CVPR 2008 Guo CL, Ma Q, Zhang LM. (2008). Spatio-temporal saliency detection using phase spectrum of quaternion Fourier transform. In: Proceedings of CVPR 2008
Zurück zum Zitat Harel J, Koch C, Perona P (2007) Graph-based visual saliency. Adv NIPS 19:545–552 Harel J, Koch C, Perona P (2007) Graph-based visual saliency. Adv NIPS 19:545–552
Zurück zum Zitat Hou X, Zhang L (2007) Saliency detection: a spectral residual approach. In: Proceedings of CVPR 2007 Hou X, Zhang L (2007) Saliency detection: a spectral residual approach. In: Proceedings of CVPR 2007
Zurück zum Zitat Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans PAMI 20(11):1254–1259 Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans PAMI 20(11):1254–1259
Zurück zum Zitat Itti L, Braun J, Lee DK, Koch C (1999) Attentional modulation of human pattern discrimination psychophysics reproduced by a quantitative model. Neural Netw 19:143–1439 Itti L, Braun J, Lee DK, Koch C (1999) Attentional modulation of human pattern discrimination psychophysics reproduced by a quantitative model. Neural Netw 19:143–1439
Zurück zum Zitat Li Z, Dayan P (2006) Pre-attentive visual selection. Neural Netw 19:143–1439 Li Z, Dayan P (2006) Pre-attentive visual selection. Neural Netw 19:143–1439
Zurück zum Zitat Lu ZK, Lin WS, Yang XK, Ong E, Yao S (2005) Modeling visual attention’s modulatory after effects on visual sensitivity and quality evaluation. IEEE Trans IP 14(11):1928–1942 Lu ZK, Lin WS, Yang XK, Ong E, Yao S (2005) Modeling visual attention’s modulatory after effects on visual sensitivity and quality evaluation. IEEE Trans IP 14(11):1928–1942
Zurück zum Zitat Navon D (1997) Forest before trees—precedence of global features in visual-perception. Cogn Psychol 9:353–383CrossRef Navon D (1997) Forest before trees—precedence of global features in visual-perception. Cogn Psychol 9:353–383CrossRef
Zurück zum Zitat Nothdurft HC (2000) Salience from feature contrast: variations with texture density. Vision Res 40(23):3181–3200CrossRefPubMed Nothdurft HC (2000) Salience from feature contrast: variations with texture density. Vision Res 40(23):3181–3200CrossRefPubMed
Zurück zum Zitat Ruderman D (1994) The statistics of natural images. Netw Comput Neural Syst 5(4):517–548CrossRef Ruderman D (1994) The statistics of natural images. Netw Comput Neural Syst 5(4):517–548CrossRef
Zurück zum Zitat Rutishauser U, Walther D, Koch C, Perona P (2004) Is bottom-up attention useful for object recognition? In: Proceedings of CVPR 2004 Rutishauser U, Walther D, Koch C, Perona P (2004) Is bottom-up attention useful for object recognition? In: Proceedings of CVPR 2004
Zurück zum Zitat Simoncelli EP, Schwartz O (1999) Modeling surround suppression in V1 neurons with a statistically-derived normalization model. Adv NIPS 11:153–159 Simoncelli EP, Schwartz O (1999) Modeling surround suppression in V1 neurons with a statistically-derived normalization model. Adv NIPS 11:153–159
Zurück zum Zitat Tatler BW, Baddeley RJ, Gilchrist ID (2005) Visual correlates of fixation selection: effects of scale and time. Vision Res 45:643–659CrossRefPubMed Tatler BW, Baddeley RJ, Gilchrist ID (2005) Visual correlates of fixation selection: effects of scale and time. Vision Res 45:643–659CrossRefPubMed
Zurück zum Zitat Walther D, Koch C (2006) Modeling attention to salient proto-objects. Neural Netw 19:1395–1407CrossRefPubMed Walther D, Koch C (2006) Modeling attention to salient proto-objects. Neural Netw 19:1395–1407CrossRefPubMed
Metadaten
Titel
Visual saliency: a biologically plausible contourlet-like frequency domain approach
verfasst von
Peng Bian
Liming Zhang
Publikationsdatum
01.09.2010
Verlag
Springer Netherlands
Erschienen in
Cognitive Neurodynamics / Ausgabe 3/2010
Print ISSN: 1871-4080
Elektronische ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-010-9122-0

Weitere Artikel der Ausgabe 3/2010

Cognitive Neurodynamics 3/2010 Zur Ausgabe