Skip to main content
Top

2015 | OriginalPaper | Chapter

Search Guided Saliency

Authors : Shijian Lu, Byung-Uck Kim, Nicolas Lomenie, Joo-Hwee Lim, Jianfei Cai

Published in: Computer Vision - ACCV 2014 Workshops

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We propose a new type of saliency as inspired by findings from visual search studies - the searching difficulty is correlated with the target-distractor contrast, the distractor homogeneity, as well as the target uniqueness. By putting an image pixel as the target and the surrounding pixels as distractors, a search guided saliency model is designed in accordance with these findings. In particular, three saliency measures in correspondence to the three searching factors are simultaneously computed and integrated by using a series of contextual histograms. The proposed model has been evaluated over three public datasets and experiments show superior prediction of the human fixations when compared to the state-of-the-art models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Tsotsos, J.: Analyzing vision at the complexity level. Behav. Brain Sci. 13, 423–445 (1990)CrossRef Tsotsos, J.: Analyzing vision at the complexity level. Behav. Brain Sci. 13, 423–445 (1990)CrossRef
2.
go back to reference Feng, J., Wei, Y., Tao, L., Zhang, C., Sun, J.: Salient object detection by composition. In: IEEE ICCV, pp. 1028–1035 (2011) Feng, J., Wei, Y., Tao, L., Zhang, C., Sun, J.: Salient object detection by composition. In: IEEE ICCV, pp. 1028–1035 (2011)
3.
go back to reference Marchesotti, L., Cifarelli, C., Csurka, G.: A framework for visual saliency detection with applications to image thumbnailing. In: IEEE ICCV, pp. 2232–2239 (2009) Marchesotti, L., Cifarelli, C., Csurka, G.: A framework for visual saliency detection with applications to image thumbnailing. In: IEEE ICCV, pp. 2232–2239 (2009)
4.
go back to reference Sharma, G., Jurie, F., Schmid, C.: Discriminative spatial saliency for image classification. In: IEEE CVPR, pp. 3506–3513 (2012) Sharma, G., Jurie, F., Schmid, C.: Discriminative spatial saliency for image classification. In: IEEE CVPR, pp. 3506–3513 (2012)
5.
go back to reference Wang, P., Wang, J., Zeng, G., Feng, J., Zha, H., Li, S.: Salient object detection for searched web images via global saliency. In: IEEE CVPR, pp. 3194–3201 (2012) Wang, P., Wang, J., Zeng, G., Feng, J., Zha, H., Li, S.: Salient object detection for searched web images via global saliency. In: IEEE CVPR, pp. 3194–3201 (2012)
6.
go back to reference Bruce, N., Tsotsos, J.: Saliency, attention, and visual search: an information theoretic approach. J. Vis. 9, 1–24 (2009)CrossRef Bruce, N., Tsotsos, J.: Saliency, attention, and visual search: an information theoretic approach. J. Vis. 9, 1–24 (2009)CrossRef
7.
go back to reference Hou, X., Zhang, L.: Saliency detection: a spectral residual approach. In: IEEE CVPR, pp. 1–8 (2007) Hou, X., Zhang, L.: Saliency detection: a spectral residual approach. In: IEEE CVPR, pp. 1–8 (2007)
8.
go back to reference Judd, T., Durand, F., Torralba, A.: A benchmark of computational models of saliency to predict human fixations. MIT Computer Science and Artificial Intelligence Laboratory Technical Report, MIT-CSAIL-TR-2012-001 (2012) Judd, T., Durand, F., Torralba, A.: A benchmark of computational models of saliency to predict human fixations. MIT Computer Science and Artificial Intelligence Laboratory Technical Report, MIT-CSAIL-TR-2012-001 (2012)
9.
go back to reference Borji, A., Sihite, D., Itti, L.: Quantitative analysis of human-model agreement in visual saliency modeling: a comparative study. IEEE TIP 22, 55–69 (2012)MathSciNet Borji, A., Sihite, D., Itti, L.: Quantitative analysis of human-model agreement in visual saliency modeling: a comparative study. IEEE TIP 22, 55–69 (2012)MathSciNet
10.
go back to reference Gao, D., Vasconcelos, N.: Bottom-up saliency is a discriminant process. In: IEEE ICCV, pp. 1–6 (2007) Gao, D., Vasconcelos, N.: Bottom-up saliency is a discriminant process. In: IEEE ICCV, pp. 1–6 (2007)
11.
go back to reference Itti, L., Koch, C.: Computational modeling of visual attention. Nat. Rev. Neurosci. 2, 194–203 (2001)CrossRef Itti, L., Koch, C.: Computational modeling of visual attention. Nat. Rev. Neurosci. 2, 194–203 (2001)CrossRef
12.
go back to reference Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE TPAMI 20, 1254–1259 (1998)CrossRef Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE TPAMI 20, 1254–1259 (1998)CrossRef
13.
go back to reference Liu, T., Sun, J., Zheng, N., Tang, X., Shum, H.: Learning to detect a salient object. In: IEEE CVPR, pp. 1–8 (2007) Liu, T., Sun, J., Zheng, N., Tang, X., Shum, H.: Learning to detect a salient object. In: IEEE CVPR, pp. 1–8 (2007)
14.
go back to reference Cheng, M., Zhang, G., Mitra, N., Huang, X., Hu, S.: Global contrast based salient region detection. In: IEEE CVPR, pp. 409–16 (2011) Cheng, M., Zhang, G., Mitra, N., Huang, X., Hu, S.: Global contrast based salient region detection. In: IEEE CVPR, pp. 409–16 (2011)
15.
go back to reference Lu, S., Lim, J.-H.: Saliency modeling from image histograms. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VII. LNCS, vol. 7578, pp. 321–332. Springer, Heidelberg (2012) CrossRef Lu, S., Lim, J.-H.: Saliency modeling from image histograms. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VII. LNCS, vol. 7578, pp. 321–332. Springer, Heidelberg (2012) CrossRef
16.
go back to reference Lu, S., Tan, C., Lim, J.: Robust and efficient saliency modeling from image co-occurrence histograms. IEEE TPAMI 36, 195–201 (2013) Lu, S., Tan, C., Lim, J.: Robust and efficient saliency modeling from image co-occurrence histograms. IEEE TPAMI 36, 195–201 (2013)
17.
go back to reference Goferman, S., Zelnik-Manor, Tal, A.: Context-aware saliency detection. In: IEEE CVPR, pp. 2376–2383 (2010) Goferman, S., Zelnik-Manor, Tal, A.: Context-aware saliency detection. In: IEEE CVPR, pp. 2376–2383 (2010)
18.
go back to reference Wang, L., Xue, J., Zheng, N., Hua, G.: Automatic salient object extraction with contextual cue. In: IEEE ICCV, pp. 105–112 (2011) Wang, L., Xue, J., Zheng, N., Hua, G.: Automatic salient object extraction with contextual cue. In: IEEE ICCV, pp. 105–112 (2011)
19.
go back to reference Margolin, R., Tal, A., Zelnik-Manor, L.: What makes a patch distinct? In: IEEE CVPR, pp. 1139–1146 (2013) Margolin, R., Tal, A., Zelnik-Manor, L.: What makes a patch distinct? In: IEEE CVPR, pp. 1139–1146 (2013)
20.
go back to reference Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency-tuned salient region detection. In: IEEE CVPR, pp. 1597–1604 (2009) Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency-tuned salient region detection. In: IEEE CVPR, pp. 1597–1604 (2009)
21.
go back to reference Guo, C., Ma, Q., Zhang, L.: Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In: IEEE CVPR, pp. 1–8 (2008) Guo, C., Ma, Q., Zhang, L.: Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In: IEEE CVPR, pp. 1–8 (2008)
22.
go back to reference Hou, X., Harel, J., Koch, C.: Image signature: highlighting sparse salient regions. IEEE TPAMI 34, 194–201 (2012)CrossRef Hou, X., Harel, J., Koch, C.: Image signature: highlighting sparse salient regions. IEEE TPAMI 34, 194–201 (2012)CrossRef
23.
go back to reference Bruce, N., Tsotsos, J.: Saliency based on information maximization. NIPS 18, 155–162 (2006) Bruce, N., Tsotsos, J.: Saliency based on information maximization. NIPS 18, 155–162 (2006)
24.
go back to reference Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predict where humans look. In: IEEE ICCV, pp. 2106–2113 (2009) Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predict where humans look. In: IEEE ICCV, pp. 2106–2113 (2009)
25.
go back to reference Zhang, L., Tong, M.H., Marks, T.K., Cottrell, G.W.: Sun: a bayesian framework for saliency using natural statistics. J. Vis. 8, 1–20 (2008) Zhang, L., Tong, M.H., Marks, T.K., Cottrell, G.W.: Sun: a bayesian framework for saliency using natural statistics. J. Vis. 8, 1–20 (2008)
26.
go back to reference Zhao, Q., Koch, C.: Learning a saliency map using fixated locations in natural scenes. J. Vis. 3, 1–15 (2011)CrossRef Zhao, Q., Koch, C.: Learning a saliency map using fixated locations in natural scenes. J. Vis. 3, 1–15 (2011)CrossRef
27.
go back to reference Rudoy, D., Goldman, D., Shechtman, E., Zelnik-Manor, L.: Learning video saliency from human gaze using candidate selection. In: IEEE CVPR, pp. 1147–1154 (2013) Rudoy, D., Goldman, D., Shechtman, E., Zelnik-Manor, L.: Learning video saliency from human gaze using candidate selection. In: IEEE CVPR, pp. 1147–1154 (2013)
28.
go back to reference Treisman, A., Gelade, G.: A feature-integration theory of attention. Cogn. Psychol. 12, 97–136 (1980)CrossRef Treisman, A., Gelade, G.: A feature-integration theory of attention. Cogn. Psychol. 12, 97–136 (1980)CrossRef
29.
go back to reference Duncan, J., Humphreys, G.: Visual search and stimulus similarity. Psychol. Rev. 96, 433–458 (1989)CrossRef Duncan, J., Humphreys, G.: Visual search and stimulus similarity. Psychol. Rev. 96, 433–458 (1989)CrossRef
30.
go back to reference Wolfe, J.: Guided search 2.0 a revised model of visual search. Psychon. Bull. Rev. 1, 202–238 (1994)CrossRef Wolfe, J.: Guided search 2.0 a revised model of visual search. Psychon. Bull. Rev. 1, 202–238 (1994)CrossRef
31.
go back to reference Borji, A., Itti, L.: Exploiting local and global patch rarities for saliency detection. In: IEEE CVPR, pp. 478–485 (2012) Borji, A., Itti, L.: Exploiting local and global patch rarities for saliency detection. In: IEEE CVPR, pp. 478–485 (2012)
32.
go back to reference Tatler, B., Baddeley, R., Gilchrist, I.: Visual correlates of fixation selection effects of scale and time. Vis. Res. 45, 643–659 (2005)CrossRef Tatler, B., Baddeley, R., Gilchrist, I.: Visual correlates of fixation selection effects of scale and time. Vis. Res. 45, 643–659 (2005)CrossRef
Metadata
Title
Search Guided Saliency
Authors
Shijian Lu
Byung-Uck Kim
Nicolas Lomenie
Joo-Hwee Lim
Jianfei Cai
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-16628-5_32

Premium Partner