Skip to main content

2015 | OriginalPaper | Buchkapitel

Saliency Aggregation: Does Unity Make Strength?

verfasst von : Olivier Le Meur, Zhi Liu

Erschienen in: Computer Vision -- ACCV 2014

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this study, we investigate whether the aggregation of saliency maps allows to outperform the best saliency models. This paper discusses various aggregation methods; six unsupervised and four supervised learning methods are tested on two existing eye fixation datasets. Results show that a simple average of the TOP 2 saliency maps significantly outperforms the best saliency models. Considering more saliency models tends to decrease the performance, even when robust aggregation methods are used. Concerning the supervised learning methods, we provide evidence that it is possible to further increase the performance, under the condition that an image similar to the input image can be found in the training dataset. Our results might have an impact for critical applications which require robust and relevant saliency maps.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiol. 4, 219–227 (1985) Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiol. 4, 219–227 (1985)
2.
Zurück zum Zitat Borji, A., Itti, L.: State-of-the-art in visual attention modeling. IEEE Trans. Pattern Anal. Mach. Intell. 35, 185–207 (2013)CrossRef Borji, A., Itti, L.: State-of-the-art in visual attention modeling. IEEE Trans. Pattern Anal. Mach. Intell. 35, 185–207 (2013)CrossRef
3.
Zurück zum Zitat Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Proceedings of Neural Information Processing Systems (NIPS) (2006) Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Proceedings of Neural Information Processing Systems (NIPS) (2006)
4.
Zurück zum Zitat Le Meur, O., Le Callet, P., Barba, D., Thoreau, D.: A coherent computational approach to model the bottom-up visual attention. IEEE Trans. PAMI 28, 802–817 (2006)CrossRef Le Meur, O., Le Callet, P., Barba, D., Thoreau, D.: A coherent computational approach to model the bottom-up visual attention. IEEE Trans. PAMI 28, 802–817 (2006)CrossRef
5.
Zurück zum Zitat Garcia-Diaz, A., Fdez-Vidal, X.R., Pardo, X.M., Dosil, R.: Saliency from hierarchical adaptation through decorrelation and variance normalization. Image Vis. Comput. 30, 51–64 (2012)CrossRef Garcia-Diaz, A., Fdez-Vidal, X.R., Pardo, X.M., Dosil, R.: Saliency from hierarchical adaptation through decorrelation and variance normalization. Image Vis. Comput. 30, 51–64 (2012)CrossRef
6.
Zurück zum Zitat Itti, L., Koch, C., Niebur, E.: A model for saliency-based visual attention for rapid scene analysis. IEEE Trans. PAMI 20, 1254–1259 (1998)CrossRef Itti, L., Koch, C., Niebur, E.: A model for saliency-based visual attention for rapid scene analysis. IEEE Trans. PAMI 20, 1254–1259 (1998)CrossRef
7.
Zurück zum Zitat Bruce, N., Tsotsos, J.: Saliency, attention and visual search: an information theoretic approach. J. Vis. 9, 1–24 (2009)CrossRef Bruce, N., Tsotsos, J.: Saliency, attention and visual search: an information theoretic approach. J. Vis. 9, 1–24 (2009)CrossRef
8.
Zurück zum Zitat Hou, X., Zhang, L.: Saliency detection: A spectral residual approach. In: CVPR (2007) Hou, X., Zhang, L.: Saliency detection: A spectral residual approach. In: CVPR (2007)
9.
Zurück zum Zitat Borji, A., Sihite, D.N., Itti, L.: Salient object detection: A benchmark. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 414–429. Springer, Heidelberg (2012) CrossRef Borji, A., Sihite, D.N., Itti, L.: Salient object detection: A benchmark. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 414–429. Springer, Heidelberg (2012) CrossRef
10.
Zurück zum Zitat Mai, L., Niu, Y., Feng, L.: Saliency aggregation: a data-driven approach. In: CVPR (2013) Mai, L., Niu, Y., Feng, L.: Saliency aggregation: a data-driven approach. In: CVPR (2013)
11.
Zurück zum Zitat Liu, Z., Zou, W., Le Meur, O.: Saliency tree: A novel saliency detection framework. IEEE Trans. Image Process. 23, 1937–1952 (2014)CrossRefMathSciNet Liu, Z., Zou, W., Le Meur, O.: Saliency tree: A novel saliency detection framework. IEEE Trans. Image Process. 23, 1937–1952 (2014)CrossRefMathSciNet
12.
Zurück zum Zitat Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predict where people look. In: ICCV (2009) Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predict where people look. In: ICCV (2009)
13.
Zurück zum Zitat Riche, N., Mancas, M., Duvinage, M., Mibulumukini, M., Gosselin, B., Dutoit, T.: Rare 2012: A multi-scale rarity-based saliency detection with its comparative statistical analysis. Sig. Process. Image Commun. 28, 642–658 (2013)CrossRef Riche, N., Mancas, M., Duvinage, M., Mibulumukini, M., Gosselin, B., Dutoit, T.: Rare 2012: A multi-scale rarity-based saliency detection with its comparative statistical analysis. Sig. Process. Image Commun. 28, 642–658 (2013)CrossRef
14.
Zurück zum Zitat Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. PAMI 26, 1124–1137 (2004)CrossRef Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. PAMI 26, 1124–1137 (2004)CrossRef
15.
Zurück zum Zitat Le Meur, O., Baccino, T.: Methods for comparing scanpaths and saliency maps: strengths and weaknesses. Behav. Res. Method 1, 1–16 (2012) Le Meur, O., Baccino, T.: Methods for comparing scanpaths and saliency maps: strengths and weaknesses. Behav. Res. Method 1, 1–16 (2012)
16.
Zurück zum Zitat Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 5500, 2323–2326 (2000)CrossRef Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 5500, 2323–2326 (2000)CrossRef
17.
Zurück zum Zitat Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: Advances in Neural Information Processing System, (NIPS) (2000) Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: Advances in Neural Information Processing System, (NIPS) (2000)
18.
Zurück zum Zitat Huber, P.: Robust regression: Asymptotics, conjectures and monte carlo. Ann. Stat. 1, 799–821 (1973)CrossRefMATH Huber, P.: Robust regression: Asymptotics, conjectures and monte carlo. Ann. Stat. 1, 799–821 (1973)CrossRefMATH
19.
Zurück zum Zitat Peters, R.J., Iyer, A., Itti, L., Koch, C.: Components of bottom-up gaze allocation in natural images. Vis. Res. 45, 2397–2416 (2005)CrossRef Peters, R.J., Iyer, A., Itti, L., Koch, C.: Components of bottom-up gaze allocation in natural images. Vis. Res. 45, 2397–2416 (2005)CrossRef
20.
Zurück zum Zitat Borji, A., Sihite, D.N., Itti, L.: Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study. IEEE Trans. Image Process. 22, 55–69 (2012)CrossRefMathSciNet Borji, A., Sihite, D.N., Itti, L.: Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study. IEEE Trans. Image Process. 22, 55–69 (2012)CrossRefMathSciNet
21.
Zurück zum Zitat Jégou, H., Perronnin, F., Douze, M., Sánchez, J., Pérez, P., Schmid, C.: Aggregating local image descriptors into compact codes. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1704–1716 (2012)CrossRef Jégou, H., Perronnin, F., Douze, M., Sánchez, J., Pérez, P., Schmid, C.: Aggregating local image descriptors into compact codes. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1704–1716 (2012)CrossRef
22.
Zurück zum Zitat Yubing, T., Cheikh, F., Guraya, F., Konik, H., Trémeau, A.: A spatiotemporal saliency model for video surveillance. Cogn. Comput. 3, 241–263 (2011)CrossRef Yubing, T., Cheikh, F., Guraya, F., Konik, H., Trémeau, A.: A spatiotemporal saliency model for video surveillance. Cogn. Comput. 3, 241–263 (2011)CrossRef
23.
Zurück zum Zitat Liu, Z., Zhang, X., Luo, S., Le Meur, O.: Superpixel-based spatiotemporal saliency detection. IEEE Trans. Circuits Syst. Video Technol. 24, 1522–1540 (2014)CrossRef Liu, Z., Zhang, X., Luo, S., Le Meur, O.: Superpixel-based spatiotemporal saliency detection. IEEE Trans. Circuits Syst. Video Technol. 24, 1522–1540 (2014)CrossRef
24.
Zurück zum Zitat Mamede, S., Splinter, T., van Gog, T., Rikers, R.M.J.P., Schmidt, H.: Exploring the role of salient distracting clinical features in the emergence of diagnostic errors and the mechanisms through which reflection counteracts mistakes. BMJ Qual. Saf. 21, 295–300 (2012)CrossRef Mamede, S., Splinter, T., van Gog, T., Rikers, R.M.J.P., Schmidt, H.: Exploring the role of salient distracting clinical features in the emergence of diagnostic errors and the mechanisms through which reflection counteracts mistakes. BMJ Qual. Saf. 21, 295–300 (2012)CrossRef
25.
Zurück zum Zitat Won, W.J., Lee, M., Son, J.W.: Implementation of road traffic signs detection based on saliency map model. In: Intelligent Vehicles Symposium, pp. 542–547 (2008) Won, W.J., Lee, M., Son, J.W.: Implementation of road traffic signs detection based on saliency map model. In: Intelligent Vehicles Symposium, pp. 542–547 (2008)
Metadaten
Titel
Saliency Aggregation: Does Unity Make Strength?
verfasst von
Olivier Le Meur
Zhi Liu
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-16817-3_2