Skip to main content

2017 | OriginalPaper | Buchkapitel

Exploiting Visual Saliency Algorithms for Object-Based Attention: A New Color and Scale-Based Approach

verfasst von : Edoardo Ardizzone, Alessandro Bruno, Francesco Gugliuzza

Erschienen in: Image Analysis and Processing - ICIAP 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Visual Saliency aims to detect the most important regions of an image from a perceptual point of view. More in detail, the goal of Visual Saliency is to build a Saliency Map revealing the salient subset of a given image by analyzing bottom-up and top-down factors of Visual Attention. In this paper we proposed a new method for Saliency detection based on colour and scale analysis, extending our previous work based on SIFT spatial density inspection. We conducted several experiments to study the relationships between saliency methods and the object attention processes and we collected experimental data by tracking the eye movements of thirty viewers in the first three seconds of observation of several images. More precisely, we used a dataset that consists of images with an object in the foreground on an homogeneous background. We are interested in studying the performance of our saliency method with respect to the real fixation maps collected during the experiments. We compared the performances of our method with several state of the art methods with very encouraging results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Not to be confused with CIE XYZ.
 
Literatur
1.
Zurück zum Zitat Li, J., Gao, W.: Visual Saliency Computation: A Machine Learning Perspective, vol. 8408. Springer, Heidelberg (2014) Li, J., Gao, W.: Visual Saliency Computation: A Machine Learning Perspective, vol. 8408. Springer, Heidelberg (2014)
2.
Zurück zum Zitat Snowden, R., Snowden, R.J., Thompson, P., Troscianko, T.: Basic Vision: An Introduction to Visual Perception. Oxford University Press, Oxford (2012) Snowden, R., Snowden, R.J., Thompson, P., Troscianko, T.: Basic Vision: An Introduction to Visual Perception. Oxford University Press, Oxford (2012)
3.
Zurück zum Zitat Egeth, H.E., Yantis, S.: Visual attention: control, representation, and time course. Annu. Rev. Psychol. 48(1), 269–297 (1997)CrossRef Egeth, H.E., Yantis, S.: Visual attention: control, representation, and time course. Annu. Rev. Psychol. 48(1), 269–297 (1997)CrossRef
4.
Zurück zum Zitat Bressler, S.L., Tang, W., Sylvester, C.M., Shulman, G.L., Corbetta, M.: Top-down control of human visual cortex by frontal and parietal cortex in anticipatory visual spatial attention. J. Neurosci. 28(40), 10056–10061 (2008)CrossRef Bressler, S.L., Tang, W., Sylvester, C.M., Shulman, G.L., Corbetta, M.: Top-down control of human visual cortex by frontal and parietal cortex in anticipatory visual spatial attention. J. Neurosci. 28(40), 10056–10061 (2008)CrossRef
6.
Zurück zum Zitat Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRef Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRef
7.
Zurück zum Zitat Harel, J., Koch, C., Perona, P., et al.: Graph-based visual saliency. In: NIPS, vol. 1, p. 5 (2006) Harel, J., Koch, C., Perona, P., et al.: Graph-based visual saliency. In: NIPS, vol. 1, p. 5 (2006)
8.
Zurück zum Zitat Luo, J.: Subject content-based intelligent cropping of digital photos. In: 2007 IEEE International Conference on Multimedia and Expo, pp. 2218–2221. IEEE (2007) Luo, J.: Subject content-based intelligent cropping of digital photos. In: 2007 IEEE International Conference on Multimedia and Expo, pp. 2218–2221. IEEE (2007)
9.
Zurück zum Zitat Tsai, M.J., Hou, H.T., Lai, M.L., Liu, W.Y., Yang, F.Y.: Visual attention for solving multiple-choice science problem: an eye-tracking analysis. Comput. Educ. 58(1), 375–385 (2012)CrossRef Tsai, M.J., Hou, H.T., Lai, M.L., Liu, W.Y., Yang, F.Y.: Visual attention for solving multiple-choice science problem: an eye-tracking analysis. Comput. Educ. 58(1), 375–385 (2012)CrossRef
11.
Zurück zum Zitat Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predict where humans look. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 2106–2113. IEEE (2009) Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predict where humans look. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 2106–2113. IEEE (2009)
12.
Zurück zum Zitat Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. In: Vaina, L.M. (ed.) Matters of Intelligence. Synthese Library (Studies in Epistemology, Logic, Methodology, and Philosophy of Science), pp. 115–141. Springer, Dordrecht (1987). doi:10.1007/978-94-009-3833-5_5 CrossRef Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. In: Vaina, L.M. (ed.) Matters of Intelligence. Synthese Library (Studies in Epistemology, Logic, Methodology, and Philosophy of Science), pp. 115–141. Springer, Dordrecht (1987). doi:10.​1007/​978-94-009-3833-5_​5 CrossRef
13.
Zurück zum Zitat Wang, L., Dong, S.L., Li, H.S., Zhu, X.B.: A brief survey of low-level saliency detection. In: 2016 International Conference on Information System and Artificial Intelligence (ISAI), pp. 590–593. IEEE (2016) Wang, L., Dong, S.L., Li, H.S., Zhu, X.B.: A brief survey of low-level saliency detection. In: 2016 International Conference on Information System and Artificial Intelligence (ISAI), pp. 590–593. IEEE (2016)
14.
Zurück zum Zitat Sun, L., Tang, Y., Zhang, H.: Visual saliency detection based on multi-scale and multi-channel mean. Multimedia Tools Appl. 75(1), 667–684 (2016)CrossRef Sun, L., Tang, Y., Zhang, H.: Visual saliency detection based on multi-scale and multi-channel mean. Multimedia Tools Appl. 75(1), 667–684 (2016)CrossRef
15.
Zurück zum Zitat Ardizzone, E., Bruno, A., Mazzola, G.: Visual saliency by keypoints distribution analysis. In: Maino, G., Foresti, G.L. (eds.) ICIAP 2011. LNCS, vol. 6978, pp. 691–699. Springer, Heidelberg (2011). doi:10.1007/978-3-642-24085-0_70 CrossRef Ardizzone, E., Bruno, A., Mazzola, G.: Visual saliency by keypoints distribution analysis. In: Maino, G., Foresti, G.L. (eds.) ICIAP 2011. LNCS, vol. 6978, pp. 691–699. Springer, Heidelberg (2011). doi:10.​1007/​978-3-642-24085-0_​70 CrossRef
16.
Zurück zum Zitat Ardizzone, E., Bruno, A., Mazzola, G.: Scale detection via keypoint density maps in regular or near-regular textures. Pattern Recogn. Lett. 34(16), 2071–2078 (2013)CrossRef Ardizzone, E., Bruno, A., Mazzola, G.: Scale detection via keypoint density maps in regular or near-regular textures. Pattern Recogn. Lett. 34(16), 2071–2078 (2013)CrossRef
18.
Zurück zum Zitat Sundstedt, V., Chalmers, A., Cater, K., Debattista, K.: Top-down visual attention for efficient rendering of task related scenes. In: VMV, pp. 209–216 (2004) Sundstedt, V., Chalmers, A., Cater, K., Debattista, K.: Top-down visual attention for efficient rendering of task related scenes. In: VMV, pp. 209–216 (2004)
19.
Zurück zum Zitat Yang, J., Yang, M.H.: Top-down visual saliency via joint CRF and dictionary learning. IEEE Trans. Pattern Anal. Mach. Intell. 39(3), 576–588 (2017)CrossRef Yang, J., Yang, M.H.: Top-down visual saliency via joint CRF and dictionary learning. IEEE Trans. Pattern Anal. Mach. Intell. 39(3), 576–588 (2017)CrossRef
20.
Zurück zum Zitat Tsotsos, J.K., Rothenstein, A.: Computational models of visual attention. Scholarpedia 6(1), 6201 (2011)CrossRef Tsotsos, J.K., Rothenstein, A.: Computational models of visual attention. Scholarpedia 6(1), 6201 (2011)CrossRef
21.
Zurück zum Zitat Chen, L.Q., Xie, X., Fan, X., Ma, W.Y., Zhang, H.J., Zhou, H.Q.: A visual attention model for adapting images on small displays. Multimedia Syst. 9(4), 353–364 (2003)CrossRef Chen, L.Q., Xie, X., Fan, X., Ma, W.Y., Zhang, H.J., Zhou, H.Q.: A visual attention model for adapting images on small displays. Multimedia Syst. 9(4), 353–364 (2003)CrossRef
23.
Zurück zum Zitat Yu, J.G., Xia, G.S., Gao, C., Samal, A.: A computational model for object-based visual saliency: spreading attention along Gestalt cues. IEEE Trans. Multimedia 18(2), 273–286 (2016)CrossRef Yu, J.G., Xia, G.S., Gao, C., Samal, A.: A computational model for object-based visual saliency: spreading attention along Gestalt cues. IEEE Trans. Multimedia 18(2), 273–286 (2016)CrossRef
24.
Zurück zum Zitat Li, G., Yu, Y.: Visual saliency detection based on multiscale deep CNN features. IEEE Trans. Image Process. 25(11), 5012–5024 (2016)MathSciNetCrossRef Li, G., Yu, Y.: Visual saliency detection based on multiscale deep CNN features. IEEE Trans. Image Process. 25(11), 5012–5024 (2016)MathSciNetCrossRef
25.
Zurück zum Zitat Toet, A.: Computational versus psychophysical bottom-up image saliency: a comparative evaluation study. IEEE Trans. Pattern Anal. Mach. Intell. 33(11), 2131–2146 (2011)CrossRef Toet, A.: Computational versus psychophysical bottom-up image saliency: a comparative evaluation study. IEEE Trans. Pattern Anal. Mach. Intell. 33(11), 2131–2146 (2011)CrossRef
26.
Zurück zum Zitat Duncan, K., Sarkar, S.: Saliency in images and video: a brief survey. IET Comput. Vis. 6(6), 514–523 (2012)CrossRef Duncan, K., Sarkar, S.: Saliency in images and video: a brief survey. IET Comput. Vis. 6(6), 514–523 (2012)CrossRef
27.
Zurück zum Zitat Viksten, F., Forssén, P.E., Johansson, B., Moe, A.: Comparison of local image descriptors for full 6 degree-of-freedom pose estimation. In: IEEE International Conference on Robotics and Automation, ICRA 2009, pp. 2779–2786. IEEE (2009) Viksten, F., Forssén, P.E., Johansson, B., Moe, A.: Comparison of local image descriptors for full 6 degree-of-freedom pose estimation. In: IEEE International Conference on Robotics and Automation, ICRA 2009, pp. 2779–2786. IEEE (2009)
28.
Zurück zum Zitat Gibaldi, A., Vanegas, M., Bex, P.J., Maiello, G.: Evaluation of the Tobii EyeX Eye tracking controller and Matlab toolkit for research. Behav. Res. Methods 49, 1–24 (2016) Gibaldi, A., Vanegas, M., Bex, P.J., Maiello, G.: Evaluation of the Tobii EyeX Eye tracking controller and Matlab toolkit for research. Behav. Res. Methods 49, 1–24 (2016)
29.
Zurück zum Zitat Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
30.
Zurück zum Zitat Engel, S., Zhang, X., Wandell, B.: Colour tuning in human visual cortex measured with functional magnetic resonance imaging. Nature 388(6637), 68–71 (1997)CrossRef Engel, S., Zhang, X., Wandell, B.: Colour tuning in human visual cortex measured with functional magnetic resonance imaging. Nature 388(6637), 68–71 (1997)CrossRef
31.
Zurück zum Zitat Sharma, G.: Color fundamentals for digital imaging. In: Digital Color Imaging Handbook. CRC Press (2002) Sharma, G.: Color fundamentals for digital imaging. In: Digital Color Imaging Handbook. CRC Press (2002)
33.
Zurück zum Zitat Bylinskii, Z., Judd, T., Oliva, A., Torralba, A., Durand, F.: What do different evaluation metrics tell us about saliency models? arXiv preprint arXiv:1604.03605 (2016) Bylinskii, Z., Judd, T., Oliva, A., Torralba, A., Durand, F.: What do different evaluation metrics tell us about saliency models? arXiv preprint arXiv:​1604.​03605 (2016)
Metadaten
Titel
Exploiting Visual Saliency Algorithms for Object-Based Attention: A New Color and Scale-Based Approach
verfasst von
Edoardo Ardizzone
Alessandro Bruno
Francesco Gugliuzza
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-68548-9_18

Premium Partner