Skip to main content

2015 | OriginalPaper | Buchkapitel

Robust Salient Object Detection and Segmentation

verfasst von : Hong Li, Wen Wu, Enhua Wu

Erschienen in: Image and Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Background prior has been widely used in many salient object detection models with promising results. These methods assume that the image boundary is all background. Then, color feature based methods are used to extract the salient object. However, such assumption may be inaccurate when the salient object is partially cropped by the image boundary. Besides, using only color feature is also insufficient. We present a novel salient object detection model based on background selection and multi-features. Firstly, we present a simple but effective method to pick out more reliable background seeds. Secondly, we utilize multi-features enhanced graph-based manifold ranking to get the saliency maps. Finally, we also present the salient object segmentation via computed saliency map. Qualitative and quantitative evaluation results on three widely used data sets demonstrate significant appeal and advantages of our technique compared with many state-of-the art models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
For different channels in LAB and RGB color spaces, we perform the calculation separately and add the results together to get the corresponding feature descriptor.
 
Literatur
1.
Zurück zum Zitat Rutishauser, U., Walther, D., Koch, C., Perona, P.: Is bottom-up attention useful for object recognition?. In: IEEE CVPR, pp. II-37–II-44 (2004) Rutishauser, U., Walther, D., Koch, C., Perona, P.: Is bottom-up attention useful for object recognition?. In: IEEE CVPR, pp. II-37–II-44 (2004)
2.
Zurück zum Zitat Ren, Z., Gao, S., Chia, L.-T., Tsang, I.: Region-based saliency detection and its application in object recognition. IEEE TCSVT 24(5), 769–779 (2013) Ren, Z., Gao, S., Chia, L.-T., Tsang, I.: Region-based saliency detection and its application in object recognition. IEEE TCSVT 24(5), 769–779 (2013)
3.
Zurück zum Zitat Guo, C., Zhang, L.: A novel multi resolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE TIP 19(1), 185–198 (2010)MATH Guo, C., Zhang, L.: A novel multi resolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE TIP 19(1), 185–198 (2010)MATH
4.
Zurück zum Zitat Itti, L.: Automatic foveation for video compression using a neurobiological model of visual attention. IEEE TIP 13(10), 1304–1318 (2004) Itti, L.: Automatic foveation for video compression using a neurobiological model of visual attention. IEEE TIP 13(10), 1304–1318 (2004)
5.
Zurück zum Zitat Ding, Y., Xiao, J., Yu, J.: Importance filtering for image retargeting. In: IEEE CVPR, pp. 89–96 (2011) Ding, Y., Xiao, J., Yu, J.: Importance filtering for image retargeting. In: IEEE CVPR, pp. 89–96 (2011)
6.
Zurück zum Zitat Sun, J., Ling, H.: Scale and object aware image retargeting for thumbnail browsing. In: ICCV, pp. 1511–1518 (2011) Sun, J., Ling, H.: Scale and object aware image retargeting for thumbnail browsing. In: ICCV, pp. 1511–1518 (2011)
7.
Zurück zum Zitat Borji, A., Sihite, D.N., Itti, L.: Salient object detection: a benchmark. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 414–429. Springer, Heidelberg (2012) CrossRef Borji, A., Sihite, D.N., Itti, L.: Salient object detection: a benchmark. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 414–429. Springer, Heidelberg (2012) CrossRef
8.
Zurück zum Zitat Borji, A., Cheng, M.M., Jiang, H. Z., Li, J.: Salient object detection: a survey. CORR, abs/1411.5878 (2014) Borji, A., Cheng, M.M., Jiang, H. Z., Li, J.: Salient object detection: a survey. CORR, abs/1411.5878 (2014)
9.
Zurück zum Zitat Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. IEEE Trans. Patt. Anal. Mach. Intell. 32(10), 1915–1925 (2012)CrossRef Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. IEEE Trans. Patt. Anal. Mach. Intell. 32(10), 1915–1925 (2012)CrossRef
10.
Zurück zum Zitat Jiang, H., Wang, J., Yuan, Z., Liu, T., Zheng, N., Li, S.: Automatic salient object segmentation based on context and shape prior. In: BMVC, pp. 110.1–110.12 (2011) Jiang, H., Wang, J., Yuan, Z., Liu, T., Zheng, N., Li, S.: Automatic salient object segmentation based on context and shape prior. In: BMVC, pp. 110.1–110.12 (2011)
11.
Zurück zum Zitat Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Patt. Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRef Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Patt. Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRef
12.
Zurück zum Zitat Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency Tuned salient region detection. In: IEEE CVPR, pp. 1597–1604 (2009) Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency Tuned salient region detection. In: IEEE CVPR, pp. 1597–1604 (2009)
13.
Zurück zum Zitat Cheng, M., Zhang, G.X., Mitra, N.J. Huang, X., Hu, S.M.: Global contrast based salient region detection. In: IEEE CVPR, pp. 409–416 (2011) Cheng, M., Zhang, G.X., Mitra, N.J. Huang, X., Hu, S.M.: Global contrast based salient region detection. In: IEEE CVPR, pp. 409–416 (2011)
14.
Zurück zum Zitat Duan, L., Wu, C., Miao, J., Qing, L., Fu, Y.: Visual saliency detection by spatially weighted dissimilarity. In: IEEE CVPR, pp. 473–480 (2011) Duan, L., Wu, C., Miao, J., Qing, L., Fu, Y.: Visual saliency detection by spatially weighted dissimilarity. In: IEEE CVPR, pp. 473–480 (2011)
15.
Zurück zum Zitat Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predict where humans look. In: International Conference on Computer Vision, pp. 2106–2113 (2009) Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predict where humans look. In: International Conference on Computer Vision, pp. 2106–2113 (2009)
16.
Zurück zum Zitat Wei, Y., Wen, F., Zhu, W., Sun, J.: Geodesic saliency using background priors. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part III. LNCS, vol. 7574, pp. 29–42. Springer, Heidelberg (2012) CrossRef Wei, Y., Wen, F., Zhu, W., Sun, J.: Geodesic saliency using background priors. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part III. LNCS, vol. 7574, pp. 29–42. Springer, Heidelberg (2012) CrossRef
17.
Zurück zum Zitat Yang, C., Zhang, L., Lu, H., Ruan, X., Yang, M.H.: Saliency detection via graph-based manifold ranking. In: IEEE CVPR, pp. 3166–3173 (2013) Yang, C., Zhang, L., Lu, H., Ruan, X., Yang, M.H.: Saliency detection via graph-based manifold ranking. In: IEEE CVPR, pp. 3166–3173 (2013)
18.
Zurück zum Zitat Zhu, W., Liang, S., Wei, Y., Sun, J.: Saliency optimization from robust background detection. In: IEEE CVPR, pp. 2814–2821 (2014) Zhu, W., Liang, S., Wei, Y., Sun, J.: Saliency optimization from robust background detection. In: IEEE CVPR, pp. 2814–2821 (2014)
19.
Zurück zum Zitat Zhou, D., Weston, J., Gretton, A., Bousquet, O., Scholkopf, B.: Ranking on data manifolds. In: NIPS (2004) Zhou, D., Weston, J., Gretton, A., Bousquet, O., Scholkopf, B.: Ranking on data manifolds. In: NIPS (2004)
20.
Zurück zum Zitat Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Scholkopf, B.: Learning with local and global consistency. In: NIPS, pp. 321–328 (2004) Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Scholkopf, B.: Learning with local and global consistency. In: NIPS, pp. 321–328 (2004)
21.
Zurück zum Zitat Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Susstrunk, S.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Patt. Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Susstrunk, S.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Patt. Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef
22.
Zurück zum Zitat Gorisse, D., Cord, M., Precioso, F.: Locality-sensitive hashing for chi2 distance. IEEE Trans. Patt. Anal. Mach. Intell. 34(2), 402–409 (2012)CrossRef Gorisse, D., Cord, M., Precioso, F.: Locality-sensitive hashing for chi2 distance. IEEE Trans. Patt. Anal. Mach. Intell. 34(2), 402–409 (2012)CrossRef
23.
Zurück zum Zitat Movahedi, V., Elder, J.: Design and perceptual validation of performance measures for salient object segmentation. In: IEEE CVPRW, pp. 49–56 (2010) Movahedi, V., Elder, J.: Design and perceptual validation of performance measures for salient object segmentation. In: IEEE CVPRW, pp. 49–56 (2010)
24.
Zurück zum Zitat Yan, Q., Xu, L., Shi, J., Jia, J.: Hierarchical saliency detection. In: IEEE CVPR, pp. 1155–1162 (2013) Yan, Q., Xu, L., Shi, J., Jia, J.: Hierarchical saliency detection. In: IEEE CVPR, pp. 1155–1162 (2013)
25.
Zurück zum Zitat Li, X., Li, Y., Shen, C., Dick, A., Hengel, A.: Contextual hypergraph modelling for salient object detection. In: IEEE ICCV, pp. 3328–3335 (2013) Li, X., Li, Y., Shen, C., Dick, A., Hengel, A.: Contextual hypergraph modelling for salient object detection. In: IEEE ICCV, pp. 3328–3335 (2013)
26.
Zurück zum Zitat Rezazadegan Tavakoli, H., Rahtu, E., Heikkilä, J.: Fast and efficient saliency detection using sparse sampling and kernel density estimation. In: Heyden, A., Kahl, F. (eds.) SCIA 2011. LNCS, vol. 6688, pp. 666–675. Springer, Heidelberg (2011) CrossRef Rezazadegan Tavakoli, H., Rahtu, E., Heikkilä, J.: Fast and efficient saliency detection using sparse sampling and kernel density estimation. In: Heyden, A., Kahl, F. (eds.) SCIA 2011. LNCS, vol. 6688, pp. 666–675. Springer, Heidelberg (2011) CrossRef
27.
Zurück zum Zitat Kim, J., Han, D., Tai, Y.W., Kim, J.: Salient region detection via high-dimensional color transform. In: IEEE CVPR, pp. 883–890 (2014) Kim, J., Han, D., Tai, Y.W., Kim, J.: Salient region detection via high-dimensional color transform. In: IEEE CVPR, pp. 883–890 (2014)
28.
Zurück zum Zitat Jiang, B., Zhang, L., Lu, H., Yang, C.: Saliency detection via absorbing markov chain. In: IEEE ICCV, pp. 1665–1672 (2013) Jiang, B., Zhang, L., Lu, H., Yang, C.: Saliency detection via absorbing markov chain. In: IEEE ICCV, pp. 1665–1672 (2013)
29.
Zurück zum Zitat Achanta, R., Susstrunk, S.: Saliency detection using maximum symmetric surround. In: IEEE ICIP, pp. 2653–2656 (2010) Achanta, R., Susstrunk, S.: Saliency detection using maximum symmetric surround. In: IEEE ICIP, pp. 2653–2656 (2010)
30.
Zurück zum Zitat Margolin, R., Tal, A., Manor, L.: What makes a patch distinct?. In: IEEE CVPR, pp. 1139–1146 (2013) Margolin, R., Tal, A., Manor, L.: What makes a patch distinct?. In: IEEE CVPR, pp. 1139–1146 (2013)
31.
Zurück zum Zitat Perazzi, F., Krahenbuhl, P., Pritch, Y., Hornung, A.: Saliency filters: contrast based filtering for salient region detection. In: IEEE CVPR, pp. 733–740 (2012) Perazzi, F., Krahenbuhl, P., Pritch, Y., Hornung, A.: Saliency filters: contrast based filtering for salient region detection. In: IEEE CVPR, pp. 733–740 (2012)
32.
Zurück zum Zitat Chang, K., Liu, T, Chen, H., Lai, S.: Fusing generic objectness and visual saliency for salient object detection. In: IEEE ICCV, pp. 914–921 (2011) Chang, K., Liu, T, Chen, H., Lai, S.: Fusing generic objectness and visual saliency for salient object detection. In: IEEE ICCV, pp. 914–921 (2011)
33.
Zurück zum Zitat Xie, Y., Lu, L.: Visual saliency detection based on bayesian model. In: IEEE ICIP, pp. 645–648 (2011) Xie, Y., Lu, L.: Visual saliency detection based on bayesian model. In: IEEE ICIP, pp. 645–648 (2011)
34.
Zurück zum Zitat Shen, X., Wu, Y.: A unified approach to salient object detection via low rank matrix recovery. In: IEEE CVPR, pp. 853–860 (2012) Shen, X., Wu, Y.: A unified approach to salient object detection via low rank matrix recovery. In: IEEE CVPR, pp. 853–860 (2012)
35.
Zurück zum Zitat Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: NIPS, pp. 545–552 (2006) Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: NIPS, pp. 545–552 (2006)
36.
Zurück zum Zitat Hou, X., Zhang, L.: Saliency detection: a spectral residual approach. In: IEEE CVPR, pp. 1–8 (2007) Hou, X., Zhang, L.: Saliency detection: a spectral residual approach. In: IEEE CVPR, pp. 1–8 (2007)
Metadaten
Titel
Robust Salient Object Detection and Segmentation
verfasst von
Hong Li
Wen Wu
Enhua Wu
Copyright-Jahr
2015
Verlag
Springer International Publishing
DOI
https://doi.org/10.1007/978-3-319-21969-1_24