Skip to main content
Top

2017 | OriginalPaper | Chapter

RGB-D Saliency Detection with Multi-feature-fused Optimization

Authors : Tianyi Zhang, Zhong Yang, Jiarong Song

Published in: Image and Graphics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper proposes a three-stage method using color, joint entropy and depth to detect salient regions in an image. In the first stage, coarse saliency maps are computed through multi-feature-fused manifold ranking. However, graph-based saliency detection methods like manifold ranking often have problems of inconsistency and misdetection if some parts of the background or objects have relatively high contrast with its surrounding areas. To solve this problem and provide more robust results in varying conditions, depth information is repeatedly used to segment and refine saliency maps. In details, a self-adaptive segment method based on depth distribution is used secondly to filter the less significant areas and enhance the salient objects. At last, the saliency-depth consistency check is implemented to suppress the highlighted areas in the background and enhance the suppressed parts of objects. Qualitative and quantitative evaluation on a challenging RGB-D dataset demonstrates significant appeal and advantages of our algorithm compared with eight state-of-the-art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRef Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRef
3.
go back to reference Schade, U., Meinecke, C.: Texture segmentation: do the processing units on the saliency map increase with eccentricity? Vis. Res. 51(1), 1–12 (2011)CrossRef Schade, U., Meinecke, C.: Texture segmentation: do the processing units on the saliency map increase with eccentricity? Vis. Res. 51(1), 1–12 (2011)CrossRef
4.
go back to reference Fang, Y., et al.: Saliency detection in the compressed domain for adaptive image retargeting. IEEE Trans. Image Process. 21(9), 3888–3901 (2012)MathSciNetCrossRefMATH Fang, Y., et al.: Saliency detection in the compressed domain for adaptive image retargeting. IEEE Trans. Image Process. 21(9), 3888–3901 (2012)MathSciNetCrossRefMATH
5.
go back to reference Chen, Y., Pan, Y., Song, M., et al.: Image retargeting with a 3D saliency model. Signal Process. 112, 53–63 (2015)CrossRef Chen, Y., Pan, Y., Song, M., et al.: Image retargeting with a 3D saliency model. Signal Process. 112, 53–63 (2015)CrossRef
6.
go back to reference Guo, C., Zhang, L.: A novel multi-resolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans. Image Process. 19(1), 185–198 (2010)MathSciNetCrossRefMATH Guo, C., Zhang, L.: A novel multi-resolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans. Image Process. 19(1), 185–198 (2010)MathSciNetCrossRefMATH
7.
go back to reference Ren, Z., et al.: Region-based saliency detection and its application in object recognition. IEEE Trans. Circuits Syst. Video Technol. 24(5), 769–779 (2014)CrossRef Ren, Z., et al.: Region-based saliency detection and its application in object recognition. IEEE Trans. Circuits Syst. Video Technol. 24(5), 769–779 (2014)CrossRef
8.
go back to reference Zhu, J.Y., et al.: Unsupervised object class discovery via saliency-guided multiple class learning. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 3218–3225. IEEE, Rhode Island (2012) Zhu, J.Y., et al.: Unsupervised object class discovery via saliency-guided multiple class learning. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 3218–3225. IEEE, Rhode Island (2012)
9.
go back to reference Sharma, G., Jurie, F., Schmid, C.: Discriminative spatial saliency for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 3506–3513. IEEE, Rhode Island (2012) Sharma, G., Jurie, F., Schmid, C.: Discriminative spatial saliency for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 3506–3513. IEEE, Rhode Island (2012)
10.
go back to reference Borji, A., et al.: Salient object detection: a survey. Eprint Arxiv, vol. 16, no. 7, pp. 1–26 (2014) Borji, A., et al.: Salient object detection: a survey. Eprint Arxiv, vol. 16, no. 7, pp. 1–26 (2014)
11.
go back to reference Cheng, M.M., et al.: Global contrast based salient region detection. In: IEEE Conference on Computer Vision & Pattern Recognition 2015, pp. 409–416. IEEE, Boston (2015) Cheng, M.M., et al.: Global contrast based salient region detection. In: IEEE Conference on Computer Vision & Pattern Recognition 2015, pp. 409–416. IEEE, Boston (2015)
12.
go back to reference Duan, L., et al.: Visual saliency detection by spatially weighted dissimilarity. In: IEEE Conference on Computer Vision and Pattern Recognition 2011, pp. 473–480. IEEE, Colorado (2011) Duan, L., et al.: Visual saliency detection by spatially weighted dissimilarity. In: IEEE Conference on Computer Vision and Pattern Recognition 2011, pp. 473–480. IEEE, Colorado (2011)
13.
go back to reference Yang, C., et al.: Saliency detection via graph-based manifold ranking. In: IEEE Conference on Computer Vision and Pattern Recognition 2013, pp. 3166–3173. IEEE, Oregon (2013) Yang, C., et al.: Saliency detection via graph-based manifold ranking. In: IEEE Conference on Computer Vision and Pattern Recognition 2013, pp. 3166–3173. IEEE, Oregon (2013)
14.
go back to reference Qin, Y., et al.: Saliency detection via cellular automata. In: IEEE Conference on Computer Vision and Pattern Recognition 2015, pp. 110–119. IEEE, Boston, (2015) Qin, Y., et al.: Saliency detection via cellular automata. In: IEEE Conference on Computer Vision and Pattern Recognition 2015, pp. 110–119. IEEE, Boston, (2015)
15.
go back to reference Lang, C., et al.: Depth matters: influence of depth cues on visual saliency. In: European Conference on Computer Vision 2012, pp. 101–115. IEEE, Florence (2012) Lang, C., et al.: Depth matters: influence of depth cues on visual saliency. In: European Conference on Computer Vision 2012, pp. 101–115. IEEE, Florence (2012)
16.
go back to reference Ju, R., et al.: Depth saliency based on anisotropic center-surround difference. In: IEEE International Conference on Image Processing 2014, pp. 1115–1119. IEEE, Paris (2014) Ju, R., et al.: Depth saliency based on anisotropic center-surround difference. In: IEEE International Conference on Image Processing 2014, pp. 1115–1119. IEEE, Paris (2014)
17.
go back to reference Wang, A., et al.: Salient object detection with high-level prior based on Bayesian Fusion. IET Comput. Vis. 11(2), 161–172 (2017)CrossRef Wang, A., et al.: Salient object detection with high-level prior based on Bayesian Fusion. IET Comput. Vis. 11(2), 161–172 (2017)CrossRef
18.
go back to reference Peng, H., et al.: RGBD salient object detection: a benchmark and algorithms. In: European Conference on Computer Vision 2014, pp. 92–109. IEEE, Zurich (2014) Peng, H., et al.: RGBD salient object detection: a benchmark and algorithms. In: European Conference on Computer Vision 2014, pp. 92–109. IEEE, Zurich (2014)
19.
go back to reference Achanta, R., Shaji, A., Smith, K., et al.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef Achanta, R., Shaji, A., Smith, K., et al.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef
20.
go back to reference Hirschmuller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 328–341 (2008)CrossRef Hirschmuller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 328–341 (2008)CrossRef
21.
go back to reference Perazzi, F., et al.: Saliency filters: contrast based filtering for salient region detection. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 733–740. IEEE, Rhode Island (2012) Perazzi, F., et al.: Saliency filters: contrast based filtering for salient region detection. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 733–740. IEEE, Rhode Island (2012)
22.
go back to reference Wei, Y., et al.: Geodesic saliency using background priors. In: European Conference on Computer Vision 2012, pp. 29–42. IEEE, Florence (2012) Wei, Y., et al.: Geodesic saliency using background priors. In: European Conference on Computer Vision 2012, pp. 29–42. IEEE, Florence (2012)
23.
go back to reference Zhu, W., et al.: Saliency optimization from robust background detection. In: IEEE Conference on Computer Vision and Pattern Recognition 2014, pp. 2814–2821. IEEE, Columbus (2014) Zhu, W., et al.: Saliency optimization from robust background detection. In: IEEE Conference on Computer Vision and Pattern Recognition 2014, pp. 2814–2821. IEEE, Columbus (2014)
24.
go back to reference Margolin, R., Tal, A., Zelnik-Manor, L.: What makes a patch distinct. IEEE Trans. Comput. Vis. Pattern Recogn. 9(4), 1139–1146 (2013) Margolin, R., Tal, A., Zelnik-Manor, L.: What makes a patch distinct. IEEE Trans. Comput. Vis. Pattern Recogn. 9(4), 1139–1146 (2013)
25.
go back to reference Duan, L., et al.: Visual saliency detection by spatially weighted dissimilarity. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 473–48. IEEE, Colorado, (2011) Duan, L., et al.: Visual saliency detection by spatially weighted dissimilarity. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 473–48. IEEE, Colorado, (2011)
Metadata
Title
RGB-D Saliency Detection with Multi-feature-fused Optimization
Authors
Tianyi Zhang
Zhong Yang
Jiarong Song
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-71598-8_2

Premium Partner