Skip to main content

2017 | OriginalPaper | Buchkapitel

RGB-D Saliency Detection with Multi-feature-fused Optimization

verfasst von : Tianyi Zhang, Zhong Yang, Jiarong Song

Erschienen in: Image and Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a three-stage method using color, joint entropy and depth to detect salient regions in an image. In the first stage, coarse saliency maps are computed through multi-feature-fused manifold ranking. However, graph-based saliency detection methods like manifold ranking often have problems of inconsistency and misdetection if some parts of the background or objects have relatively high contrast with its surrounding areas. To solve this problem and provide more robust results in varying conditions, depth information is repeatedly used to segment and refine saliency maps. In details, a self-adaptive segment method based on depth distribution is used secondly to filter the less significant areas and enhance the salient objects. At last, the saliency-depth consistency check is implemented to suppress the highlighted areas in the background and enhance the suppressed parts of objects. Qualitative and quantitative evaluation on a challenging RGB-D dataset demonstrates significant appeal and advantages of our algorithm compared with eight state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRef Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRef
3.
Zurück zum Zitat Schade, U., Meinecke, C.: Texture segmentation: do the processing units on the saliency map increase with eccentricity? Vis. Res. 51(1), 1–12 (2011)CrossRef Schade, U., Meinecke, C.: Texture segmentation: do the processing units on the saliency map increase with eccentricity? Vis. Res. 51(1), 1–12 (2011)CrossRef
4.
Zurück zum Zitat Fang, Y., et al.: Saliency detection in the compressed domain for adaptive image retargeting. IEEE Trans. Image Process. 21(9), 3888–3901 (2012)MathSciNetCrossRefMATH Fang, Y., et al.: Saliency detection in the compressed domain for adaptive image retargeting. IEEE Trans. Image Process. 21(9), 3888–3901 (2012)MathSciNetCrossRefMATH
5.
Zurück zum Zitat Chen, Y., Pan, Y., Song, M., et al.: Image retargeting with a 3D saliency model. Signal Process. 112, 53–63 (2015)CrossRef Chen, Y., Pan, Y., Song, M., et al.: Image retargeting with a 3D saliency model. Signal Process. 112, 53–63 (2015)CrossRef
6.
Zurück zum Zitat Guo, C., Zhang, L.: A novel multi-resolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans. Image Process. 19(1), 185–198 (2010)MathSciNetCrossRefMATH Guo, C., Zhang, L.: A novel multi-resolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans. Image Process. 19(1), 185–198 (2010)MathSciNetCrossRefMATH
7.
Zurück zum Zitat Ren, Z., et al.: Region-based saliency detection and its application in object recognition. IEEE Trans. Circuits Syst. Video Technol. 24(5), 769–779 (2014)CrossRef Ren, Z., et al.: Region-based saliency detection and its application in object recognition. IEEE Trans. Circuits Syst. Video Technol. 24(5), 769–779 (2014)CrossRef
8.
Zurück zum Zitat Zhu, J.Y., et al.: Unsupervised object class discovery via saliency-guided multiple class learning. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 3218–3225. IEEE, Rhode Island (2012) Zhu, J.Y., et al.: Unsupervised object class discovery via saliency-guided multiple class learning. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 3218–3225. IEEE, Rhode Island (2012)
9.
Zurück zum Zitat Sharma, G., Jurie, F., Schmid, C.: Discriminative spatial saliency for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 3506–3513. IEEE, Rhode Island (2012) Sharma, G., Jurie, F., Schmid, C.: Discriminative spatial saliency for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 3506–3513. IEEE, Rhode Island (2012)
10.
Zurück zum Zitat Borji, A., et al.: Salient object detection: a survey. Eprint Arxiv, vol. 16, no. 7, pp. 1–26 (2014) Borji, A., et al.: Salient object detection: a survey. Eprint Arxiv, vol. 16, no. 7, pp. 1–26 (2014)
11.
Zurück zum Zitat Cheng, M.M., et al.: Global contrast based salient region detection. In: IEEE Conference on Computer Vision & Pattern Recognition 2015, pp. 409–416. IEEE, Boston (2015) Cheng, M.M., et al.: Global contrast based salient region detection. In: IEEE Conference on Computer Vision & Pattern Recognition 2015, pp. 409–416. IEEE, Boston (2015)
12.
Zurück zum Zitat Duan, L., et al.: Visual saliency detection by spatially weighted dissimilarity. In: IEEE Conference on Computer Vision and Pattern Recognition 2011, pp. 473–480. IEEE, Colorado (2011) Duan, L., et al.: Visual saliency detection by spatially weighted dissimilarity. In: IEEE Conference on Computer Vision and Pattern Recognition 2011, pp. 473–480. IEEE, Colorado (2011)
13.
Zurück zum Zitat Yang, C., et al.: Saliency detection via graph-based manifold ranking. In: IEEE Conference on Computer Vision and Pattern Recognition 2013, pp. 3166–3173. IEEE, Oregon (2013) Yang, C., et al.: Saliency detection via graph-based manifold ranking. In: IEEE Conference on Computer Vision and Pattern Recognition 2013, pp. 3166–3173. IEEE, Oregon (2013)
14.
Zurück zum Zitat Qin, Y., et al.: Saliency detection via cellular automata. In: IEEE Conference on Computer Vision and Pattern Recognition 2015, pp. 110–119. IEEE, Boston, (2015) Qin, Y., et al.: Saliency detection via cellular automata. In: IEEE Conference on Computer Vision and Pattern Recognition 2015, pp. 110–119. IEEE, Boston, (2015)
15.
Zurück zum Zitat Lang, C., et al.: Depth matters: influence of depth cues on visual saliency. In: European Conference on Computer Vision 2012, pp. 101–115. IEEE, Florence (2012) Lang, C., et al.: Depth matters: influence of depth cues on visual saliency. In: European Conference on Computer Vision 2012, pp. 101–115. IEEE, Florence (2012)
16.
Zurück zum Zitat Ju, R., et al.: Depth saliency based on anisotropic center-surround difference. In: IEEE International Conference on Image Processing 2014, pp. 1115–1119. IEEE, Paris (2014) Ju, R., et al.: Depth saliency based on anisotropic center-surround difference. In: IEEE International Conference on Image Processing 2014, pp. 1115–1119. IEEE, Paris (2014)
17.
Zurück zum Zitat Wang, A., et al.: Salient object detection with high-level prior based on Bayesian Fusion. IET Comput. Vis. 11(2), 161–172 (2017)CrossRef Wang, A., et al.: Salient object detection with high-level prior based on Bayesian Fusion. IET Comput. Vis. 11(2), 161–172 (2017)CrossRef
18.
Zurück zum Zitat Peng, H., et al.: RGBD salient object detection: a benchmark and algorithms. In: European Conference on Computer Vision 2014, pp. 92–109. IEEE, Zurich (2014) Peng, H., et al.: RGBD salient object detection: a benchmark and algorithms. In: European Conference on Computer Vision 2014, pp. 92–109. IEEE, Zurich (2014)
19.
Zurück zum Zitat Achanta, R., Shaji, A., Smith, K., et al.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef Achanta, R., Shaji, A., Smith, K., et al.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef
20.
Zurück zum Zitat Hirschmuller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 328–341 (2008)CrossRef Hirschmuller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 328–341 (2008)CrossRef
21.
Zurück zum Zitat Perazzi, F., et al.: Saliency filters: contrast based filtering for salient region detection. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 733–740. IEEE, Rhode Island (2012) Perazzi, F., et al.: Saliency filters: contrast based filtering for salient region detection. In: IEEE Conference on Computer Vision and Pattern Recognition 2012, pp. 733–740. IEEE, Rhode Island (2012)
22.
Zurück zum Zitat Wei, Y., et al.: Geodesic saliency using background priors. In: European Conference on Computer Vision 2012, pp. 29–42. IEEE, Florence (2012) Wei, Y., et al.: Geodesic saliency using background priors. In: European Conference on Computer Vision 2012, pp. 29–42. IEEE, Florence (2012)
23.
Zurück zum Zitat Zhu, W., et al.: Saliency optimization from robust background detection. In: IEEE Conference on Computer Vision and Pattern Recognition 2014, pp. 2814–2821. IEEE, Columbus (2014) Zhu, W., et al.: Saliency optimization from robust background detection. In: IEEE Conference on Computer Vision and Pattern Recognition 2014, pp. 2814–2821. IEEE, Columbus (2014)
24.
Zurück zum Zitat Margolin, R., Tal, A., Zelnik-Manor, L.: What makes a patch distinct. IEEE Trans. Comput. Vis. Pattern Recogn. 9(4), 1139–1146 (2013) Margolin, R., Tal, A., Zelnik-Manor, L.: What makes a patch distinct. IEEE Trans. Comput. Vis. Pattern Recogn. 9(4), 1139–1146 (2013)
25.
Zurück zum Zitat Duan, L., et al.: Visual saliency detection by spatially weighted dissimilarity. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 473–48. IEEE, Colorado, (2011) Duan, L., et al.: Visual saliency detection by spatially weighted dissimilarity. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 473–48. IEEE, Colorado, (2011)
Metadaten
Titel
RGB-D Saliency Detection with Multi-feature-fused Optimization
verfasst von
Tianyi Zhang
Zhong Yang
Jiarong Song
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-71598-8_2