Skip to main content

2017 | OriginalPaper | Buchkapitel

Co-saliency Detection Based on Superpixel Clustering

verfasst von : Guiqian Zhu, Yi Ji, Xianjin Jiang, Zenan Xu, Chunping Liu

Erschienen in: Knowledge Science, Engineering and Management

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The exiting co-saliency detection methods achieve poor performance in computation speed and accuracy. Therefore, we propose a superpixel clustering based co-saliency detection method. The proposed method consists of three parts: multi-scale visual saliency map, weak co-saliency map and fusing stage. Multi-scale visual saliency map is generated by multi-scale superpixel pyramid with content-sensitive. Weak co-saliency map is computed by superpixel clustering feature space with RGB and CIELab color features as well as Gabor texture feature in order to the representation of global correlation. Lastly, a final strong co-saliency map is obtained by fusing the multi-scale visual saliency map and weak co-saliency map based on three kinds of metrics (contrast, position and repetition). The experiment results in the public datasets show that the proposed method improves the computation speed and the performance of co-saliency detection. A better and less time-consuming co-saliency map is obtained by comparing with other state-of-the-art co-saliency detection methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cheng, M.M., Mitra, N.J., Huang, X., Hu, S.: SalientShape: group saliency in image collections. Vis. Comput. 30(4), 1–10 (2014)CrossRef Cheng, M.M., Mitra, N.J., Huang, X., Hu, S.: SalientShape: group saliency in image collections. Vis. Comput. 30(4), 1–10 (2014)CrossRef
2.
Zurück zum Zitat Mukherjee, L., Singh, V., Peng, J.: Scale invariant cosegmentation for image groups. In: Computer Vision and Pattern Recognition, pp. 1881–1888. IEEE, Piscataway (2011) Mukherjee, L., Singh, V., Peng, J.: Scale invariant cosegmentation for image groups. In: Computer Vision and Pattern Recognition, pp. 1881–1888. IEEE, Piscataway (2011)
3.
Zurück zum Zitat Chang, K.Y., Liu, T.L., Lai, S.H.: From co-saliency to co-segmentation: an efficient and fully unsupervised energy minimization model. In: Computer Vision and Pattern Recognition, pp. 2011–2136. IEEE, Piscataway (2011) Chang, K.Y., Liu, T.L., Lai, S.H.: From co-saliency to co-segmentation: an efficient and fully unsupervised energy minimization model. In: Computer Vision and Pattern Recognition, pp. 2011–2136. IEEE, Piscataway (2011)
4.
Zurück zum Zitat Zund, F., Pritch, Y., Sorkine-Hornung, A., et al.: Content-aware compression using saliency-driven image retargeting. In: International Conference on Computer Vision, pp. 1845–1849. IEEE, Piscataway (2013) Zund, F., Pritch, Y., Sorkine-Hornung, A., et al.: Content-aware compression using saliency-driven image retargeting. In: International Conference on Computer Vision, pp. 1845–1849. IEEE, Piscataway (2013)
5.
Zurück zum Zitat Jerripothula, K.R., Cai, J., Yuan, J.: CATS: co-saliency activated tracklet selection for video co-localization. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9911, pp. 187–202. Springer, Cham (2016). doi:10.1007/978-3-319-46478-7_12 Jerripothula, K.R., Cai, J., Yuan, J.: CATS: co-saliency activated tracklet selection for video co-localization. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9911, pp. 187–202. Springer, Cham (2016). doi:10.​1007/​978-3-319-46478-7_​12
6.
Zurück zum Zitat Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. Trans. Patt. Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRef Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. Trans. Patt. Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRef
7.
Zurück zum Zitat Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Neural Information Processing Systems, pp. 545–552. Curran Associates, Inc., New York (2006) Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Neural Information Processing Systems, pp. 545–552. Curran Associates, Inc., New York (2006)
8.
Zurück zum Zitat Tong, N., Lu, H., Ruan, X., et al.: Salient object detection via bootstrap learning. In: Computer Vision and Pattern Recognition, pp. 1884–1892. IEEE, Piscataway (2015) Tong, N., Lu, H., Ruan, X., et al.: Salient object detection via bootstrap learning. In: Computer Vision and Pattern Recognition, pp. 1884–1892. IEEE, Piscataway (2015)
9.
Zurück zum Zitat Lee, G., Tai, Y.W., Kim, J.: Deep saliency with encoded low level distance map and high level features. In: Computer Vision and Pattern Recognition, pp. 660–668. IEEE, Piscataway (2016) Lee, G., Tai, Y.W., Kim, J.: Deep saliency with encoded low level distance map and high level features. In: Computer Vision and Pattern Recognition, pp. 660–668. IEEE, Piscataway (2016)
10.
Zurück zum Zitat Jacobs, D.E., Goldman, D.B., Shechtman, E.: Cosaliency: Where people look when comparing images. In: ACM Symposium on User Interface Software and Technology, pp. 219–228. ACM, New York (2010) Jacobs, D.E., Goldman, D.B., Shechtman, E.: Cosaliency: Where people look when comparing images. In: ACM Symposium on User Interface Software and Technology, pp. 219–228. ACM, New York (2010)
11.
Zurück zum Zitat Li, H., Meng, F., Ngan, K.N.: Co-salient object detection from multiple images. Trans. Multimedia 15(8), 1896–1909 (2013)CrossRef Li, H., Meng, F., Ngan, K.N.: Co-salient object detection from multiple images. Trans. Multimedia 15(8), 1896–1909 (2013)CrossRef
12.
Zurück zum Zitat Fu, H., Cao, X., Tu, Z.: Cluster-based co-saliency detection. Trans. Image Process. 22(10), 3766–3778 (2013)MathSciNetCrossRef Fu, H., Cao, X., Tu, Z.: Cluster-based co-saliency detection. Trans. Image Process. 22(10), 3766–3778 (2013)MathSciNetCrossRef
13.
Zurück zum Zitat Li, L., Liu, Z., Zou, W., et al.: Co-saliency detection based on region-level fusion and pixel-level refinement. In: International Conference on Multimedia and Expo, pp. 1–6. IEEE, Los Alamitos (2014) Li, L., Liu, Z., Zou, W., et al.: Co-saliency detection based on region-level fusion and pixel-level refinement. In: International Conference on Multimedia and Expo, pp. 1–6. IEEE, Los Alamitos (2014)
14.
Zurück zum Zitat Li, Y., Fu, K., Liu, Z., Yang, J.: Efficient saliency-model-guided visual co-saliency detection. Sig. Process. Lett. 22(5), 588–592 (2015)CrossRef Li, Y., Fu, K., Liu, Z., Yang, J.: Efficient saliency-model-guided visual co-saliency detection. Sig. Process. Lett. 22(5), 588–592 (2015)CrossRef
15.
Zurück zum Zitat Zhang, D., Han, J., Li, C., et al.: Co-saliency detection via looking deep and wide. In: Computer Vision and Pattern Recognition, pp. 2994–3002. IEEE, Piscataway (2015) Zhang, D., Han, J., Li, C., et al.: Co-saliency detection via looking deep and wide. In: Computer Vision and Pattern Recognition, pp. 2994–3002. IEEE, Piscataway (2015)
16.
Zurück zum Zitat Zhang, D., Meng, D., Li, C., et al.: A self-paced multiple-instance learning framework for co-saliency detection. In: International Conference on Computer Vision, pp. 594–602. IEEE, Piscataway (2015) Zhang, D., Meng, D., Li, C., et al.: A self-paced multiple-instance learning framework for co-saliency detection. In: International Conference on Computer Vision, pp. 594–602. IEEE, Piscataway (2015)
17.
Zurück zum Zitat Liu, Y.J., Yu, C.C., Yu, M.J., et al.: Manifold SLIC: a fast method to compute content-sensitive superpixels. In: Computer Vision and Pattern Recognition, pp. 651–659. IEEE, Piscataway (2016) Liu, Y.J., Yu, C.C., Yu, M.J., et al.: Manifold SLIC: a fast method to compute content-sensitive superpixels. In: Computer Vision and Pattern Recognition, pp. 651–659. IEEE, Piscataway (2016)
18.
Zurück zum Zitat Liu, T., Yuan, Z., Sun, J., Wang, J., Zheng, N., Tang, X., Shum, H.: Learning to detect a salient object. Trans. Patt. Anal. Mach. Intell. 33(2), 353–367 (2011)CrossRef Liu, T., Yuan, Z., Sun, J., Wang, J., Zheng, N., Tang, X., Shum, H.: Learning to detect a salient object. Trans. Patt. Anal. Mach. Intell. 33(2), 353–367 (2011)CrossRef
19.
Zurück zum Zitat Li, Y., Hou, X., Koch, C., et al.: The secrets of salient object segmentation. In: Computer Vision and Pattern Recognition, pp. 280–287. IEEE, Piscataway (2014) Li, Y., Hou, X., Koch, C., et al.: The secrets of salient object segmentation. In: Computer Vision and Pattern Recognition, pp. 280–287. IEEE, Piscataway (2014)
20.
Zurück zum Zitat Batra, D., Kowdle, A., Parikh, D., et al.: iCoseg: Interactive co-segmentation with intelligent scribble guidance. In: Computer Vision and Pattern Recognition, pp. 3169–3176. IEEE, Piscataway (2010) Batra, D., Kowdle, A., Parikh, D., et al.: iCoseg: Interactive co-segmentation with intelligent scribble guidance. In: Computer Vision and Pattern Recognition, pp. 3169–3176. IEEE, Piscataway (2010)
21.
Zurück zum Zitat Winn, J., Criminisi, A., Minka, T.: Object categorization by learned universal visual dictionary. In: International Conference on Computer Vision Computer Vision, pp. 1800–1807. IEEE, Piscataway (2005) Winn, J., Criminisi, A., Minka, T.: Object categorization by learned universal visual dictionary. In: International Conference on Computer Vision Computer Vision, pp. 1800–1807. IEEE, Piscataway (2005)
22.
Zurück zum Zitat Riche, N., Mancas, M., Duvinage, M., Mibulumukini, M., Gosselin, B., Dutoit, T.: Rare 2012: a multi-scale rarity-based saliency detection with its comparative statistical analysis. Sig. Process. Image Commun. 28(6), 642–658 (2013)CrossRef Riche, N., Mancas, M., Duvinage, M., Mibulumukini, M., Gosselin, B., Dutoit, T.: Rare 2012: a multi-scale rarity-based saliency detection with its comparative statistical analysis. Sig. Process. Image Commun. 28(6), 642–658 (2013)CrossRef
Metadaten
Titel
Co-saliency Detection Based on Superpixel Clustering
verfasst von
Guiqian Zhu
Yi Ji
Xianjin Jiang
Zenan Xu
Chunping Liu
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-63558-3_24