Skip to main content
Top

2017 | OriginalPaper | Chapter

Visual Saliency Fusion Based Multi-feature for Semantic Image Retrieval

Authors : Jianan Chen, Cong Bai, Ling Huang, Zhi Liu, Shengyong Chen

Published in: Computer Vision

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, a saliency fusion based content-based image retrieval method is proposed. Different saliency detection methods were conducted firstly and the output saliency maps were fused by double low rank matrix recovery method. Then the images were segmented into foreground and background according to the fusion result. As the foreground and background had the different impacts on the semantic understanding of the image, different features represented in the form of histogram were extracted. Finally, a fusion of z-score normalized Chi-Square distance is adopted as the similarity measurement. This proposal has been implemented on three widely used benchmark databases and the results evaluated in terms of mean Average Precision (mAP), precision, recall, and F1-measure show that our proposal outperforms the referred state-of-the-art approaches.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bai, C., Chen, J.N., Huang, L., Kplama, K., Chen, S.: Saliency based multi-feature modeling for semantic image retrieval. J. Vis. Commun. Image Representation (Accepted) Bai, C., Chen, J.N., Huang, L., Kplama, K., Chen, S.: Saliency based multi-feature modeling for semantic image retrieval. J. Vis. Commun. Image Representation (Accepted)
2.
go back to reference Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends® Mach. Learn. 3(1), 1–122 (2011) Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends® Mach. Learn. 3(1), 1–122 (2011)
3.
go back to reference Cheng, M.M., Mitra, N.J., Huang, X., Torr, P.H.S., Hu, S.M.: Global contrast based salient region detection. IEEE Tran. Pattern Anal. Mach. Intel. 37(3), 569–582 (2015)CrossRef Cheng, M.M., Mitra, N.J., Huang, X., Torr, P.H.S., Hu, S.M.: Global contrast based salient region detection. IEEE Tran. Pattern Anal. Mach. Intel. 37(3), 569–582 (2015)CrossRef
4.
go back to reference Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intel. 24(5), 603–619 (2002)CrossRef Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intel. 24(5), 603–619 (2002)CrossRef
6.
go back to reference Jiang, B., Zhang, L., Lu, H., Yang, C., Yang, M.H.: Saliency detection via absorbing markov chain. In: ICCV, pp. 1665–1672 (2013) Jiang, B., Zhang, L., Lu, H., Yang, C., Yang, M.H.: Saliency detection via absorbing markov chain. In: ICCV, pp. 1665–1672 (2013)
7.
go back to reference Li, J., Lei, L., Zhang, F., Jian, Y., Rajan, D.: Double low rank matrix recovery for saliency fusion. IEEE Trans. Image Process. 25(9), 4421–4432 (2016)MathSciNetCrossRef Li, J., Lei, L., Zhang, F., Jian, Y., Rajan, D.: Double low rank matrix recovery for saliency fusion. IEEE Trans. Image Process. 25(9), 4421–4432 (2016)MathSciNetCrossRef
8.
go back to reference Li, Z., Tang, J.: Weakly supervised deep matrix factorization for social image understanding. IEEE Trans. Image Process. 26(1), 276–288 (2017)MathSciNetCrossRef Li, Z., Tang, J.: Weakly supervised deep matrix factorization for social image understanding. IEEE Trans. Image Process. 26(1), 276–288 (2017)MathSciNetCrossRef
9.
go back to reference Li, Z., Tang, J., He, X.: Robust structured nonnegative matrix factorization for image representation. IEEE Trans. Neural Networks Learn. Syst. PP(99), 1–14 (2017) Li, Z., Tang, J., He, X.: Robust structured nonnegative matrix factorization for image representation. IEEE Trans. Neural Networks Learn. Syst. PP(99), 1–14 (2017)
10.
go back to reference Liu, G.H., Li, Z.Y., Zhang, L., Xu, Y.: Image retrieval based on micro-structure descriptor. Pattern Recogn. 44(9), 2123–2133 (2011)CrossRef Liu, G.H., Li, Z.Y., Zhang, L., Xu, Y.: Image retrieval based on micro-structure descriptor. Pattern Recogn. 44(9), 2123–2133 (2011)CrossRef
11.
go back to reference Liu, G.H., Yang, J.Y., Li, Z.Y.: Content-based image retrieval using computational visual attention model. Pattern Recogn. 48(8), 2554–2566 (2015)CrossRef Liu, G.H., Yang, J.Y., Li, Z.Y.: Content-based image retrieval using computational visual attention model. Pattern Recogn. 48(8), 2554–2566 (2015)CrossRef
12.
go back to reference Liu, Y., Zhang, D., Lu, G., Ma, W.: A survey of content-based image retrieval with high-level semantics. Pattern Recogn. 40(1), 262–282 (2007)CrossRefMATH Liu, Y., Zhang, D., Lu, G., Ma, W.: A survey of content-based image retrieval with high-level semantics. Pattern Recogn. 40(1), 262–282 (2007)CrossRefMATH
13.
go back to reference Liu, Z., Zou, W., Le, M.O.: Saliency tree: a novel saliency detection framework. IEEE Trans. Image Process. 23(5), 1937–1952 (2014)MathSciNetCrossRefMATH Liu, Z., Zou, W., Le, M.O.: Saliency tree: a novel saliency detection framework. IEEE Trans. Image Process. 23(5), 1937–1952 (2014)MathSciNetCrossRefMATH
14.
go back to reference Lowe, D.G., Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef Lowe, D.G., Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
15.
go back to reference Mei, T., Rui, Y., Li, S., Tian, Q.: Multimedia search reranking. ACM Comput. Surv. 46(3), 1–38 (2014)CrossRef Mei, T., Rui, Y., Li, S., Tian, Q.: Multimedia search reranking. ACM Comput. Surv. 46(3), 1–38 (2014)CrossRef
16.
go back to reference Qin, Y., Lu, H., Xu, Y., Wang, H.: Saliency detection via cellular automata. In: Computer Vision and Pattern Recognition, pp. 110–119 (2015) Qin, Y., Lu, H., Xu, Y., Wang, H.: Saliency detection via cellular automata. In: Computer Vision and Pattern Recognition, pp. 110–119 (2015)
17.
go back to reference Sivic, J., Zisserman, A.: Video google: A text retrieval approach to object matching in videos. In: IEEE International Conference on Computer Vision, p. 1470 (2003) Sivic, J., Zisserman, A.: Video google: A text retrieval approach to object matching in videos. In: IEEE International Conference on Computer Vision, p. 1470 (2003)
18.
go back to reference Tong, N., Lu, H., Xiang, R., Yang, M.H.: Salient object detection via bootstrap learning. In: Computer Vision and Pattern Recognition, pp. 1884–1892 (2015) Tong, N., Lu, H., Xiang, R., Yang, M.H.: Salient object detection via bootstrap learning. In: Computer Vision and Pattern Recognition, pp. 1884–1892 (2015)
19.
go back to reference Tong, N., Lu, H., Zhang, L., Xiang, R.: Saliency detection with multi-scale superpixels. IEEE Sig. Process. Lett. 21(9), 1035–1039 (2014)CrossRef Tong, N., Lu, H., Zhang, L., Xiang, R.: Saliency detection with multi-scale superpixels. IEEE Sig. Process. Lett. 21(9), 1035–1039 (2014)CrossRef
20.
go back to reference Yang, C., Zhang, L., Lu, H., Ruan, X., Yang, M.H.: Saliency detection via graph-based manifold ranking. In: Computer Vision and Pattern Recognition, pp. 3166–3173 (2013) Yang, C., Zhang, L., Lu, H., Ruan, X., Yang, M.H.: Saliency detection via graph-based manifold ranking. In: Computer Vision and Pattern Recognition, pp. 3166–3173 (2013)
21.
go back to reference Zhang, J., Li, D., Zhao, Y., Chen, Z., Yuan, Y.: Representation of image content based on roi-bow. J. Vis. Commun. Image Representation 26, 37–49 (2015)CrossRef Zhang, J., Li, D., Zhao, Y., Chen, Z., Yuan, Y.: Representation of image content based on roi-bow. J. Vis. Commun. Image Representation 26, 37–49 (2015)CrossRef
Metadata
Title
Visual Saliency Fusion Based Multi-feature for Semantic Image Retrieval
Authors
Jianan Chen
Cong Bai
Ling Huang
Zhi Liu
Shengyong Chen
Copyright Year
2017
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-7302-1_11

Premium Partner