Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 4/2020

01-11-2019 | Original Article

Weighted multi-deep ranking supervised hashing for efficient image retrieval

Authors: Jiayong Li, Wing W. Y. Ng, Xing Tian, Sam Kwong, Hui Wang

Published in: International Journal of Machine Learning and Cybernetics | Issue 4/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Deep hashing has proven to be efficient and effective for large-scale image retrieval due to the strong representation capability of deep networks. Existing deep hashing methods only utilize a single deep hash table. In order to achieve both higher retrieval recall and precision, longer hash codes can be used but at the expense of higher space usage. To address this issue, a novel deep hashing method is proposed in this paper, weighted multi-deep ranking supervised hashing (WMDRH), which employs multiple weighted deep hash tables to improve precision/recall without increasing space usage. The hash table is constructed as an additional layer in a deep network. Hash codes are generated by minimizing the loss function that contains two terms: (1) the ranking pairwise loss and (2) the classification loss. The ranking pairwise loss ensures to generate discriminative hash codes by penalizing more for the (dis)similar image pairs with (small)large Hamming distances. The classification loss guarantees the hash codes to be effective for category prediction. Different hash bits in each individual hash table are treated differently by assigning corresponding weights based on information preservation and bit diversity. Moreover, multiple hash tables are integrated by assigning the appropriate weight to each table according to its mean average precision (MAP) score for image retrieval. Experiments on three widely-used image databases show the proposed method outperforms state-of-the-art hashing methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Datar M, Immorlica N, Indyk P, Mirrokni VS (2004) Locality-sensitive hashing scheme based on p-stable distributions. In: Proc. of the twentieth annual symposium on computational geometry, pp 253–262 Datar M, Immorlica N, Indyk P, Mirrokni VS (2004) Locality-sensitive hashing scheme based on p-stable distributions. In: Proc. of the twentieth annual symposium on computational geometry, pp 253–262
2.
go back to reference Gong Y, Lazebnik S, Gordo A, Perronnin F (2013) Iterative quantization: a procrustean approach to learning binary codes for large-scale image retrieval. IEEE Trans Pattern Anal Mach Intell 35(12):2916–2929CrossRef Gong Y, Lazebnik S, Gordo A, Perronnin F (2013) Iterative quantization: a procrustean approach to learning binary codes for large-scale image retrieval. IEEE Trans Pattern Anal Mach Intell 35(12):2916–2929CrossRef
3.
go back to reference Weiss Y, Torralba A, Fergus R (2009) Spectral hashing. In: Proc. of advances in neural information processing systems, pp 1753–1760 Weiss Y, Torralba A, Fergus R (2009) Spectral hashing. In: Proc. of advances in neural information processing systems, pp 1753–1760
4.
go back to reference Norouzi M,Fleet DJ (2011) Minimal loss hashing for compact binary codes. In: Proc. international conference on machine learning, pp 353–360 Norouzi M,Fleet DJ (2011) Minimal loss hashing for compact binary codes. In: Proc. international conference on machine learning, pp 353–360
5.
go back to reference Dniz G, Bueno J, la Salido TFD (2011) Face recognition using histograms of oriented gradients. Proc Pattern Recogn Lett 32(12):1598–1603CrossRef Dniz G, Bueno J, la Salido TFD (2011) Face recognition using histograms of oriented gradients. Proc Pattern Recogn Lett 32(12):1598–1603CrossRef
6.
go back to reference Huang D, Shan C, Ardabilian M, Wang Y, Chen L (2011) Local binary patterns and its application to facial image analysis: a survey. IEEE Trans Syst Man Cybern 41(6):765–781CrossRef Huang D, Shan C, Ardabilian M, Wang Y, Chen L (2011) Local binary patterns and its application to facial image analysis: a survey. IEEE Trans Syst Man Cybern 41(6):765–781CrossRef
7.
go back to reference Ahonen T, Rahtu E, Ojansivu V, Heikkila J (2008) Recognition of blurred faces using local phase quantization. In: Proc. international conference on pattern recognition Ahonen T, Rahtu E, Ojansivu V, Heikkila J (2008) Recognition of blurred faces using local phase quantization. In: Proc. international conference on pattern recognition
8.
go back to reference Paul E, Ajeena BAS (2015) Mining images for image annotation using surf detection technique. In: Proc. international conference on control, communication and computing India Paul E, Ajeena BAS (2015) Mining images for image annotation using surf detection technique. In: Proc. international conference on control, communication and computing India
9.
go back to reference Purandare V, Talele KT (2014) Efficient heterogeneous face recognition using scale invariant feature transform. In: Proc. international conference on circuits, systems, communication and information technology applications Purandare V, Talele KT (2014) Efficient heterogeneous face recognition using scale invariant feature transform. In: Proc. international conference on circuits, systems, communication and information technology applications
10.
go back to reference Liu H, Wang R, Shan S, Chen X (2016) Deep supervised hashing for fast image retrieval. In: Proc. IEEE conference on computer vision and pattern recognition, pp 2064–2072 Liu H, Wang R, Shan S, Chen X (2016) Deep supervised hashing for fast image retrieval. In: Proc. IEEE conference on computer vision and pattern recognition, pp 2064–2072
11.
go back to reference Xia R, Pan Y, Lai H, Liu C, Yan S (2014) Supervised hashing for image retrieval via image representation learning. In: Proc. AAAI conference on artificial intelligence, pp 2156–2162 Xia R, Pan Y, Lai H, Liu C, Yan S (2014) Supervised hashing for image retrieval via image representation learning. In: Proc. AAAI conference on artificial intelligence, pp 2156–2162
12.
go back to reference Lai H, Pan Y, Liu Y, Yan S (2015) Simultaneous feature learning and hash coding with deep neural networks, pp 3270–3278 Lai H, Pan Y, Liu Y, Yan S (2015) Simultaneous feature learning and hash coding with deep neural networks, pp 3270–3278
13.
go back to reference Yao T, Long F, Mei T, Rui Y (2016) Deep semantic-preserving and ranking-based hashing for image retrieval. In: Proc. international joint conference on artificial intelligence, pp 3931–3937 Yao T, Long F, Mei T, Rui Y (2016) Deep semantic-preserving and ranking-based hashing for image retrieval. In: Proc. international joint conference on artificial intelligence, pp 3931–3937
14.
go back to reference Zhang R, Lin L, Zhang R, Zuo W, Zhang L (2015) Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Trans Image Process 24(12):4766–4779MathSciNetCrossRef Zhang R, Lin L, Zhang R, Zuo W, Zhang L (2015) Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Trans Image Process 24(12):4766–4779MathSciNetCrossRef
15.
go back to reference Lin J, Li Z, Tang J (2017) Discriminative deep hashing for scalable face image retrieval. In: Proc. international joint conference on artificial intelligence, pp 2266–2272 Lin J, Li Z, Tang J (2017) Discriminative deep hashing for scalable face image retrieval. In: Proc. international joint conference on artificial intelligence, pp 2266–2272
16.
go back to reference Xu H, Wang J, Li Z, Zeng G, Li S, Yu N (2011) Complementaryhashing for approximate nearest neighbor search. In: Proc international conference on computer vision Xu H, Wang J, Li Z, Zeng G, Li S, Yu N (2011) Complementaryhashing for approximate nearest neighbor search. In: Proc international conference on computer vision
17.
go back to reference Li P, Cheng J, Lu H (2013) Hashing with dual complementary projection learning for fast image retrieval. Proc Neurocomput 120(10):83–89CrossRef Li P, Cheng J, Lu H (2013) Hashing with dual complementary projection learning for fast image retrieval. Proc Neurocomput 120(10):83–89CrossRef
18.
go back to reference Raginsky M, Lazebnik S (2009) Locality-sensitive binary codes from shift-invariant kernels. In: Proc of Conf and workshop on neural information processing systems, pp 1509–1517 Raginsky M, Lazebnik S (2009) Locality-sensitive binary codes from shift-invariant kernels. In: Proc of Conf and workshop on neural information processing systems, pp 1509–1517
19.
go back to reference Ng WWY, Lv Y, Zeng Z, Yeung DS, Chan PPK (2017) Sequential conditional entropy maximization semi-supervised hashing for semantic image retrieval. Int J Mach Learn Cybern 8(2):571–586CrossRef Ng WWY, Lv Y, Zeng Z, Yeung DS, Chan PPK (2017) Sequential conditional entropy maximization semi-supervised hashing for semantic image retrieval. Int J Mach Learn Cybern 8(2):571–586CrossRef
20.
go back to reference Liu Y, Feng L, Liu S, Sun M (2019) An ELM based local topology preserving hashing. Int J Mach Learn Cybern 2019:1–18 Liu Y, Feng L, Liu S, Sun M (2019) An ELM based local topology preserving hashing. Int J Mach Learn Cybern 2019:1–18
21.
go back to reference Kulis B, Grauman K (2009) Kernelized locality-sensitive hashing for scalable image search. In: Proc of IEEE Int Conf on computer vision, pp 2130–2137 Kulis B, Grauman K (2009) Kernelized locality-sensitive hashing for scalable image search. In: Proc of IEEE Int Conf on computer vision, pp 2130–2137
22.
go back to reference Lv Y, Ng WW, Zeng Z, Yeung DS, Chan PP (2015) Asymmetric cyclical hashing for large scale image retrieval. IEEE Trans Multimedia 17(8):1225–1235CrossRef Lv Y, Ng WW, Zeng Z, Yeung DS, Chan PP (2015) Asymmetric cyclical hashing for large scale image retrieval. IEEE Trans Multimedia 17(8):1225–1235CrossRef
23.
go back to reference Guo Y, Ding G, Liu L, Han J, Shao L (2017) Learning to hash with optimized anchor embedding for scalable retrieval. IEEE Trans Image Process 26(3):1344–1354MathSciNetCrossRef Guo Y, Ding G, Liu L, Han J, Shao L (2017) Learning to hash with optimized anchor embedding for scalable retrieval. IEEE Trans Image Process 26(3):1344–1354MathSciNetCrossRef
24.
go back to reference Liu X, Du B, Deng C, Liu M, Lang B (2016) Structure sensitive hashing with adaptive product quantization. IEEE Trans Cybern 46(10):2252–2264CrossRef Liu X, Du B, Deng C, Liu M, Lang B (2016) Structure sensitive hashing with adaptive product quantization. IEEE Trans Cybern 46(10):2252–2264CrossRef
25.
go back to reference Wang J, Kumar S, Chang S-F (2012) Semi-supervised hashing for large-scale search. IEEE Trans Pattern Anal Mach Intell 34(12):2393–2406CrossRef Wang J, Kumar S, Chang S-F (2012) Semi-supervised hashing for large-scale search. IEEE Trans Pattern Anal Mach Intell 34(12):2393–2406CrossRef
26.
go back to reference Wu C, Zhu J, Cai D, Chen C, Bu J (2013) Semi-supervised nonlinear hashing using bootstrap sequential projection learning. IEEE Trans Knowl Data Eng 25(6):1380–1393CrossRef Wu C, Zhu J, Cai D, Chen C, Bu J (2013) Semi-supervised nonlinear hashing using bootstrap sequential projection learning. IEEE Trans Knowl Data Eng 25(6):1380–1393CrossRef
27.
go back to reference Liu W, Wang J, Ji R, Jiang Y-G, Chang S-F (2012) Supervised hashing with kernels. In: Proc. computer vision and pattern recognition, pp 2074–2081 Liu W, Wang J, Ji R, Jiang Y-G, Chang S-F (2012) Supervised hashing with kernels. In: Proc. computer vision and pattern recognition, pp 2074–2081
28.
go back to reference Kulis B, Darrell T (2009) Learning to hash with binary reconstructive embeddings. In: Proc. neural information processing systems, pp 1042–1050 Kulis B, Darrell T (2009) Learning to hash with binary reconstructive embeddings. In: Proc. neural information processing systems, pp 1042–1050
29.
go back to reference Song D, Liu RJW, Meyer DA, Smith JR (2015) Top rank supervised binary coding for visual search. In: Proc. IEEE international conference on computer vision, pp 1922–1930 Song D, Liu RJW, Meyer DA, Smith JR (2015) Top rank supervised binary coding for visual search. In: Proc. IEEE international conference on computer vision, pp 1922–1930
30.
go back to reference Ng WWY, Li J, Feng S, Yeung DS, Chan PPK (2015) Sensitivity based image filtering for multi-hashing in large scale image retrieval problems. Int J Mach Learn Cybern 6(5):777–794CrossRef Ng WWY, Li J, Feng S, Yeung DS, Chan PPK (2015) Sensitivity based image filtering for multi-hashing in large scale image retrieval problems. Int J Mach Learn Cybern 6(5):777–794CrossRef
31.
go back to reference Salakhutdinov R, Hinton G (2009) Semantic hashing. Proc Int J Approx Reasoning 50(7):969–978CrossRef Salakhutdinov R, Hinton G (2009) Semantic hashing. Proc Int J Approx Reasoning 50(7):969–978CrossRef
32.
go back to reference Zhu H, Long M, Wang J, Cao Y (2016) Deep hashing network for efficient similarity retrieval. In: Proc AAAI conference on artificial intelligence, pp 2415–2421 Zhu H, Long M, Wang J, Cao Y (2016) Deep hashing network for efficient similarity retrieval. In: Proc AAAI conference on artificial intelligence, pp 2415–2421
33.
go back to reference Li W, Wang S, Kang W (2016) Feature learning based deep supervised hashing with pairwise labels. In: Proc. international joint conference on artificial intelligence, pp 1711–1717 Li W, Wang S, Kang W (2016) Feature learning based deep supervised hashing with pairwise labels. In: Proc. international joint conference on artificial intelligence, pp 1711–1717
34.
go back to reference Wang X, Shi Y, Kitani K (2016) Deep supervised hashing with triplet labels. In: Proc. Asian conference on computer vision, pp 70–84CrossRef Wang X, Shi Y, Kitani K (2016) Deep supervised hashing with triplet labels. In: Proc. Asian conference on computer vision, pp 70–84CrossRef
35.
go back to reference Liu Y, Song J, Zhou K, Yan L, Liu L, Zou F, Shao L (2018) Deep self-taught hashing for image retrieval. IEEE Trans Cybern 2018:1–13CrossRef Liu Y, Song J, Zhou K, Yan L, Liu L, Zou F, Shao L (2018) Deep self-taught hashing for image retrieval. IEEE Trans Cybern 2018:1–13CrossRef
36.
go back to reference Galton F (1892) Finger prints. Macmillan, London Galton F (1892) Finger prints. Macmillan, London
37.
go back to reference Chua T-S, Tang J, Hong R, Li H, Luo Z, Zheng Y (2009) Nus-wide: a real-world web image database from national university of singapore. In: Proceeding crence on image and video retrieval. ACM, p 48 Chua T-S, Tang J, Hong R, Li H, Luo Z, Zheng Y (2009) Nus-wide: a real-world web image database from national university of singapore. In: Proceeding crence on image and video retrieval. ACM, p 48
38.
go back to reference Liu W, Wang J, Ji R, Jiang Y, Chang S (2012) Supervised hashing with kernels. In: Proc. IEEE conference on computer vision and pattern recognition Liu W, Wang J, Ji R, Jiang Y, Chang S (2012) Supervised hashing with kernels. In: Proc. IEEE conference on computer vision and pattern recognition
39.
go back to reference Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Proc. advances in neural information processing systems Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Proc. advances in neural information processing systems
Metadata
Title
Weighted multi-deep ranking supervised hashing for efficient image retrieval
Authors
Jiayong Li
Wing W. Y. Ng
Xing Tian
Sam Kwong
Hui Wang
Publication date
01-11-2019
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 4/2020
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-019-01026-0

Other articles of this Issue 4/2020

International Journal of Machine Learning and Cybernetics 4/2020 Go to the issue