Skip to main content
Erschienen in: International Journal of Multimedia Information Retrieval 1/2024

01.03.2024 | Regular Paper

Incremental image retrieval method based on feature perception and deep hashing

verfasst von: Kaiyang Liao, Jie Lin, Yuanlin Zheng, Keer Wang, Wen Feng

Erschienen in: International Journal of Multimedia Information Retrieval | Ausgabe 1/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

How to propose an image retrieval algorithm with adaptable model and wide range of applications for large-scale datasets has become a critical technical problem in current image retrieval. This paper proposed an Incremental Image Retrieval Method Based on Feature Perception and Deep Hashing. The algorithm contains two important parts: the hash function learning part and the incremental hash code mapping part. Firstly, a module is designed called Feature Perception Module to obtain multi-scale global context-aware information. It also keeps the scale and shape of the final extracted deep features invariant. Then, a new incremental hash loss function is designed to maintain the similarity between the query image and the dataset image; the advantage of this is that it can reduce the time cost of updating the model. The experimental results show that the algorithm model can perform well in incremental image retrieval. It is shown that the algorithm can solve the current problem of low retrieval efficiency and high cost due to retraining models caused by the dramatic increase in the number of images in the image retrieval field.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Dubey SR (2022) A decade survey of content based image retrieval using deep learning. IEEE Trans Circuits Syst Video Technol 32:2687–2704CrossRef Dubey SR (2022) A decade survey of content based image retrieval using deep learning. IEEE Trans Circuits Syst Video Technol 32:2687–2704CrossRef
2.
Zurück zum Zitat Liang X, Tang Z, Huang Z et al (2023) Efficient hashing method using 2D-2D PCA for image copy detection. IEEE Trans Knowl Data Eng, pp 3765–3778 Liang X, Tang Z, Huang Z et al (2023) Efficient hashing method using 2D-2D PCA for image copy detection. IEEE Trans Knowl Data Eng, pp 3765–3778
3.
Zurück zum Zitat Liang X, Tang Z, Huang Z et al (2023) Robust image hashing with isomap and saliency map for copy detection. IEEE Trans Multimedia, pp 1085–1097 Liang X, Tang Z, Huang Z et al (2023) Robust image hashing with isomap and saliency map for copy detection. IEEE Trans Multimedia, pp 1085–1097
4.
Zurück zum Zitat Huang Z, Tang Z, Huang Z et al (2023) Perceptual image hashing with locality preserving projection for copy detection. IEEE Trans Depend Secure Comput, pp 463–477 Huang Z, Tang Z, Huang Z et al (2023) Perceptual image hashing with locality preserving projection for copy detection. IEEE Trans Depend Secure Comput, pp 463–477
5.
Zurück zum Zitat Li T, Zhang Z, Pei L et al (2022) HashFormer: vision transformer based deep hashing for image retrieval. In: Proceedings of the IEEE signal process, pp 827–831 Li T, Zhang Z, Pei L et al (2022) HashFormer: vision transformer based deep hashing for image retrieval. In: Proceedings of the IEEE signal process, pp 827–831
6.
Zurück zum Zitat Jiang Q, Li W (2018) Asymmetric deep supervised hashing. In: Proceedings of the AAAI conference on artificial intelligence, pp 1–8 Jiang Q, Li W (2018) Asymmetric deep supervised hashing. In: Proceedings of the AAAI conference on artificial intelligence, pp 1–8
7.
Zurück zum Zitat Shen F, Gao X, Liu L et al (2017) Deep asymmetric pairwise hashing. In: Proceedings of the 25th ACM international conference on Multimedia, pp 1522–1530 Shen F, Gao X, Liu L et al (2017) Deep asymmetric pairwise hashing. In: Proceedings of the 25th ACM international conference on Multimedia, pp 1522–1530
8.
Zurück zum Zitat Ho T, Ly N (2012) A scene text-based image retrieval system. In: Proceedings of the IEEE international symposium on signal processing and information technology, pp 79–84 Ho T, Ly N (2012) A scene text-based image retrieval system. In: Proceedings of the IEEE international symposium on signal processing and information technology, pp 79–84
9.
Zurück zum Zitat Kumar PM, Rao TS, Raj LA et al (2021) An efficient text-based image retrieval using natural language processing (NLP) techniques. Intell Syst Des, pp 505–519 Kumar PM, Rao TS, Raj LA et al (2021) An efficient text-based image retrieval using natural language processing (NLP) techniques. Intell Syst Des, pp 505–519
10.
Zurück zum Zitat Ruikar SD, kabade RS (2016) Content based image retrieval by combining feature vector. In: International conference on wireless communications, signal processing and networking, pp1517–1523 Ruikar SD, kabade RS (2016) Content based image retrieval by combining feature vector. In: International conference on wireless communications, signal processing and networking, pp1517–1523
11.
Zurück zum Zitat Dubey SR (2021) A decade survey of content based image retrieval using deep learning. In: IEEE Trans Circuits Syst Video Technol, pp 2687–2704 Dubey SR (2021) A decade survey of content based image retrieval using deep learning. In: IEEE Trans Circuits Syst Video Technol, pp 2687–2704
12.
Zurück zum Zitat Andrea MK (2017) Content Based image retrieval using salient orientation histograms. In: Proceedings of the IEEE international conference on image processing, pp 2480–2484 Andrea MK (2017) Content Based image retrieval using salient orientation histograms. In: Proceedings of the IEEE international conference on image processing, pp 2480–2484
13.
Zurück zum Zitat Razavian AS, Azizpour H, Sullivan J et al (2014) CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 806–813 Razavian AS, Azizpour H, Sullivan J et al (2014) CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 806–813
14.
Zurück zum Zitat Jing L, Tian Y (2020) Self-supervised visual feature learning with deep neural networks: a survey. IEEE Trans Pattern Anal Mach Intell, pp 4037–4058 Jing L, Tian Y (2020) Self-supervised visual feature learning with deep neural networks: a survey. IEEE Trans Pattern Anal Mach Intell, pp 4037–4058
15.
Zurück zum Zitat Amato F, López A, Vaňhara P et al (2013) Artificial neural networks in medical diagnosis. J Appl Biomed, pp. 47–58 Amato F, López A, Vaňhara P et al (2013) Artificial neural networks in medical diagnosis. J Appl Biomed, pp. 47–58
16.
Zurück zum Zitat Krizhevsky A, Hinton GE (2011) Using very deep auto-encoders for content-based image retrieval. In: 19th European symposium on artificial neural networks, pp 1–7 Krizhevsky A, Hinton GE (2011) Using very deep auto-encoders for content-based image retrieval. In: 19th European symposium on artificial neural networks, pp 1–7
17.
Zurück zum Zitat Kang Y, Kim S, Choi S (2012) Deep learning to hash with multiple representations. In: Proceedings of the IEEE international conference on data mining, pp 930–935 Kang Y, Kim S, Choi S (2012) Deep learning to hash with multiple representations. In: Proceedings of the IEEE international conference on data mining, pp 930–935
18.
Zurück zum Zitat Wu P, Steven CH, Xia H et al (2012) Online multimodal deep similarity learning with application to image retrieval. In: Proceedings of the 21st ACM international conference on Multimedia, pp 153–162 Wu P, Steven CH, Xia H et al (2012) Online multimodal deep similarity learning with application to image retrieval. In: Proceedings of the 21st ACM international conference on Multimedia, pp 153–162
19.
Zurück zum Zitat Babenko A, Slesarev A, Chigorin A et al (2014) Neural codes for image retrieval. In: Proceedings of the European conference on computer vision, pp 584–599 Babenko A, Slesarev A, Chigorin A et al (2014) Neural codes for image retrieval. In: Proceedings of the European conference on computer vision, pp 584–599
20.
Zurück zum Zitat Wang J, Song Y, Leung T et al (2014) Learning fine-grained image similarity with deep ranking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1386–1393 Wang J, Song Y, Leung T et al (2014) Learning fine-grained image similarity with deep ranking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1386–1393
21.
Zurück zum Zitat Zhang R, Lin L, Zhang R et al (2015) Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Trans Image Process, pp 4766–4779 Zhang R, Lin L, Zhang R et al (2015) Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Trans Image Process, pp 4766–4779
22.
Zurück zum Zitat Zhu H, Long M, Wang J et al (2016) Deep hashing network for efficient similarity retrieval. In: Proceedings of the AAAI conference on artificial intelligence, pp 2415–2421 Zhu H, Long M, Wang J et al (2016) Deep hashing network for efficient similarity retrieval. In: Proceedings of the AAAI conference on artificial intelligence, pp 2415–2421
23.
Zurück zum Zitat Cao Y, Long M, Liu B et al (2018) Deep cauchy hashing for hamming space retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1229–1237 Cao Y, Long M, Liu B et al (2018) Deep cauchy hashing for hamming space retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1229–1237
24.
Zurück zum Zitat Su S, Zhang C, Han K et al (2018) Greedy hash: towards fast optimization for accurate hash coding in CNN. In: Proceedings of the 32nd international conference on neural information processing systems, pp 798–807 Su S, Zhang C, Han K et al (2018) Greedy hash: towards fast optimization for accurate hash coding in CNN. In: Proceedings of the 32nd international conference on neural information processing systems, pp 798–807
25.
Zurück zum Zitat Wu D, Liu J, Li B et al (2018) Deep index-compatible hashing for fast image retrieval. In: Proceedings of the IEEE international conference on multimedia and expo, pp 1–6 Wu D, Liu J, Li B et al (2018) Deep index-compatible hashing for fast image retrieval. In: Proceedings of the IEEE international conference on multimedia and expo, pp 1–6
26.
Zurück zum Zitat Wu D, Dai Q, Liu J et al (2019) Deep incremental hashing network for efficient image retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 9069–9077 Wu D, Dai Q, Liu J et al (2019) Deep incremental hashing network for efficient image retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 9069–9077
27.
Zurück zum Zitat Bai J, Ni B, Wang M et al (2019) Deep progressive hashing for image retrieval. IEEE Trans Multimedia, pp 3178–3193 Bai J, Ni B, Wang M et al (2019) Deep progressive hashing for image retrieval. IEEE Trans Multimedia, pp 3178–3193
28.
Zurück zum Zitat Shen Y, Liu L, Shao L (2019) Unsupervised binary representation learning with deep variational networks. Int J Comput Vis, pp 1614–1628 Shen Y, Liu L, Shao L (2019) Unsupervised binary representation learning with deep variational networks. Int J Comput Vis, pp 1614–1628
29.
Zurück zum Zitat Shen Y, Qin J, Chen J et al. Auto-encoding twin-bottleneck hashing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2818–2827 Shen Y, Qin J, Chen J et al. Auto-encoding twin-bottleneck hashing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2818–2827
30.
Zurück zum Zitat Wang R, Wang R, Qiao S et al (2020) Deep position-aware hashing for semantic continuous image retrieval. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 2493–2502 Wang R, Wang R, Qiao S et al (2020) Deep position-aware hashing for semantic continuous image retrieval. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 2493–2502
31.
Zurück zum Zitat Garg M, Dhiman G (2021) A novel content-based image retrieval approach for classification using GLCM features and texture fused LBP variants. Neural Comput Appl, pp1311–1328 Garg M, Dhiman G (2021) A novel content-based image retrieval approach for classification using GLCM features and texture fused LBP variants. Neural Comput Appl, pp1311–1328
34.
Zurück zum Zitat Wang X, Zhang Z, Wu B et al (2021) Prototype-supervised adversarial network for targeted attack of deep hashing. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 16357–16366 Wang X, Zhang Z, Wu B et al (2021) Prototype-supervised adversarial network for targeted attack of deep hashing. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 16357–16366
35.
Zurück zum Zitat Yu Y, Yang L, Wang S (2021) Deep hash image retrieval method based on anti-autoencoder. In: Proceedings of the international conference on systems and informatics (ICSAI), pp 1–5 Yu Y, Yang L, Wang S (2021) Deep hash image retrieval method based on anti-autoencoder. In: Proceedings of the international conference on systems and informatics (ICSAI), pp 1–5
38.
Zurück zum Zitat Mensink T, Verbeek J, Perronnin F et al (2013) Distance-based image classification: generalizing to new classes at near-zero cost. IEEE Trans Pattern Anal Mach Intell, pp 2624–2637 Mensink T, Verbeek J, Perronnin F et al (2013) Distance-based image classification: generalizing to new classes at near-zero cost. IEEE Trans Pattern Anal Mach Intell, pp 2624–2637
39.
Zurück zum Zitat Kuzborskij I, Orabona F, Caputo B (2013) From n to n+1: multiclass transfer incremental learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3358–3365 Kuzborskij I, Orabona F, Caputo B (2013) From n to n+1: multiclass transfer incremental learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3358–3365
40.
Zurück zum Zitat Rebuffi SA, Kolesnikov A, Sperl G et al (2017) icarl: Incremental classifier and representation learning. In: Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pp 2001–2020 Rebuffi SA, Kolesnikov A, Sperl G et al (2017) icarl: Incremental classifier and representation learning. In: Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pp 2001–2020
41.
Zurück zum Zitat Lin G, Shen C, Shi Q et al (2014) Fast supervised hashing with decision trees for high-dimensional data. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1963–1970 Lin G, Shen C, Shi Q et al (2014) Fast supervised hashing with decision trees for high-dimensional data. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1963–1970
42.
Zurück zum Zitat Li W, Sheng W, Kang W (2015) Feature learning based deep supervised hashing with pairwise labels. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, pp 1711–1717 Li W, Sheng W, Kang W (2015) Feature learning based deep supervised hashing with pairwise labels. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, pp 1711–1717
43.
Zurück zum Zitat Gong Y, Lazebnik S, Gordo A et al (2012) Iterative quantization: A procrustean approach to learning binary codes for large-scale image retrieval. In Proceedings of the IEEE transactions on pattern analysis and machine intelligence, pp 2916–2929 Gong Y, Lazebnik S, Gordo A et al (2012) Iterative quantization: A procrustean approach to learning binary codes for large-scale image retrieval. In Proceedings of the IEEE transactions on pattern analysis and machine intelligence, pp 2916–2929
45.
Zurück zum Zitat Yuan L, Wang T, Zhang X et al (2020) Central similarity quantization for efficient image and video retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3083–3092 Yuan L, Wang T, Zhang X et al (2020) Central similarity quantization for efficient image and video retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3083–3092
46.
Zurück zum Zitat Zhang Z, Zhu X, Lu G et al (2021) Probability ordinal-preserving semantic hashing for large-scale image retrieval. ACM Trans Knowl Discov Data, pp 1–22 Zhang Z, Zhu X, Lu G et al (2021) Probability ordinal-preserving semantic hashing for large-scale image retrieval. ACM Trans Knowl Discov Data, pp 1–22
47.
Zurück zum Zitat Long J, Sun L, Guo L et al (2022) Label embedding semantic-guided hashing. Neurocomputing, pp 1–13 Long J, Sun L, Guo L et al (2022) Label embedding semantic-guided hashing. Neurocomputing, pp 1–13
Metadaten
Titel
Incremental image retrieval method based on feature perception and deep hashing
verfasst von
Kaiyang Liao
Jie Lin
Yuanlin Zheng
Keer Wang
Wen Feng
Publikationsdatum
01.03.2024
Verlag
Springer London
Erschienen in
International Journal of Multimedia Information Retrieval / Ausgabe 1/2024
Print ISSN: 2192-6611
Elektronische ISSN: 2192-662X
DOI
https://doi.org/10.1007/s13735-024-00319-7

Weitere Artikel der Ausgabe 1/2024

International Journal of Multimedia Information Retrieval 1/2024 Zur Ausgabe

Premium Partner