Skip to main content
Top
Published in: Wireless Personal Communications 1/2022

30-09-2021

Content-Based Image Recognition and Tagging by Deep Learning Methods

Authors: A. Jeya Christy, K. Dhanalakshmi

Published in: Wireless Personal Communications | Issue 1/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Deep learning techniques is growing wider day by day in the process of Content based Image retrieval (CBIR). The recognition of the image is based on its shape, attributes, and tag. It is challenging to establish the connection between semantic ideas in the vast real-world applications. The social media is dominating the globe by throwing its wide range of features where the people are finding difficulty in choosing their suitable objects or images because of any redundancy. So the proposed method is based on Content-based image recognition and tagging by using deep learning techniques. The tagging of the image is used here for easy identification of the objects. The Geon similarity model is used to extract the maximum similarity of the different images by its accurate and rapid computation methods. The modified grey wolf optimization method and the novelty based convolution neural network, ResNet-50, is applied here as a hashing technique and classifier to get high recognition rate and accuracy values when compared to the state of art methods. The performance attributes of the modified convolutional neural network give a high value of precision, accuracy, recall, and mAP.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Piras, L., & Giacinto, G. (2017). Information fusion in content based image retrieval: A comprehensive overview. Information Fusion, 37, 50–60.CrossRef Piras, L., & Giacinto, G. (2017). Information fusion in content based image retrieval: A comprehensive overview. Information Fusion, 37, 50–60.CrossRef
2.
go back to reference He, L., Xie, L., Shu, H., & Hu, S., (2019). "Discrete semi-supervised learning for multi-label image classification and large-scale image retrieval," Multimedia Tools and Applications, pp. 1–19. He, L., Xie, L., Shu, H., & Hu, S., (2019). "Discrete semi-supervised learning for multi-label image classification and large-scale image retrieval," Multimedia Tools and Applications, pp. 1–19.
3.
go back to reference Memon, M. H., Li, J.-P., Memon, I., & Arain, Q. A. (2017). GEO matching regions: Multiple regions of interests using content based image retrieval based on relative locations. Multimedia Tools and Applications, 76, 15377–15411.CrossRef Memon, M. H., Li, J.-P., Memon, I., & Arain, Q. A. (2017). GEO matching regions: Multiple regions of interests using content based image retrieval based on relative locations. Multimedia Tools and Applications, 76, 15377–15411.CrossRef
4.
go back to reference Corrales, D., Corrales, J., & Ledezma, A. (2018). How to address the data quality issues in regression models: A guided process for data cleaning. Symmetry, 10, 99.CrossRef Corrales, D., Corrales, J., & Ledezma, A. (2018). How to address the data quality issues in regression models: A guided process for data cleaning. Symmetry, 10, 99.CrossRef
5.
go back to reference Ramacharyulu, P., Kumar, J. P., Prasad, G., & Sreedhar, B. (2014). Sulphur doped nano TiO2: Synthesis, characterization and photocatalytic degradation of a toxic chemical in presence of sunlight. Materials Chemistry and Physics, 148, 692–698.CrossRef Ramacharyulu, P., Kumar, J. P., Prasad, G., & Sreedhar, B. (2014). Sulphur doped nano TiO2: Synthesis, characterization and photocatalytic degradation of a toxic chemical in presence of sunlight. Materials Chemistry and Physics, 148, 692–698.CrossRef
6.
go back to reference Saritha, R. R., Paul, V., & Kumar, P. G. (2019). Content based image retrieval using deep learning process. Cluster Computing, 22, 4187–4200.CrossRef Saritha, R. R., Paul, V., & Kumar, P. G. (2019). Content based image retrieval using deep learning process. Cluster Computing, 22, 4187–4200.CrossRef
7.
go back to reference Xu, H., Wang, J.-Y., & Mao, L., (2017). "Relevance feedback for Content-based Image Retrieval using deep learning," in 2017 2nd International Conference on Image, Vision and Computing (ICIVC), 2017, pp. 629–633 Xu, H., Wang, J.-Y., & Mao, L., (2017). "Relevance feedback for Content-based Image Retrieval using deep learning," in 2017 2nd International Conference on Image, Vision and Computing (ICIVC), 2017, pp. 629–633
8.
go back to reference Zhou, Z., & Zhang, L. (2018). Content-Based Image Retrieval Using Iterative Search. Neural Processing Letters, 47, 907–919.CrossRef Zhou, Z., & Zhang, L. (2018). Content-Based Image Retrieval Using Iterative Search. Neural Processing Letters, 47, 907–919.CrossRef
9.
go back to reference Alzu’bi, A., Amira, A., & Ramzan, N. (2017). Content-based image retrieval with compact deep convolutional features. Neurocomputing, 249, 95–105.CrossRef Alzu’bi, A., Amira, A., & Ramzan, N. (2017). Content-based image retrieval with compact deep convolutional features. Neurocomputing, 249, 95–105.CrossRef
10.
go back to reference Celik, C., & Bilge, H. S. (2017). Content based image retrieval with sparse representations and local feature descriptors: A comparative study. Pattern Recognition, 68, 1–13.CrossRef Celik, C., & Bilge, H. S. (2017). Content based image retrieval with sparse representations and local feature descriptors: A comparative study. Pattern Recognition, 68, 1–13.CrossRef
11.
go back to reference Rivas-Sánchez, M., Guerrero-Lebrero, M. D. L. P., Guerrero, E., Bárcena-Gonzalez, G., Martel, J., & Galindo, P. L. (2017). "Using Deep Learning for Image Similarity in Product Matching," in International Work-Conference on Artificial Neural Networks, 2017, pp. 281–290. Rivas-Sánchez, M., Guerrero-Lebrero, M. D. L. P., Guerrero, E., Bárcena-Gonzalez, G., Martel, J., & Galindo, P. L. (2017). "Using Deep Learning for Image Similarity in Product Matching," in International Work-Conference on Artificial Neural Networks, 2017, pp. 281–290.
12.
go back to reference Ma, Y., Liu, Y., Xie, Q., & Li, L. (2019). CNN-feature based automatic image annotation method. Multimedia Tools and Applications, 78, 3767–3780.CrossRef Ma, Y., Liu, Y., Xie, Q., & Li, L. (2019). CNN-feature based automatic image annotation method. Multimedia Tools and Applications, 78, 3767–3780.CrossRef
13.
go back to reference Wang, Y., Zhu, L., Qian, X., & Han, J. (2018). Joint hypergraph learning for tag-based image retrieval. IEEE Transactions on Image Processing, 27, 4437–4451.MathSciNetCrossRef Wang, Y., Zhu, L., Qian, X., & Han, J. (2018). Joint hypergraph learning for tag-based image retrieval. IEEE Transactions on Image Processing, 27, 4437–4451.MathSciNetCrossRef
14.
go back to reference Lu, D., Liu, X., & Qian, X. (2016). Tag-based image search by social re-ranking. IEEE Transactions on Multimedia, 18, 1628–1639.CrossRef Lu, D., Liu, X., & Qian, X. (2016). Tag-based image search by social re-ranking. IEEE Transactions on Multimedia, 18, 1628–1639.CrossRef
15.
go back to reference Liang, R.-Z., Shi, L., Wang, H., Meng, J., Wang, J. J.-Y., Sun, Q. et al., (2016). "Optimizing top precision performance measure of content-based image retrieval by learning similarity function," in 2016 23rd International conference on pattern recognition (ICPR), pp. 2954–2958. Liang, R.-Z., Shi, L., Wang, H., Meng, J., Wang, J. J.-Y., Sun, Q. et al., (2016). "Optimizing top precision performance measure of content-based image retrieval by learning similarity function," in 2016 23rd International conference on pattern recognition (ICPR), pp. 2954–2958.
16.
go back to reference Shukla, A. K., & Kanungo, S., (2019). "Enhanced Bag-of-Features Method Using Grey Wolf Optimization for Automated Face Retrieval," in International Conference on Advances in Computing and Data Sciences, pp. 519–528. Shukla, A. K., & Kanungo, S., (2019). "Enhanced Bag-of-Features Method Using Grey Wolf Optimization for Automated Face Retrieval," in International Conference on Advances in Computing and Data Sciences, pp. 519–528.
17.
go back to reference Wang, X., Lee, F., & Chen, Q. (2019). Similarity-preserving hashing based on deep neural networks for large-scale image retrieval. Journal of Visual Communication and Image Representation, 61, 260–271.CrossRef Wang, X., Lee, F., & Chen, Q. (2019). Similarity-preserving hashing based on deep neural networks for large-scale image retrieval. Journal of Visual Communication and Image Representation, 61, 260–271.CrossRef
18.
go back to reference Huang, C., Luo, X., Zhang, J., Liao, Q., Wang, X., Jiang, Z. L., et al. (2020). Explore instance similarity: An instance correlation based hashing method for multi-label cross-model retrieval. Information Processing & Management, 57, 102165.CrossRef Huang, C., Luo, X., Zhang, J., Liao, Q., Wang, X., Jiang, Z. L., et al. (2020). Explore instance similarity: An instance correlation based hashing method for multi-label cross-model retrieval. Information Processing & Management, 57, 102165.CrossRef
19.
go back to reference Peng, T., Boxberg, M., Weichert, W., Navab, N., & Marr, C., (2019). "Multi-task learning of a deep k-nearest neighbour network for histopathological image classification and retrieval," in International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 676–684 Peng, T., Boxberg, M., Weichert, W., Navab, N., & Marr, C., (2019). "Multi-task learning of a deep k-nearest neighbour network for histopathological image classification and retrieval," in International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 676–684
21.
go back to reference Sahu, S., Singh, A. K., Ghrera, S., & Elhoseny, M. (2019). An approach for de-noising and contrast enhancement of retinal fundus image using CLAHE. Optics & Laser Technology, 110, 87–98.CrossRef Sahu, S., Singh, A. K., Ghrera, S., & Elhoseny, M. (2019). An approach for de-noising and contrast enhancement of retinal fundus image using CLAHE. Optics & Laser Technology, 110, 87–98.CrossRef
22.
go back to reference Rashno, A. & Rashno, E. (2019). "Content-based image retrieval system with most relevant features among wavelet and color features," arXiv preprint arXiv:1902.02059. Rashno, A. & Rashno, E. (2019). "Content-based image retrieval system with most relevant features among wavelet and color features," arXiv preprint arXiv:​1902.​02059.
23.
go back to reference Sundara Vadivel, P., Yuvaraj, D., Navaneetha Krishnan, S., & Mathusudhanan, S. (2019). An efficient CBIR system based on color histogram, edge, and texture features. Concurrency and Computation: Practice and Experience, 31, e4994.CrossRef Sundara Vadivel, P., Yuvaraj, D., Navaneetha Krishnan, S., & Mathusudhanan, S. (2019). An efficient CBIR system based on color histogram, edge, and texture features. Concurrency and Computation: Practice and Experience, 31, e4994.CrossRef
24.
go back to reference Özyurt, F., Tuncer, T., Avci, E., Koc, M., & Serhatlioğlu, İ. (2019). A novel liver image classification method using perceptual hash-based convolutional neural network. Arabian Journal for Science and Engineering, 44, 3173–3182.CrossRef Özyurt, F., Tuncer, T., Avci, E., Koc, M., & Serhatlioğlu, İ. (2019). A novel liver image classification method using perceptual hash-based convolutional neural network. Arabian Journal for Science and Engineering, 44, 3173–3182.CrossRef
25.
go back to reference Al-Tashi, Q., Rais, H. M., Abdulkadir,S. J., Mirjalili, S., & Alhussian, H., (2020). "A Review of Grey Wolf Optimizer-Based Feature Selection Methods for Classification," In Evolutionary Machine Learning Techniques, ed: Springer, pp. 273–286 Al-Tashi, Q., Rais, H. M., Abdulkadir,S. J., Mirjalili, S., & Alhussian, H., (2020). "A Review of Grey Wolf Optimizer-Based Feature Selection Methods for Classification," In Evolutionary Machine Learning Techniques, ed: Springer, pp. 273–286
26.
go back to reference Ashqar, B. A., & Abu-Naser, S. S. (2019). Identifying images of invasive hydrangea using pre-trained deep convolutional neural networks. International Journal of Academic Engineering Research (IJAER), 3, 28–36. Ashqar, B. A., & Abu-Naser, S. S. (2019). Identifying images of invasive hydrangea using pre-trained deep convolutional neural networks. International Journal of Academic Engineering Research (IJAER), 3, 28–36.
27.
go back to reference Hoppenstedt, B., Kammerer, K., Reichert, M., Spiliopoulou M., & Pryss, R., (2019). "Convolutional Neural Networks for Image Recognition in Mixed Reality Using Voice Command Labeling," in International Conference on Augmented Reality, Virtual Reality and Computer Graphics, 2019, pp. 63–70. Hoppenstedt, B., Kammerer, K., Reichert, M., Spiliopoulou M., & Pryss, R., (2019). "Convolutional Neural Networks for Image Recognition in Mixed Reality Using Voice Command Labeling," in International Conference on Augmented Reality, Virtual Reality and Computer Graphics, 2019, pp. 63–70.
28.
go back to reference Chen, T., Xu, M., Hui, X., Wu, H., & Lin L., (2019). "Learning semantic-specific graph representation for multi-label image recognition," in Proceedings of the IEEE International Conference on Computer Vision, pp. 522–531. Chen, T., Xu, M., Hui, X., Wu, H., & Lin L., (2019). "Learning semantic-specific graph representation for multi-label image recognition," in Proceedings of the IEEE International Conference on Computer Vision, pp. 522–531.
29.
go back to reference Cui, H., Zhu, L., Li, J., Yang, Y., & Nie, L. (2019). Scalable deep hashing for large-scale social image retrieval. IEEE Transactions on Image Processing, 29, 1271–1284.MathSciNetCrossRef Cui, H., Zhu, L., Li, J., Yang, Y., & Nie, L. (2019). Scalable deep hashing for large-scale social image retrieval. IEEE Transactions on Image Processing, 29, 1271–1284.MathSciNetCrossRef
30.
go back to reference Wang, Y., Zhang, L., Nie, F., Li, X., Chen, Z., & Wang, F., (2019). "WeGAN: Deep Image Hashing with Weighted Generative Adversarial Networks," IEEE Transactions on Multimedia. Wang, Y., Zhang, L., Nie, F., Li, X., Chen, Z., & Wang, F., (2019). "WeGAN: Deep Image Hashing with Weighted Generative Adversarial Networks," IEEE Transactions on Multimedia.
Metadata
Title
Content-Based Image Recognition and Tagging by Deep Learning Methods
Authors
A. Jeya Christy
K. Dhanalakshmi
Publication date
30-09-2021
Publisher
Springer US
Published in
Wireless Personal Communications / Issue 1/2022
Print ISSN: 0929-6212
Electronic ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-021-09159-8

Other articles of this Issue 1/2022

Wireless Personal Communications 1/2022 Go to the issue