Skip to main content
Top
Published in: Neural Computing and Applications 7/2020

05-02-2020 | Deep Learning & Neural Computing for Intelligent Sensing and Control

Content semantic image analysis and storage method based on intelligent computing of machine learning annotation

Authors: PengCheng Wei, Fangcheng He, Yang Zou

Published in: Neural Computing and Applications | Issue 7/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the popularity of computers and the rapid development of various application platforms, the explosive growth of data poses a huge challenge to data analysis and storage. For large-scale image analysis applications, the time delay in storing read data becomes an important issue that constrains this application. The semantic information asymmetry between image application and storage is the root cause of this problem. In view of content semantic analysis, in recent years, intelligent computing has become the main research direction. Among them, machine learning has become a research hot spot because of its offline learning and online generation characteristics. For the semantics of image content, machine learning can complete tasks such as content semantic association, classification, annotation and hash mapping, and provide algorithm support for applying image semantics and improving semantic analysis ability in large-scale environment. Image annotation is an important topic in the semantic analysis of image content. Annotation can establish a classification relationship between image content and semantics. In order to solve the problem of extracting a large amount of data in large-scale image analysis, a content semantic image content analysis and storage scheme based on intelligent computer learning image annotation is proposed. Combined with DSTH work, the program introduces deep learning, visual lexicon and map metadata. Hash semantic metadata supplemental metadata is obtained through deep learning, and semantic metadata is constructed and managed in a hierarchical structure. In addition, according to the characteristics of the graph structure, by improving the PageRank algorithm, the SemRank node ranking algorithm based on Hamming distance is proposed. Experimental results demonstrate the effectiveness and reliability of the algorithm.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Szegedy C et al (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 22–30 Szegedy C et al (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 22–30
2.
go back to reference Piras L, Giacinto G (2017) Information fusion in content based image retrieval: a comprehensive overview. Inf Fusion 37:50–60CrossRef Piras L, Giacinto G (2017) Information fusion in content based image retrieval: a comprehensive overview. Inf Fusion 37:50–60CrossRef
3.
go back to reference Mehmood Z, Mahmood T, Javid MA (2018) Content-based image retrieval and semantic automatic image annotation based on the weighted average of triangular histograms using support vector machine. Appl Intell 48(1):166–181CrossRef Mehmood Z, Mahmood T, Javid MA (2018) Content-based image retrieval and semantic automatic image annotation based on the weighted average of triangular histograms using support vector machine. Appl Intell 48(1):166–181CrossRef
4.
go back to reference Gong Y et al (2017) Ranking approach to train deep neural nets for multilabel image annotation. U.S. Patent No. 9,552,549, 24 Jan 2017, pp 34–50 Gong Y et al (2017) Ranking approach to train deep neural nets for multilabel image annotation. U.S. Patent No. 9,552,549, 24 Jan 2017, pp 34–50
5.
go back to reference Li X et al (2016) Socializing the semantic gap: a comparative survey on image tag assignment, refinement, and retrieval. ACM Comput Surv (CSUR) 49(1):14CrossRef Li X et al (2016) Socializing the semantic gap: a comparative survey on image tag assignment, refinement, and retrieval. ACM Comput Surv (CSUR) 49(1):14CrossRef
7.
go back to reference Alzu’bi A, Amira A, Ramzan N (2015) Semantic content-based image retrieval: a comprehensive study. J Vis Commun Image Represent 32:20–54CrossRef Alzu’bi A, Amira A, Ramzan N (2015) Semantic content-based image retrieval: a comprehensive study. J Vis Commun Image Represent 32:20–54CrossRef
8.
go back to reference Wang T, Wang W (2016) Research on new multi-feature large-scale image retrieval algorithm based on semantic parsing and modified kernel clustering method. Int J Secur Appl 10(1):139–154 Wang T, Wang W (2016) Research on new multi-feature large-scale image retrieval algorithm based on semantic parsing and modified kernel clustering method. Int J Secur Appl 10(1):139–154
9.
go back to reference Yao X et al (2016) Semantic annotation of high-resolution satellite images via weakly supervised learning. IEEE Trans Geosci Remote Sens 54(6):3660–3671CrossRef Yao X et al (2016) Semantic annotation of high-resolution satellite images via weakly supervised learning. IEEE Trans Geosci Remote Sens 54(6):3660–3671CrossRef
11.
go back to reference Zhang H et al (2016) Adaptive incremental learning of image semantics with application to social robot. Neurocomputing 173:93–101CrossRef Zhang H et al (2016) Adaptive incremental learning of image semantics with application to social robot. Neurocomputing 173:93–101CrossRef
12.
go back to reference Demir B, Bruzzone L (2015) A novel active learning method in relevance feedback for content-based remote sensing image retrieval. IEEE Trans Geosci Remote Sens 53(5):2323–2334CrossRef Demir B, Bruzzone L (2015) A novel active learning method in relevance feedback for content-based remote sensing image retrieval. IEEE Trans Geosci Remote Sens 53(5):2323–2334CrossRef
13.
go back to reference Loukas C (2018) Video content analysis of surgical procedures. Surg Endosc 32(2):553–568CrossRef Loukas C (2018) Video content analysis of surgical procedures. Surg Endosc 32(2):553–568CrossRef
14.
go back to reference Zhao F et al (2015) Deep semantic ranking based hashing for multi-label image retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 34–50 Zhao F et al (2015) Deep semantic ranking based hashing for multi-label image retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 34–50
15.
go back to reference Yuan L, Yao E, Tan G (2018) Automated and precise event detection method for big data in biomedical imaging with support vector machine. Comput Syst Sci Eng 33(2):105–114 Yuan L, Yao E, Tan G (2018) Automated and precise event detection method for big data in biomedical imaging with support vector machine. Comput Syst Sci Eng 33(2):105–114
16.
go back to reference Münzer B, Schoeffmann K, Böszörmenyi L (2018) Content-based processing and analysis of endoscopic images and videos: a survey. Multimed Tools Appl 77(1):1323–1362CrossRef Münzer B, Schoeffmann K, Böszörmenyi L (2018) Content-based processing and analysis of endoscopic images and videos: a survey. Multimed Tools Appl 77(1):1323–1362CrossRef
17.
go back to reference Bhaumik H et al (2016) Hybrid soft computing approaches to content based video retrieval: a brief review. Appl Soft Comput 46:1008–1029CrossRef Bhaumik H et al (2016) Hybrid soft computing approaches to content based video retrieval: a brief review. Appl Soft Comput 46:1008–1029CrossRef
18.
go back to reference Celik C, Bilge HS (2017) Content based image retrieval with sparse representations and local feature descriptors: a comparative study. Pattern Recognit 68:1–13CrossRef Celik C, Bilge HS (2017) Content based image retrieval with sparse representations and local feature descriptors: a comparative study. Pattern Recognit 68:1–13CrossRef
19.
go back to reference Xu Z, Hu C, Mei L (2016) Video structured description technology based intelligence analysis of surveillance videos for public security applications. Multimed Tools Appl 75(19):12155–12172CrossRef Xu Z, Hu C, Mei L (2016) Video structured description technology based intelligence analysis of surveillance videos for public security applications. Multimed Tools Appl 75(19):12155–12172CrossRef
20.
go back to reference Gharbia R, Hassanien AE, El-Baz AH, Elhoseny M, Gunasekaran M (2018) Multi-spectral and panchromatic image fusion approach using stationary wavelet transform and swarm flower pollination optimization for remote sensing applications. Future Gener Comput Syst 88:501–511CrossRef Gharbia R, Hassanien AE, El-Baz AH, Elhoseny M, Gunasekaran M (2018) Multi-spectral and panchromatic image fusion approach using stationary wavelet transform and swarm flower pollination optimization for remote sensing applications. Future Gener Comput Syst 88:501–511CrossRef
21.
go back to reference Xie X et al (2018) A semantic-based method for visualizing large image collections. IEEE Trans Vis Comput Gr 25:2362–2377CrossRef Xie X et al (2018) A semantic-based method for visualizing large image collections. IEEE Trans Vis Comput Gr 25:2362–2377CrossRef
22.
go back to reference Capuozzo G, Borghini M, Mammoliti F (2016) Computer-implemented method, a computer program product and a computer system for image processing. U.S. Patent No. 9,349,077, 24 May 2016, pp 1–10 Capuozzo G, Borghini M, Mammoliti F (2016) Computer-implemented method, a computer program product and a computer system for image processing. U.S. Patent No. 9,349,077, 24 May 2016, pp 1–10
23.
go back to reference Tyagi V (2017) Content-based image retrieval techniques: a review. In: Content-based image retrieval. Springer, Singapore, pp 29–48 Tyagi V (2017) Content-based image retrieval techniques: a review. In: Content-based image retrieval. Springer, Singapore, pp 29–48
Metadata
Title
Content semantic image analysis and storage method based on intelligent computing of machine learning annotation
Authors
PengCheng Wei
Fangcheng He
Yang Zou
Publication date
05-02-2020
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 7/2020
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-04739-4

Other articles of this Issue 7/2020

Neural Computing and Applications 7/2020 Go to the issue

Deep Learning & Neural Computing for Intelligent Sensing and Control

Application research of improved genetic algorithm based on machine learning in production scheduling

Premium Partner