Skip to main content
Erschienen in: Neural Computing and Applications 7/2020

05.02.2020 | Deep Learning & Neural Computing for Intelligent Sensing and Control

Content semantic image analysis and storage method based on intelligent computing of machine learning annotation

verfasst von: PengCheng Wei, Fangcheng He, Yang Zou

Erschienen in: Neural Computing and Applications | Ausgabe 7/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the popularity of computers and the rapid development of various application platforms, the explosive growth of data poses a huge challenge to data analysis and storage. For large-scale image analysis applications, the time delay in storing read data becomes an important issue that constrains this application. The semantic information asymmetry between image application and storage is the root cause of this problem. In view of content semantic analysis, in recent years, intelligent computing has become the main research direction. Among them, machine learning has become a research hot spot because of its offline learning and online generation characteristics. For the semantics of image content, machine learning can complete tasks such as content semantic association, classification, annotation and hash mapping, and provide algorithm support for applying image semantics and improving semantic analysis ability in large-scale environment. Image annotation is an important topic in the semantic analysis of image content. Annotation can establish a classification relationship between image content and semantics. In order to solve the problem of extracting a large amount of data in large-scale image analysis, a content semantic image content analysis and storage scheme based on intelligent computer learning image annotation is proposed. Combined with DSTH work, the program introduces deep learning, visual lexicon and map metadata. Hash semantic metadata supplemental metadata is obtained through deep learning, and semantic metadata is constructed and managed in a hierarchical structure. In addition, according to the characteristics of the graph structure, by improving the PageRank algorithm, the SemRank node ranking algorithm based on Hamming distance is proposed. Experimental results demonstrate the effectiveness and reliability of the algorithm.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Szegedy C et al (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 22–30 Szegedy C et al (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 22–30
2.
Zurück zum Zitat Piras L, Giacinto G (2017) Information fusion in content based image retrieval: a comprehensive overview. Inf Fusion 37:50–60CrossRef Piras L, Giacinto G (2017) Information fusion in content based image retrieval: a comprehensive overview. Inf Fusion 37:50–60CrossRef
3.
Zurück zum Zitat Mehmood Z, Mahmood T, Javid MA (2018) Content-based image retrieval and semantic automatic image annotation based on the weighted average of triangular histograms using support vector machine. Appl Intell 48(1):166–181CrossRef Mehmood Z, Mahmood T, Javid MA (2018) Content-based image retrieval and semantic automatic image annotation based on the weighted average of triangular histograms using support vector machine. Appl Intell 48(1):166–181CrossRef
4.
Zurück zum Zitat Gong Y et al (2017) Ranking approach to train deep neural nets for multilabel image annotation. U.S. Patent No. 9,552,549, 24 Jan 2017, pp 34–50 Gong Y et al (2017) Ranking approach to train deep neural nets for multilabel image annotation. U.S. Patent No. 9,552,549, 24 Jan 2017, pp 34–50
5.
Zurück zum Zitat Li X et al (2016) Socializing the semantic gap: a comparative survey on image tag assignment, refinement, and retrieval. ACM Comput Surv (CSUR) 49(1):14CrossRef Li X et al (2016) Socializing the semantic gap: a comparative survey on image tag assignment, refinement, and retrieval. ACM Comput Surv (CSUR) 49(1):14CrossRef
7.
Zurück zum Zitat Alzu’bi A, Amira A, Ramzan N (2015) Semantic content-based image retrieval: a comprehensive study. J Vis Commun Image Represent 32:20–54CrossRef Alzu’bi A, Amira A, Ramzan N (2015) Semantic content-based image retrieval: a comprehensive study. J Vis Commun Image Represent 32:20–54CrossRef
8.
Zurück zum Zitat Wang T, Wang W (2016) Research on new multi-feature large-scale image retrieval algorithm based on semantic parsing and modified kernel clustering method. Int J Secur Appl 10(1):139–154 Wang T, Wang W (2016) Research on new multi-feature large-scale image retrieval algorithm based on semantic parsing and modified kernel clustering method. Int J Secur Appl 10(1):139–154
9.
Zurück zum Zitat Yao X et al (2016) Semantic annotation of high-resolution satellite images via weakly supervised learning. IEEE Trans Geosci Remote Sens 54(6):3660–3671CrossRef Yao X et al (2016) Semantic annotation of high-resolution satellite images via weakly supervised learning. IEEE Trans Geosci Remote Sens 54(6):3660–3671CrossRef
11.
Zurück zum Zitat Zhang H et al (2016) Adaptive incremental learning of image semantics with application to social robot. Neurocomputing 173:93–101CrossRef Zhang H et al (2016) Adaptive incremental learning of image semantics with application to social robot. Neurocomputing 173:93–101CrossRef
12.
Zurück zum Zitat Demir B, Bruzzone L (2015) A novel active learning method in relevance feedback for content-based remote sensing image retrieval. IEEE Trans Geosci Remote Sens 53(5):2323–2334CrossRef Demir B, Bruzzone L (2015) A novel active learning method in relevance feedback for content-based remote sensing image retrieval. IEEE Trans Geosci Remote Sens 53(5):2323–2334CrossRef
13.
Zurück zum Zitat Loukas C (2018) Video content analysis of surgical procedures. Surg Endosc 32(2):553–568CrossRef Loukas C (2018) Video content analysis of surgical procedures. Surg Endosc 32(2):553–568CrossRef
14.
Zurück zum Zitat Zhao F et al (2015) Deep semantic ranking based hashing for multi-label image retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 34–50 Zhao F et al (2015) Deep semantic ranking based hashing for multi-label image retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 34–50
15.
Zurück zum Zitat Yuan L, Yao E, Tan G (2018) Automated and precise event detection method for big data in biomedical imaging with support vector machine. Comput Syst Sci Eng 33(2):105–114 Yuan L, Yao E, Tan G (2018) Automated and precise event detection method for big data in biomedical imaging with support vector machine. Comput Syst Sci Eng 33(2):105–114
16.
Zurück zum Zitat Münzer B, Schoeffmann K, Böszörmenyi L (2018) Content-based processing and analysis of endoscopic images and videos: a survey. Multimed Tools Appl 77(1):1323–1362CrossRef Münzer B, Schoeffmann K, Böszörmenyi L (2018) Content-based processing and analysis of endoscopic images and videos: a survey. Multimed Tools Appl 77(1):1323–1362CrossRef
17.
Zurück zum Zitat Bhaumik H et al (2016) Hybrid soft computing approaches to content based video retrieval: a brief review. Appl Soft Comput 46:1008–1029CrossRef Bhaumik H et al (2016) Hybrid soft computing approaches to content based video retrieval: a brief review. Appl Soft Comput 46:1008–1029CrossRef
18.
Zurück zum Zitat Celik C, Bilge HS (2017) Content based image retrieval with sparse representations and local feature descriptors: a comparative study. Pattern Recognit 68:1–13CrossRef Celik C, Bilge HS (2017) Content based image retrieval with sparse representations and local feature descriptors: a comparative study. Pattern Recognit 68:1–13CrossRef
19.
Zurück zum Zitat Xu Z, Hu C, Mei L (2016) Video structured description technology based intelligence analysis of surveillance videos for public security applications. Multimed Tools Appl 75(19):12155–12172CrossRef Xu Z, Hu C, Mei L (2016) Video structured description technology based intelligence analysis of surveillance videos for public security applications. Multimed Tools Appl 75(19):12155–12172CrossRef
20.
Zurück zum Zitat Gharbia R, Hassanien AE, El-Baz AH, Elhoseny M, Gunasekaran M (2018) Multi-spectral and panchromatic image fusion approach using stationary wavelet transform and swarm flower pollination optimization for remote sensing applications. Future Gener Comput Syst 88:501–511CrossRef Gharbia R, Hassanien AE, El-Baz AH, Elhoseny M, Gunasekaran M (2018) Multi-spectral and panchromatic image fusion approach using stationary wavelet transform and swarm flower pollination optimization for remote sensing applications. Future Gener Comput Syst 88:501–511CrossRef
21.
Zurück zum Zitat Xie X et al (2018) A semantic-based method for visualizing large image collections. IEEE Trans Vis Comput Gr 25:2362–2377CrossRef Xie X et al (2018) A semantic-based method for visualizing large image collections. IEEE Trans Vis Comput Gr 25:2362–2377CrossRef
22.
Zurück zum Zitat Capuozzo G, Borghini M, Mammoliti F (2016) Computer-implemented method, a computer program product and a computer system for image processing. U.S. Patent No. 9,349,077, 24 May 2016, pp 1–10 Capuozzo G, Borghini M, Mammoliti F (2016) Computer-implemented method, a computer program product and a computer system for image processing. U.S. Patent No. 9,349,077, 24 May 2016, pp 1–10
23.
Zurück zum Zitat Tyagi V (2017) Content-based image retrieval techniques: a review. In: Content-based image retrieval. Springer, Singapore, pp 29–48 Tyagi V (2017) Content-based image retrieval techniques: a review. In: Content-based image retrieval. Springer, Singapore, pp 29–48
Metadaten
Titel
Content semantic image analysis and storage method based on intelligent computing of machine learning annotation
verfasst von
PengCheng Wei
Fangcheng He
Yang Zou
Publikationsdatum
05.02.2020
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 7/2020
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-04739-4

Weitere Artikel der Ausgabe 7/2020

Neural Computing and Applications 7/2020 Zur Ausgabe

Premium Partner