Skip to main content
Erschienen in: Computing 5/2014

01.05.2014

Automatic image annotation approach based on optimization of classes scores

verfasst von: Nashwa El-Bendary, Tai-hoon Kim, Aboul Ella Hassanien, Mohamed Sami

Erschienen in: Computing | Ausgabe 5/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This article presents an automatic image level annotation approach that takes advantage of both context and semantics presented in segmented images. The proposed approach is based on the optimization of classes’ scores using particle swarm optimization. In addition, random forest classifier and normalized cuts algorithm have been applied for automatic image classification, annotation, and clustering. For the proposed approach, each input image is segmented using the normalized cuts segmentation algorithm in order to create a descriptor for each segment. Two parameter selection models have been selected for particle swarm optimization algorithm and many voting techniques have been implemented to find the most suitable set of annotation words per image. Experimental results, using Corel5k benchmark annotated images dataset, demonstrate that applying optimization algorithms along with random forest classifier achieved noticeable increase in image annotation performance measures compared to related researches on the same dataset.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chen Z, Hou J, Zhang D, Qin X (2012) An annotation rule extraction algorithm for image retrieval. Pattern Recognit Lett 33(10):1257–1268CrossRef Chen Z, Hou J, Zhang D, Qin X (2012) An annotation rule extraction algorithm for image retrieval. Pattern Recognit Lett 33(10):1257–1268CrossRef
2.
Zurück zum Zitat Zhang D, Islam M, Lu G (2012) A review on automatic image annotation techniques. Pattern Recognit 45(1):346–362CrossRef Zhang D, Islam M, Lu G (2012) A review on automatic image annotation techniques. Pattern Recognit 45(1):346–362CrossRef
3.
Zurück zum Zitat Wang Y, Mei T, Gong S, Hua X (2009) Combining global, regional and contextual features for automatic image annotation. Pattern Recognit 42(2):259–266CrossRefMATH Wang Y, Mei T, Gong S, Hua X (2009) Combining global, regional and contextual features for automatic image annotation. Pattern Recognit 42(2):259–266CrossRefMATH
4.
Zurück zum Zitat Yao J, Zhang Z, Antani S, Long R, Thoma G (2008) Automatic medical image annotation and retrieval. Neurocomputing 71(10):2012–2022CrossRef Yao J, Zhang Z, Antani S, Long R, Thoma G (2008) Automatic medical image annotation and retrieval. Neurocomputing 71(10):2012–2022CrossRef
5.
Zurück zum Zitat Yu N, Hua K, Cheng H (2012) A multi-directional search technique for image annotation propagation. J Vis Commun Image Represent 23(1):237–244CrossRef Yu N, Hua K, Cheng H (2012) A multi-directional search technique for image annotation propagation. J Vis Commun Image Represent 23(1):237–244CrossRef
6.
Zurück zum Zitat Gao Y, YIN Y, Uozumi T (2012) A hierarchical image annotation method based on SVM and semi-supervised EM. Acta Automatica Sinica 36(7):960–967CrossRef Gao Y, YIN Y, Uozumi T (2012) A hierarchical image annotation method based on SVM and semi-supervised EM. Acta Automatica Sinica 36(7):960–967CrossRef
7.
Zurück zum Zitat Qi X, Han Y (2007) Incorporating multiple SVM for automatic image annotation. Pattern Recognit 40(2):728–741CrossRefMATH Qi X, Han Y (2007) Incorporating multiple SVM for automatic image annotation. Pattern Recognit 40(2):728–741CrossRefMATH
8.
Zurück zum Zitat Li R, Lu J, Zhang Y, Zhao T (2010) Dynamic adaboost learning with feature selection based on parallel genetic algorithm for image annotation. Knowl Based Syst 23(3):195–201CrossRef Li R, Lu J, Zhang Y, Zhao T (2010) Dynamic adaboost learning with feature selection based on parallel genetic algorithm for image annotation. Knowl Based Syst 23(3):195–201CrossRef
10.
Zurück zum Zitat Hironobu YM, Takahashi H, Oka R (1999) Image-to-word transformation based on dividing and vector quantizing images with words. Boltzmann machines. Neural Netw 405–409 Hironobu YM, Takahashi H, Oka R (1999) Image-to-word transformation based on dividing and vector quantizing images with words. Boltzmann machines. Neural Netw 405–409
11.
Zurück zum Zitat Duygulu P, Barnard K, Freitas J, Forsyth D (2002) Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In: 7th European conference on computer vision (ECCV 2002). Springer, LNCS, Copenhagen, 28–31 May 2002, pp 97–112 Duygulu P, Barnard K, Freitas J, Forsyth D (2002) Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In: 7th European conference on computer vision (ECCV 2002). Springer, LNCS, Copenhagen, 28–31 May 2002, pp 97–112
12.
Zurück zum Zitat Jeon J, Lavrenko V, Manmatha R (2003) Automatic image annotation and retrieval using cross-media relevance models. In: 26th annual international ACM SIGIR conference on research and development in information retrieval. ACM, Toronto, 28 July–1 August 2003, pp 119–126 Jeon J, Lavrenko V, Manmatha R (2003) Automatic image annotation and retrieval using cross-media relevance models. In: 26th annual international ACM SIGIR conference on research and development in information retrieval. ACM, Toronto, 28 July–1 August 2003, pp 119–126
13.
Zurück zum Zitat Lavrenko V, Manmatha R, Jeon J (2003) A model for learning the semantics of pictures. In: 16th conference on advances in neural information processing systems (NIPS 16), Vancouver. MIT Press, Canada, 8–13 December 2003 Lavrenko V, Manmatha R, Jeon J (2003) A model for learning the semantics of pictures. In: 16th conference on advances in neural information processing systems (NIPS 16), Vancouver. MIT Press, Canada, 8–13 December 2003
14.
Zurück zum Zitat Feng SL, Manmatha R, Lavrenko V (2004) Multiple Bernoulli relevance models for image and video annotation. In: IEEE computer society conference on computer vision and pattern recognition (CVPR ’04). IEEE, Washington, 27 June–2 July 2004, pp 1002–1009 Feng SL, Manmatha R, Lavrenko V (2004) Multiple Bernoulli relevance models for image and video annotation. In: IEEE computer society conference on computer vision and pattern recognition (CVPR ’04). IEEE, Washington, 27 June–2 July 2004, pp 1002–1009
15.
Zurück zum Zitat Cusano C, Ciocca G, Schettini R (2004) Image annotation using SVM. Internet Imaging IV 5304(1):330–338 Cusano C, Ciocca G, Schettini R (2004) Image annotation using SVM. Internet Imaging IV 5304(1):330–338
16.
Zurück zum Zitat Zhu S, Tan X (2011) A novel automatic image annotation method based on multi-instance learning. Procedia Eng 15:3439–3444CrossRef Zhu S, Tan X (2011) A novel automatic image annotation method based on multi-instance learning. Procedia Eng 15:3439–3444CrossRef
17.
Zurück zum Zitat Wang L, Khan L (2006) Automatic image annotation and retrieval using weighted feature selection. Multimed Tools Appl 29(1):55–71CrossRef Wang L, Khan L (2006) Automatic image annotation and retrieval using weighted feature selection. Multimed Tools Appl 29(1):55–71CrossRef
18.
Zurück zum Zitat Lu J, Zhao T, Zhang Y (2008) Feature selection based-on genetic algorithm for image annotation. Knowl Based Syst J 21(8):887–891CrossRef Lu J, Zhao T, Zhang Y (2008) Feature selection based-on genetic algorithm for image annotation. Knowl Based Syst J 21(8):887–891CrossRef
19.
Zurück zum Zitat Sun F, He JP (2009) A normalized cuts based image segmentation method. In: 2nd International conference on information and computing science. IEEE, Manchester, 21–22 May 2009, pp 333–336 Sun F, He JP (2009) A normalized cuts based image segmentation method. In: 2nd International conference on information and computing science. IEEE, Manchester, 21–22 May 2009, pp 333–336
20.
Zurück zum Zitat Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905CrossRef Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905CrossRef
21.
Zurück zum Zitat Clerc M, Kennedy J (2003) The particle swarm—explosion, stability, and convergence in a multidimensional complex space. IEEE Trans Evol Comput 6(1):58–73CrossRef Clerc M, Kennedy J (2003) The particle swarm—explosion, stability, and convergence in a multidimensional complex space. IEEE Trans Evol Comput 6(1):58–73CrossRef
22.
Zurück zum Zitat Trelea IC (2003) The particle swarm optimization algorithm: convergence analysis and parameter selection. Inf Process Lett 85(6):317–325CrossRefMATHMathSciNet Trelea IC (2003) The particle swarm optimization algorithm: convergence analysis and parameter selection. Inf Process Lett 85(6):317–325CrossRefMATHMathSciNet
23.
Zurück zum Zitat Kennedy J, Eberhart R (1995) Particle swarm optimization. In: IEEE International conference on neural networks, vol. 4. IEEE, Perth, 27 November–1 December 1995, pp 1942–1948 Kennedy J, Eberhart R (1995) Particle swarm optimization. In: IEEE International conference on neural networks, vol. 4. IEEE, Perth, 27 November–1 December 1995, pp 1942–1948
25.
Zurück zum Zitat Ho TK (1995) Random decision forests. In: 3rd International conference on document analysis and recognition (ICDAR 1995), vol. 1. IEEE Computer Society, Montreal, 14–15 August 1995, pp 278–282 Ho TK (1995) Random decision forests. In: 3rd International conference on document analysis and recognition (ICDAR 1995), vol. 1. IEEE Computer Society, Montreal, 14–15 August 1995, pp 278–282
26.
Zurück zum Zitat Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832–844CrossRef Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832–844CrossRef
27.
Zurück zum Zitat Breiman L, Friedman JH, Olshen RA, Stone CJ (1984) Classification and regression trees. Chapman and Hall, New YorkMATH Breiman L, Friedman JH, Olshen RA, Stone CJ (1984) Classification and regression trees. Chapman and Hall, New YorkMATH
Metadaten
Titel
Automatic image annotation approach based on optimization of classes scores
verfasst von
Nashwa El-Bendary
Tai-hoon Kim
Aboul Ella Hassanien
Mohamed Sami
Publikationsdatum
01.05.2014
Verlag
Springer Vienna
Erschienen in
Computing / Ausgabe 5/2014
Print ISSN: 0010-485X
Elektronische ISSN: 1436-5057
DOI
https://doi.org/10.1007/s00607-013-0342-0

Premium Partner