Skip to main content
Top
Published in: Computing 5/2014

01-05-2014

Automatic image annotation approach based on optimization of classes scores

Authors: Nashwa El-Bendary, Tai-hoon Kim, Aboul Ella Hassanien, Mohamed Sami

Published in: Computing | Issue 5/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This article presents an automatic image level annotation approach that takes advantage of both context and semantics presented in segmented images. The proposed approach is based on the optimization of classes’ scores using particle swarm optimization. In addition, random forest classifier and normalized cuts algorithm have been applied for automatic image classification, annotation, and clustering. For the proposed approach, each input image is segmented using the normalized cuts segmentation algorithm in order to create a descriptor for each segment. Two parameter selection models have been selected for particle swarm optimization algorithm and many voting techniques have been implemented to find the most suitable set of annotation words per image. Experimental results, using Corel5k benchmark annotated images dataset, demonstrate that applying optimization algorithms along with random forest classifier achieved noticeable increase in image annotation performance measures compared to related researches on the same dataset.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chen Z, Hou J, Zhang D, Qin X (2012) An annotation rule extraction algorithm for image retrieval. Pattern Recognit Lett 33(10):1257–1268CrossRef Chen Z, Hou J, Zhang D, Qin X (2012) An annotation rule extraction algorithm for image retrieval. Pattern Recognit Lett 33(10):1257–1268CrossRef
2.
go back to reference Zhang D, Islam M, Lu G (2012) A review on automatic image annotation techniques. Pattern Recognit 45(1):346–362CrossRef Zhang D, Islam M, Lu G (2012) A review on automatic image annotation techniques. Pattern Recognit 45(1):346–362CrossRef
3.
go back to reference Wang Y, Mei T, Gong S, Hua X (2009) Combining global, regional and contextual features for automatic image annotation. Pattern Recognit 42(2):259–266CrossRefMATH Wang Y, Mei T, Gong S, Hua X (2009) Combining global, regional and contextual features for automatic image annotation. Pattern Recognit 42(2):259–266CrossRefMATH
4.
go back to reference Yao J, Zhang Z, Antani S, Long R, Thoma G (2008) Automatic medical image annotation and retrieval. Neurocomputing 71(10):2012–2022CrossRef Yao J, Zhang Z, Antani S, Long R, Thoma G (2008) Automatic medical image annotation and retrieval. Neurocomputing 71(10):2012–2022CrossRef
5.
go back to reference Yu N, Hua K, Cheng H (2012) A multi-directional search technique for image annotation propagation. J Vis Commun Image Represent 23(1):237–244CrossRef Yu N, Hua K, Cheng H (2012) A multi-directional search technique for image annotation propagation. J Vis Commun Image Represent 23(1):237–244CrossRef
6.
go back to reference Gao Y, YIN Y, Uozumi T (2012) A hierarchical image annotation method based on SVM and semi-supervised EM. Acta Automatica Sinica 36(7):960–967CrossRef Gao Y, YIN Y, Uozumi T (2012) A hierarchical image annotation method based on SVM and semi-supervised EM. Acta Automatica Sinica 36(7):960–967CrossRef
7.
go back to reference Qi X, Han Y (2007) Incorporating multiple SVM for automatic image annotation. Pattern Recognit 40(2):728–741CrossRefMATH Qi X, Han Y (2007) Incorporating multiple SVM for automatic image annotation. Pattern Recognit 40(2):728–741CrossRefMATH
8.
go back to reference Li R, Lu J, Zhang Y, Zhao T (2010) Dynamic adaboost learning with feature selection based on parallel genetic algorithm for image annotation. Knowl Based Syst 23(3):195–201CrossRef Li R, Lu J, Zhang Y, Zhao T (2010) Dynamic adaboost learning with feature selection based on parallel genetic algorithm for image annotation. Knowl Based Syst 23(3):195–201CrossRef
10.
go back to reference Hironobu YM, Takahashi H, Oka R (1999) Image-to-word transformation based on dividing and vector quantizing images with words. Boltzmann machines. Neural Netw 405–409 Hironobu YM, Takahashi H, Oka R (1999) Image-to-word transformation based on dividing and vector quantizing images with words. Boltzmann machines. Neural Netw 405–409
11.
go back to reference Duygulu P, Barnard K, Freitas J, Forsyth D (2002) Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In: 7th European conference on computer vision (ECCV 2002). Springer, LNCS, Copenhagen, 28–31 May 2002, pp 97–112 Duygulu P, Barnard K, Freitas J, Forsyth D (2002) Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In: 7th European conference on computer vision (ECCV 2002). Springer, LNCS, Copenhagen, 28–31 May 2002, pp 97–112
12.
go back to reference Jeon J, Lavrenko V, Manmatha R (2003) Automatic image annotation and retrieval using cross-media relevance models. In: 26th annual international ACM SIGIR conference on research and development in information retrieval. ACM, Toronto, 28 July–1 August 2003, pp 119–126 Jeon J, Lavrenko V, Manmatha R (2003) Automatic image annotation and retrieval using cross-media relevance models. In: 26th annual international ACM SIGIR conference on research and development in information retrieval. ACM, Toronto, 28 July–1 August 2003, pp 119–126
13.
go back to reference Lavrenko V, Manmatha R, Jeon J (2003) A model for learning the semantics of pictures. In: 16th conference on advances in neural information processing systems (NIPS 16), Vancouver. MIT Press, Canada, 8–13 December 2003 Lavrenko V, Manmatha R, Jeon J (2003) A model for learning the semantics of pictures. In: 16th conference on advances in neural information processing systems (NIPS 16), Vancouver. MIT Press, Canada, 8–13 December 2003
14.
go back to reference Feng SL, Manmatha R, Lavrenko V (2004) Multiple Bernoulli relevance models for image and video annotation. In: IEEE computer society conference on computer vision and pattern recognition (CVPR ’04). IEEE, Washington, 27 June–2 July 2004, pp 1002–1009 Feng SL, Manmatha R, Lavrenko V (2004) Multiple Bernoulli relevance models for image and video annotation. In: IEEE computer society conference on computer vision and pattern recognition (CVPR ’04). IEEE, Washington, 27 June–2 July 2004, pp 1002–1009
15.
go back to reference Cusano C, Ciocca G, Schettini R (2004) Image annotation using SVM. Internet Imaging IV 5304(1):330–338 Cusano C, Ciocca G, Schettini R (2004) Image annotation using SVM. Internet Imaging IV 5304(1):330–338
16.
go back to reference Zhu S, Tan X (2011) A novel automatic image annotation method based on multi-instance learning. Procedia Eng 15:3439–3444CrossRef Zhu S, Tan X (2011) A novel automatic image annotation method based on multi-instance learning. Procedia Eng 15:3439–3444CrossRef
17.
go back to reference Wang L, Khan L (2006) Automatic image annotation and retrieval using weighted feature selection. Multimed Tools Appl 29(1):55–71CrossRef Wang L, Khan L (2006) Automatic image annotation and retrieval using weighted feature selection. Multimed Tools Appl 29(1):55–71CrossRef
18.
go back to reference Lu J, Zhao T, Zhang Y (2008) Feature selection based-on genetic algorithm for image annotation. Knowl Based Syst J 21(8):887–891CrossRef Lu J, Zhao T, Zhang Y (2008) Feature selection based-on genetic algorithm for image annotation. Knowl Based Syst J 21(8):887–891CrossRef
19.
go back to reference Sun F, He JP (2009) A normalized cuts based image segmentation method. In: 2nd International conference on information and computing science. IEEE, Manchester, 21–22 May 2009, pp 333–336 Sun F, He JP (2009) A normalized cuts based image segmentation method. In: 2nd International conference on information and computing science. IEEE, Manchester, 21–22 May 2009, pp 333–336
20.
go back to reference Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905CrossRef Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905CrossRef
21.
go back to reference Clerc M, Kennedy J (2003) The particle swarm—explosion, stability, and convergence in a multidimensional complex space. IEEE Trans Evol Comput 6(1):58–73CrossRef Clerc M, Kennedy J (2003) The particle swarm—explosion, stability, and convergence in a multidimensional complex space. IEEE Trans Evol Comput 6(1):58–73CrossRef
22.
go back to reference Trelea IC (2003) The particle swarm optimization algorithm: convergence analysis and parameter selection. Inf Process Lett 85(6):317–325CrossRefMATHMathSciNet Trelea IC (2003) The particle swarm optimization algorithm: convergence analysis and parameter selection. Inf Process Lett 85(6):317–325CrossRefMATHMathSciNet
23.
go back to reference Kennedy J, Eberhart R (1995) Particle swarm optimization. In: IEEE International conference on neural networks, vol. 4. IEEE, Perth, 27 November–1 December 1995, pp 1942–1948 Kennedy J, Eberhart R (1995) Particle swarm optimization. In: IEEE International conference on neural networks, vol. 4. IEEE, Perth, 27 November–1 December 1995, pp 1942–1948
25.
go back to reference Ho TK (1995) Random decision forests. In: 3rd International conference on document analysis and recognition (ICDAR 1995), vol. 1. IEEE Computer Society, Montreal, 14–15 August 1995, pp 278–282 Ho TK (1995) Random decision forests. In: 3rd International conference on document analysis and recognition (ICDAR 1995), vol. 1. IEEE Computer Society, Montreal, 14–15 August 1995, pp 278–282
26.
go back to reference Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832–844CrossRef Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832–844CrossRef
27.
go back to reference Breiman L, Friedman JH, Olshen RA, Stone CJ (1984) Classification and regression trees. Chapman and Hall, New YorkMATH Breiman L, Friedman JH, Olshen RA, Stone CJ (1984) Classification and regression trees. Chapman and Hall, New YorkMATH
Metadata
Title
Automatic image annotation approach based on optimization of classes scores
Authors
Nashwa El-Bendary
Tai-hoon Kim
Aboul Ella Hassanien
Mohamed Sami
Publication date
01-05-2014
Publisher
Springer Vienna
Published in
Computing / Issue 5/2014
Print ISSN: 0010-485X
Electronic ISSN: 1436-5057
DOI
https://doi.org/10.1007/s00607-013-0342-0

Premium Partner