Skip to main content
Top
Published in: Soft Computing 2/2010

01-01-2010 | Focus

Image category learning and classification via optimal linear combination of multiple partially matching kernels

Authors: Si-Yao Fu, Guo-Sheng Yang, Zeng-Guang Hou

Published in: Soft Computing | Issue 2/2010

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multiple kernel learning (MKL) aims at simultaneously optimizing kernel weights while training the support vector machine (SVM) to get satisfactory classification or regression results. Recent publications and developments based on SVM have shown that by using MKL one can enhance interpretability of the decision function and improve classifier performance, which motivates researchers to explore the use of homogeneous model obtained as linear combination of various types of kernels. In this paper, we show that MKL problems can be solved efficiently by modified projection gradient method and applied for image categorization and object detection. The kernel is defined as a linear combination of feature histogram function that can measure the degree of similarity of partial correspondence between feature sets for discriminative classification, which allows recognition robust to within-class variation, pose changes, and articulation. We evaluate our proposed framework on the ETH-80 dataset for several multi-level image encodings for supervised and unsupervised object recognition and report competitive results.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Andersen ED, Andersen KD (2000) The MOSEK interior point optimizer for linear programming: an implementation of the homogeneous algorithm. High Perf Optim 33:197–232 Andersen ED, Andersen KD (2000) The MOSEK interior point optimizer for linear programming: an implementation of the homogeneous algorithm. High Perf Optim 33:197–232
go back to reference Bach FR (2008) Consistency of the group Lasso and multiple kernel learning. J Mach Learn Res (JMLR) 9:1179–1225MathSciNet Bach FR (2008) Consistency of the group Lasso and multiple kernel learning. J Mach Learn Res (JMLR) 9:1179–1225MathSciNet
go back to reference Bach FR, Lanckriet GG, Jordan M (2004) Multiple kernel learning, conic duality, and the SMO algorithm. In: Proceedings of the twenty-first international conference on machine learning, pp 775–782 Bach FR, Lanckriet GG, Jordan M (2004) Multiple kernel learning, conic duality, and the SMO algorithm. In: Proceedings of the twenty-first international conference on machine learning, pp 775–782
go back to reference Biederman I, Ju G (1988) Surface vs. edge-based determinants of visual recognition. Cogn Psychol 20(1):38–64CrossRef Biederman I, Ju G (1988) Surface vs. edge-based determinants of visual recognition. Cogn Psychol 20(1):38–64CrossRef
go back to reference Bosch A, Zisserman A, Munoz X (2007) Representing shape with a spatial pyramid kernel. In: Proceedings of the international conference on image video retrieval Bosch A, Zisserman A, Munoz X (2007) Representing shape with a spatial pyramid kernel. In: Proceedings of the international conference on image video retrieval
go back to reference Boyd S, Vandenberghe L (2004) Convex optimization. Cambridge University Press, CambridgeMATH Boyd S, Vandenberghe L (2004) Convex optimization. Cambridge University Press, CambridgeMATH
go back to reference Calamai PH, Moré JJ (1987) Projected gradients methods for linearly constrained problems. Math Program 39(1):93–116MATHCrossRef Calamai PH, Moré JJ (1987) Projected gradients methods for linearly constrained problems. Math Program 39(1):93–116MATHCrossRef
go back to reference Chapelle O, Vapnik V, Bousquet O, Mukerjhee S (2002) Choosing multiple parameters for SVM. Mach Learn 46(1):131–159MATHCrossRef Chapelle O, Vapnik V, Bousquet O, Mukerjhee S (2002) Choosing multiple parameters for SVM. Mach Learn 46(1):131–159MATHCrossRef
go back to reference Fei-Fei L, Fergus R, Perona P (2006) One-shot learning of object categories. IEEE Trans Pattern Anal Mach Intell 28(4):594–611CrossRef Fei-Fei L, Fergus R, Perona P (2006) One-shot learning of object categories. IEEE Trans Pattern Anal Mach Intell 28(4):594–611CrossRef
go back to reference Fergus R, Perona P, Zisserman A (2003) Object class recognition by unsupervised scale-invariant learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 264–271 Fergus R, Perona P, Zisserman A (2003) Object class recognition by unsupervised scale-invariant learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 264–271
go back to reference Fu SY, Hou ZG, Liang ZZ, Zuo Q, Tan M, Fu XY (2008a) Unsupervised learning of categories from sets of partially matching image features for power transmission line inspection robot. In: Proceedings of the IEEE world conference on computational intelligence Fu SY, Hou ZG, Liang ZZ, Zuo Q, Tan M, Fu XY (2008a) Unsupervised learning of categories from sets of partially matching image features for power transmission line inspection robot. In: Proceedings of the IEEE world conference on computational intelligence
go back to reference Fu SY, Hou ZG, Liang ZZ, Tan M (2008b) Multiple kernel learning from sets of partially matching image features. In: Proceedings of UKACC Fu SY, Hou ZG, Liang ZZ, Tan M (2008b) Multiple kernel learning from sets of partially matching image features. In: Proceedings of UKACC
go back to reference Grauman K, Darrell T (2005) The pyramid match kernel: discriminative classification with sets of image features. In: Proceedings of the IEEE international conference on computer vision Grauman K, Darrell T (2005) The pyramid match kernel: discriminative classification with sets of image features. In: Proceedings of the IEEE international conference on computer vision
go back to reference Grauman K, Darrell T (2006) Unsupervised learning of categories from sets of partially matching image features. In: Proceedings of the IEEE computer vision pattern recognition Grauman K, Darrell T (2006) Unsupervised learning of categories from sets of partially matching image features. In: Proceedings of the IEEE computer vision pattern recognition
go back to reference Hadjidemetriou E, Grossberg M, Nayar S (2004) Multiresolution histograms and their use in recognition. IEEE Trans Pattern Anal Mach Intell 26(7):831–847CrossRef Hadjidemetriou E, Grossberg M, Nayar S (2004) Multiresolution histograms and their use in recognition. IEEE Trans Pattern Anal Mach Intell 26(7):831–847CrossRef
go back to reference Kumar A, Sminchisescu C (2007) Support kernel machines for object recognition. In: Proceedings of the IEEE international conference on computer vision Kumar A, Sminchisescu C (2007) Support kernel machines for object recognition. In: Proceedings of the IEEE international conference on computer vision
go back to reference Lanckriet G, Cristinanini N, Ghaoui EL, Bartlett P, Jordan M (2004) Learning the kernel matrix with semi-definite programming. J Mach Learn Res 5:27–72 Lanckriet G, Cristinanini N, Ghaoui EL, Bartlett P, Jordan M (2004) Learning the kernel matrix with semi-definite programming. J Mach Learn Res 5:27–72
go back to reference La Torre Frade FD, Vinyals O (2007) Learning kernel expansions for image classification. In: Proceedings of the IEEE computer vision and pattern recognition La Torre Frade FD, Vinyals O (2007) Learning kernel expansions for image classification. In: Proceedings of the IEEE computer vision and pattern recognition
go back to reference Lazebnik S, Schmid C, Ponce J (2006) Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proceedings of the IEEE computer vision and pattern recognition Lazebnik S, Schmid C, Ponce J (2006) Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proceedings of the IEEE computer vision and pattern recognition
go back to reference Lowe D (2004) Distinctive image features from scale-invariant keypoints. Proc IEEE Int J Comput Vis 60(2):91–110CrossRef Lowe D (2004) Distinctive image features from scale-invariant keypoints. Proc IEEE Int J Comput Vis 60(2):91–110CrossRef
go back to reference Luenberger D (1984) Linear and nonlinear programming. Addison-Wesley, USA Luenberger D (1984) Linear and nonlinear programming. Addison-Wesley, USA
go back to reference Lv F, Nevatia R (2007) Single view human action recogntion using key pose matching and viterbi path searching. In: Proceedings of the IEEE international conference on computer vision Lv F, Nevatia R (2007) Single view human action recogntion using key pose matching and viterbi path searching. In: Proceedings of the IEEE international conference on computer vision
go back to reference Rakotomamonjy A, Bach F, Canu S, Grandvalet Y (2007) More efficiency in multiple kernel learning. In: Proceedings of international conference on machine learning (ICML) Rakotomamonjy A, Bach F, Canu S, Grandvalet Y (2007) More efficiency in multiple kernel learning. In: Proceedings of international conference on machine learning (ICML)
go back to reference Rakotomamonjy A, Bach F, Canu S, Grandvalet Y (2008) SimpleMKL. J Mach Learn Res (JMLR) 9:2491–2521MathSciNet Rakotomamonjy A, Bach F, Canu S, Grandvalet Y (2008) SimpleMKL. J Mach Learn Res (JMLR) 9:2491–2521MathSciNet
go back to reference Sonnerburg S, Raetsch G, Schaefer C, Scholkopf B (2006) Large scale multiple kernel learning. J Mach Learn Res 7:1531–1565MathSciNet Sonnerburg S, Raetsch G, Schaefer C, Scholkopf B (2006) Large scale multiple kernel learning. J Mach Learn Res 7:1531–1565MathSciNet
go back to reference Wallraven C, Caputo B, Graf A (2003) Recognition with local features: the kernel recipe. In: Proceedings of the IEEE international conference on computer vision Wallraven C, Caputo B, Graf A (2003) Recognition with local features: the kernel recipe. In: Proceedings of the IEEE international conference on computer vision
go back to reference Winter JD, Wagemans J (2004) Contour-based object identification and segmentation: stimuli, norms and data, and software tools. Behav Res Methods Instrum Comput 36(4):604–624 Winter JD, Wagemans J (2004) Contour-based object identification and segmentation: stimuli, norms and data, and software tools. Behav Res Methods Instrum Comput 36(4):604–624
Metadata
Title
Image category learning and classification via optimal linear combination of multiple partially matching kernels
Authors
Si-Yao Fu
Guo-Sheng Yang
Zeng-Guang Hou
Publication date
01-01-2010
Publisher
Springer-Verlag
Published in
Soft Computing / Issue 2/2010
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-009-0436-y

Other articles of this Issue 2/2010

Soft Computing 2/2010 Go to the issue

Premium Partner