Skip to main content
Erschienen in: Neural Processing Letters 3/2014

01.06.2014

Efficient Feature Scaling for Support Vector Machines with a Quadratic Kernel

verfasst von: Zhizheng Liang, Ning Liu

Erschienen in: Neural Processing Letters | Ausgabe 3/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Choosing multiple hyperparameters for support vector machines has gained wide attention from researchers and this also provides a strategy for automatically selecting scaling factors of features. This paper proposes an efficient feature scaling method for support vector machines with a quadratic kernel. The proposed method alternately performs the standard SVM algorithm and the eigen-decomposition until some criteria are met. It is interesting to note that scaling factors of features can be analytically obtained for fixed support vectors. The experiments on a toy example, UCI data sets, and face images are carried out to demonstrate the feasibility and effectiveness of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Schölkopf B, Smola A, Müller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef Schölkopf B, Smola A, Müller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef
2.
Zurück zum Zitat Vapnik V (1998) Statistical leaning theory. Wiley, New York Vapnik V (1998) Statistical leaning theory. Wiley, New York
3.
Zurück zum Zitat Schölkopf B, Burges C, Vapnik V (1995) Extracting support data for a given task. Proceedings of first international conference on knowledge discovery and data mining. AAAI Press, Menlo Park, pp 884–889 Schölkopf B, Burges C, Vapnik V (1995) Extracting support data for a given task. Proceedings of first international conference on knowledge discovery and data mining. AAAI Press, Menlo Park, pp 884–889
4.
Zurück zum Zitat Liao S, Yang C, Ding L (2011) Approximate parameter tuning of support vector machines. The 3rd international conference on intelligent systems and applications 38(10):1–4 Liao S, Yang C, Ding L (2011) Approximate parameter tuning of support vector machines. The 3rd international conference on intelligent systems and applications 38(10):1–4
5.
Zurück zum Zitat Guyon I, Saffari A, Dror G, Cawley G (2010) Model section: beyond the Bayesian/frequentist divide. J Mach Learn Res 11:61–87 Guyon I, Saffari A, Dror G, Cawley G (2010) Model section: beyond the Bayesian/frequentist divide. J Mach Learn Res 11:61–87
6.
Zurück zum Zitat Chapelle O, Vapnik V, Bousquet O, Mukherjee S (2002) Choosing multiple parameters for support vector machines. Mach Learn 46:131–159CrossRefMATH Chapelle O, Vapnik V, Bousquet O, Mukherjee S (2002) Choosing multiple parameters for support vector machines. Mach Learn 46:131–159CrossRefMATH
7.
Zurück zum Zitat Keerthi SS (2002) Efficient tuning of SVM hyperparameters using radius/margin bound and iterative algorithms. IEEE Trans Neural Netw 13:1225–1229CrossRef Keerthi SS (2002) Efficient tuning of SVM hyperparameters using radius/margin bound and iterative algorithms. IEEE Trans Neural Netw 13:1225–1229CrossRef
8.
9.
Zurück zum Zitat Ong CS, Smola AJ, Williamson RC (2006) Learning the kernel with hyperkernels. J Mach Learn Res 6:1043–1071MathSciNet Ong CS, Smola AJ, Williamson RC (2006) Learning the kernel with hyperkernels. J Mach Learn Res 6:1043–1071MathSciNet
10.
Zurück zum Zitat Lanckriet GRG, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2004) Learning the kernel matrix semidefinite programming. J Mach Learn Res 5:27–72MATH Lanckriet GRG, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2004) Learning the kernel matrix semidefinite programming. J Mach Learn Res 5:27–72MATH
11.
Zurück zum Zitat Argyriou A, Micchelli C A, Pontil M (2005) Learning convex combinations of continuously parameterized basic kernels. The 18th annual conference on learning theory(COLT), Betinoro, Italy, June 27–30 Argyriou A, Micchelli C A, Pontil M (2005) Learning convex combinations of continuously parameterized basic kernels. The 18th annual conference on learning theory(COLT), Betinoro, Italy, June 27–30
12.
Zurück zum Zitat Bennett KP, Hu J, Ji X, Pang JS (2006) Model selection via bilevel optimization. International joint conference on, neural networks, pp 1922–1929 Bennett KP, Hu J, Ji X, Pang JS (2006) Model selection via bilevel optimization. International joint conference on, neural networks, pp 1922–1929
13.
Zurück zum Zitat Kunapuli G, Bennett KP, Hu J, Pang JS (2008) Classification model selection via bilevel programming. Optim Methods Softw 23(4):475–489CrossRefMATHMathSciNet Kunapuli G, Bennett KP, Hu J, Pang JS (2008) Classification model selection via bilevel programming. Optim Methods Softw 23(4):475–489CrossRefMATHMathSciNet
14.
Zurück zum Zitat Bennett KP, Hu J, Ji X, Pang JS (2008) Bilevel optimization and machine learning. Lecture notes in computer science, computational intelligence: research frontiers 5050:25–47CrossRef Bennett KP, Hu J, Ji X, Pang JS (2008) Bilevel optimization and machine learning. Lecture notes in computer science, computational intelligence: research frontiers 5050:25–47CrossRef
15.
Zurück zum Zitat Kunapuli G, Bennett KP, Pang JS (2008) Bilevel model selection for support vector machines. Data mining and mathematical programming 45:129–158 Kunapuli G, Bennett KP, Pang JS (2008) Bilevel model selection for support vector machines. Data mining and mathematical programming 45:129–158
16.
Zurück zum Zitat Moore G, Bergeron C, Bennett K P (2009) Nonconvex bilevel programming for hyperparameter selection. IEEE international conference on data mining workshops, pp 374–381. Moore G, Bergeron C, Bennett K P (2009) Nonconvex bilevel programming for hyperparameter selection. IEEE international conference on data mining workshops, pp 374–381.
18.
Zurück zum Zitat Weston J, Mukherjee S, Chapelle O, Pontil M, Poggio T, Vapnik V (2001) Feature selection for SVMs. Adv Neural Inf Process Syst 13:668–674 Weston J, Mukherjee S, Chapelle O, Pontil M, Poggio T, Vapnik V (2001) Feature selection for SVMs. Adv Neural Inf Process Syst 13:668–674
19.
Zurück zum Zitat Bradley PS, Mangasarian OL (1998) Feature selection via concave minimization and support vector machine. International conference on machine learning, pp 82–90 Bradley PS, Mangasarian OL (1998) Feature selection via concave minimization and support vector machine. International conference on machine learning, pp 82–90
20.
Zurück zum Zitat Grandvalet Y, Canu S (2002) Adaptive scaling for feature selection in SVMs. Adv Neural Inf Process Syst 15:553–560 Grandvalet Y, Canu S (2002) Adaptive scaling for feature selection in SVMs. Adv Neural Inf Process Syst 15:553–560
21.
Zurück zum Zitat Wolf L, Shashua A (2005) Feature selection for unsupervised and supervised inference: the emergence of sparsity in a weighted-based approach. J Mach Learn Res 6(12):1855–1887MATHMathSciNet Wolf L, Shashua A (2005) Feature selection for unsupervised and supervised inference: the emergence of sparsity in a weighted-based approach. J Mach Learn Res 6(12):1855–1887MATHMathSciNet
22.
Zurück zum Zitat Zhang X (2004) Matrix theory and its applications. Springer, New York Zhang X (2004) Matrix theory and its applications. Springer, New York
23.
Zurück zum Zitat Duan K, Keerthi SS, Poo AN (2003) Evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing 51:41–59CrossRef Duan K, Keerthi SS, Poo AN (2003) Evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing 51:41–59CrossRef
Metadaten
Titel
Efficient Feature Scaling for Support Vector Machines with a Quadratic Kernel
verfasst von
Zhizheng Liang
Ning Liu
Publikationsdatum
01.06.2014
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2014
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-013-9301-1

Weitere Artikel der Ausgabe 3/2014

Neural Processing Letters 3/2014 Zur Ausgabe

Neuer Inhalt