Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 6/2017

09.07.2016 | Original Article

Improved sparse LSSVMS based on the localized generalization error model

verfasst von: Binbin Sun, Wing W. Y. Ng, Patrick P. K. Chan

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 6/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The least squares support vector machine (LSSVM) is computationally efficient because it converts the quadratic programming problem in the training of SVM to a linear programming problem. The sparse LSSVM is proposed to promote the predictive speed and generalization capability. In this paper, two sparse LSSVM algorithms: the SMRLSSVM and the RQRLSSVM are proposed based on the Localized Generalization Error of the LSSVM. Experimental results show that the RQRLSSVM yields both better generalization capability and sparseness in comparison to other sparse LSSVM algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300CrossRefMATH Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300CrossRefMATH
2.
Zurück zum Zitat Sun BB et al (2013) Hyper-Parameter Selection for Sparse Ls-Svm Via Minimization of Its Localized Generalization Error. Int J Wavel Multiresolution Inf Process 11(3):1350030CrossRefMATHMathSciNet Sun BB et al (2013) Hyper-Parameter Selection for Sparse Ls-Svm Via Minimization of Its Localized Generalization Error. Int J Wavel Multiresolution Inf Process 11(3):1350030CrossRefMATHMathSciNet
3.
Zurück zum Zitat van Gestel T et al (2004) Benchmarking least squares support vector machine classifiers. Mach Learn 54(1):5–32CrossRefMATH van Gestel T et al (2004) Benchmarking least squares support vector machine classifiers. Mach Learn 54(1):5–32CrossRefMATH
4.
Zurück zum Zitat Jiao LC, Bo LF, Wang L (2007) Fast sparse approximation for least squares support vector machine. IEEE Trans Neural Networks 18(3):685–697CrossRef Jiao LC, Bo LF, Wang L (2007) Fast sparse approximation for least squares support vector machine. IEEE Trans Neural Networks 18(3):685–697CrossRef
5.
Zurück zum Zitat Yang LX et al (2014) Sparse least square support vector machine via coupled compressive pruning. Neurocomputing 131:77–86CrossRef Yang LX et al (2014) Sparse least square support vector machine via coupled compressive pruning. Neurocomputing 131:77–86CrossRef
6.
Zurück zum Zitat Zhao YP, Sun JG (2009) Recursive reduced least squares support vector regression. Pattern Recogn 42(5):837–842CrossRefMATH Zhao YP, Sun JG (2009) Recursive reduced least squares support vector regression. Pattern Recogn 42(5):837–842CrossRefMATH
7.
Zurück zum Zitat Zhao YP et al (2012) An improved recursive reduced least squares support vector regression. Neurocomputing 87:1–9CrossRef Zhao YP et al (2012) An improved recursive reduced least squares support vector regression. Neurocomputing 87:1–9CrossRef
8.
Zurück zum Zitat Downs T, Gates KE, Masters A (2002) Exact simplification of support vector solutions. J Mach Learn Res 2(2):293–297MATHMathSciNet Downs T, Gates KE, Masters A (2002) Exact simplification of support vector solutions. J Mach Learn Res 2(2):293–297MATHMathSciNet
10.
Zurück zum Zitat Lee YJ, Huang SY (2007) Reduced support vector machines: a statistical theory. IEEE Trans Neural Networks 18(1):1–13CrossRef Lee YJ, Huang SY (2007) Reduced support vector machines: a statistical theory. IEEE Trans Neural Networks 18(1):1–13CrossRef
11.
Zurück zum Zitat Lin KM, Lin CJ (2003) A study on reduced support vector machines. IEEE Trans Neural Networks 14(6):1449–1459CrossRef Lin KM, Lin CJ (2003) A study on reduced support vector machines. IEEE Trans Neural Networks 14(6):1449–1459CrossRef
12.
Zurück zum Zitat Carvalho BPR, Braga AP (2009) IP-LSSVM: a two-step sparse classifier. Pattern Recogn Lett 30(16):1507–1515CrossRef Carvalho BPR, Braga AP (2009) IP-LSSVM: a two-step sparse classifier. Pattern Recogn Lett 30(16):1507–1515CrossRef
13.
Zurück zum Zitat Zeng XY, Chen XW (2005) SMO-based pruning methods for sparse least squares support vector machines. IEEE Trans Neural Netw 16(6):1541–1546CrossRef Zeng XY, Chen XW (2005) SMO-based pruning methods for sparse least squares support vector machines. IEEE Trans Neural Netw 16(6):1541–1546CrossRef
14.
Zurück zum Zitat Zhao YP, Wang KK, Li F (2015) A pruning method of refining recursive reduced least squares support vector regression. Inf Sci 296:160–174CrossRefMATHMathSciNet Zhao YP, Wang KK, Li F (2015) A pruning method of refining recursive reduced least squares support vector regression. Inf Sci 296:160–174CrossRefMATHMathSciNet
15.
Zurück zum Zitat Suykens JA, Lukas L, Vandewalle J (2000) Sparse approximation using least square vector machines. In: IEEE Proc. Int. Symp. Circuits Syst., pp 757–760 Suykens JA, Lukas L, Vandewalle J (2000) Sparse approximation using least square vector machines. In: IEEE Proc. Int. Symp. Circuits Syst., pp 757–760
16.
Zurück zum Zitat Gao JB, Kwan PW, Shi DM (2010) Sparse kernel learning with LASSO and Bayesian inference algorithm. Neural Netw 23(2):257–264CrossRef Gao JB, Kwan PW, Shi DM (2010) Sparse kernel learning with LASSO and Bayesian inference algorithm. Neural Netw 23(2):257–264CrossRef
17.
Zurück zum Zitat Liu JL et al (2011) A weighted L-q adaptive least squares support vector machine classifier—Robust and sparse approximation. Expert Syst Appl 38(3):2253–2259CrossRef Liu JL et al (2011) A weighted L-q adaptive least squares support vector machine classifier—Robust and sparse approximation. Expert Syst Appl 38(3):2253–2259CrossRef
18.
Zurück zum Zitat Chen S, Hong X, Harris CJ (2008) An orthogonal forward regression technique for sparse kernel density estimation. Neurocomputing 71(4–6):931–943CrossRef Chen S, Hong X, Harris CJ (2008) An orthogonal forward regression technique for sparse kernel density estimation. Neurocomputing 71(4–6):931–943CrossRef
19.
Zurück zum Zitat Yeung DS, Li J-C, Ng WWY, Chan PPK (2016) MLPNN training via a multiobjective optimization of training error and stochastic sensitivity. IEEE Trans Neural Netw Learn Syst 27(5):978–992CrossRefMathSciNet Yeung DS, Li J-C, Ng WWY, Chan PPK (2016) MLPNN training via a multiobjective optimization of training error and stochastic sensitivity. IEEE Trans Neural Netw Learn Syst 27(5):978–992CrossRefMathSciNet
20.
Zurück zum Zitat Ng WWY et al (2008) Feature selection using localized generalization error for supervised classification problems using RBFNN. Pattern Recogn 41(12):3706–3719CrossRefMATH Ng WWY et al (2008) Feature selection using localized generalization error for supervised classification problems using RBFNN. Pattern Recogn 41(12):3706–3719CrossRefMATH
21.
Zurück zum Zitat Yeung DS et al (2007) Localized generalization error model and its application to architecture selection for radial basis function neural network. IEEE Trans Neural Netw 18(5):1294–1305CrossRef Yeung DS et al (2007) Localized generalization error model and its application to architecture selection for radial basis function neural network. IEEE Trans Neural Netw 18(5):1294–1305CrossRef
22.
Zurück zum Zitat Ng WWY et al (2015) Diversified sensitivity-based undersampling for imbalance classification problems. IEEE Tras Cybern 45(11):2402–2412CrossRef Ng WWY et al (2015) Diversified sensitivity-based undersampling for imbalance classification problems. IEEE Tras Cybern 45(11):2402–2412CrossRef
23.
24.
Zurück zum Zitat Lu SX, Wang XZ, Zhang GQ, Zhou X (2015) Effective algorithms of the Moore–Penrose inverse matrices for extreme learning machine. Intell Data Anal 19(4):743–760CrossRef Lu SX, Wang XZ, Zhang GQ, Zhou X (2015) Effective algorithms of the Moore–Penrose inverse matrices for extreme learning machine. Intell Data Anal 19(4):743–760CrossRef
Metadaten
Titel
Improved sparse LSSVMS based on the localized generalization error model
verfasst von
Binbin Sun
Wing W. Y. Ng
Patrick P. K. Chan
Publikationsdatum
09.07.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 6/2017
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-016-0563-6

Weitere Artikel der Ausgabe 6/2017

International Journal of Machine Learning and Cybernetics 6/2017 Zur Ausgabe

Neuer Inhalt