Skip to main content

2014 | OriginalPaper | Buchkapitel

Extreme Support Vector Regression

verfasst von : Wentao Zhu, Jun Miao, Laiyun Qing

Erschienen in: Extreme Learning Machines 2013: Algorithms and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Extreme Support Vector Machine (ESVM), a variant of ELM, is a nonlinear SVM algorithm based on regularized least squares optimization. In this chapter, a regression algorithm, Extreme Support Vector Regression (ESVR), is proposed based on ESVM. Experiments show that, ESVR has a better generalization ability than the traditional ELM. Furthermore, ESVM can reach comparable accuracy as SVR and LS-SVR, but has much faster learning speed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat G.-B. Huang, D.H. Wang, Y. Lan, Extreme learning machines: a survey. Int. J. Mach. Learn. Cybernet. 2(2), 107–122 (2011)CrossRef G.-B. Huang, D.H. Wang, Y. Lan, Extreme learning machines: a survey. Int. J. Mach. Learn. Cybernet. 2(2), 107–122 (2011)CrossRef
2.
Zurück zum Zitat G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: a new learning scheme of feedforward neural networks, in Proceedings. 2004 IEEE International Joint Conference on Neural Networks, 2004, vol. 2, pp. 985–990, IEEE, 2004 G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: a new learning scheme of feedforward neural networks, in Proceedings. 2004 IEEE International Joint Conference on Neural Networks, 2004, vol. 2, pp. 985–990, IEEE, 2004
3.
Zurück zum Zitat G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: theory and applications. Neurocomputing. 70(1), 489–501 (2006) G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: theory and applications. Neurocomputing. 70(1), 489–501 (2006)
4.
Zurück zum Zitat W. Zong, H. Zhou, G.-B. Huang, Z. Lin, Face recognition based on kernelized extreme learning machine, in Autonomous and Intelligent Systems (Springer, Berlin, 2011) pp. 263–272 W. Zong, H. Zhou, G.-B. Huang, Z. Lin, Face recognition based on kernelized extreme learning machine, in Autonomous and Intelligent Systems (Springer, Berlin, 2011) pp. 263–272
5.
Zurück zum Zitat H.-J. Rong, Y.-S. Ong, A.-H. Tan, Z. Zhu, A fast pruned-extreme learning machine for classification problem. Neurocomputing. 72(1), 359–366 (2008) H.-J. Rong, Y.-S. Ong, A.-H. Tan, Z. Zhu, A fast pruned-extreme learning machine for classification problem. Neurocomputing. 72(1), 359–366 (2008)
6.
Zurück zum Zitat M. van Heeswijk, Y. Miche, T. Lindh-Knuutila, P.A. Hilbers, T. Honkela, E. Oja, A. Lendasse, Adaptive ensemble models of extreme learning machines for time series prediction, in Artificial Neural Networks—ICANN 2009 (Springer, Berlin, 2009) pp. 305–314 M. van Heeswijk, Y. Miche, T. Lindh-Knuutila, P.A. Hilbers, T. Honkela, E. Oja, A. Lendasse, Adaptive ensemble models of extreme learning machines for time series prediction, in Artificial Neural Networks—ICANN 2009 (Springer, Berlin, 2009) pp. 305–314
7.
Zurück zum Zitat G.-B. Huang, L. Chen, Convex incremental extreme learning machine. Neurocomputing. 70(16), 3056–3062 (2007) G.-B. Huang, L. Chen, Convex incremental extreme learning machine. Neurocomputing. 70(16), 3056–3062 (2007)
8.
Zurück zum Zitat Q. He, T. Shang, F. Zhuang, Z. Shi, Parallel extreme learning machine for regression based on mapreduce. Neurocomputing. 102, 52–58 (2013) Q. He, T. Shang, F. Zhuang, Z. Shi, Parallel extreme learning machine for regression based on mapreduce. Neurocomputing. 102, 52–58 (2013)
9.
Zurück zum Zitat Q. Liu, Q. He, Z. Shi, Extreme support vector machine classifier, in Advances in Knowledge Discovery and Data Mining (Springer, Berlin, 2008) pp. 222–233 Q. Liu, Q. He, Z. Shi, Extreme support vector machine classifier, in Advances in Knowledge Discovery and Data Mining (Springer, Berlin, 2008) pp. 222–233
10.
Zurück zum Zitat Q. He, C. Du, Q. Wang, F. Zhuang, Z. Shi, A parallel incremental extreme svm classifier. Neurocomputing. 74(16), 2532–2540 (2011) Q. He, C. Du, Q. Wang, F. Zhuang, Z. Shi, A parallel incremental extreme svm classifier. Neurocomputing. 74(16), 2532–2540 (2011)
11.
Zurück zum Zitat B. Frénay, M. Verleysen, Using SVMs with randomised feature spaces: an extreme learning approach, in Proceedings of the 18th European symposium on Artificial Neural Networks (ESANN), Bruges, Belgium, pp. 28–30 (2010) B. Frénay, M. Verleysen, Using SVMs with randomised feature spaces: an extreme learning approach, in Proceedings of the 18th European symposium on Artificial Neural Networks (ESANN), Bruges, Belgium, pp. 28–30 (2010)
12.
Zurück zum Zitat A. Subasi, A decision support system for diagnosis of neuromuscular disorders using DWT and evolutionary support vector machines. Signal Image Video Process. 7, 1–10 (2013) A. Subasi, A decision support system for diagnosis of neuromuscular disorders using DWT and evolutionary support vector machines. Signal Image Video Process. 7, 1–10 (2013)
13.
Zurück zum Zitat P.-F. Pai, M.-F. Hsu, An enhanced support vector machines model for classification and rule generation, in Computational Optimization, Methods and Algorithms (Springer, Berlin 2011) pp. 241–258 P.-F. Pai, M.-F. Hsu, An enhanced support vector machines model for classification and rule generation, in Computational Optimization, Methods and Algorithms (Springer, Berlin 2011) pp. 241–258
14.
Zurück zum Zitat G.-B. Huang, H. Zhou, X. Ding, R. Zhang, Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B Cybern. 42(2), 513–529 (2012)CrossRef G.-B. Huang, H. Zhou, X. Ding, R. Zhang, Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B Cybern. 42(2), 513–529 (2012)CrossRef
15.
Zurück zum Zitat C.R. Rao, S.K. Mitra, Generalized Inverse of a Matrix and Its Applications (Wiley, New York, 1971) C.R. Rao, S.K. Mitra, Generalized Inverse of a Matrix and Its Applications (Wiley, New York, 1971)
16.
Zurück zum Zitat G.-B. Huang, X. Ding, H. Zhou, Optimization method based extreme learning machine for classification. Neurocomputing. 74(1), 155–163 (2010) G.-B. Huang, X. Ding, H. Zhou, Optimization method based extreme learning machine for classification. Neurocomputing. 74(1), 155–163 (2010)
17.
Zurück zum Zitat C. Cortes, V. Vapnik, Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)MATH C. Cortes, V. Vapnik, Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)MATH
18.
19.
Zurück zum Zitat N.-Y. Liang, G.-B. Huang, P. Saratchandran, N. Sundararajan, A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans. Neural Networks. 17(6), 1411–1423 (2006) N.-Y. Liang, G.-B. Huang, P. Saratchandran, N. Sundararajan, A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans. Neural Networks. 17(6), 1411–1423 (2006)
Metadaten
Titel
Extreme Support Vector Regression
verfasst von
Wentao Zhu
Jun Miao
Laiyun Qing
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-04741-6_3

Premium Partner