Skip to main content
Erschienen in: Cognitive Computation 4/2016

01.08.2016

An Analytical Study on Reasoning of Extreme Learning Machine for Classification from Its Inductive Bias

verfasst von: Pak Kin Wong, Xiang Hui Gao, Ka In Wong, Chi Man Vong

Erschienen in: Cognitive Computation | Ausgabe 4/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Since extreme learning machine (ELM) was proposed, hundreds of studies have been conducted on this subject in various areas, from theoretical researches to practical applications. However, there are very few papers in the literature to reveal the reasons why in ELM classification the class with the highest output value is being chosen as the predicted class for a given input. In order to give a clear insight into this question, this paper analyzes the rationality of ELM reasoning from the perspective of its inductive bias. The analysis results show that the choice of highest output in ELM is reasonable for both binary and multiclass classification problems. In addition, to deal with multiclass problems ELM uses the well-known one-against-all strategy, in which unclassifiable regions may exist. This paper also gives a clear explanation on how ELM resolves the unclassifiable regions, through both analysis and experiments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK. Extreme learning machine: theory and applications. Neurocomputing. 2006;70:489–501.CrossRef Huang GB, Zhu QY, Siew CK. Extreme learning machine: theory and applications. Neurocomputing. 2006;70:489–501.CrossRef
2.
Zurück zum Zitat Huang G-B, Chen L. Convex incremental extreme learning machine. Neurocomputing. 2007;70:3056–62.CrossRef Huang G-B, Chen L. Convex incremental extreme learning machine. Neurocomputing. 2007;70:3056–62.CrossRef
3.
Zurück zum Zitat Huang G, Huang GB, Song SJ, You KY. Trends in extreme learning machines: a review. Neural Netw. 2015;61:32–48.CrossRefPubMed Huang G, Huang GB, Song SJ, You KY. Trends in extreme learning machines: a review. Neural Netw. 2015;61:32–48.CrossRefPubMed
4.
Zurück zum Zitat Feng G, Huang G-B, Lin Q, Gay R. Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans Neural Netw. 2009;20:1352–7.CrossRefPubMed Feng G, Huang G-B, Lin Q, Gay R. Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans Neural Netw. 2009;20:1352–7.CrossRefPubMed
5.
Zurück zum Zitat Liu N, Wang H. Ensemble based extreme learning machine. IEEE Signal Process Lett. 2010;17:754–7.CrossRef Liu N, Wang H. Ensemble based extreme learning machine. IEEE Signal Process Lett. 2010;17:754–7.CrossRef
6.
Zurück zum Zitat Zong WW, Huang GB, Chen YQ. Weighted extreme learning machine for imbalance learning. Neurocomputing. 2013;101:229–42.CrossRef Zong WW, Huang GB, Chen YQ. Weighted extreme learning machine for imbalance learning. Neurocomputing. 2013;101:229–42.CrossRef
7.
Zurück zum Zitat Gao H, Shiji S, Gupta JND, Cheng W. Semi-supervised and unsupervised extreme learning machines. IEEE Trans Cybern. 2014;44:2405–17.CrossRef Gao H, Shiji S, Gupta JND, Cheng W. Semi-supervised and unsupervised extreme learning machines. IEEE Trans Cybern. 2014;44:2405–17.CrossRef
8.
Zurück zum Zitat Zhang F, Qi L, Chen E. Extended extreme learning machine for biometric signal classification. J Comput Theor Nanosci. 2015;12:1247–51.CrossRef Zhang F, Qi L, Chen E. Extended extreme learning machine for biometric signal classification. J Comput Theor Nanosci. 2015;12:1247–51.CrossRef
9.
Zurück zum Zitat Liu H, Tian H-Q, Li Y-F. Four wind speed multi-step forecasting models using extreme learning machines and signal decomposing algorithms. Energy Convers Manage. 2015;100:16–22.CrossRef Liu H, Tian H-Q, Li Y-F. Four wind speed multi-step forecasting models using extreme learning machines and signal decomposing algorithms. Energy Convers Manage. 2015;100:16–22.CrossRef
10.
Zurück zum Zitat Li W, Chen C, Su H, Du Q. Local binary patterns and extreme learning machine for hyperspectral imagery classification. IEEE Trans Geosci Remote Sens. 2015;53:3681–93.CrossRef Li W, Chen C, Su H, Du Q. Local binary patterns and extreme learning machine for hyperspectral imagery classification. IEEE Trans Geosci Remote Sens. 2015;53:3681–93.CrossRef
11.
Zurück zum Zitat Vong CM, Tai KI, Pun CM, Wong PK. Fast and accurate face detection by sparse Bayesian extreme learning machine. Neural Comput Appl. 2015;26:1149–56.CrossRef Vong CM, Tai KI, Pun CM, Wong PK. Fast and accurate face detection by sparse Bayesian extreme learning machine. Neural Comput Appl. 2015;26:1149–56.CrossRef
12.
Zurück zum Zitat Huang GB, Zhou HM, Ding XJ, Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B Cybern. 2012;42:513–29.CrossRef Huang GB, Zhou HM, Ding XJ, Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B Cybern. 2012;42:513–29.CrossRef
13.
Zurück zum Zitat Zhang T. Statistical analysis of some multi-category large margin classification methods. J Mach Learn Res. 2004;5:1225–51. Zhang T. Statistical analysis of some multi-category large margin classification methods. J Mach Learn Res. 2004;5:1225–51.
14.
Zurück zum Zitat Abe S. Support vector machines for pattern classification. London: Springer; 2010.CrossRef Abe S. Support vector machines for pattern classification. London: Springer; 2010.CrossRef
15.
Zurück zum Zitat Mitchell TM. The need for biases in learning generalizations. New Jersey: Department of Computer Science, Laboratory for Computer Science Research, Rutgers University; 1980. Mitchell TM. The need for biases in learning generalizations. New Jersey: Department of Computer Science, Laboratory for Computer Science Research, Rutgers University; 1980.
16.
Zurück zum Zitat Mitchell TM. Machine Learning. Burr Ridge: McGraw Hill; 1997. Mitchell TM. Machine Learning. Burr Ridge: McGraw Hill; 1997.
Metadaten
Titel
An Analytical Study on Reasoning of Extreme Learning Machine for Classification from Its Inductive Bias
verfasst von
Pak Kin Wong
Xiang Hui Gao
Ka In Wong
Chi Man Vong
Publikationsdatum
01.08.2016
Verlag
Springer US
Erschienen in
Cognitive Computation / Ausgabe 4/2016
Print ISSN: 1866-9956
Elektronische ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-016-9414-8

Weitere Artikel der Ausgabe 4/2016

Cognitive Computation 4/2016 Zur Ausgabe