Skip to main content
Top
Published in: Cognitive Computation 4/2016

01-08-2016

An Analytical Study on Reasoning of Extreme Learning Machine for Classification from Its Inductive Bias

Authors: Pak Kin Wong, Xiang Hui Gao, Ka In Wong, Chi Man Vong

Published in: Cognitive Computation | Issue 4/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Since extreme learning machine (ELM) was proposed, hundreds of studies have been conducted on this subject in various areas, from theoretical researches to practical applications. However, there are very few papers in the literature to reveal the reasons why in ELM classification the class with the highest output value is being chosen as the predicted class for a given input. In order to give a clear insight into this question, this paper analyzes the rationality of ELM reasoning from the perspective of its inductive bias. The analysis results show that the choice of highest output in ELM is reasonable for both binary and multiclass classification problems. In addition, to deal with multiclass problems ELM uses the well-known one-against-all strategy, in which unclassifiable regions may exist. This paper also gives a clear explanation on how ELM resolves the unclassifiable regions, through both analysis and experiments.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Huang GB, Zhu QY, Siew CK. Extreme learning machine: theory and applications. Neurocomputing. 2006;70:489–501.CrossRef Huang GB, Zhu QY, Siew CK. Extreme learning machine: theory and applications. Neurocomputing. 2006;70:489–501.CrossRef
2.
go back to reference Huang G-B, Chen L. Convex incremental extreme learning machine. Neurocomputing. 2007;70:3056–62.CrossRef Huang G-B, Chen L. Convex incremental extreme learning machine. Neurocomputing. 2007;70:3056–62.CrossRef
3.
go back to reference Huang G, Huang GB, Song SJ, You KY. Trends in extreme learning machines: a review. Neural Netw. 2015;61:32–48.CrossRefPubMed Huang G, Huang GB, Song SJ, You KY. Trends in extreme learning machines: a review. Neural Netw. 2015;61:32–48.CrossRefPubMed
4.
go back to reference Feng G, Huang G-B, Lin Q, Gay R. Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans Neural Netw. 2009;20:1352–7.CrossRefPubMed Feng G, Huang G-B, Lin Q, Gay R. Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans Neural Netw. 2009;20:1352–7.CrossRefPubMed
5.
go back to reference Liu N, Wang H. Ensemble based extreme learning machine. IEEE Signal Process Lett. 2010;17:754–7.CrossRef Liu N, Wang H. Ensemble based extreme learning machine. IEEE Signal Process Lett. 2010;17:754–7.CrossRef
6.
go back to reference Zong WW, Huang GB, Chen YQ. Weighted extreme learning machine for imbalance learning. Neurocomputing. 2013;101:229–42.CrossRef Zong WW, Huang GB, Chen YQ. Weighted extreme learning machine for imbalance learning. Neurocomputing. 2013;101:229–42.CrossRef
7.
go back to reference Gao H, Shiji S, Gupta JND, Cheng W. Semi-supervised and unsupervised extreme learning machines. IEEE Trans Cybern. 2014;44:2405–17.CrossRef Gao H, Shiji S, Gupta JND, Cheng W. Semi-supervised and unsupervised extreme learning machines. IEEE Trans Cybern. 2014;44:2405–17.CrossRef
8.
go back to reference Zhang F, Qi L, Chen E. Extended extreme learning machine for biometric signal classification. J Comput Theor Nanosci. 2015;12:1247–51.CrossRef Zhang F, Qi L, Chen E. Extended extreme learning machine for biometric signal classification. J Comput Theor Nanosci. 2015;12:1247–51.CrossRef
9.
go back to reference Liu H, Tian H-Q, Li Y-F. Four wind speed multi-step forecasting models using extreme learning machines and signal decomposing algorithms. Energy Convers Manage. 2015;100:16–22.CrossRef Liu H, Tian H-Q, Li Y-F. Four wind speed multi-step forecasting models using extreme learning machines and signal decomposing algorithms. Energy Convers Manage. 2015;100:16–22.CrossRef
10.
go back to reference Li W, Chen C, Su H, Du Q. Local binary patterns and extreme learning machine for hyperspectral imagery classification. IEEE Trans Geosci Remote Sens. 2015;53:3681–93.CrossRef Li W, Chen C, Su H, Du Q. Local binary patterns and extreme learning machine for hyperspectral imagery classification. IEEE Trans Geosci Remote Sens. 2015;53:3681–93.CrossRef
11.
go back to reference Vong CM, Tai KI, Pun CM, Wong PK. Fast and accurate face detection by sparse Bayesian extreme learning machine. Neural Comput Appl. 2015;26:1149–56.CrossRef Vong CM, Tai KI, Pun CM, Wong PK. Fast and accurate face detection by sparse Bayesian extreme learning machine. Neural Comput Appl. 2015;26:1149–56.CrossRef
12.
go back to reference Huang GB, Zhou HM, Ding XJ, Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B Cybern. 2012;42:513–29.CrossRef Huang GB, Zhou HM, Ding XJ, Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B Cybern. 2012;42:513–29.CrossRef
13.
go back to reference Zhang T. Statistical analysis of some multi-category large margin classification methods. J Mach Learn Res. 2004;5:1225–51. Zhang T. Statistical analysis of some multi-category large margin classification methods. J Mach Learn Res. 2004;5:1225–51.
14.
go back to reference Abe S. Support vector machines for pattern classification. London: Springer; 2010.CrossRef Abe S. Support vector machines for pattern classification. London: Springer; 2010.CrossRef
15.
go back to reference Mitchell TM. The need for biases in learning generalizations. New Jersey: Department of Computer Science, Laboratory for Computer Science Research, Rutgers University; 1980. Mitchell TM. The need for biases in learning generalizations. New Jersey: Department of Computer Science, Laboratory for Computer Science Research, Rutgers University; 1980.
16.
go back to reference Mitchell TM. Machine Learning. Burr Ridge: McGraw Hill; 1997. Mitchell TM. Machine Learning. Burr Ridge: McGraw Hill; 1997.
Metadata
Title
An Analytical Study on Reasoning of Extreme Learning Machine for Classification from Its Inductive Bias
Authors
Pak Kin Wong
Xiang Hui Gao
Ka In Wong
Chi Man Vong
Publication date
01-08-2016
Publisher
Springer US
Published in
Cognitive Computation / Issue 4/2016
Print ISSN: 1866-9956
Electronic ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-016-9414-8

Other articles of this Issue 4/2016

Cognitive Computation 4/2016 Go to the issue

Premium Partner