Skip to main content
Top
Published in: Neural Processing Letters 3/2016

01-12-2016

A Kind of Parameters Self-adjusting Extreme Learning Machine

Authors: Peifeng Niu, Yunpeng Ma, Mengning Li, Shanshan Yan, Guoqiang Li

Published in: Neural Processing Letters | Issue 3/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Extreme learning machine (ELM) is a kind of feed-forward single hidden layer neural network, whose input weights and thresholds of hidden layers are generated randomly. Because the output-weights of ELM are calculated by the least-square method, the ELM presents a high speed on training and testing. However, the random input-weights and thresholds of hidden layers are not the best parameters, which can not pledge the training goals of the ELM to achieve the global minimum. In order to obtain the optimal input-weights and bias of hidden layer, this paper proposes the self-adjusting extreme learning machine, called SA-ELM. Based on the idea of the ameliorated teaching learning based optimization, the input-weights and the bias of hidden layer of extreme learning machine are adjusted with “teaching phase” and “learning phase” to minimize the objective function values. The SA-ELM is applied to the eight benchmark functions to test its validity and feasibility. Compared with ELM and fast learning network, the SA-ELM owns good regression accuracy and generalization performance. Besides, the SA-ELM is applied to build the thermal efficiency model of a 300 MW pulverized coal furnace. The experiment results reveal that the proposed algorithm owns engineering practical application value.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Salakhutdinov R, Larochelle H (2010) Efficient learning of deep Boltzmann machines. In: International conference on artificial intelligence and statistics, pp 693–700 Salakhutdinov R, Larochelle H (2010) Efficient learning of deep Boltzmann machines. In: International conference on artificial intelligence and statistics, pp 693–700
3.
go back to reference Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural network. In: Proceedings of IEEE international joint conference on neural network, vol 2, pp 985–990 Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural network. In: Proceedings of IEEE international joint conference on neural network, vol 2, pp 985–990
4.
go back to reference Wang SC (2003) Artificial neural network. Interdisciplinary computing in Java programming. Springer, HeidelbergCrossRef Wang SC (2003) Artificial neural network. Interdisciplinary computing in Java programming. Springer, HeidelbergCrossRef
5.
go back to reference Li L, Liu D, Ouyang J (2012) A new regularization classification method based on extreme learning machine in network data. J Inf Comput Sci 9(12):3351–3363 Li L, Liu D, Ouyang J (2012) A new regularization classification method based on extreme learning machine in network data. J Inf Comput Sci 9(12):3351–3363
6.
go back to reference Karpagachelvi S, Arthanari M, Sivakumar M (2012) Classification of electrocardiogram signals with support vector machines and extreme learning machine. Neural Comput Appl 21(6):1331–1339CrossRef Karpagachelvi S, Arthanari M, Sivakumar M (2012) Classification of electrocardiogram signals with support vector machines and extreme learning machine. Neural Comput Appl 21(6):1331–1339CrossRef
7.
go back to reference Yu J, Rui Y, Tang YY et al (2014) High-order distance-based multiview stochastic learning in image classification. IEEE Trans Cybern 44(12):2431–2442CrossRef Yu J, Rui Y, Tang YY et al (2014) High-order distance-based multiview stochastic learning in image classification. IEEE Trans Cybern 44(12):2431–2442CrossRef
8.
go back to reference Yu J, Hong R, Wang M et al (2014) Image clustering based on sparse patch alignment framework. Pattern Recognit 47(11):3512–3519CrossRef Yu J, Hong R, Wang M et al (2014) Image clustering based on sparse patch alignment framework. Pattern Recognit 47(11):3512–3519CrossRef
9.
go back to reference Lan Y, Soh YC, Huang GB (2010) Two-stage extreme learning machine for regression. Neurocomputing 73(16–18):3028–3038CrossRef Lan Y, Soh YC, Huang GB (2010) Two-stage extreme learning machine for regression. Neurocomputing 73(16–18):3028–3038CrossRef
10.
go back to reference Tang X, Han M (2009) Partial Lanczos extreme learning machine for singal-output regression problems. Neurocomputing 72(13–15):3066–3076CrossRef Tang X, Han M (2009) Partial Lanczos extreme learning machine for singal-output regression problems. Neurocomputing 72(13–15):3066–3076CrossRef
11.
go back to reference Mikolov T, Chen K, Corrado G et al (2013) Efficient estimation of word representations in vector space. arXiv preprint. arXiv:1301.3781 Mikolov T, Chen K, Corrado G et al (2013) Efficient estimation of word representations in vector space. arXiv preprint. arXiv:​1301.​3781
12.
go back to reference Zong W, Huang GB (2011) Face recognition based on extreme learning machine. Neurocomputing 74(16):2541–2551CrossRef Zong W, Huang GB (2011) Face recognition based on extreme learning machine. Neurocomputing 74(16):2541–2551CrossRef
13.
go back to reference Pan C, Park DS, Yang Y et al (2012) Leukocyte image segmentation by visual attention and extreme learning machine. Neural Comput Appl 21(6):1217–1227CrossRef Pan C, Park DS, Yang Y et al (2012) Leukocyte image segmentation by visual attention and extreme learning machine. Neural Comput Appl 21(6):1217–1227CrossRef
14.
go back to reference Yu J, Hong R, Wang M et al (2014) Image clustering based on sparse patch alignment framework. Pattern Recognit 47(11):3512–3519CrossRef Yu J, Hong R, Wang M et al (2014) Image clustering based on sparse patch alignment framework. Pattern Recognit 47(11):3512–3519CrossRef
15.
go back to reference Yu J, Rui Y, Tao D (2014) Click prediction for web image reranking using multimodal sparse coding. IEEE Trans Image Process 23(5):2019–2032MathSciNetCrossRef Yu J, Rui Y, Tao D (2014) Click prediction for web image reranking using multimodal sparse coding. IEEE Trans Image Process 23(5):2019–2032MathSciNetCrossRef
16.
go back to reference Wu S, Wang Y, Cheng S (2013) Extreme learning machine based wind speed estimation and sensorless control for wind turbine power generation system. Neurocomputing 102:163–175CrossRef Wu S, Wang Y, Cheng S (2013) Extreme learning machine based wind speed estimation and sensorless control for wind turbine power generation system. Neurocomputing 102:163–175CrossRef
17.
go back to reference Luo Y, Tang J, Yan J et al (2014) Pre-trained multi-view word embedding using two-side neural network. In: Twenty-eighth AAAI conference on artificial intelligence Luo Y, Tang J, Yan J et al (2014) Pre-trained multi-view word embedding using two-side neural network. In: Twenty-eighth AAAI conference on artificial intelligence
18.
go back to reference Yu J, Tao D (2013) Modern machine learning techniques and their applications in cartoon animation research. Wiley, HobokenCrossRef Yu J, Tao D (2013) Modern machine learning techniques and their applications in cartoon animation research. Wiley, HobokenCrossRef
19.
go back to reference Cao JW, Lin ZP, Huang GB (2012) Self-adaptive evolutionary extreme learning machine. Neural Process Lett 36:285–305CrossRef Cao JW, Lin ZP, Huang GB (2012) Self-adaptive evolutionary extreme learning machine. Neural Process Lett 36:285–305CrossRef
20.
go back to reference Zhu QY, Qin AK, Suganthan PN, Huang GB (2005) Evolutionary extreme learning machine. Pattern Recognit 38:1759–1763CrossRefMATH Zhu QY, Qin AK, Suganthan PN, Huang GB (2005) Evolutionary extreme learning machine. Pattern Recognit 38:1759–1763CrossRefMATH
21.
go back to reference Matias T, Souza F, Araujo R, Antunes CH (2014) Learning of a single-hidden layer feedforward neural network using an optimized extreme learning machine. Neurocomputing 129:428–436CrossRef Matias T, Souza F, Araujo R, Antunes CH (2014) Learning of a single-hidden layer feedforward neural network using an optimized extreme learning machine. Neurocomputing 129:428–436CrossRef
22.
go back to reference Han F, Yao HF, Ling QH (2013) An improved evolutionary extreme learning machine based on particle swarm optimization. Neurocomputing 116:87–93CrossRef Han F, Yao HF, Ling QH (2013) An improved evolutionary extreme learning machine based on particle swarm optimization. Neurocomputing 116:87–93CrossRef
23.
go back to reference Li GQ, Niu PF, Ma YP, Wang HB, Zhang WP (2014) Tuning extreme learning machine by an improved artificial bee colony to model and optimize the boiler efficiency. Knowl Based Syst 67:278–289CrossRef Li GQ, Niu PF, Ma YP, Wang HB, Zhang WP (2014) Tuning extreme learning machine by an improved artificial bee colony to model and optimize the boiler efficiency. Knowl Based Syst 67:278–289CrossRef
24.
go back to reference Li GQ, Niu PF, Liu C, Zhang WP (2012) Enhanced combination modeling method for combustion efficiency in coal-fired boilers. Appl Soft Comput 12:3132–3140CrossRef Li GQ, Niu PF, Liu C, Zhang WP (2012) Enhanced combination modeling method for combustion efficiency in coal-fired boilers. Appl Soft Comput 12:3132–3140CrossRef
25.
go back to reference Li GQ, Niu PF, Zhang WP, Liu YC (2013) Model NOx emissions by least squares support vector machine with tuning based on ameliorated teaching-learning-based optimization. Chemom Intell Lab Syst 126:11–20CrossRef Li GQ, Niu PF, Zhang WP, Liu YC (2013) Model NOx emissions by least squares support vector machine with tuning based on ameliorated teaching-learning-based optimization. Chemom Intell Lab Syst 126:11–20CrossRef
26.
27.
go back to reference Liang NY, Huang gb, Saratchandran P, Sundararajan N (2006) A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17:1411–1423CrossRef Liang NY, Huang gb, Saratchandran P, Sundararajan N (2006) A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17:1411–1423CrossRef
28.
go back to reference Rao RV, Savsani VJ, Vakharia DP (2011) Teaching-learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput Aided Des 43(3):303–315CrossRef Rao RV, Savsani VJ, Vakharia DP (2011) Teaching-learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput Aided Des 43(3):303–315CrossRef
29.
go back to reference Zhou H, Zhao JP, Zheng LG, Wang CL, Cen KF (2012) Modeling NOx emissions from coal-fired utility boilers using support vector regression with ant colony optimization. Eng Appl Artif Intell 25:147–158CrossRef Zhou H, Zhao JP, Zheng LG, Wang CL, Cen KF (2012) Modeling NOx emissions from coal-fired utility boilers using support vector regression with ant colony optimization. Eng Appl Artif Intell 25:147–158CrossRef
30.
go back to reference Song Z, Kusiak A (2007) Constraint-based control of boiler efficiency: a data-mining approach. IEEE Trans Ind Inform 3(1):73–83CrossRef Song Z, Kusiak A (2007) Constraint-based control of boiler efficiency: a data-mining approach. IEEE Trans Ind Inform 3(1):73–83CrossRef
Metadata
Title
A Kind of Parameters Self-adjusting Extreme Learning Machine
Authors
Peifeng Niu
Yunpeng Ma
Mengning Li
Shanshan Yan
Guoqiang Li
Publication date
01-12-2016
Publisher
Springer US
Published in
Neural Processing Letters / Issue 3/2016
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-016-9496-z

Other articles of this Issue 3/2016

Neural Processing Letters 3/2016 Go to the issue