Skip to main content
Erschienen in: Neural Computing and Applications 11/2018

09.03.2017 | Original Article

Improved Meta-ELM with error feedback incremental ELM as hidden nodes

verfasst von: Weidong Zou, Fenxi Yao, Baihai Zhang, Zixiao Guan

Erschienen in: Neural Computing and Applications | Ausgabe 11/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Liao et al. (Neurocomputing 128:81–87, 2014) proposed a meta-learning approach to extreme learning machine (Meta-ELM), which can obtain good generalization performance by training multiple ELMs. However, one of its open problems is overfitting when minimizing training error. In this paper, we propose an improved meta-learning model of ELM (improved Meta-ELM) to handle the problem. The improved Meta-ELM architecture is composed of some base ELMs which are error feedback incremental extreme learning machine (EFI-ELM) and the top ELM. The improved Meta-ELM includes two stages. First, each base ELM with EFI-ELM is trained on a subset of training data. Then, the top ELM learns with the base ELMs as hidden nodes. Simulation results on some artificial and benchmark datasets show that the proposed improved Meta-ELM model is more feasible and effective than Meta-ELM.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Liu HP, Liu YH, Sun FC (2015) Robust exemplar extraction using structured sparse coding. IEEE Trans Neural Netw Learn Syst 26(8):1816–1821MathSciNetCrossRef Liu HP, Liu YH, Sun FC (2015) Robust exemplar extraction using structured sparse coding. IEEE Trans Neural Netw Learn Syst 26(8):1816–1821MathSciNetCrossRef
2.
Zurück zum Zitat Liu HP, Qin J, Sun FC, Di Guo Extreme kernel sparse learning for tactile object recognition, IEEE Trans Cybern, In press Liu HP, Qin J, Sun FC, Di Guo Extreme kernel sparse learning for tactile object recognition, IEEE Trans Cybern, In press
3.
Zurück zum Zitat Yang YM, Jonathan Wu QM (2009) Mutilayer extreme learning machine with subnetwork nodes for representation learning. IEEE Trans Cybern 20(8):1352–1357 Yang YM, Jonathan Wu QM (2009) Mutilayer extreme learning machine with subnetwork nodes for representation learning. IEEE Trans Cybern 20(8):1352–1357
4.
Zurück zum Zitat Cao J, Zhao Y, Lai X, Ong MEH, Yin C, Koh Z, Liu N (2015) Landmark recognition with sparse representation classification and extreme learning machine. J Frankl Inst 352(10):4528–4545MathSciNetCrossRef Cao J, Zhao Y, Lai X, Ong MEH, Yin C, Koh Z, Liu N (2015) Landmark recognition with sparse representation classification and extreme learning machine. J Frankl Inst 352(10):4528–4545MathSciNetCrossRef
5.
Zurück zum Zitat Huang GB, Bai Z, Kasun LLC, Vong CM (2015) Local receptive fields based extreme learning machine. IEEE Comput Intell Mag 10(2):18–29CrossRef Huang GB, Bai Z, Kasun LLC, Vong CM (2015) Local receptive fields based extreme learning machine. IEEE Comput Intell Mag 10(2):18–29CrossRef
6.
Zurück zum Zitat Guo D, Zhang Y, Xiao Z, Mao M, Liu J (2015) Common nature of learning between Bp-Type and Hopfield-type neural networks. Neurocomputing 167:578–586CrossRef Guo D, Zhang Y, Xiao Z, Mao M, Liu J (2015) Common nature of learning between Bp-Type and Hopfield-type neural networks. Neurocomputing 167:578–586CrossRef
7.
Zurück zum Zitat Qi XX, Yuan ZH, Han XW (2015) Diagnosis of misalignment faults by tacholess order tracking analysis and RBF networks. Neurocomputing 169:439–448CrossRef Qi XX, Yuan ZH, Han XW (2015) Diagnosis of misalignment faults by tacholess order tracking analysis and RBF networks. Neurocomputing 169:439–448CrossRef
8.
Zurück zum Zitat Ekici S, Yildirim S, Poyraz M (2009) A transmission line fault locator based on Elman recurrent networks. Appl Soft Comput 9(1):341–347CrossRef Ekici S, Yildirim S, Poyraz M (2009) A transmission line fault locator based on Elman recurrent networks. Appl Soft Comput 9(1):341–347CrossRef
9.
Zurück zum Zitat Huang GB, Chen L, Siew CK (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17(4):879–892CrossRef Huang GB, Chen L, Siew CK (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17(4):879–892CrossRef
10.
Zurück zum Zitat Huang GB, Chen L (2007) Convex incremental extreme learning machine. Neurocomputing 70:3056–3062CrossRef Huang GB, Chen L (2007) Convex incremental extreme learning machine. Neurocomputing 70:3056–3062CrossRef
11.
Zurück zum Zitat Huang GB, Chen L (2008) Enhanced random search based incremental extreme learning machine. Neurocomputing 71(16–18):3460–3468CrossRef Huang GB, Chen L (2008) Enhanced random search based incremental extreme learning machine. Neurocomputing 71(16–18):3460–3468CrossRef
12.
Zurück zum Zitat Miche Y, Sorjamaa A, Bas P, Simula O, Jutten C, Lendasse A (2010) OP-ELM: optimally pruned extreme learning machine. IEEE Trans Neural Netw 21(1):158–162CrossRef Miche Y, Sorjamaa A, Bas P, Simula O, Jutten C, Lendasse A (2010) OP-ELM: optimally pruned extreme learning machine. IEEE Trans Neural Netw 21(1):158–162CrossRef
13.
Zurück zum Zitat Feng G, Huang GB, Lin Q, Gay R (2009) Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans Neural Netw 20(8):1352–1357CrossRef Feng G, Huang GB, Lin Q, Gay R (2009) Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans Neural Netw 20(8):1352–1357CrossRef
14.
Zurück zum Zitat Lan Y, Soh YC, Huang GB (2010) Two-stage extreme learning machine for regression. Neurocomputing 73(1):3028–3038CrossRef Lan Y, Soh YC, Huang GB (2010) Two-stage extreme learning machine for regression. Neurocomputing 73(1):3028–3038CrossRef
15.
Zurück zum Zitat Yang YM, Wang YN, Yuan XF (2012) Bidirectional extreme learning machine for regression problem and its learning effectiveness. IEEE Trans Neural Netw Learn Syst 23:1498–1505CrossRef Yang YM, Wang YN, Yuan XF (2012) Bidirectional extreme learning machine for regression problem and its learning effectiveness. IEEE Trans Neural Netw Learn Syst 23:1498–1505CrossRef
16.
Zurück zum Zitat Sun ZL, Choi TM, Au KF, Yu Y (2008) Sales forecasting using extreme learning machine with applications in fashion retailing. Decis Support Syst 46(1):411–419CrossRef Sun ZL, Choi TM, Au KF, Yu Y (2008) Sales forecasting using extreme learning machine with applications in fashion retailing. Decis Support Syst 46(1):411–419CrossRef
17.
Zurück zum Zitat Lan Y, Soh YC, Huang GB (2009) Ensemble of online sequential extreme learning machine. Neurocomputing 135(72):3391–3395CrossRef Lan Y, Soh YC, Huang GB (2009) Ensemble of online sequential extreme learning machine. Neurocomputing 135(72):3391–3395CrossRef
18.
Zurück zum Zitat Liao SZ, Feng C (2014) Meta-ELM: ELM with ELM hidden nodes. Neurocomputing 128:81–87CrossRef Liao SZ, Feng C (2014) Meta-ELM: ELM with ELM hidden nodes. Neurocomputing 128:81–87CrossRef
19.
Zurück zum Zitat Horn RA, Johnson CR (2012) Matrix analysis. Cambridge University Press Horn RA, Johnson CR (2012) Matrix analysis. Cambridge University Press
Metadaten
Titel
Improved Meta-ELM with error feedback incremental ELM as hidden nodes
verfasst von
Weidong Zou
Fenxi Yao
Baihai Zhang
Zixiao Guan
Publikationsdatum
09.03.2017
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 11/2018
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-017-2922-y

Weitere Artikel der Ausgabe 11/2018

Neural Computing and Applications 11/2018 Zur Ausgabe