Skip to main content
Erschienen in: Neural Processing Letters 2/2018

27.07.2017

Fast Learning Network with Parallel Layer Perceptrons

verfasst von: Guoqiang Li, Xiaobin Qi, Bin Chen, Yunpeng Ma, Peifeng Niu, Zhiwang Chen

Erschienen in: Neural Processing Letters | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a novel artificial neural network called Parallel Layer Perceptron Fast Learning Network (PLP-FLN). In PLP-FLN, a parallel single hidden layer feed-forward neural network is added on the basis of Fast Learning Network (FLN) which is an improved Extreme Learning Machine (ELM). Input weights and hidden layer biases are randomly generated. The weights connect the output nodes and the input nodes, and the weights connect the output nodes and the hidden nodes are analytically determined based on least squares methods. In order to test the PLP-FLN validity, this paper compared it with ELM, FLN, Kernel ELM and Incremental ELM through 12 regression applications and 7 classification problems. By comparing the experimental results, it shows that the PLP-FLN with much more compact networks have demonstrated better approximations, classification performances and generalization ability.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Green M, Ekelund U, Edenbrandt L et al (2009) Exploring new possibilities for case-based explanation of artificial neural network ensembles. Neural Netw 22:75–81CrossRef Green M, Ekelund U, Edenbrandt L et al (2009) Exploring new possibilities for case-based explanation of artificial neural network ensembles. Neural Netw 22:75–81CrossRef
2.
Zurück zum Zitat May RJ, Maier HR, Dandy GC (2010) Data splitting for artificial neural networks using SOM-based stratified sampling. Neural Netw Off J Int Neural Netw Soc 23:283–294CrossRef May RJ, Maier HR, Dandy GC (2010) Data splitting for artificial neural networks using SOM-based stratified sampling. Neural Netw Off J Int Neural Netw Soc 23:283–294CrossRef
3.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70:489–501CrossRef Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70:489–501CrossRef
4.
Zurück zum Zitat Bin LI, Yi-Bin LI (2011) Chaotic time series prediction based on ELM learning algorithm. Tianjin Daxue Xuebao 44:701–704MathSciNet Bin LI, Yi-Bin LI (2011) Chaotic time series prediction based on ELM learning algorithm. Tianjin Daxue Xuebao 44:701–704MathSciNet
5.
Zurück zum Zitat Huang GB, Siew CK (2005) Extreme learning machine with randomly assigned RBF kernels. Int J Inf Technol 11:16–24 Huang GB, Siew CK (2005) Extreme learning machine with randomly assigned RBF kernels. Int J Inf Technol 11:16–24
6.
Zurück zum Zitat Li MB, Meng JE (2006) Nonlinear system identification using extreme learning machine. Control, automation, robotics and vision, 2006. ICARCV ’06. In: 9th international conference on. IEEE, 1–4 Li MB, Meng JE (2006) Nonlinear system identification using extreme learning machine. Control, automation, robotics and vision, 2006. ICARCV ’06. In: 9th international conference on. IEEE, 1–4
7.
Zurück zum Zitat Rong HJ, Huang GB, Sundararajan N et al (2009) Online sequential fuzzy extreme learning machine for function approximation and classification problems. IEEE Trans Syst Man Cybern Part B Cybern A Publ IEEE Syst Man Cybern Soc 39:1067–1072CrossRef Rong HJ, Huang GB, Sundararajan N et al (2009) Online sequential fuzzy extreme learning machine for function approximation and classification problems. IEEE Trans Syst Man Cybern Part B Cybern A Publ IEEE Syst Man Cybern Soc 39:1067–1072CrossRef
8.
Zurück zum Zitat Han F, Huang DS (2006) Improved extreme learning machine for function approximation by encoding a priori information. Neurocomputing 69:2369–2373CrossRef Han F, Huang DS (2006) Improved extreme learning machine for function approximation by encoding a priori information. Neurocomputing 69:2369–2373CrossRef
9.
Zurück zum Zitat Rong HJ, Ong YS, Tan AH et al (2008) A fast pruned-extreme learning machine for classification problem. Neurocomputing 72:359–366CrossRef Rong HJ, Ong YS, Tan AH et al (2008) A fast pruned-extreme learning machine for classification problem. Neurocomputing 72:359–366CrossRef
10.
Zurück zum Zitat Suresh S, Babu RV, Kim HJ (2009) No-reference image quality assessment using modified extreme learning machine classifier. Appl Soft Comput 9:541–552CrossRef Suresh S, Babu RV, Kim HJ (2009) No-reference image quality assessment using modified extreme learning machine classifier. Appl Soft Comput 9:541–552CrossRef
11.
Zurück zum Zitat Li G, Niu P (2013) An enhanced extreme learning machine based on ridge regression for regression. Neural Comput Appl 22:803–810CrossRef Li G, Niu P (2013) An enhanced extreme learning machine based on ridge regression for regression. Neural Comput Appl 22:803–810CrossRef
12.
Zurück zum Zitat Romero E, Alquézar R (2012) Comparing error minimized extreme learning machines and support vector sequential feed-forward neural networks. Neural Netw 25:122–129CrossRef Romero E, Alquézar R (2012) Comparing error minimized extreme learning machines and support vector sequential feed-forward neural networks. Neural Netw 25:122–129CrossRef
13.
Zurück zum Zitat Li G, Niu P, Duan X et al (2013) Fast learning network: a novel artificial neural network with a fast learning speed. Neural Comput Appl 24:1683–1695CrossRef Li G, Niu P, Duan X et al (2013) Fast learning network: a novel artificial neural network with a fast learning speed. Neural Comput Appl 24:1683–1695CrossRef
14.
Zurück zum Zitat Liu X, Wang L, Huang GB et al (2013) Multiple kernel extreme learning machine. Neurocomputing 149:253–264CrossRef Liu X, Wang L, Huang GB et al (2013) Multiple kernel extreme learning machine. Neurocomputing 149:253–264CrossRef
15.
Zurück zum Zitat Huang GB, Li MB, Chen L et al (2008) Incremental extreme learning machine with fully complex hidden nodes[J]. Neurocomputing 71:576–583CrossRef Huang GB, Li MB, Chen L et al (2008) Incremental extreme learning machine with fully complex hidden nodes[J]. Neurocomputing 71:576–583CrossRef
16.
Zurück zum Zitat Caminhas WM, Vieira DAG, Vasconcelos JA (2003) Parallel layer perceptron. Neurocomputing 55:771–778CrossRef Caminhas WM, Vieira DAG, Vasconcelos JA (2003) Parallel layer perceptron. Neurocomputing 55:771–778CrossRef
18.
Zurück zum Zitat Funahashi KI (1989) On the approximate realization of continuous mappings by neural networks. Neural Netw 2:183–192CrossRef Funahashi KI (1989) On the approximate realization of continuous mappings by neural networks. Neural Netw 2:183–192CrossRef
19.
Zurück zum Zitat Jang JSR (1993) FIS: adaptive-network-based fuzzy inference system. Inst Electr Electron Eng Inc 23:665–685 Jang JSR (1993) FIS: adaptive-network-based fuzzy inference system. Inst Electr Electron Eng Inc 23:665–685
20.
Zurück zum Zitat Hunter D, Wilamowski BM (2011) Parallel multi-layer neural network architecture with improved efficiency. In: The 4th international conference on human system interactions (HSI), Yokohama, Japan, May 19–21, pp 299–304 Hunter D, Wilamowski BM (2011) Parallel multi-layer neural network architecture with improved efficiency. In: The 4th international conference on human system interactions (HSI), Yokohama, Japan, May 19–21, pp 299–304
21.
Zurück zum Zitat Gao Z (2013) Parallel and distributed implementation of a multilayer perceptron neural network on a wireless sensor network. Dissertations & Theses—Gradworks Gao Z (2013) Parallel and distributed implementation of a multilayer perceptron neural network on a wireless sensor network. Dissertations & Theses—Gradworks
22.
Zurück zum Zitat Bhattacharjee D, Basu DK, Kundu M et al (2010) A parallel framework for multilayer perceptron for human face recognition. Int J Comput Sci Secur 3(6):491–507 Bhattacharjee D, Basu DK, Kundu M et al (2010) A parallel framework for multilayer perceptron for human face recognition. Int J Comput Sci Secur 3(6):491–507
23.
Zurück zum Zitat Sotirov S, Atanassov K, Krawczak M (2010) Generalized net model for parallel optimization of multilayer perceptron with momentum backpropagation algorithm Intelligent Systems. In: IEEE, 281–285 Sotirov S, Atanassov K, Krawczak M (2010) Generalized net model for parallel optimization of multilayer perceptron with momentum backpropagation algorithm Intelligent Systems. In: IEEE, 281–285
24.
Zurück zum Zitat Tavares LD, Saldanha RR, Vieira DAG (2015) Extreme learning machine with parallel layer perceptrons. Neurocomputing 166:164–171CrossRef Tavares LD, Saldanha RR, Vieira DAG (2015) Extreme learning machine with parallel layer perceptrons. Neurocomputing 166:164–171CrossRef
25.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings international joint Conference neural Networks, vol 2. pp 985–990 Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings international joint Conference neural Networks, vol 2. pp 985–990
26.
Zurück zum Zitat Karaboga D, Basturk B (2008) On the performance of artificial bee colony (ABC) algorithm. Appl Soft Comput 8:687–697CrossRef Karaboga D, Basturk B (2008) On the performance of artificial bee colony (ABC) algorithm. Appl Soft Comput 8:687–697CrossRef
27.
Zurück zum Zitat Li G, Niu P, Xiao X (2012) Development and investigation of efficient artificial bee colony algorithm for numerical function optimization. Appl Soft Comput 12(1):320–332CrossRef Li G, Niu P, Xiao X (2012) Development and investigation of efficient artificial bee colony algorithm for numerical function optimization. Appl Soft Comput 12(1):320–332CrossRef
28.
Zurück zum Zitat Li J (2002) Over-fitting in neural network learning algorithms and its solving strategies. Zhendong Ceshi Yu Zhenduan/J Vib Meas Diagn 22:260–264 Li J (2002) Over-fitting in neural network learning algorithms and its solving strategies. Zhendong Ceshi Yu Zhenduan/J Vib Meas Diagn 22:260–264
29.
Zurück zum Zitat Kohavi R (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the 14th international joint conference on Artificial intelligence, vol 2. San Francisco, USA, pp 1137–1143 Kohavi R (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the 14th international joint conference on Artificial intelligence, vol 2. San Francisco, USA, pp 1137–1143
30.
Zurück zum Zitat Tianyun LI, Chen C, Cheng W et al (2007) Application of cross validation in power quality de-noising. Autom Electr Power Syst 31:75–78 Tianyun LI, Chen C, Cheng W et al (2007) Application of cross validation in power quality de-noising. Autom Electr Power Syst 31:75–78
31.
Zurück zum Zitat Liang N-Y, Huang G-B, Saratchandran P, Sundararajan N (2006) A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17:1411–1423CrossRef Liang N-Y, Huang G-B, Saratchandran P, Sundararajan N (2006) A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17:1411–1423CrossRef
32.
Zurück zum Zitat Lan Y, Soh YC, Huang G-B (2010) Two-stage extreme learning machine for regression. Neurocomputing 73:3028–3038CrossRef Lan Y, Soh YC, Huang G-B (2010) Two-stage extreme learning machine for regression. Neurocomputing 73:3028–3038CrossRef
Metadaten
Titel
Fast Learning Network with Parallel Layer Perceptrons
verfasst von
Guoqiang Li
Xiaobin Qi
Bin Chen
Yunpeng Ma
Peifeng Niu
Zhiwang Chen
Publikationsdatum
27.07.2017
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2018
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-017-9667-6

Weitere Artikel der Ausgabe 2/2018

Neural Processing Letters 2/2018 Zur Ausgabe

Neuer Inhalt