Skip to main content
Erschienen in: Neural Computing and Applications 7-8/2014

01.06.2014 | Original Article

A novel self-adaptive extreme learning machine based on affinity propagation for radial basis function neural network

verfasst von: Shifei Ding, Gang Ma, Zhongzhi Shi

Erschienen in: Neural Computing and Applications | Ausgabe 7-8/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, a novel self-adaptive extreme learning machine (ELM) based on affinity propagation (AP) is proposed to optimize the radial basis function neural network (RBFNN). As is well known, the parameters of original ELM which developed by G.-B. Huang are randomly determined. However, that cannot objectively obtain a set of optimal parameters of RBFNN trained by ELM algorithm for different realistic datasets. The AP algorithm can automatically produce a set of clustering centers for the different datasets. According to the results of AP, we can, respectively, get the cluster number and the radius value of each cluster. In that case, the above cluster number and radius value can be used to initialize the number and widths of hidden layer neurons in RBFNN and that is also the parameters of coefficient matrix H of ELM. This may successfully avoid the subjectivity prior knowledge and randomness of training RBFNN. Experimental results show that the method proposed in this thesis has a more powerful generalization capability than conventional ELM for an RBFNN.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Muzhou Hou, Xuli Han (2011) The multidimensional function approximation based on constructive wavelet RBF neural network. Appl Soft Comput 11(2):2173–2177CrossRef Muzhou Hou, Xuli Han (2011) The multidimensional function approximation based on constructive wavelet RBF neural network. Appl Soft Comput 11(2):2173–2177CrossRef
2.
Zurück zum Zitat Beyhan S, Alci M (2010) Stable modeling based control methods using a new RBF network. ISA Trans 49(4):510–518CrossRef Beyhan S, Alci M (2010) Stable modeling based control methods using a new RBF network. ISA Trans 49(4):510–518CrossRef
3.
Zurück zum Zitat Han H-G, Chen Q, Qiao J-F (2011) An efficient self-organizing RBF neural network for water quality prediction. Neural Netw 24(7):717–725CrossRefMATH Han H-G, Chen Q, Qiao J-F (2011) An efficient self-organizing RBF neural network for water quality prediction. Neural Netw 24(7):717–725CrossRefMATH
4.
Zurück zum Zitat Zhang A, Zhang L (2004) RBF neural networks for the prediction of building interference effects. Comput Struct 82(27):2333–2339CrossRef Zhang A, Zhang L (2004) RBF neural networks for the prediction of building interference effects. Comput Struct 82(27):2333–2339CrossRef
6.
Zurück zum Zitat Shifei D, Ma G, Xu X (2011) A rough RBF neural networks optimized by the genetic algorithm. Adv Inf Sci Serv Sci 3(7):332–339 Shifei D, Ma G, Xu X (2011) A rough RBF neural networks optimized by the genetic algorithm. Adv Inf Sci Serv Sci 3(7):332–339
7.
Zurück zum Zitat Mao Z, Jia M (2012) ELM based LF temperature prediction model and its online sequential learning. Control and Decision Conference (CCDC), 2012 24th Chinese, vol 5. pp 2362–2365 Mao Z, Jia M (2012) ELM based LF temperature prediction model and its online sequential learning. Control and Decision Conference (CCDC), 2012 24th Chinese, vol 5. pp 2362–2365
8.
Zurück zum Zitat Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1-3):489–501CrossRef Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1-3):489–501CrossRef
9.
Zurück zum Zitat Liu X, Gao C, Li P (2012) A comparative analysis of support vector machines and extreme learning machines. Neural Netw 33:58–66CrossRef Liu X, Gao C, Li P (2012) A comparative analysis of support vector machines and extreme learning machines. Neural Netw 33:58–66CrossRef
10.
Zurück zum Zitat Park H-S, Chung Y-D, Oh S-K, Pedrycz W, Kim H-K (2011) Design of information granule-oriented RBF neural networks and its application to power supply for high-field magnet. Eng Appl Artif Intell 24(3):543–554CrossRef Park H-S, Chung Y-D, Oh S-K, Pedrycz W, Kim H-K (2011) Design of information granule-oriented RBF neural networks and its application to power supply for high-field magnet. Eng Appl Artif Intell 24(3):543–554CrossRef
11.
Zurück zum Zitat Shen W, Guo X, Wu C, Wu D (2011) Forecasting stock indices using radial basis function neural networks optimized by artificial fish swarm algorithm. Knowl Based Syst 24(3):378–385CrossRef Shen W, Guo X, Wu C, Wu D (2011) Forecasting stock indices using radial basis function neural networks optimized by artificial fish swarm algorithm. Knowl Based Syst 24(3):378–385CrossRef
12.
Zurück zum Zitat Wu X, Zhu X, Cao G, Tu H (2008) Predictive control of SOFC based on a GA-RBF neural network model. J Power Sources 179(1):232–239CrossRef Wu X, Zhu X, Cao G, Tu H (2008) Predictive control of SOFC based on a GA-RBF neural network model. J Power Sources 179(1):232–239CrossRef
13.
Zurück zum Zitat Qu N, Mi H, Wang B, Ren Y (2009) Application of GA-RBF networks to the nondestructive determination of active component in pharmaceutical powder by NIR spectroscopy. J Taiwan Inst Chem Eng 40(2):163–167CrossRef Qu N, Mi H, Wang B, Ren Y (2009) Application of GA-RBF networks to the nondestructive determination of active component in pharmaceutical powder by NIR spectroscopy. J Taiwan Inst Chem Eng 40(2):163–167CrossRef
14.
Zurück zum Zitat dos Coelho LS, Santos AAP (2011) A RBF neural network model with GARCH errors: application to electricity price forecasting. Electr Power Syst Res 81(1):74–83CrossRef dos Coelho LS, Santos AAP (2011) A RBF neural network model with GARCH errors: application to electricity price forecasting. Electr Power Syst Res 81(1):74–83CrossRef
16.
Zurück zum Zitat Zhong Y, Zheng M, Wu J, Shen W, Zhou Y, Zhou C (2012) Search the optimal preference of affinity propagation algorithm. In: Intelligent computation technology and automation (ICICTA), 2012 fifth international conference, vol 1. pp 304–307 Zhong Y, Zheng M, Wu J, Shen W, Zhou Y, Zhou C (2012) Search the optimal preference of affinity propagation algorithm. In: Intelligent computation technology and automation (ICICTA), 2012 fifth international conference, vol 1. pp 304–307
17.
Zurück zum Zitat Cheng L, Hu J (2009) Matrix theory. China University of Mining and Technology Press, Xuzhou Cheng L, Hu J (2009) Matrix theory. China University of Mining and Technology Press, Xuzhou
18.
Zurück zum Zitat Huang G, Siew C-K (2004) Extreme learning machine: RBF network case. Control Autom Robot Vis Conf 2:1029–1036 Huang G, Siew C-K (2004) Extreme learning machine: RBF network case. Control Autom Robot Vis Conf 2:1029–1036
19.
Zurück zum Zitat Huang G-B, Zhu Q-Y, Siew C-K (2004) Extreme learning machine: a new learning scheme of feed forward neural networks. In: Proceedings of international joint conference on neural networks (IJCNN2004), vol 6. pp 25–29 Huang G-B, Zhu Q-Y, Siew C-K (2004) Extreme learning machine: a new learning scheme of feed forward neural networks. In: Proceedings of international joint conference on neural networks (IJCNN2004), vol 6. pp 25–29
20.
Zurück zum Zitat Huang G-B, Babri HA (1998) Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans Neural Networks 9(1):224–229CrossRef Huang G-B, Babri HA (1998) Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans Neural Networks 9(1):224–229CrossRef
21.
Zurück zum Zitat Huang G-B (2003) Learning capability and storage capacity of two-hidden-layer feedforward networks. IEEE Trans Neural Networks 14(2):274–281CrossRef Huang G-B (2003) Learning capability and storage capacity of two-hidden-layer feedforward networks. IEEE Trans Neural Networks 14(2):274–281CrossRef
Metadaten
Titel
A novel self-adaptive extreme learning machine based on affinity propagation for radial basis function neural network
verfasst von
Shifei Ding
Gang Ma
Zhongzhi Shi
Publikationsdatum
01.06.2014
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 7-8/2014
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-013-1385-z

Weitere Artikel der Ausgabe 7-8/2014

Neural Computing and Applications 7-8/2014 Zur Ausgabe

Premium Partner