Skip to main content
Top

2018 | OriginalPaper | Chapter

A New Method for Learning RBF Networks by Utilizing Singular Regions

Authors : Seiya Satoh, Ryohei Nakano

Published in: Artificial Intelligence and Soft Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The usual way to learn radial basis function (RBF) networks consists of two stages: first, select reasonable weights between input and hidden layers, and then optimize weights between hidden and output layers. When we learn multilayer perceptrons (MLPs), we usually employ the stochastic descent called backpropagation (BP) algorithm or 2nd-order methods such as pseudo-Newton method and conjugate gradient method. Recently new learning methods called singularity stairs following (SSF) methods have been proposed for learning real-valued or complex-valued MLPs by making good use of singular regions. SSF can monotonically decrease training error along with the increase of hidden units, and stably find a series of excellent solutions. This paper proposes a completely new method for learning RBF networks by introducing the SSF paradigm, and compares its performance with those of existing learning methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Bishop, C.M.: Neural Networks for Pattern Recognition. Clarendon Press, Oxford (1995)MATH Bishop, C.M.: Neural Networks for Pattern Recognition. Clarendon Press, Oxford (1995)MATH
3.
go back to reference Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum-likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B 39, 1–38 (1977)MathSciNetMATH Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum-likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B 39, 1–38 (1977)MathSciNetMATH
4.
go back to reference Fletcher, R.: Practical Methods of Optimization, 2nd edn. Wiley, Hoboken (1987)MATH Fletcher, R.: Practical Methods of Optimization, 2nd edn. Wiley, Hoboken (1987)MATH
5.
go back to reference Fukumizu, K., Amari, S.: Local minima and plateaus in hierarchical structure of multilayer perceptrons. Neural Netw. 13(3), 317–327 (2000)CrossRef Fukumizu, K., Amari, S.: Local minima and plateaus in hierarchical structure of multilayer perceptrons. Neural Netw. 13(3), 317–327 (2000)CrossRef
6.
go back to reference Làzaro, M., Santamarìa, I., Pantaleòn, C.: A new EM-based training algorithm for RBF networks. Neural Netw. 16, 69–77 (2003)CrossRef Làzaro, M., Santamarìa, I., Pantaleòn, C.: A new EM-based training algorithm for RBF networks. Neural Netw. 16, 69–77 (2003)CrossRef
7.
go back to reference Little, M.A., McSharry, P.E., Roberts, S.J., Costello, D.A.E., Moroz, I.M.: Exploiting nonlinear recurrence and fractal scaling properties for voice disorder detection. Biomed. Eng. OnLine 6, 23 (2007)CrossRef Little, M.A., McSharry, P.E., Roberts, S.J., Costello, D.A.E., Moroz, I.M.: Exploiting nonlinear recurrence and fractal scaling properties for voice disorder detection. Biomed. Eng. OnLine 6, 23 (2007)CrossRef
8.
go back to reference Nitta, T.: Local minima in hierarchical structures of complex-valued neural networks. Neural Netw. 43, 1–7 (2013)MATHCrossRef Nitta, T.: Local minima in hierarchical structures of complex-valued neural networks. Neural Netw. 43, 1–7 (2013)MATHCrossRef
9.
go back to reference Satoh, S., Nakano, R.: Multilayer perceptron learning utilizing singular regions and search pruning. In: Proceedings of International Conference on Machine Learning and Data Analysis, pp. 790–795 (2013) Satoh, S., Nakano, R.: Multilayer perceptron learning utilizing singular regions and search pruning. In: Proceedings of International Conference on Machine Learning and Data Analysis, pp. 790–795 (2013)
10.
go back to reference Satoh, S., Nakano, R.: A yet faster version of complex-valued multilayer perceptron learning using singular regions and search pruning. In: Proceedings of 7th International Joint Conference on Computational Intelligence (IJCCI), NCTA, vol. 3, pp. 122–129 (2015) Satoh, S., Nakano, R.: A yet faster version of complex-valued multilayer perceptron learning using singular regions and search pruning. In: Proceedings of 7th International Joint Conference on Computational Intelligence (IJCCI), NCTA, vol. 3, pp. 122–129 (2015)
Metadata
Title
A New Method for Learning RBF Networks by Utilizing Singular Regions
Authors
Seiya Satoh
Ryohei Nakano
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-91253-0_21

Premium Partner