Skip to main content

2018 | OriginalPaper | Buchkapitel

A New Method for Learning RBF Networks by Utilizing Singular Regions

verfasst von : Seiya Satoh, Ryohei Nakano

Erschienen in: Artificial Intelligence and Soft Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The usual way to learn radial basis function (RBF) networks consists of two stages: first, select reasonable weights between input and hidden layers, and then optimize weights between hidden and output layers. When we learn multilayer perceptrons (MLPs), we usually employ the stochastic descent called backpropagation (BP) algorithm or 2nd-order methods such as pseudo-Newton method and conjugate gradient method. Recently new learning methods called singularity stairs following (SSF) methods have been proposed for learning real-valued or complex-valued MLPs by making good use of singular regions. SSF can monotonically decrease training error along with the increase of hidden units, and stably find a series of excellent solutions. This paper proposes a completely new method for learning RBF networks by introducing the SSF paradigm, and compares its performance with those of existing learning methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Bishop, C.M.: Neural Networks for Pattern Recognition. Clarendon Press, Oxford (1995)MATH Bishop, C.M.: Neural Networks for Pattern Recognition. Clarendon Press, Oxford (1995)MATH
3.
Zurück zum Zitat Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum-likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B 39, 1–38 (1977)MathSciNetMATH Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum-likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B 39, 1–38 (1977)MathSciNetMATH
4.
Zurück zum Zitat Fletcher, R.: Practical Methods of Optimization, 2nd edn. Wiley, Hoboken (1987)MATH Fletcher, R.: Practical Methods of Optimization, 2nd edn. Wiley, Hoboken (1987)MATH
5.
Zurück zum Zitat Fukumizu, K., Amari, S.: Local minima and plateaus in hierarchical structure of multilayer perceptrons. Neural Netw. 13(3), 317–327 (2000)CrossRef Fukumizu, K., Amari, S.: Local minima and plateaus in hierarchical structure of multilayer perceptrons. Neural Netw. 13(3), 317–327 (2000)CrossRef
6.
Zurück zum Zitat Làzaro, M., Santamarìa, I., Pantaleòn, C.: A new EM-based training algorithm for RBF networks. Neural Netw. 16, 69–77 (2003)CrossRef Làzaro, M., Santamarìa, I., Pantaleòn, C.: A new EM-based training algorithm for RBF networks. Neural Netw. 16, 69–77 (2003)CrossRef
7.
Zurück zum Zitat Little, M.A., McSharry, P.E., Roberts, S.J., Costello, D.A.E., Moroz, I.M.: Exploiting nonlinear recurrence and fractal scaling properties for voice disorder detection. Biomed. Eng. OnLine 6, 23 (2007)CrossRef Little, M.A., McSharry, P.E., Roberts, S.J., Costello, D.A.E., Moroz, I.M.: Exploiting nonlinear recurrence and fractal scaling properties for voice disorder detection. Biomed. Eng. OnLine 6, 23 (2007)CrossRef
8.
Zurück zum Zitat Nitta, T.: Local minima in hierarchical structures of complex-valued neural networks. Neural Netw. 43, 1–7 (2013)MATHCrossRef Nitta, T.: Local minima in hierarchical structures of complex-valued neural networks. Neural Netw. 43, 1–7 (2013)MATHCrossRef
9.
Zurück zum Zitat Satoh, S., Nakano, R.: Multilayer perceptron learning utilizing singular regions and search pruning. In: Proceedings of International Conference on Machine Learning and Data Analysis, pp. 790–795 (2013) Satoh, S., Nakano, R.: Multilayer perceptron learning utilizing singular regions and search pruning. In: Proceedings of International Conference on Machine Learning and Data Analysis, pp. 790–795 (2013)
10.
Zurück zum Zitat Satoh, S., Nakano, R.: A yet faster version of complex-valued multilayer perceptron learning using singular regions and search pruning. In: Proceedings of 7th International Joint Conference on Computational Intelligence (IJCCI), NCTA, vol. 3, pp. 122–129 (2015) Satoh, S., Nakano, R.: A yet faster version of complex-valued multilayer perceptron learning using singular regions and search pruning. In: Proceedings of 7th International Joint Conference on Computational Intelligence (IJCCI), NCTA, vol. 3, pp. 122–129 (2015)
Metadaten
Titel
A New Method for Learning RBF Networks by Utilizing Singular Regions
verfasst von
Seiya Satoh
Ryohei Nakano
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-91253-0_21