Skip to main content

2017 | OriginalPaper | Buchkapitel

Improvement of RBF Training by Removing of Selected Pattern

verfasst von : Pawel Rozycki, Janusz Kolbusz, Oleksandr Lysenko, Bogdan M. Wilamowski

Erschienen in: Artificial Intelligence and Soft Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Number of training patterns has a huge impact on artificial neural networks training process, not only because of time-consuming aspects but also on network capacities. During training process the error for the most patterns reaches low error very fast and is hold to the end of training so can be safely removed without prejudice to further training process. Skilful removal of patterns during training allow to achieve better training results decreasing both training time and training error. The paper presents some implementations of this approach for Error Correction algorithm and RBF networks. The effectiveness of proposed methods has been confirmed by several experiments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323, 533–6 (1986)CrossRef Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323, 533–6 (1986)CrossRef
2.
Zurück zum Zitat Fahlman, S.E., Lebiere, C.: The cascade-correlation learning architecture. In: Advances in Neural Information Processing Systems 2. pp. 524–532. Morgan Kaufmann, San Mateo (1990) Fahlman, S.E., Lebiere, C.: The cascade-correlation learning architecture. In: Advances in Neural Information Processing Systems 2. pp. 524–532. Morgan Kaufmann, San Mateo (1990)
3.
Zurück zum Zitat Wilamowski, B.M., Bo, W., Korniak, J.: Big data and deep learning. In: 20th Jubilee IEEE International Conference on Intelligent Engineering Systems (INES 2016), 30 June–July 2, pp. 11–16 (2016) Wilamowski, B.M., Bo, W., Korniak, J.: Big data and deep learning. In: 20th Jubilee IEEE International Conference on Intelligent Engineering Systems (INES 2016), 30 June–July 2, pp. 11–16 (2016)
4.
Zurück zum Zitat Lang, K.L., Witbrock, M.J.: Learning to tell two spirals apart. In: Proceedings of the 1988 Connectionists Models Summer School. Morgan Kaufman (1998) Lang, K.L., Witbrock, M.J.: Learning to tell two spirals apart. In: Proceedings of the 1988 Connectionists Models Summer School. Morgan Kaufman (1998)
5.
Zurück zum Zitat Wilamowski, B.M., Korniak, J.: Learning architectures with enhanced capabilities and easier training. In: 19th IEEE International Conference on Intelligent Engineering Systems (INES 2015), 03–05 September, pp. 21–29 (2015) Wilamowski, B.M., Korniak, J.: Learning architectures with enhanced capabilities and easier training. In: 19th IEEE International Conference on Intelligent Engineering Systems (INES 2015), 03–05 September, pp. 21–29 (2015)
7.
Zurück zum Zitat Ciresan, D.C., Meier, U., Gambardella, L.M., Schmidhuber, J.: Deep big simple neural nets excel on handwritten digit recognition. CoRR (2010) Ciresan, D.C., Meier, U., Gambardella, L.M., Schmidhuber, J.: Deep big simple neural nets excel on handwritten digit recognition. CoRR (2010)
8.
Zurück zum Zitat Wilamowski, B.M., Yu, H.: Neural network learning without backpropagation. IEEE Trans. Neural Netw. 21(11), 1793–80 (2010)CrossRef Wilamowski, B.M., Yu, H.: Neural network learning without backpropagation. IEEE Trans. Neural Netw. 21(11), 1793–80 (2010)CrossRef
9.
Zurück zum Zitat Werbo, P.J.: Back-propagation: past and future. In: Proceeding of International Conference on Neural Networks, San Diego, CA, vol. 1, pp. 343–354 (1988) Werbo, P.J.: Back-propagation: past and future. In: Proceeding of International Conference on Neural Networks, San Diego, CA, vol. 1, pp. 343–354 (1988)
10.
Zurück zum Zitat Yu, H., Reiner, P., Xie, T., Bartczak, T., Wilamowski, B.M.: An incremental design of radial basis function networks. IEEE Trans. Neural Netw. Learn. Syst. 25(10), 1793–80 (2014)CrossRef Yu, H., Reiner, P., Xie, T., Bartczak, T., Wilamowski, B.M.: An incremental design of radial basis function networks. IEEE Trans. Neural Netw. Learn. Syst. 25(10), 1793–80 (2014)CrossRef
11.
Zurück zum Zitat Nguyen, G.H., Bouzerdoum, A., Phung, S.L.: Efficient supervised learning with reduced training exemplars. In: 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), Hong Kong, pp. 2981–2987 (2008) Nguyen, G.H., Bouzerdoum, A., Phung, S.L.: Efficient supervised learning with reduced training exemplars. In: 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), Hong Kong, pp. 2981–2987 (2008)
12.
Zurück zum Zitat Lozano, M.T.: Data reduction techniques in classification processes. Ph.D. Dissertation, Universitat Jaume I, Spain (2007) Lozano, M.T.: Data reduction techniques in classification processes. Ph.D. Dissertation, Universitat Jaume I, Spain (2007)
13.
Zurück zum Zitat Chouvatut, V., Jindaluang, W., Boonchieng, E.: Training set size reduction in large dataset problems. In: 2015 International Computer Science and Engineering Conference (ICSEC), Chiang Mai, pp. 1–5 (2015) Chouvatut, V., Jindaluang, W., Boonchieng, E.: Training set size reduction in large dataset problems. In: 2015 International Computer Science and Engineering Conference (ICSEC), Chiang Mai, pp. 1–5 (2015)
14.
Zurück zum Zitat Kolbusz, J., Rozycki, P.: Outliers elimination for error correction algorithm improvement. In: CS&P Proceedings 24th International Workshop Concurrency, Specification & Programming, (CS & P 2015), vol. 2, pp. 120–129 (2015) Kolbusz, J., Rozycki, P.: Outliers elimination for error correction algorithm improvement. In: CS&P Proceedings 24th International Workshop Concurrency, Specification & Programming, (CS & P 2015), vol. 2, pp. 120–129 (2015)
15.
Zurück zum Zitat Xie, T.: Growing and learning algorithms of radial basis function networks. Ph.D. Dissertation, Auburn University, USA (2013) Xie, T.: Growing and learning algorithms of radial basis function networks. Ph.D. Dissertation, Auburn University, USA (2013)
16.
Zurück zum Zitat Dieterich, J., Hartke, B.: Empirical review of standard benchmark functions using evolutionary global optimization. Appl. Math. 3(10A), 1552–64 (2012)CrossRef Dieterich, J., Hartke, B.: Empirical review of standard benchmark functions using evolutionary global optimization. Appl. Math. 3(10A), 1552–64 (2012)CrossRef
17.
Zurück zum Zitat Wilamowski, B.M., Jaeger, R.C.: Implementation of RBF type networks by MLP networks. In: IEEE International Conference on Neural Networks (ICNN 96), pp. 1670–1675 (1996) Wilamowski, B.M., Jaeger, R.C.: Implementation of RBF type networks by MLP networks. In: IEEE International Conference on Neural Networks (ICNN 96), pp. 1670–1675 (1996)
18.
Zurück zum Zitat Wu, X., Wilamowski, B.M.: Advantage analysis of sigmoid based RBF networks. In: Proceedings of the 17th IEEE International Conference on Intelligent Engineering Systems (INES 13), pp. 243–248 (2013) Wu, X., Wilamowski, B.M.: Advantage analysis of sigmoid based RBF networks. In: Proceedings of the 17th IEEE International Conference on Intelligent Engineering Systems (INES 13), pp. 243–248 (2013)
Metadaten
Titel
Improvement of RBF Training by Removing of Selected Pattern
verfasst von
Pawel Rozycki
Janusz Kolbusz
Oleksandr Lysenko
Bogdan M. Wilamowski
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-59063-9_14