Skip to main content

2016 | OriginalPaper | Buchkapitel

A Radial Basis Function Neural Network Training Mechanism for Pattern Classification Tasks

verfasst von : Antonios D. Niros, George E. Tsekouras

Erschienen in: Unsupervised Learning Algorithms

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter proposes a radial basis function network learning approach for classification problems that combines hierarchical fuzzy clustering and particle swarm optimization (PSO) with discriminant analysis to elaborate on an effective design of radial basis function neural network classifier. To eliminate the redundant information, the training data are pre-processed to create a partition of the feature space into a number of fuzzy subspaces. The center elements of the subspaces are considered as a new data set which is further clustered by means of a weighted clustering scheme. The obtained cluster centers coincide with the centers of the network’s basis functions. The method of PSO is used to estimate the neuron connecting weights involved in the learning process. The proposed classifier is applied to three machine learning data sets, and its results are compared to other relative approaches that exist in the literature.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Haykin, S.: Neural Networks: A Comprehensive Foundation. Prentice Hall, Upper Saddle River (1999)MATH Haykin, S.: Neural Networks: A Comprehensive Foundation. Prentice Hall, Upper Saddle River (1999)MATH
2.
Zurück zum Zitat Schwenker, F., Kestler, H.A., Palm, G.: Three learning phases for radial-basis-function networks. Neural Netw. 14, 439–458 (2001)CrossRefMATH Schwenker, F., Kestler, H.A., Palm, G.: Three learning phases for radial-basis-function networks. Neural Netw. 14, 439–458 (2001)CrossRefMATH
3.
Zurück zum Zitat Xie, T., Yu, H., Hewlett, J., Rózycki, P., Wilamowski, B.: Fast and efficient second-order method for training radial basis function networks. IEEE Trans. Neural Netw. 23(4), 609–619 (2012)CrossRef Xie, T., Yu, H., Hewlett, J., Rózycki, P., Wilamowski, B.: Fast and efficient second-order method for training radial basis function networks. IEEE Trans. Neural Netw. 23(4), 609–619 (2012)CrossRef
4.
Zurück zum Zitat Chen, Y., Peng, L., Abraham, A.: Hierarchical radial basis function neural networks for classification problems. Advances in Neural Networks. Lecture Notes in Computer Science, vol. 3971, pp. 873–879 (2006) Chen, Y., Peng, L., Abraham, A.: Hierarchical radial basis function neural networks for classification problems. Advances in Neural Networks. Lecture Notes in Computer Science, vol. 3971, pp. 873–879 (2006)
5.
Zurück zum Zitat Chen, Y., Yang, B., Zhou, J.: Automatic Design of Hierarchical RBF Networks for System Identification. PRICAI'06, Lecture Notes on Artificial Intelligence, 4099, 1191–1195 (2006) Chen, Y., Yang, B., Zhou, J.: Automatic Design of Hierarchical RBF Networks for System Identification. PRICAI'06, Lecture Notes on Artificial Intelligence, 4099, 1191–1195 (2006)
6.
Zurück zum Zitat González, J., Rojas, I., Pomares, H., Ortega, J., Prieto, A.: A new clustering technique for function approximation. IEEE Trans. Neural Netw. 13(1), 132–142 (2002)CrossRef González, J., Rojas, I., Pomares, H., Ortega, J., Prieto, A.: A new clustering technique for function approximation. IEEE Trans. Neural Netw. 13(1), 132–142 (2002)CrossRef
7.
Zurück zum Zitat Hou, M., Han, X.: Constructive approximation to multivariate function by decay RBF neural network. IEEE Trans. Neural Netw. 21(9), 1517–1523 (2010)CrossRef Hou, M., Han, X.: Constructive approximation to multivariate function by decay RBF neural network. IEEE Trans. Neural Netw. 21(9), 1517–1523 (2010)CrossRef
8.
Zurück zum Zitat Huan, H.X., Hien, D.T.T., Tue, H.H.: Efficient algorithm for training interpolation RBF networks with equally spaced nodes. IEEE Trans. Neural Netw. 22(6), 982–988 (2011)CrossRef Huan, H.X., Hien, D.T.T., Tue, H.H.: Efficient algorithm for training interpolation RBF networks with equally spaced nodes. IEEE Trans. Neural Netw. 22(6), 982–988 (2011)CrossRef
9.
Zurück zum Zitat Babuska, R., Verbruggen, H.: Neuro-fuzzy methods for nonlinear system identification. Annu. Rev. Control 27, 73–85 (2004)CrossRef Babuska, R., Verbruggen, H.: Neuro-fuzzy methods for nonlinear system identification. Annu. Rev. Control 27, 73–85 (2004)CrossRef
10.
Zurück zum Zitat Behloul, F., Lelieveldt, B.P.F., Boudraa, A., Reiber, J.H.C.: Optimal design of radial basis function neural networks for fuzzy-rule extraction in high dimensional data. Pattern Recognit. 35, 659–675 (2002)CrossRefMATH Behloul, F., Lelieveldt, B.P.F., Boudraa, A., Reiber, J.H.C.: Optimal design of radial basis function neural networks for fuzzy-rule extraction in high dimensional data. Pattern Recognit. 35, 659–675 (2002)CrossRefMATH
11.
Zurück zum Zitat Haddadnia, J.H., Faez, K., Ahmadi, M.: A fuzzy hybrid algorithm for radial basis function neural network application in human face recognition. Pattern Recognit. 36, 1187–1202 (2003)CrossRefMATH Haddadnia, J.H., Faez, K., Ahmadi, M.: A fuzzy hybrid algorithm for radial basis function neural network application in human face recognition. Pattern Recognit. 36, 1187–1202 (2003)CrossRefMATH
12.
Zurück zum Zitat Wong, Y.W., Seng, K.P., Ang, L.M.: Radial basis function neural network with incremental learning for face recognition. IEEE Trans. Syst. Man. Cybern. B Cybern. 41(4), 940–949 (2011)CrossRef Wong, Y.W., Seng, K.P., Ang, L.M.: Radial basis function neural network with incremental learning for face recognition. IEEE Trans. Syst. Man. Cybern. B Cybern. 41(4), 940–949 (2011)CrossRef
13.
Zurück zum Zitat Valdez, F., Melin, P., Castillo, O.: Evolutionary method combining particle swarm optimisation and genetic algorithms using fuzzy logic for parameter adaptation and aggregation: the case neural network optimisation for face recognition. Int. J. Artif. Intell. Soft Comput. 2(1–2), 77–102 (2010)CrossRef Valdez, F., Melin, P., Castillo, O.: Evolutionary method combining particle swarm optimisation and genetic algorithms using fuzzy logic for parameter adaptation and aggregation: the case neural network optimisation for face recognition. Int. J. Artif. Intell. Soft Comput. 2(1–2), 77–102 (2010)CrossRef
14.
Zurück zum Zitat Theodoridis, S., Koutroumbas, K.: Pattern Recognition, 2nd edn. Elsevier, San Diego (2003)MATH Theodoridis, S., Koutroumbas, K.: Pattern Recognition, 2nd edn. Elsevier, San Diego (2003)MATH
15.
Zurück zum Zitat Bishop, C.M.: Neural Networks for Pattern Recognition. Clarendon, Oxford (1995)MATH Bishop, C.M.: Neural Networks for Pattern Recognition. Clarendon, Oxford (1995)MATH
16.
Zurück zum Zitat Staiano, A., Tagliaferri, R., Pedrycz, W.: Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering. Neurocomputing 69, 1570–1581 (2006)CrossRef Staiano, A., Tagliaferri, R., Pedrycz, W.: Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering. Neurocomputing 69, 1570–1581 (2006)CrossRef
17.
Zurück zum Zitat Park, H.S., Pedrycz, W., Oh, S.K.: Granular neural networks and their development through context-based clustering and adjustable dimensionality of receptive fields. IEEE Trans. Neural Netw. 20(10), 1604–1616 (2009)CrossRef Park, H.S., Pedrycz, W., Oh, S.K.: Granular neural networks and their development through context-based clustering and adjustable dimensionality of receptive fields. IEEE Trans. Neural Netw. 20(10), 1604–1616 (2009)CrossRef
18.
Zurück zum Zitat Fathi, V., Montazer Gh, A.: An improvement in RBF learning algorithm based on PSO for real time applications. Neurocomputing 111, 169–176 (2013)CrossRef Fathi, V., Montazer Gh, A.: An improvement in RBF learning algorithm based on PSO for real time applications. Neurocomputing 111, 169–176 (2013)CrossRef
19.
Zurück zum Zitat Carlisle, A., Dozier, G.: Adapting particle swarm optimization to dynamic environments. In: Proceedings of International Conference on Artificial Intelligence, pp. 429–434 (2000) Carlisle, A., Dozier, G.: Adapting particle swarm optimization to dynamic environments. In: Proceedings of International Conference on Artificial Intelligence, pp. 429–434 (2000)
21.
Zurück zum Zitat Clerc, M., Kennedy, J.: The particle swarm – explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evol. Comput. 6(1), 58–73 (2002)CrossRef Clerc, M., Kennedy, J.: The particle swarm – explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evol. Comput. 6(1), 58–73 (2002)CrossRef
22.
Zurück zum Zitat Oh, S.K., Kima, W.D., Pedrycz, W., Park, B.J.: Polynomial-based radial basis function neural networks (P-RBF NNs) realized with the aid of particle swarm optimization. Fuzzy Sets Syst. 163, 54–77 (2011) (Elsevier)MathSciNetCrossRefMATH Oh, S.K., Kima, W.D., Pedrycz, W., Park, B.J.: Polynomial-based radial basis function neural networks (P-RBF NNs) realized with the aid of particle swarm optimization. Fuzzy Sets Syst. 163, 54–77 (2011) (Elsevier)MathSciNetCrossRefMATH
23.
Zurück zum Zitat Tsekouras, G.E., Tsimikas, J.: On training RBF neural networks using input-output fuzzy clustering and particle swarm optimization. Fuzzy Sets Syst. 221, 65–89 (2013)MathSciNetCrossRefMATH Tsekouras, G.E., Tsimikas, J.: On training RBF neural networks using input-output fuzzy clustering and particle swarm optimization. Fuzzy Sets Syst. 221, 65–89 (2013)MathSciNetCrossRefMATH
24.
Zurück zum Zitat Qasem, S.N., Shamsuddin, S.M.: Improving performance of radial basis function network with particle swarm optimization. IEEE International Conference on Systems, Man and Cybernetics, pp. 534–540 (2009) Qasem, S.N., Shamsuddin, S.M.: Improving performance of radial basis function network with particle swarm optimization. IEEE International Conference on Systems, Man and Cybernetics, pp. 534–540 (2009)
25.
Zurück zum Zitat Qasem, S.N., Shamsuddin, S.M.: Radial basis function network based on time variant multi-objective particle swarm optimization for medical diseases diagnosis. Appl. Soft Comput. 11, 1427–1438 (2011)CrossRef Qasem, S.N., Shamsuddin, S.M.: Radial basis function network based on time variant multi-objective particle swarm optimization for medical diseases diagnosis. Appl. Soft Comput. 11, 1427–1438 (2011)CrossRef
26.
Zurück zum Zitat Chen, S., Hong, X., Harris, C.J.: Particle swarm optimization aided orthogonal forward regression for unified data modeling. IEEE Trans. Evol. Comput. 14(4), 477–499 (2010)CrossRef Chen, S., Hong, X., Harris, C.J.: Particle swarm optimization aided orthogonal forward regression for unified data modeling. IEEE Trans. Evol. Comput. 14(4), 477–499 (2010)CrossRef
27.
Zurück zum Zitat Linkens, D.A., Chen, M.Y.: Input selection and partition validation for fuzzy modelling using neural network. Fuzzy Sets Syst. 107, 299–308 (1999)MathSciNetCrossRef Linkens, D.A., Chen, M.Y.: Input selection and partition validation for fuzzy modelling using neural network. Fuzzy Sets Syst. 107, 299–308 (1999)MathSciNetCrossRef
28.
Zurück zum Zitat Tsekouras, G.E., Sarimveis, H., Bafas, G.: A simple algorithm for training fuzzy systems using input–output data. Adv. Eng. Softw. 34(5), 247–259 (2003)CrossRefMATH Tsekouras, G.E., Sarimveis, H., Bafas, G.: A simple algorithm for training fuzzy systems using input–output data. Adv. Eng. Softw. 34(5), 247–259 (2003)CrossRefMATH
29.
30.
Zurück zum Zitat Tsekouras, G.E.: On the use of the weighted fuzzy c-means in fuzzy modeling. Adv. Eng. Softw. 36, 287–300 (2005)CrossRefMATH Tsekouras, G.E.: On the use of the weighted fuzzy c-means in fuzzy modeling. Adv. Eng. Softw. 36, 287–300 (2005)CrossRefMATH
31.
Zurück zum Zitat Tsekouras, G.E., Sarimveis, H., Kavakli, E., Bafas, G.: A hierarchical fuzzy-clustering approach to fuzzy modeling. Fuzzy Sets Syst. 150(2), 245–266 (2005)MathSciNetCrossRefMATH Tsekouras, G.E., Sarimveis, H., Kavakli, E., Bafas, G.: A hierarchical fuzzy-clustering approach to fuzzy modeling. Fuzzy Sets Syst. 150(2), 245–266 (2005)MathSciNetCrossRefMATH
32.
Zurück zum Zitat Niros, A.D., Tsekouras, G.E.: On training radial basis function neural networks using optimal fuzzy clustering. In: 17th IEEE Mediterranean Conference on Control and Automation, pp.395–400 (2009) Niros, A.D., Tsekouras, G.E.: On training radial basis function neural networks using optimal fuzzy clustering. In: 17th IEEE Mediterranean Conference on Control and Automation, pp.395–400 (2009)
33.
Zurück zum Zitat Jensen, F.: An Introduction to Bayesian Networks. UCL Press/Springer, Berlin, Germany (1996) Jensen, F.: An Introduction to Bayesian Networks. UCL Press/Springer, Berlin, Germany (1996)
34.
Zurück zum Zitat Anagnostopoulos, I., Maglogiannis, I.: Neural network-based diagnostic and prognostic estimations in breast cancer micro scopic instances. Med. Biol. Eng. Comput. 44(9), 773–784 (2006)CrossRef Anagnostopoulos, I., Maglogiannis, I.: Neural network-based diagnostic and prognostic estimations in breast cancer micro scopic instances. Med. Biol. Eng. Comput. 44(9), 773–784 (2006)CrossRef
35.
Zurück zum Zitat Adamczak, R., Duch, W., Jankowski, N.: New developments in the feature space mapping model. In: Third Conference on Neural Networks and Their Applications, Kule, October 1997, pp. 65–70 (1997) Adamczak, R., Duch, W., Jankowski, N.: New developments in the feature space mapping model. In: Third Conference on Neural Networks and Their Applications, Kule, October 1997, pp. 65–70 (1997)
36.
Zurück zum Zitat Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. Wiley, New York (2002)MATH Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. Wiley, New York (2002)MATH
37.
Zurück zum Zitat Abbass, H.A.: An evolutionary artificial neural networks approach for breast cancer diagnosis. Artif. Intell. Med. 25(3), 265–281 (2002)CrossRef Abbass, H.A.: An evolutionary artificial neural networks approach for breast cancer diagnosis. Artif. Intell. Med. 25(3), 265–281 (2002)CrossRef
38.
Zurück zum Zitat Young, Z.R.: A novel radial basis function neural network for discriminant analysis. IEEE Trans. Neural Netw. 17(3), 604–612 (2006)CrossRef Young, Z.R.: A novel radial basis function neural network for discriminant analysis. IEEE Trans. Neural Netw. 17(3), 604–612 (2006)CrossRef
39.
Zurück zum Zitat Tipping, M.E.: The relevance vector machine. Adv. Neural Inf. Process. Syst. 12, 652–658 (2000) Tipping, M.E.: The relevance vector machine. Adv. Neural Inf. Process. Syst. 12, 652–658 (2000)
40.
41.
Zurück zum Zitat Aeberhard, S., Coomans, D., de Vel, O.: Comparison of classifiers in high dimensional settings, Department of Computer Science and Department of Mathematics and Statistics, James Cook. University of North Queensland, Technical Report 92-02 (1992) Aeberhard, S., Coomans, D., de Vel, O.: Comparison of classifiers in high dimensional settings, Department of Computer Science and Department of Mathematics and Statistics, James Cook. University of North Queensland, Technical Report 92-02 (1992)
42.
Zurück zum Zitat Kotsiantis, S.B., Pintelas, P.E.: Logitboost of simple Bayesian classifier. Informatica 29, 53–59 (2005) Kotsiantis, S.B., Pintelas, P.E.: Logitboost of simple Bayesian classifier. Informatica 29, 53–59 (2005)
43.
Zurück zum Zitat Lim, T., Loh, W., Shih, Y.: A comparison of prediction accuracy, complexity, and training time of thirty three old and new classification algorithms. Mach. Learn. 40, 203–228 (2000)CrossRefMATH Lim, T., Loh, W., Shih, Y.: A comparison of prediction accuracy, complexity, and training time of thirty three old and new classification algorithms. Mach. Learn. 40, 203–228 (2000)CrossRefMATH
Metadaten
Titel
A Radial Basis Function Neural Network Training Mechanism for Pattern Classification Tasks
verfasst von
Antonios D. Niros
George E. Tsekouras
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-24211-8_8

Neuer Inhalt