Skip to main content
Erschienen in: Neural Computing and Applications 2/2012

01.03.2012 | Original Article

Plane-Gaussian artificial neural network

verfasst von: Xubing Yang, Songcan Chen, Bin Chen

Erschienen in: Neural Computing and Applications | Ausgabe 2/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multilayer perceptrons (MLPs) and radial basis functions networks (RBFNs) have been widely concerned in recent years. In this paper, based on k-plane clustering (kPC) algorithm, we propose a novel artificial network model termed as Plane-Gaussian network to enlarge the arsenal of the neural networks. This network adopts a so-called Plane-Gaussian activation function (PGF) in hidden neurons. Replacing traditional central point of Gaussian radial basis function (RBF) with central hyperplane, PGF forms a band-shaped rather than spheral-shaped receptive field in RBF, which makes PGF able to express its peculiar geometrical characteristics: locality and globality. Importantly, it is also proved that PGF network (PGFN) having one hidden layer is capable of universal approximation. As a universal approximator, PGFN gives an informal way of bridging the gap between MLP and RBFN. The experiments report comparison between training time and classification accuracies on some artificial and UCI datasets and conclude that (1) PGFN runs significantly faster than MLP and (2) PGFN has comparable or better classification performance than MLP and RBFN, especially in subspace-distributed datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Fußnoten
1
To distinguish with the foresaid parameter k such as kPC and k-means, here let k 1 denotes the number of nearest neighbors to a given sample.
 
Literatur
1.
Zurück zum Zitat Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice Hall, NJMATH Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice Hall, NJMATH
2.
Zurück zum Zitat Bishop CM (1995) Neural networks and pattern recognition. Oxford University Press, Oxford Bishop CM (1995) Neural networks and pattern recognition. Oxford University Press, Oxford
3.
Zurück zum Zitat Barreto AMS, Barbosa HJC, Ebecken NFF (2006) GOLS-Genetic orthogonal least squares algorithm for training RBF networks. Neurocomputing 69(16–18):2041–2064CrossRef Barreto AMS, Barbosa HJC, Ebecken NFF (2006) GOLS-Genetic orthogonal least squares algorithm for training RBF networks. Neurocomputing 69(16–18):2041–2064CrossRef
4.
Zurück zum Zitat Sarimveis H, Doganis P, Alexandridis A (2006) A classification technique based on radial basis function neural networks. Adv Eng Softw 37(4):218–221CrossRef Sarimveis H, Doganis P, Alexandridis A (2006) A classification technique based on radial basis function neural networks. Adv Eng Softw 37(4):218–221CrossRef
5.
Zurück zum Zitat Smyrnakis MG, Evans DJ (2007) Classifying Ischemic events using a Bayesian inference multilayer percetron and input variable evaluation using automatic relevance determination. Comput Cardiol 34:305–308 Smyrnakis MG, Evans DJ (2007) Classifying Ischemic events using a Bayesian inference multilayer percetron and input variable evaluation using automatic relevance determination. Comput Cardiol 34:305–308
6.
Zurück zum Zitat Cybenko G (1989) Approximation by superpositions of a sigmoidal function. Math Control Signals Syst 5(4):303–314MathSciNetCrossRef Cybenko G (1989) Approximation by superpositions of a sigmoidal function. Math Control Signals Syst 5(4):303–314MathSciNetCrossRef
7.
Zurück zum Zitat Funahashi K (1989) On the approximate realization of continuous mappings by neural networks. Neural Netw 2(3):183–192MATHCrossRef Funahashi K (1989) On the approximate realization of continuous mappings by neural networks. Neural Netw 2(3):183–192MATHCrossRef
8.
Zurück zum Zitat Hornik K, Stinchcombe M, White H (1990) Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks. Neural Networks 3(5):551–560CrossRef Hornik K, Stinchcombe M, White H (1990) Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks. Neural Networks 3(5):551–560CrossRef
9.
Zurück zum Zitat Park J, Sandberg IW (1991) Universal approximation using radial-basis-function networks. Neural Comput 3(2):246–257CrossRef Park J, Sandberg IW (1991) Universal approximation using radial-basis-function networks. Neural Comput 3(2):246–257CrossRef
10.
Zurück zum Zitat Nam MD, Thanh TC (2003) Approximation of function and its derivatives using radial basis function networks. Appl Math Modell 27(3):197–220MATHCrossRef Nam MD, Thanh TC (2003) Approximation of function and its derivatives using radial basis function networks. Appl Math Modell 27(3):197–220MATHCrossRef
11.
Zurück zum Zitat Lehtokangas M, Saarinen J (1998) Centroid based multilayer perceptron networks. Neural Process Lett 7:101–106CrossRef Lehtokangas M, Saarinen J (1998) Centroid based multilayer perceptron networks. Neural Process Lett 7:101–106CrossRef
12.
Zurück zum Zitat Irigoyen E, Pinzolas M (in press) Numerical bounds to assure initial local stability of NARX multilayer perceptrons and radial basis functions. Neurocomputing Irigoyen E, Pinzolas M (in press) Numerical bounds to assure initial local stability of NARX multilayer perceptrons and radial basis functions. Neurocomputing
13.
Zurück zum Zitat Oliveira ALI, Melo BJM, Meira SRL (2005) Improving constructive training of RBF networks through selective pruning and model selection. Neurocomputing 64:537–541CrossRef Oliveira ALI, Melo BJM, Meira SRL (2005) Improving constructive training of RBF networks through selective pruning and model selection. Neurocomputing 64:537–541CrossRef
14.
Zurück zum Zitat Delogu R, Fanni A, Montisci A (2008) Geometrical synthesis of MLP neural networks. Neurocomputing 71(4–6):919–930CrossRef Delogu R, Fanni A, Montisci A (2008) Geometrical synthesis of MLP neural networks. Neurocomputing 71(4–6):919–930CrossRef
15.
Zurück zum Zitat De Silva CR, Ranganath S, De Silva LC (2008) Cloud basis function neural network: a modified RBF network architecture for holistic facial expression recognition. Pattern Recogn 41(4):1241–1253MATHCrossRef De Silva CR, Ranganath S, De Silva LC (2008) Cloud basis function neural network: a modified RBF network architecture for holistic facial expression recognition. Pattern Recogn 41(4):1241–1253MATHCrossRef
16.
Zurück zum Zitat Qu N, Wang L, Zhu M et al (2008) Radial basis function networks combined with genetic algorithm applied to nondestructive determination of compound erythromycin ethylsuccinate powder. Chemom Intell Lab Syst 90(2):145–152CrossRef Qu N, Wang L, Zhu M et al (2008) Radial basis function networks combined with genetic algorithm applied to nondestructive determination of compound erythromycin ethylsuccinate powder. Chemom Intell Lab Syst 90(2):145–152CrossRef
17.
Zurück zum Zitat Huan HX, Hien DTT, Huynh HT (2007) A novel efficient two-phase algorithm for training interpolation radial basis function networks. Signal Process 87(11):2708–2717MATHCrossRef Huan HX, Hien DTT, Huynh HT (2007) A novel efficient two-phase algorithm for training interpolation radial basis function networks. Signal Process 87(11):2708–2717MATHCrossRef
18.
Zurück zum Zitat Yeung DS, Chan PPK, Ng WWY (2009) Radial basis function network learning using localized generalization error bound. Inf Sci 179:3199–3217MATHCrossRef Yeung DS, Chan PPK, Ng WWY (2009) Radial basis function network learning using localized generalization error bound. Inf Sci 179:3199–3217MATHCrossRef
19.
Zurück zum Zitat Yeung DS, Wang D, Ng WWY, Tsang ECC, Wang X (2007) Structured large margin machines: sensitive to data distributions. Mach Learn 68(2):171–200CrossRef Yeung DS, Wang D, Ng WWY, Tsang ECC, Wang X (2007) Structured large margin machines: sensitive to data distributions. Mach Learn 68(2):171–200CrossRef
20.
Zurück zum Zitat Duda RO, Hart RE, Stock DG (2001) Pattern classification, 2nd edn. Wiley, New YorkMATH Duda RO, Hart RE, Stock DG (2001) Pattern classification, 2nd edn. Wiley, New YorkMATH
21.
Zurück zum Zitat Bezdek JC (1981) Pattern recognition with fuzzy objective function algorithms. Plenum Press, New YorkMATH Bezdek JC (1981) Pattern recognition with fuzzy objective function algorithms. Plenum Press, New YorkMATH
23.
Zurück zum Zitat Castillo PA, Merelo JJ, Arenas MG, Romero G (2007) Comparing evolutionary hybrid systems for design and optimization of multilayer perceptron structure along training parameters. Inf Sci 177(14):2884–2905CrossRef Castillo PA, Merelo JJ, Arenas MG, Romero G (2007) Comparing evolutionary hybrid systems for design and optimization of multilayer perceptron structure along training parameters. Inf Sci 177(14):2884–2905CrossRef
24.
Zurück zum Zitat Gao D, Ji Y (2005) Classification methodologies of multilayer perceptrons with sigmoid activation functions. Pattern Recognit 38(10):1469–1482 Gao D, Ji Y (2005) Classification methodologies of multilayer perceptrons with sigmoid activation functions. Pattern Recognit 38(10):1469–1482
25.
Zurück zum Zitat Kiernan L, Mason JD, Warwick K (1996) Robust initialization of Gaussian radial basis function networks using partitioned k-means clustering. Electron Lett 32(7): 671–673 Kiernan L, Mason JD, Warwick K (1996) Robust initialization of Gaussian radial basis function networks using partitioned k-means clustering. Electron Lett 32(7): 671–673
26.
Zurück zum Zitat Bruzzone L, Prieto DF (1999) A technique for the selection of kernel-function parameters in RBF neural networks for classification of remote-sensing images. IEEE Trans Vol Geosci Remote Sensing 37(2):1179–1184CrossRef Bruzzone L, Prieto DF (1999) A technique for the selection of kernel-function parameters in RBF neural networks for classification of remote-sensing images. IEEE Trans Vol Geosci Remote Sensing 37(2):1179–1184CrossRef
27.
Zurück zum Zitat Jeffreys H, Jeffreys BS (1988) Methods of mathematical physics, 3rd edn. Cambridge University Press, Cambridge Jeffreys H, Jeffreys BS (1988) Methods of mathematical physics, 3rd edn. Cambridge University Press, Cambridge
28.
Zurück zum Zitat Chen TP, Chen H (1995) Approximation capability to functions of several variables nonlinear functionals and operators by radial basis function neural networks. IEEE Trans Neural Netw 6(4):904–910CrossRef Chen TP, Chen H (1995) Approximation capability to functions of several variables nonlinear functionals and operators by radial basis function neural networks. IEEE Trans Neural Netw 6(4):904–910CrossRef
29.
Zurück zum Zitat Rudin W (1987) Real and complex analysis, 3rd edn. McGraw-Hill, Inc., New YorkMATH Rudin W (1987) Real and complex analysis, 3rd edn. McGraw-Hill, Inc., New YorkMATH
31.
Zurück zum Zitat Draghici S (2002) On the capabilities of neural networks using limited precision weights. Neural Netw 15:395–414CrossRef Draghici S (2002) On the capabilities of neural networks using limited precision weights. Neural Netw 15:395–414CrossRef
32.
33.
Zurück zum Zitat Huang GB, Babri HA (1998) Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans Neural Netw 9(1):224–229CrossRef Huang GB, Babri HA (1998) Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans Neural Netw 9(1):224–229CrossRef
34.
Zurück zum Zitat Teoh EJ, Xiang C, Tan KC (2006) Estimating the number of hidden neurons in a feedforward network using the singular value decomposition. LNCS 3971. Springer, Berlin, pp 858–865 Teoh EJ, Xiang C, Tan KC (2006) Estimating the number of hidden neurons in a feedforward network using the singular value decomposition. LNCS 3971. Springer, Berlin, pp 858–865
35.
Zurück zum Zitat Trenn S (2008) Multilayer perceptrons: approximation order and necessary number o hidden units. IEEE Trans Neural Netw 19(5):836–844CrossRef Trenn S (2008) Multilayer perceptrons: approximation order and necessary number o hidden units. IEEE Trans Neural Netw 19(5):836–844CrossRef
36.
Zurück zum Zitat Mehrabi S, Maghsoudloo M, Arabalibeik H et al (2009) Application of multilayer perceptron and radial basis function neural networks in differentiation between chronic obstructive pulmonary and congestive heart failure diseases. Expert Syst Appl 36:6956–6959CrossRef Mehrabi S, Maghsoudloo M, Arabalibeik H et al (2009) Application of multilayer perceptron and radial basis function neural networks in differentiation between chronic obstructive pulmonary and congestive heart failure diseases. Expert Syst Appl 36:6956–6959CrossRef
37.
Zurück zum Zitat Bartlett PL (1998) The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Trans Inf Theory 44(2):525–536MathSciNetMATHCrossRef Bartlett PL (1998) The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Trans Inf Theory 44(2):525–536MathSciNetMATHCrossRef
38.
Zurück zum Zitat Bishop CM, Nabney I (2004) Netlab neural network software. Neural computing research group, Information engineering, Aston University Bishop CM, Nabney I (2004) Netlab neural network software. Neural computing research group, Information engineering, Aston University
39.
Zurück zum Zitat Moody TJ, Darken CJ (1988) Learning with localized receptive fields. In: Hinton G, Sejnowski T, and Touretzsky D (eds) Proceedings of the 1988 connectionist models summer school. Morgan Kaufmann, pp 133–143 Moody TJ, Darken CJ (1988) Learning with localized receptive fields. In: Hinton G, Sejnowski T, and Touretzsky D (eds) Proceedings of the 1988 connectionist models summer school. Morgan Kaufmann, pp 133–143
40.
Metadaten
Titel
Plane-Gaussian artificial neural network
verfasst von
Xubing Yang
Songcan Chen
Bin Chen
Publikationsdatum
01.03.2012
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 2/2012
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-011-0546-1

Weitere Artikel der Ausgabe 2/2012

Neural Computing and Applications 2/2012 Zur Ausgabe

Premium Partner