Skip to main content
Erschienen in: Neural Processing Letters 1/2017

24.02.2016

Hyperconic Multilayer Perceptron

verfasst von: Juan Pablo Serrano-Rubio, Arturo Hernández-Aguirre, Rafael Herrera-Guzmán

Erschienen in: Neural Processing Letters | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper introduces the design of the hyperconic multilayer perceptron (HC-MLP). Complex non-linear decision regions for classification purposes are generated by quadratic hyper-surfaces spawned by the hyperconic neurons in the hidden layer (for instance, spheres, ellipsoids, paraboloids, hyperboloids and degenerate conics). In order to generate quadratic hyper-surfaces, the hyperconic neurons’ transfer function includes the estimation of a quadratic polynomial. The proper assignment of decision regions to classes is achieved in the output layer by using spheres to determine whether a point is inside or outside the spherical region. The particle swarm optimization algorithm is used for training the HC-MLP. The learning of the HC-MLP selects the best conic surface that separates the data set vectors. For illustration purposes, two experiments are conducted using two distributions of synthetic data in order to show the advantages of HC-MLP when the patterns between classes are contiguous. Furthermore a comparison to the traditional multilayer perceptron is carried out to evaluate the complexity (in terms of the number of estimated patterns) and classification accuracy. HC-MLP is the principal component to implement a diagnosis system to detect faults in an induction motor and to implement an image segmentation system. The performance of HC-MLP is compared to other leading algorithms by using 4 databases commonly used in related literature.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Arena P, Fortuna L, Occhipinti L, Xibilia M (1994) Neural networks for quaternion-valued function approximation. In: 1994 IEEE international symposium on circuits and systems, 1994. ISCAS ’94, vol 6, pp 307–310 Arena P, Fortuna L, Occhipinti L, Xibilia M (1994) Neural networks for quaternion-valued function approximation. In: 1994 IEEE international symposium on circuits and systems, 1994. ISCAS ’94, vol 6, pp 307–310
3.
5.
Zurück zum Zitat Bishop CM (2006) Pattern recognition and machine learning (information science and statistics). Springer, Secaucus, NJMATH Bishop CM (2006) Pattern recognition and machine learning (information science and statistics). Springer, Secaucus, NJMATH
6.
Zurück zum Zitat Blake A, Rother C, Brown M, Perez P, Torr P (2004) Interactive image segmentation using an adaptive gmmrf model. In: Computer vision-ECCV 2004, pp 428–441. Springer, Berlin Blake A, Rother C, Brown M, Perez P, Torr P (2004) Interactive image segmentation using an adaptive gmmrf model. In: Computer vision-ECCV 2004, pp 428–441. Springer, Berlin
7.
Zurück zum Zitat Bookstein FL (1979) Fitting conic sections to scattered data. Comput Gr Image Process 9(1):56–71CrossRef Bookstein FL (1979) Fitting conic sections to scattered data. Comput Gr Image Process 9(1):56–71CrossRef
8.
Zurück zum Zitat Buchholz S, Sommer G (2000) A hyperbolic multilayer perceptron. In: Proceedings of the IEEE-INNS-ENNS international joint conference on neural networks, 2000. IJCNN 2000, vol 2, pp 129–133 Buchholz S, Sommer G (2000) A hyperbolic multilayer perceptron. In: Proceedings of the IEEE-INNS-ENNS international joint conference on neural networks, 2000. IJCNN 2000, vol 2, pp 129–133
9.
Zurück zum Zitat Cantu-Paz E, Kamath C (2005) An empirical comparison of combinations of evolutionary algorithms and neural networks for classification problems. IEEE Trans Syst Man Cybern B Cyber 35(5):915–927CrossRef Cantu-Paz E, Kamath C (2005) An empirical comparison of combinations of evolutionary algorithms and neural networks for classification problems. IEEE Trans Syst Man Cybern B Cyber 35(5):915–927CrossRef
10.
Zurück zum Zitat Carvalho M, Ludermir T (2007) Particle swarm optimization of neural network architectures and weights. In: 7th international conference on hybrid intelligent systems, 2007. HIS 2007. pp 336–339 Carvalho M, Ludermir T (2007) Particle swarm optimization of neural network architectures and weights. In: 7th international conference on hybrid intelligent systems, 2007. HIS 2007. pp 336–339
11.
Zurück zum Zitat Casasent DP, Barnard E (1990) Adaptive-clustering optical neural net. Appl Opt 29(17):2603–2615CrossRef Casasent DP, Barnard E (1990) Adaptive-clustering optical neural net. Appl Opt 29(17):2603–2615CrossRef
12.
Zurück zum Zitat Casasent D, Natarajan S (1995) A classifier neural net with complex-valued weights and square-law nonlinearities. Neural Netw 8(6):989–998CrossRef Casasent D, Natarajan S (1995) A classifier neural net with complex-valued weights and square-law nonlinearities. Neural Netw 8(6):989–998CrossRef
13.
Zurück zum Zitat Cheng H, Jiang X, Sun Y, Wang J (2001) Color image segmentation: advances and prospects. Pattern Recognit 34(12):2259–2281CrossRefMATH Cheng H, Jiang X, Sun Y, Wang J (2001) Color image segmentation: advances and prospects. Pattern Recognit 34(12):2259–2281CrossRefMATH
14.
Zurück zum Zitat Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of the sixth international symposium on micro machine and human science, 1995. MHS ’95. pp 39–43 Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of the sixth international symposium on micro machine and human science, 1995. MHS ’95. pp 39–43
15.
Zurück zum Zitat Engelbrecht AP (2006) Fundamentals of computational swarm intelligence. Wiley, New York Engelbrecht AP (2006) Fundamentals of computational swarm intelligence. Wiley, New York
16.
Zurück zum Zitat Garro B, Sossa H, Vzquez R (2011) Back-propagation vs particle swarm optimization algorithm: which algorithm is better to adjust the synaptic weights of a feed-forward ann? Int J Artif Intel 7(11A):208–218 Garro B, Sossa H, Vzquez R (2011) Back-propagation vs particle swarm optimization algorithm: which algorithm is better to adjust the synaptic weights of a feed-forward ann? Int J Artif Intel 7(11A):208–218
17.
Zurück zum Zitat Georgiou G, Koutsougeras C (1992) Complex domain backpropagation. IEEE Trans Circuits Syst II Analog Digit Sig Process 39(5):330–334CrossRefMATH Georgiou G, Koutsougeras C (1992) Complex domain backpropagation. IEEE Trans Circuits Syst II Analog Digit Sig Process 39(5):330–334CrossRefMATH
18.
Zurück zum Zitat Hernandez-Lopez FJ, Rivera M (2014) Change detection by probabilistic segmentation from monocular view. Mach Vis Appl 25(5):1175–1195CrossRef Hernandez-Lopez FJ, Rivera M (2014) Change detection by probabilistic segmentation from monocular view. Mach Vis Appl 25(5):1175–1195CrossRef
19.
Zurück zum Zitat Hong ZQ, Yang JY (1991) Optimal discriminant plane for a small number of samples and design method of classifier on the plane. Pattern Recognit 24(4):317–324MathSciNetCrossRef Hong ZQ, Yang JY (1991) Optimal discriminant plane for a small number of samples and design method of classifier on the plane. Pattern Recognit 24(4):317–324MathSciNetCrossRef
20.
Zurück zum Zitat Kiranyaz S, Ince T, Yildirim A, Gabbouj M (2009) Evolutionary artificial neural networks by multi-dimensional particle swarm optimization. Neural Netw 22(10):1448–1462CrossRef Kiranyaz S, Ince T, Yildirim A, Gabbouj M (2009) Evolutionary artificial neural networks by multi-dimensional particle swarm optimization. Neural Netw 22(10):1448–1462CrossRef
21.
Zurück zum Zitat Lin S, Zeng J, Xu Z (2015) Error estimate for spherical neural networks interpolation. Neural Process Lett 42(2):369–379CrossRef Lin S, Zeng J, Xu Z (2015) Error estimate for spherical neural networks interpolation. Neural Process Lett 42(2):369–379CrossRef
22.
Zurück zum Zitat Lipson H, Siegelmann HT (2000) Clustering irregular shapes using high-order neurons. Neural Comput 12(10):2331–2353CrossRef Lipson H, Siegelmann HT (2000) Clustering irregular shapes using high-order neurons. Neural Comput 12(10):2331–2353CrossRef
23.
Zurück zum Zitat Liu R, Sun X, Jiao L (2010) Particle swarm optimization based clustering: a comparison of different cluster validity indices. In: Li K, Li X, Ma S, Irwin G (eds) Life system modeling and intelligent computing, communications in computer and information science, vol 98. Springer, Berlin, pp 66–72 Liu R, Sun X, Jiao L (2010) Particle swarm optimization based clustering: a comparison of different cluster validity indices. In: Li K, Li X, Ma S, Irwin G (eds) Life system modeling and intelligent computing, communications in computer and information science, vol 98. Springer, Berlin, pp 66–72
24.
Zurück zum Zitat Lowe D, Broomhead D (1988) Multivariable functional interpolation and adaptive networks. Complex Syst 2:321–355MathSciNetMATH Lowe D, Broomhead D (1988) Multivariable functional interpolation and adaptive networks. Complex Syst 2:321–355MathSciNetMATH
25.
Zurück zum Zitat Mabu S, Obayashi M, Kuremoto T (2015) Ensemble learning of rule-based evolutionary algorithm using multi-layer perceptron for supporting decisions in stock trading problems. Appl Soft Comput 36:357–367CrossRef Mabu S, Obayashi M, Kuremoto T (2015) Ensemble learning of rule-based evolutionary algorithm using multi-layer perceptron for supporting decisions in stock trading problems. Appl Soft Comput 36:357–367CrossRef
26.
Zurück zum Zitat Minsky M (1969) Perceptrons. MIT Press, Cambridge, MAMATH Minsky M (1969) Perceptrons. MIT Press, Cambridge, MAMATH
27.
Zurück zum Zitat Misra BB, Satapathy SC, Biswal B, Dash P, Panda G (2006) Pattern classification using polynomial neural network. In: 2006 IEEE conference on cybernetics and intelligent systems, pp 1–6 Misra BB, Satapathy SC, Biswal B, Dash P, Panda G (2006) Pattern classification using polynomial neural network. In: 2006 IEEE conference on cybernetics and intelligent systems, pp 1–6
28.
Zurück zum Zitat Misra B, Satapathy S, Biswal B, Dash P, Panda G (2006) Pattern classification using polynomial neural network. In: 2006 IEEE conference on cybernetics and intelligent systems, pp 1–6. IEEE Misra B, Satapathy S, Biswal B, Dash P, Panda G (2006) Pattern classification using polynomial neural network. In: 2006 IEEE conference on cybernetics and intelligent systems, pp 1–6. IEEE
29.
Zurück zum Zitat Natarajan SS, Casasent DP (1993) Piecewise quadratic optical neural network. In: San Diego’92, pp 142–147. International Society for Optics and Photonics Natarajan SS, Casasent DP (1993) Piecewise quadratic optical neural network. In: San Diego’92, pp 142–147. International Society for Optics and Photonics
30.
Zurück zum Zitat Nejjari H, Benbouzid M (1999) Monitoring and diagnosis of induction motors electrical faults using a current park’s vector pattern learning approach. In: International conference IEMD ’99 electric machines and drives, 1999, pp 275–277 Nejjari H, Benbouzid M (1999) Monitoring and diagnosis of induction motors electrical faults using a current park’s vector pattern learning approach. In: International conference IEMD ’99 electric machines and drives, 1999, pp 275–277
31.
Zurück zum Zitat Nitta T, Buchholz S (2008) On the decision boundaries of hyperbolic neurons. In: IEEE international joint conference on neural networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence), pp 2974–2980 Nitta T, Buchholz S (2008) On the decision boundaries of hyperbolic neurons. In: IEEE international joint conference on neural networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence), pp 2974–2980
32.
Zurück zum Zitat Oh SK, Pedrycz W (2002) The design of self-organizing polynomial neural networks. Inf Sci 141(34):237–258CrossRefMATH Oh SK, Pedrycz W (2002) The design of self-organizing polynomial neural networks. Inf Sci 141(34):237–258CrossRefMATH
33.
Zurück zum Zitat Park H, Ozeki T, Amari Si (2005) Geometric approach to multilayer perceptrons. In: Handbook of geometric computing, pp 69–96. Springer, Berlin Park H, Ozeki T, Amari Si (2005) Geometric approach to multilayer perceptrons. In: Handbook of geometric computing, pp 69–96. Springer, Berlin
34.
Zurück zum Zitat Perwass C, Banarer V, Sommer G (2003) Spherical decision surfacesusing conformal modelling. In: Michaelis B, Krell G (eds) Pattern recognition. Lecture notes in computer science, vol 2781, pp 9–16. Springer, Berlin Perwass C, Banarer V, Sommer G (2003) Spherical decision surfacesusing conformal modelling. In: Michaelis B, Krell G (eds) Pattern recognition. Lecture notes in computer science, vol 2781, pp 9–16. Springer, Berlin
35.
Zurück zum Zitat Pillay P, Xu Z (1996) Motor current signature analysis. In: Industry applications conference, 1996. Thirty-first IAS annual meeting, IAS ’96., Conference record of the 1996 IEEE, vol 1, pp 587–594 Pillay P, Xu Z (1996) Motor current signature analysis. In: Industry applications conference, 1996. Thirty-first IAS annual meeting, IAS ’96., Conference record of the 1996 IEEE, vol 1, pp 587–594
36.
Zurück zum Zitat Prechelt L et al (1994) Proben1: a set of neural network benchmarkproblems and benchmarking rules. Fakultät für Informatik, Univ. Karlsruhe, Karlsruhe, Germany, Tech Rep 21:94 Prechelt L et al (1994) Proben1: a set of neural network benchmarkproblems and benchmarking rules. Fakultät für Informatik, Univ. Karlsruhe, Karlsruhe, Germany, Tech Rep 21:94
38.
Zurück zum Zitat Salinas-Gutiérrez R, Hernández-Aguirre A, Rivera-Meraz MJ, Villa-Diharce ER (2010) Supervised probabilistic classification based on gaussian copulas. In: Sidorov G, Hernández Aguirre A, Reyes García CA (eds) Advances in soft computing. Lecture notes in computer science, vol 6438, pp 104–115. Springer, Berlin Salinas-Gutiérrez R, Hernández-Aguirre A, Rivera-Meraz MJ, Villa-Diharce ER (2010) Supervised probabilistic classification based on gaussian copulas. In: Sidorov G, Hernández Aguirre A, Reyes García CA (eds) Advances in soft computing. Lecture notes in computer science, vol 6438, pp 104–115. Springer, Berlin
42.
Zurück zum Zitat Sexton RS, Dorsey RE (2000) Reliable classification using neural networks: a genetic algorithm and backpropagation comparison. Decis Support Syst 30(1):11–22CrossRef Sexton RS, Dorsey RE (2000) Reliable classification using neural networks: a genetic algorithm and backpropagation comparison. Decis Support Syst 30(1):11–22CrossRef
43.
Zurück zum Zitat Sossa, H., Garro, B., Villegas, J., Olague, G., Avils, C.: Evolutionary computation applied to the automatic design of artificial neural networks and associative memories. In: Schtze O, Coello Coello CA, Tantar AA, Tantar E, Bouvry P, Del Moral P, Legrand P (eds) Evolve—a bridge between probability, set oriented numerics, and evolutionary computation II. Advances in intelligent systems and computing, vol 175, pp 285–297. Springer, Berlin Sossa, H., Garro, B., Villegas, J., Olague, G., Avils, C.: Evolutionary computation applied to the automatic design of artificial neural networks and associative memories. In: Schtze O, Coello Coello CA, Tantar AA, Tantar E, Bouvry P, Del Moral P, Legrand P (eds) Evolve—a bridge between probability, set oriented numerics, and evolutionary computation II. Advances in intelligent systems and computing, vol 175, pp 285–297. Springer, Berlin
44.
Zurück zum Zitat Tablada L, Valena M (2012) Self-organizing polynomial neuralnetworks based on matrix inversion and differential evolution. In: Yin H, Costa J, Barreto G (eds) Intelligent data engineering andautomated learning—IDEAL 2012. Lecture notes in computer science, vol 7435, pp 399–406. Springer, Berlin Tablada L, Valena M (2012) Self-organizing polynomial neuralnetworks based on matrix inversion and differential evolution. In: Yin H, Costa J, Barreto G (eds) Intelligent data engineering andautomated learning—IDEAL 2012. Lecture notes in computer science, vol 7435, pp 399–406. Springer, Berlin
45.
Zurück zum Zitat Taylor BJ (2005) Methods and procedures for the verification and validation of artificial neural networks. Springer, Secaucus, NJ Taylor BJ (2005) Methods and procedures for the verification and validation of artificial neural networks. Springer, Secaucus, NJ
46.
Zurück zum Zitat Thomson W, Fenger M (2001) Current signature analysis to detect induction motor faults. IEEE Ind Appl Mag 7(4):26–34CrossRef Thomson W, Fenger M (2001) Current signature analysis to detect induction motor faults. IEEE Ind Appl Mag 7(4):26–34CrossRef
47.
52.
53.
Zurück zum Zitat Weber DM, Casasent DP (1998) The extended piecewise quadratic neural network. Neural Netw 11(5):837–850CrossRef Weber DM, Casasent DP (1998) The extended piecewise quadratic neural network. Neural Netw 11(5):837–850CrossRef
54.
Zurück zum Zitat Yao X, Liu Y (1997) A new evolutionary system for evolving artificial neural networks. IEEE Trans Neural Netw 8(3):694–713CrossRef Yao X, Liu Y (1997) A new evolutionary system for evolving artificial neural networks. IEEE Trans Neural Netw 8(3):694–713CrossRef
55.
Zurück zum Zitat Yu J, Xi L, Wang S (2007) An improved particle swarm optimization for evolving feedforward artificial neural networks. Neural Process Lett 26(3):217–231CrossRef Yu J, Xi L, Wang S (2007) An improved particle swarm optimization for evolving feedforward artificial neural networks. Neural Process Lett 26(3):217–231CrossRef
56.
Zurück zum Zitat Zhang C, Shao H (2000) An ann’s evolved by a new evolutionary system and its application. In: Proceedings of the 39th IEEE conference on decision and control, 2000, vol 4, pp 3562–3563 Zhang C, Shao H (2000) An ann’s evolved by a new evolutionary system and its application. In: Proceedings of the 39th IEEE conference on decision and control, 2000, vol 4, pp 3562–3563
Metadaten
Titel
Hyperconic Multilayer Perceptron
verfasst von
Juan Pablo Serrano-Rubio
Arturo Hernández-Aguirre
Rafael Herrera-Guzmán
Publikationsdatum
24.02.2016
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 1/2017
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-016-9505-2

Weitere Artikel der Ausgabe 1/2017

Neural Processing Letters 1/2017 Zur Ausgabe

Neuer Inhalt