Skip to main content
Erschienen in: Neural Computing and Applications 8/2019

30.12.2017 | Original Article

Neo-fuzzy neuron learning using backfitting algorithm

verfasst von: Jérôme Mendes, Francisco Souza, Rui Araújo, Saeid Rastegar

Erschienen in: Neural Computing and Applications | Ausgabe 8/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes an automatic and simple approach to design a neo-fuzzy neuron for identification purposes. The proposed approach uses the backfitting algorithm to learn multiple univariate additive models, where each additive model is a zero-order T-S fuzzy system which is a function of one input variable, and there is one additive model for each input variable. The multiple zero-order T-S fuzzy models constitute a neo-fuzzy neuron. The structure of the model used in this paper allows to have results with good interpretability and accuracy. To validate and demonstrate the performance and effectiveness of the proposed approach, it is applied on 10 benchmark data sets and compared with the extreme learning machine (ELM), support vector regression (SVR) algorithms, and two algorithms for design neo-fuzzy neuron systems, an adaptive learning algorithm for a neo-fuzzy neuron systems (ALNFN), and a fuzzy Kolmogorov’s network (FKN). A statistical paired t test analysis is also presented to compare the proposed approach with ELM, SVR, ALNFN, and FKN with the aim to see whether the results of the proposed approach are statistically different from ELM, SVR, ALNFN, and FKN. The results indicate that the proposed approach outperforms ELM and FKN in all data sets and outperforms SVR and ALNFN in almost all data sets that they were statistically different in almost all data sets and that in most data sets the number of fuzzy rules selected by cross-validation was small obtaining a model with a small complexity and good interpretability capability.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bodyanskiy Y, Kokshenev I, Kolodyazhniy V (2003) An adaptive learning algorithm for a neo-fuzzy neuron. In: Proceedings of the 3rd conference of the European society for fuzzy logic and technology (EUSFLAT 2003), pp 375–379 Bodyanskiy Y, Kokshenev I, Kolodyazhniy V (2003) An adaptive learning algorithm for a neo-fuzzy neuron. In: Proceedings of the 3rd conference of the European society for fuzzy logic and technology (EUSFLAT 2003), pp 375–379
2.
Zurück zum Zitat Bodyanskiy Y, Tyshchenko O, Kopaliani D (2015) A hybrid cascade neural network with an optimized pool in each cascade. Soft Comput 19(12):3445–3454CrossRef Bodyanskiy Y, Tyshchenko O, Kopaliani D (2015) A hybrid cascade neural network with an optimized pool in each cascade. Soft Comput 19(12):3445–3454CrossRef
3.
Zurück zum Zitat Bodyanskiy YV, Tyshchenko OK, Kopaliani DS (2016) Adaptive learning of an evolving cascade neo-fuzzy system in data stream mining tasks. Evolv Syst 7(2):107–116CrossRef Bodyanskiy YV, Tyshchenko OK, Kopaliani DS (2016) Adaptive learning of an evolving cascade neo-fuzzy system in data stream mining tasks. Evolv Syst 7(2):107–116CrossRef
4.
Zurück zum Zitat Box GEP, Jenkins G (1970) Time series analysis, forecasting and control. Holden-Day Inc., San FranciscoMATH Box GEP, Jenkins G (1970) Time series analysis, forecasting and control. Holden-Day Inc., San FranciscoMATH
6.
Zurück zum Zitat Cordón O (2011) A historical review of evolutionary learning methods for Mamdani-type fuzzy rule-based systems: designing interpretable genetic fuzzy systems. Int J Approx Reason 52(6):894–913CrossRef Cordón O (2011) A historical review of evolutionary learning methods for Mamdani-type fuzzy rule-based systems: designing interpretable genetic fuzzy systems. Int J Approx Reason 52(6):894–913CrossRef
7.
Zurück zum Zitat de Jesús Rubio J (2016) Least square neural network model of the crude oil blending process. Neural Netw 78:88–96 MATHCrossRef de Jesús Rubio J (2016) Least square neural network model of the crude oil blending process. Neural Netw 78:88–96 MATHCrossRef
8.
Zurück zum Zitat de Jesús Rubio J (2017) USNFIS: uniform stable neuro fuzzy inference system. Neurocomputing 262:57–66CrossRef de Jesús Rubio J (2017) USNFIS: uniform stable neuro fuzzy inference system. Neurocomputing 262:57–66CrossRef
9.
Zurück zum Zitat de Jesús Rubio J (2017) Stable Kalman filter and neural network for the chaotic systems identification. J Frankl Inst 354(16):7444–7462MathSciNetMATHCrossRef de Jesús Rubio J (2017) Stable Kalman filter and neural network for the chaotic systems identification. J Frankl Inst 354(16):7444–7462MathSciNetMATHCrossRef
10.
Zurück zum Zitat de Jesús Rubio J, Elias I, Cruz DR, Pacheco J (2017) Uniform stable radial basis function neural network for the prediction in two mechatronic processes. Neurocomputing 227:122–130CrossRef de Jesús Rubio J, Elias I, Cruz DR, Pacheco J (2017) Uniform stable radial basis function neural network for the prediction in two mechatronic processes. Neurocomputing 227:122–130CrossRef
12.
Zurück zum Zitat Herrera F, Lozano M, Verdegay JL (1995) Tuning fuzzy logic controllers by genetic algorithms. Int J Approx Reason 12(3–4):299–315MathSciNetMATHCrossRef Herrera F, Lozano M, Verdegay JL (1995) Tuning fuzzy logic controllers by genetic algorithms. Int J Approx Reason 12(3–4):299–315MathSciNetMATHCrossRef
13.
Zurück zum Zitat Hu Z, Bodyanskiy YV, Tyshchenko OK, Boiko OO (2016) Adaptive forecasting of non-stationary nonlinear time series based on the evolving weighted neuro-neo-fuzzy-ANARX-model. Int J Inf Technol Comput Sci (IJITCS) 8(10):1–10 Hu Z, Bodyanskiy YV, Tyshchenko OK, Boiko OO (2016) Adaptive forecasting of non-stationary nonlinear time series based on the evolving weighted neuro-neo-fuzzy-ANARX-model. Int J Inf Technol Comput Sci (IJITCS) 8(10):1–10
14.
Zurück zum Zitat Hu Z, Bodyanskiy YV, Tyshchenko OK, Boiko OO (2016) An evolving cascade system based on a set of neo-fuzzy nodes. Int J Intell Syst Appl (IJISA) 8(9):1–7 Hu Z, Bodyanskiy YV, Tyshchenko OK, Boiko OO (2016) An evolving cascade system based on a set of neo-fuzzy nodes. Int J Intell Syst Appl (IJISA) 8(9):1–7
15.
Zurück zum Zitat Huang GB, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122CrossRef Huang GB, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122CrossRef
16.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501 Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501
17.
Zurück zum Zitat Kolodyazhniy V, Bodyanskiy Y, Otto P (2005) Universal approximator employing neo-fuzzy neurons. In: Reusch B (ed) Computational intelligence, theory and applications, advances in soft computing, vol 33. Springer, Berlin, pp 631–640CrossRef Kolodyazhniy V, Bodyanskiy Y, Otto P (2005) Universal approximator employing neo-fuzzy neurons. In: Reusch B (ed) Computational intelligence, theory and applications, advances in soft computing, vol 33. Springer, Berlin, pp 631–640CrossRef
18.
Zurück zum Zitat Kosko B (1994) Fuzzy systems as universal approximators. IEEE Trans Comput 43(11):1329–1333MATHCrossRef Kosko B (1994) Fuzzy systems as universal approximators. IEEE Trans Comput 43(11):1329–1333MATHCrossRef
19.
Zurück zum Zitat Lemos A, Caminhas W, Gomide F (2011) Fuzzy evolving linear regression trees. Evolv Syst 2(1):1–14CrossRef Lemos A, Caminhas W, Gomide F (2011) Fuzzy evolving linear regression trees. Evolv Syst 2(1):1–14CrossRef
21.
Zurück zum Zitat Mendes J, Araújo R, Souza F (2013) Adaptive fuzzy identification and predictive control for industrial processes. Expert Syst Appl 40(17):6964–6975CrossRef Mendes J, Araújo R, Souza F (2013) Adaptive fuzzy identification and predictive control for industrial processes. Expert Syst Appl 40(17):6964–6975CrossRef
22.
Zurück zum Zitat Mendes J, Souza F, Araújo R, Gonçalves N (2012) Genetic fuzzy system for data-driven soft sensors design. Appl Soft Comput 12(10):3237–3245CrossRef Mendes J, Souza F, Araújo R, Gonçalves N (2012) Genetic fuzzy system for data-driven soft sensors design. Appl Soft Comput 12(10):3237–3245CrossRef
23.
Zurück zum Zitat Miki T, Yamakawa T (1999) Analog implementation of neo-fuzzy neuron and its on-board learning. In: Mastorakis N E (ed) Computational Intelligence and Applications. WSES Press, Piraeus, Greece. pp 144–149 Miki T, Yamakawa T (1999) Analog implementation of neo-fuzzy neuron and its on-board learning. In: Mastorakis N E (ed) Computational Intelligence and Applications. WSES Press, Piraeus, Greece. pp 144–149
24.
Zurück zum Zitat Precup RE, Hellendoorn H (2011) A survey on industrial applications of fuzzy control. Comput Ind 62(3):213–226CrossRef Precup RE, Hellendoorn H (2011) A survey on industrial applications of fuzzy control. Comput Ind 62(3):213–226CrossRef
25.
Zurück zum Zitat Rastegar S, Araújo R, Mendes J (2016) A new approach for online t-s fuzzy identification and model predictive control of nonlinear systems. J Vib Control 22(7):1820–1837MathSciNetCrossRef Rastegar S, Araújo R, Mendes J (2016) A new approach for online t-s fuzzy identification and model predictive control of nonlinear systems. J Vib Control 22(7):1820–1837MathSciNetCrossRef
26.
Zurück zum Zitat Silva AM, Caminhas W, Lemos A, Gomide F (2014) A fast learning algorithm for evolving neo-fuzzy neuron. Appl Soft Comput 14(Part B):194–209CrossRef Silva AM, Caminhas W, Lemos A, Gomide F (2014) A fast learning algorithm for evolving neo-fuzzy neuron. Appl Soft Comput 14(Part B):194–209CrossRef
27.
28.
Zurück zum Zitat Souza FA, Araújo R, Mendes J (2016) Review of soft sensor methods for regression applications. Chemom Intell Lab Syst 152:69–79CrossRef Souza FA, Araújo R, Mendes J (2016) Review of soft sensor methods for regression applications. Chemom Intell Lab Syst 152:69–79CrossRef
29.
Zurück zum Zitat Takagi T, Sugeno M (1985) Fuzzy identification of systems and its applications to modeling and control. IEEE Trans Syst Man Cybern 15(1):116–132MATHCrossRef Takagi T, Sugeno M (1985) Fuzzy identification of systems and its applications to modeling and control. IEEE Trans Syst Man Cybern 15(1):116–132MATHCrossRef
31.
Zurück zum Zitat Uchino E, Yamakawa T (1997) Soft computing based signal prediction, restoration, and filtering. In: Ruan D (ed) Intelligent hybrid systems: fuzzy logic, neural networks, and genetic algorithms. Kluwer Academic Publishers, Boston, pp 331–351CrossRef Uchino E, Yamakawa T (1997) Soft computing based signal prediction, restoration, and filtering. In: Ruan D (ed) Intelligent hybrid systems: fuzzy logic, neural networks, and genetic algorithms. Kluwer Academic Publishers, Boston, pp 331–351CrossRef
32.
33.
Zurück zum Zitat Wang LX (1997) A course in fuzzy systems and control. Prentice-Hall Inc., Upper Saddle RiverMATH Wang LX (1997) A course in fuzzy systems and control. Prentice-Hall Inc., Upper Saddle RiverMATH
34.
Zurück zum Zitat Wang LX, Mendel J (1992) Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans Neural Netw 3(5):807–814CrossRef Wang LX, Mendel J (1992) Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans Neural Netw 3(5):807–814CrossRef
35.
Zurück zum Zitat Xu S, Wang J (2016) A fast incremental extreme learning machine algorithm for data streams classification. Expert Syst Appl 65:332–344CrossRef Xu S, Wang J (2016) A fast incremental extreme learning machine algorithm for data streams classification. Expert Syst Appl 65:332–344CrossRef
36.
Zurück zum Zitat Yamakawa T, Uchino E, Miki T, Kusanag H (1992) A neo-fuzzy neuron and its applications to system identification and prediction of the system behavior. In: Proceedings of the 2nd international conference on fuzzy logic and neural networks. Iizuka, pp 477–483 Yamakawa T, Uchino E, Miki T, Kusanag H (1992) A neo-fuzzy neuron and its applications to system identification and prediction of the system behavior. In: Proceedings of the 2nd international conference on fuzzy logic and neural networks. Iizuka, pp 477–483
37.
Zurück zum Zitat Ying H (1997) General Miso Takagi-Sugeno fuzzy systems with simplified linear rule consequent as universal approximators for control and modeling applications. In: IEEE international conference on systems, man, and cybernetics. Computational cybernetics and simulation, vol 2, pp 1335–1340 Ying H (1997) General Miso Takagi-Sugeno fuzzy systems with simplified linear rule consequent as universal approximators for control and modeling applications. In: IEEE international conference on systems, man, and cybernetics. Computational cybernetics and simulation, vol 2, pp 1335–1340
Metadaten
Titel
Neo-fuzzy neuron learning using backfitting algorithm
verfasst von
Jérôme Mendes
Francisco Souza
Rui Araújo
Saeid Rastegar
Publikationsdatum
30.12.2017
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 8/2019
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-017-3301-4

Weitere Artikel der Ausgabe 8/2019

Neural Computing and Applications 8/2019 Zur Ausgabe