Skip to main content
Top
Published in: Soft Computing 11/2009

01-09-2009 | Original Paper

Self-spawning neuro-fuzzy system for rule extraction

Authors: Zhi-Qiang Liu, Tao Guan, Ya-Jun Zhang

Published in: Soft Computing | Issue 11/2009

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper we propose self-spawning neuro-fuzzy system (SSNFS), a new neuro-fuzzy system to derive fuzzy rules from data. The SSNFS model is based on a generic definition of incremental perceptron and a new learning algorithm that is capable of both structural (rule) learning and parametric learning. It constructs the fuzzy system by detecting a suitable number of rule patches and their positions and shapes in the input space. Initially the rule base consists of one single fuzzy rule; during the iterative learning process the rule base expands according to a supervised spawning validity measure. The rule induction process terminates when a given stop criterion is satisfied. SSNFS is very general since it does not require the prior knowledge about the input space and can be used in any application based on the scatter-partitioning fuzzy system. To demonstrate the effectiveness and applicability of our algorithm, we present a synthetic example and real-world modelling problems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Footnotes
1
The Iris data was obtained from http://​www.​ics.​uci.​edu/​mlearn/​MLRepository.​html via a free, public ftp site.
 
Literature
go back to reference Pomares H, Rojas I, Ortega J, Gonzalez J, and Prieto A (2000) A systematic approach to a self-generating fuzzy rule-table for function approximation. IEEE Trans Syst Man Cybern Part B Cybern 30(3):431–447CrossRef Pomares H, Rojas I, Ortega J, Gonzalez J, and Prieto A (2000) A systematic approach to a self-generating fuzzy rule-table for function approximation. IEEE Trans Syst Man Cybern Part B Cybern 30(3):431–447CrossRef
go back to reference Chen W, Saif M (2005) A novel fuzzy system with dynamic rule base. IEEE Trans Fuzzy Syst 13(5):569–582CrossRef Chen W, Saif M (2005) A novel fuzzy system with dynamic rule base. IEEE Trans Fuzzy Syst 13(5):569–582CrossRef
go back to reference Boukezzoula R, Foulloy L, Galichet S (2006) Inverse controller design for fuzzy interval systems. IEEE Trans Fuzzy Syst 14(1):569–582CrossRef Boukezzoula R, Foulloy L, Galichet S (2006) Inverse controller design for fuzzy interval systems. IEEE Trans Fuzzy Syst 14(1):569–582CrossRef
go back to reference Pal SK, Mitra S (1992) Multi-layer perceptron, fuzzy sets and classification. IEEE Trans Neural Netw 3(5):683–697CrossRef Pal SK, Mitra S (1992) Multi-layer perceptron, fuzzy sets and classification. IEEE Trans Neural Netw 3(5):683–697CrossRef
go back to reference Kandel A (1992) Fuzzy expert systems. CRC Press, Boca Raton Kandel A (1992) Fuzzy expert systems. CRC Press, Boca Raton
go back to reference Sugeno M (ed) (1985) Industrial applications of fuzzy control. Elsevier, New York Sugeno M (ed) (1985) Industrial applications of fuzzy control. Elsevier, New York
go back to reference Pedrycz W (1989) Fuzzy control and fuzzy systems. Wiley, New YorkMATH Pedrycz W (1989) Fuzzy control and fuzzy systems. Wiley, New YorkMATH
go back to reference Berenji HR, Khedkar P (1992) Learning and tuning fuzzy logic controllers through reinforcements. IEEE Trans Neural Netw 3(5):724–740CrossRef Berenji HR, Khedkar P (1992) Learning and tuning fuzzy logic controllers through reinforcements. IEEE Trans Neural Netw 3(5):724–740CrossRef
go back to reference Lin CT (1994) Neural fuzzy control systems with structure and parameter learning. World Scientific, Singpore Lin CT (1994) Neural fuzzy control systems with structure and parameter learning. World Scientific, Singpore
go back to reference Jouffe L (1998) Fuzzy inference system learning by reiforcement methods. IEEE Trans Syst Man Cybern Part C 28(3):338–355CrossRef Jouffe L (1998) Fuzzy inference system learning by reiforcement methods. IEEE Trans Syst Man Cybern Part C 28(3):338–355CrossRef
go back to reference Rojas I, Pomares H, Ortega J, Prieto A (2000) Self-organized fuzzy system generation from training examples. IEEE Trans Fuzzy Syst 8(1):23–36CrossRef Rojas I, Pomares H, Ortega J, Prieto A (2000) Self-organized fuzzy system generation from training examples. IEEE Trans Fuzzy Syst 8(1):23–36CrossRef
go back to reference Nie J, Linkens DA (1994) Fuzzy neural control: principles, algorithms, and applications. Prentice-Hall, Englewood Cliffs Nie J, Linkens DA (1994) Fuzzy neural control: principles, algorithms, and applications. Prentice-Hall, Englewood Cliffs
go back to reference Uncu ö, Türkşen İB (2007) Discrete interval type 2 fuzzy system models using uncertainty in learning parameters. IEEE Trans Fuzzy Syst 15(1):90–106CrossRef Uncu ö, Türkşen İB (2007) Discrete interval type 2 fuzzy system models using uncertainty in learning parameters. IEEE Trans Fuzzy Syst 15(1):90–106CrossRef
go back to reference Duch W, Adamczak R, Grabczewski K (2001) A new methodology of extraction, optimization and application of crisp and fuzzy logical rules. IEEE Trans Neural Netw 12(2):277–306CrossRef Duch W, Adamczak R, Grabczewski K (2001) A new methodology of extraction, optimization and application of crisp and fuzzy logical rules. IEEE Trans Neural Netw 12(2):277–306CrossRef
go back to reference Duch W, Setiono R, Żurada JM (2004) Computational intelligence methods for rule-based data understanding. Proc IEEE 92(5):771–805CrossRef Duch W, Setiono R, Żurada JM (2004) Computational intelligence methods for rule-based data understanding. Proc IEEE 92(5):771–805CrossRef
go back to reference Setnes M (2000) Supervised fuzzy clustering for rule extraction. IEEE Trans Fuzzy Syst 8(4):416–424CrossRef Setnes M (2000) Supervised fuzzy clustering for rule extraction. IEEE Trans Fuzzy Syst 8(4):416–424CrossRef
go back to reference Pal NR, Eluri VK, Mandal GK (2002) Fuzzy logic approaches to structure preserving dimensionality reduction. IEEE Trans Fuzzy Syst 10(3):277–286CrossRef Pal NR, Eluri VK, Mandal GK (2002) Fuzzy logic approaches to structure preserving dimensionality reduction. IEEE Trans Fuzzy Syst 10(3):277–286CrossRef
go back to reference Mitra P, Murthy CA, Pal SK (2002) Density-based multiscale data condensation. IEEE Trans Pattern Anal Mach Intell 24(6):734–747CrossRef Mitra P, Murthy CA, Pal SK (2002) Density-based multiscale data condensation. IEEE Trans Pattern Anal Mach Intell 24(6):734–747CrossRef
go back to reference Cherkassky V, Mulier P (1998) Learning from data. Wiley, New YorkMATH Cherkassky V, Mulier P (1998) Learning from data. Wiley, New YorkMATH
go back to reference Lee MA, Takagi H (1993) Integrating design stages of fuzzy systems using genetic algorithms. In: Proceedings of FUZZY-IEEE/IFES’93, San Franciso, CA, pp 612–617 Lee MA, Takagi H (1993) Integrating design stages of fuzzy systems using genetic algorithms. In: Proceedings of FUZZY-IEEE/IFES’93, San Franciso, CA, pp 612–617
go back to reference Ishibuchi H, Nozaki K, Yamamoto N, Tanaka H (1995) Selecting fuzzy if-then rules for classification problems using genetic algorithms. IEEE Trans Fuzzy Syst 3(2):260–270CrossRef Ishibuchi H, Nozaki K, Yamamoto N, Tanaka H (1995) Selecting fuzzy if-then rules for classification problems using genetic algorithms. IEEE Trans Fuzzy Syst 3(2):260–270CrossRef
go back to reference Yager RR, Filev DP (1993) Unified structure and parameter identification of fuzzy models. IEEE Trans Syst Man Cybern 23(4):1198–1205CrossRef Yager RR, Filev DP (1993) Unified structure and parameter identification of fuzzy models. IEEE Trans Syst Man Cybern 23(4):1198–1205CrossRef
go back to reference Wang LX, Mendel JM (1992) Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans Neural Netw 3(5):807–813CrossRef Wang LX, Mendel JM (1992) Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans Neural Netw 3(5):807–813CrossRef
go back to reference Yen J, Wang L (1999) Simplifying fuzzy rule-based models using orthogonal transformation methods. IEEE Trans Syst Man Cybern Part B 29:13–24CrossRef Yen J, Wang L (1999) Simplifying fuzzy rule-based models using orthogonal transformation methods. IEEE Trans Syst Man Cybern Part B 29:13–24CrossRef
go back to reference Brown M, Harris C (1994) Neurofuzzy adaptive modeling and control. Prentice-Hall, Englewood Cliffs Brown M, Harris C (1994) Neurofuzzy adaptive modeling and control. Prentice-Hall, Englewood Cliffs
go back to reference Fritzke B (1997) Incremental neuro-fuzzy systems. In: Proceedings of application of soft computing, SPIE international symposium on optical science, engineering and instrumentation, San Diego Fritzke B (1997) Incremental neuro-fuzzy systems. In: Proceedings of application of soft computing, SPIE international symposium on optical science, engineering and instrumentation, San Diego
go back to reference Mitra S, Hayashi Y (2000) Neuro-fuzzy rule generation: survey in soft computing framework. IEEE Trans Neural Netw 11(3):748–768CrossRef Mitra S, Hayashi Y (2000) Neuro-fuzzy rule generation: survey in soft computing framework. IEEE Trans Neural Netw 11(3):748–768CrossRef
go back to reference Jang J-SR, Sun C-T (1995) Neuro-fuzzy modeling and control. Proc IEEE 83(3):378–406CrossRef Jang J-SR, Sun C-T (1995) Neuro-fuzzy modeling and control. Proc IEEE 83(3):378–406CrossRef
go back to reference Kruse R, Nauck D (1995) Learning methods for fuzzy systems. In: Proceedings of the 3rd German GI-workshop “Neuro-Fuzzy-Systeme”, Darmstadt, Germany, vol 3, pp 683–697 Kruse R, Nauck D (1995) Learning methods for fuzzy systems. In: Proceedings of the 3rd German GI-workshop “Neuro-Fuzzy-Systeme”, Darmstadt, Germany, vol 3, pp 683–697
go back to reference Nauck D (1997) Neuro-fuzzy systems: review and prospects. In: Procedings of the 5th European congress on intelligent techniques and soft computing (EUFIT’97), Aachen, pp 1044–1053 Nauck D (1997) Neuro-fuzzy systems: review and prospects. In: Procedings of the 5th European congress on intelligent techniques and soft computing (EUFIT’97), Aachen, pp 1044–1053
go back to reference Keller JM, Tahani H (1992) Implementation of conjunctive and disconjunctive fuzzy logic rules with neural networks. Int J Approx Reason 6:221–240MATHCrossRef Keller JM, Tahani H (1992) Implementation of conjunctive and disconjunctive fuzzy logic rules with neural networks. Int J Approx Reason 6:221–240MATHCrossRef
go back to reference Zimmermann HG, Neuneier R, Dichtl H, Siekmann S (1996) Modeling the german stock index DAX with neuo-fuzzy. In: Proceedings of fourth European congress on intelligent techniques and soft computing (EUFIT96), Aachen Zimmermann HG, Neuneier R, Dichtl H, Siekmann S (1996) Modeling the german stock index DAX with neuo-fuzzy. In: Proceedings of fourth European congress on intelligent techniques and soft computing (EUFIT96), Aachen
go back to reference Nauck D, Kruse R (1995) NEFCLASS-A neuro-fuzzy approach for the classification of data. Applied computing. In: George KM, Carrol JH, Deaton E, Oppenheim D, Hightower J (eds) Proceedings of the 1995 ACM symposium on applied computing, Nashville, February 26–28. ACM Press, New York, pp 461–465 Nauck D, Kruse R (1995) NEFCLASS-A neuro-fuzzy approach for the classification of data. Applied computing. In: George KM, Carrol JH, Deaton E, Oppenheim D, Hightower J (eds) Proceedings of the 1995 ACM symposium on applied computing, Nashville, February 26–28. ACM Press, New York, pp 461–465
go back to reference Kruse R, Gebhardt J (1994) Foundations of fuzzy systems. Wiley, Chichester Kruse R, Gebhardt J (1994) Foundations of fuzzy systems. Wiley, Chichester
go back to reference MacQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of 5th Berkeley symposium on mathematical statistics and probability. University of California Press, Berkeley, pp 281–297 MacQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of 5th Berkeley symposium on mathematical statistics and probability. University of California Press, Berkeley, pp 281–297
go back to reference Mackey MC, Glass L (1977) Oscillation and chaos in physiological control systems. Science 197(4300):287–289CrossRef Mackey MC, Glass L (1977) Oscillation and chaos in physiological control systems. Science 197(4300):287–289CrossRef
go back to reference Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH
Metadata
Title
Self-spawning neuro-fuzzy system for rule extraction
Authors
Zhi-Qiang Liu
Tao Guan
Ya-Jun Zhang
Publication date
01-09-2009
Publisher
Springer-Verlag
Published in
Soft Computing / Issue 11/2009
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-008-0375-z

Other articles of this Issue 11/2009

Soft Computing 11/2009 Go to the issue

Original Paper

MV-pairs and states

Premium Partner