Skip to main content
Top
Published in: Neural Computing and Applications 2/2013

01-08-2013 | Original Article

Data mining–based hierarchical cooperative coevolutionary algorithm for TSK-type neuro-fuzzy networks design

Authors: Chi-Yao Hsu, Sheng-Fuu Lin, Jyun-Wei Chang

Published in: Neural Computing and Applications | Issue 2/2013

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This study proposes a data mining–based hierarchical cooperative coevolutionary algorithm (DMHCCA) for TSK-type neuro-fuzzy networks design. The proposed DMHCCA consists of two-level evolutions: the neuro-level evolution (NULE) and the network-level evolution (NWLE). In NULE, a data mining–based evolutionary learning algorithm is utilized to evolve neurons. The good combinations of neurons evolved in NULE are reserved for being the initial populations of NWLE. In NWLE, the initial population are mated and mutated to produce new structure of networks. Similar to NULE, the good neurons of evolved network in NWLE are inserted into the NULE. Thus, by interactive two-level evolutions, the neurons and structure of network can be evolved locally and globally, respectively. Simulation results using DMHCCA are reported and compared with other existing models. Application of DMHCCA to a three-dimensional (3D) surface alignment task is also described, and experimental results are presented better performance than other alignment systems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Lin CT, Lee CSG (1996) Neural fuzzy systems: a neuro-fuzzy synergism to intelligent system. Prentice-Hall, Englewood Cliffs, NJ Lin CT, Lee CSG (1996) Neural fuzzy systems: a neuro-fuzzy synergism to intelligent system. Prentice-Hall, Englewood Cliffs, NJ
2.
go back to reference Towell GG, Shavlik JW (1993) Extracting refined rules from knowledge-based neural networks. Mach Learn 13:71–101 Towell GG, Shavlik JW (1993) Extracting refined rules from knowledge-based neural networks. Mach Learn 13:71–101
3.
go back to reference Lin CJ, Lin CT (1997) An ART-based fuzzy adaptive learning control network. IEEE Trans Fuzzy Syst 5(4):477–496CrossRef Lin CJ, Lin CT (1997) An ART-based fuzzy adaptive learning control network. IEEE Trans Fuzzy Syst 5(4):477–496CrossRef
4.
go back to reference Wang LX, Mendel JM (1992) Generating fuzzy rules by learning from examples. IEEE Trans Syst Man Cybern 22(6):1414–1427MathSciNetCrossRef Wang LX, Mendel JM (1992) Generating fuzzy rules by learning from examples. IEEE Trans Syst Man Cybern 22(6):1414–1427MathSciNetCrossRef
5.
go back to reference Takagi T, Sugeno M (1985) Fuzzy identification of systems and its applications to modeling and control. IEEE Trans Syst Man Cybern 15:116–132MATHCrossRef Takagi T, Sugeno M (1985) Fuzzy identification of systems and its applications to modeling and control. IEEE Trans Syst Man Cybern 15:116–132MATHCrossRef
6.
go back to reference Juang CF, Lin CT (1998) An on-line self-constructing neural fuzzy inference network and its applications. IEEE Trans Fuzzy Syst 6(1):12–31CrossRef Juang CF, Lin CT (1998) An on-line self-constructing neural fuzzy inference network and its applications. IEEE Trans Fuzzy Syst 6(1):12–31CrossRef
7.
go back to reference Riemiller M, Braun H (1993) A direct adaptive method for faster backpropagation learning: the RPROP algorithm. In: Proceeding of IEEE international conference on neural networks, pp 586–591 Riemiller M, Braun H (1993) A direct adaptive method for faster backpropagation learning: the RPROP algorithm. In: Proceeding of IEEE international conference on neural networks, pp 586–591
8.
go back to reference Lin FJ, Lin CH, Shen PH (2001) Self-constructing fuzzy neural network speed controller for permanent-magnet synchronous motor drive. IEEE Trans Fuzzy Syst 9(5):751–759CrossRef Lin FJ, Lin CH, Shen PH (2001) Self-constructing fuzzy neural network speed controller for permanent-magnet synchronous motor drive. IEEE Trans Fuzzy Syst 9(5):751–759CrossRef
9.
go back to reference Takagi H, Suzuki N, Koda T, Kojima Y (1992) Neural networks designed on approximated reasoning architecture and their application. IEEE Trans Neural Netw 3(5):752–759CrossRef Takagi H, Suzuki N, Koda T, Kojima Y (1992) Neural networks designed on approximated reasoning architecture and their application. IEEE Trans Neural Netw 3(5):752–759CrossRef
10.
go back to reference Mizutani E, Jang J-SR (1995) Coactive neural fuzzy modeling. In: Proceeding of IEEE international conference on neural networks, pp 760–765 Mizutani E, Jang J-SR (1995) Coactive neural fuzzy modeling. In: Proceeding of IEEE international conference on neural networks, pp 760–765
11.
go back to reference Lin C-J, Chin C-C (2004) Prediction and identification using wavelet-based recurrent fuzzy neural networks. IEEE Trans Syst Man Cybern Part B 34(5):2144–2154CrossRef Lin C-J, Chin C-C (2004) Prediction and identification using wavelet-based recurrent fuzzy neural networks. IEEE Trans Syst Man Cybern Part B 34(5):2144–2154CrossRef
12.
go back to reference Narendra KS, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1:4–27CrossRef Narendra KS, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1:4–27CrossRef
13.
go back to reference Juang CF, Lin CT (1999) A recurrent self-organizing neural fuzzy inference network. IEEE Trans Neural Netw 10(4):828–845CrossRef Juang CF, Lin CT (1999) A recurrent self-organizing neural fuzzy inference network. IEEE Trans Neural Netw 10(4):828–845CrossRef
14.
go back to reference Mastorocostas PA, Theocharis JB (2002) A recurrent fuzzy-neural model for dynamic system identification. IEEE Trans Syst Man Cybern 32(2):176–190CrossRef Mastorocostas PA, Theocharis JB (2002) A recurrent fuzzy-neural model for dynamic system identification. IEEE Trans Syst Man Cybern 32(2):176–190CrossRef
15.
go back to reference Goldberg DE (1989) Genetic algorithms in search optimization and machine learning. Addison-Wesley, Reading, MAMATH Goldberg DE (1989) Genetic algorithms in search optimization and machine learning. Addison-Wesley, Reading, MAMATH
16.
go back to reference Koza JK (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge, MAMATH Koza JK (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge, MAMATH
17.
go back to reference Fogel LJ (1994) Evolutionary programming in perspective: the top-down view. In: Zurada JM, Marks RJ II, Goldberg C (eds) Computational intelligence: imitating life. IEEE Press, Piscataway, NJ Fogel LJ (1994) Evolutionary programming in perspective: the top-down view. In: Zurada JM, Marks RJ II, Goldberg C (eds) Computational intelligence: imitating life. IEEE Press, Piscataway, NJ
18.
go back to reference Li M, Wang Z (2009) A hybrid coevolutionary algorithm for designing fuzzy classifiers. Inf Sci 179(12):1970–1983CrossRef Li M, Wang Z (2009) A hybrid coevolutionary algorithm for designing fuzzy classifiers. Inf Sci 179(12):1970–1983CrossRef
19.
go back to reference Karr CL (1991) Design of an adaptive fuzzy logic controller using a genetic algorithm. In: Proceeding of the 4th international conference on genetic algorithms, pp 450–457 Karr CL (1991) Design of an adaptive fuzzy logic controller using a genetic algorithm. In: Proceeding of the 4th international conference on genetic algorithms, pp 450–457
20.
go back to reference Lin CT, Jou CP (2000) GA-based fuzzy reinforcement learning for control of a magnetic bearing system. IEEE Trans Syst Man Cybern Part B 30(2):276–289 Lin CT, Jou CP (2000) GA-based fuzzy reinforcement learning for control of a magnetic bearing system. IEEE Trans Syst Man Cybern Part B 30(2):276–289
21.
go back to reference Juang CF, Lin JY, Lin CT (2000) Genetic reinforcement learning through symbiotic evolution for fuzzy controller design. IEEE Trans Syst Man Cybern Part B 30(2):290–302 Juang CF, Lin JY, Lin CT (2000) Genetic reinforcement learning through symbiotic evolution for fuzzy controller design. IEEE Trans Syst Man Cybern Part B 30(2):290–302
22.
go back to reference Bandyopadhyay S, Murthy CA, Pal SK (2000) VGA-classifier: design and applications, IEEE Trans. Syst Man Cybern Part B 30(6):890–895CrossRef Bandyopadhyay S, Murthy CA, Pal SK (2000) VGA-classifier: design and applications, IEEE Trans. Syst Man Cybern Part B 30(6):890–895CrossRef
23.
go back to reference Carse B, Fogarty TC, Munro A (1996) Evolving fuzzy rule based controllers using genetic algorithms. Fuzzy Sets Syst 80(3):273–293CrossRef Carse B, Fogarty TC, Munro A (1996) Evolving fuzzy rule based controllers using genetic algorithms. Fuzzy Sets Syst 80(3):273–293CrossRef
24.
go back to reference Chen CH, Lin CJ, Lin CT (2009) Using an efficient immune symbiotic evolution learning for compensatory neuro-fuzzy controller. IEEE Trans Fuzzy Syst 17(3):668–682CrossRef Chen CH, Lin CJ, Lin CT (2009) Using an efficient immune symbiotic evolution learning for compensatory neuro-fuzzy controller. IEEE Trans Fuzzy Syst 17(3):668–682CrossRef
25.
go back to reference Lin CJ, Chen CH, Lin CT (2011) An efficient evolutionary algorithm for fuzzy inference systems. Evol Syst 2(2):83–99 Lin CJ, Chen CH, Lin CT (2011) An efficient evolutionary algorithm for fuzzy inference systems. Evol Syst 2(2):83–99
26.
go back to reference Gomez FJ (2003) Robust non-linear control through neuroevolution, Ph. D. Disseration, The University of Texas at Austin Gomez FJ (2003) Robust non-linear control through neuroevolution, Ph. D. Disseration, The University of Texas at Austin
27.
go back to reference Gomez F, Schmidhuber J (2005) Co-evolving recurrent neurons learn deep memory POMDPs. In: Proceeding of conference on genetic and evolutionary computation, pp 491–498 Gomez F, Schmidhuber J (2005) Co-evolving recurrent neurons learn deep memory POMDPs. In: Proceeding of conference on genetic and evolutionary computation, pp 491–498
28.
go back to reference Lin CJ, Hsu YC (2007) Reinforcement hybrid evolutionary learning for recurrent wavelet-based neuro-fuzzy systems. IEEE Trans Fuzzy Syst 15(4):729–745CrossRef Lin CJ, Hsu YC (2007) Reinforcement hybrid evolutionary learning for recurrent wavelet-based neuro-fuzzy systems. IEEE Trans Fuzzy Syst 15(4):729–745CrossRef
29.
go back to reference Hsu YC, Lin SF, Cheng YC (2010) Multi groups cooperation based symbiotic evolution for TSK-type neuro-fuzzy systems design. Exp Syst Appl 37(7):5320–5330CrossRef Hsu YC, Lin SF, Cheng YC (2010) Multi groups cooperation based symbiotic evolution for TSK-type neuro-fuzzy systems design. Exp Syst Appl 37(7):5320–5330CrossRef
30.
go back to reference Lee JT, Wu HW, Lee TY, Liu YH, Chen KT (2009) Mining closed patterns in multi-sequence time-series database. Data Knowl Eng 68:1071–1090CrossRef Lee JT, Wu HW, Lee TY, Liu YH, Chen KT (2009) Mining closed patterns in multi-sequence time-series database. Data Knowl Eng 68:1071–1090CrossRef
31.
go back to reference Tanbeer SK, Ahmed CF, Jeong BS (2009) Parallel and distributed algorithm for frequent pattern mining in large database. IETE Tech Rev 26:55–65CrossRef Tanbeer SK, Ahmed CF, Jeong BS (2009) Parallel and distributed algorithm for frequent pattern mining in large database. IETE Tech Rev 26:55–65CrossRef
32.
go back to reference Agrawal R, Srikant R (1994) Fast algorithm for mining association rules. In: Proceeding of the international conference on VLDB, pp 487–499 Agrawal R, Srikant R (1994) Fast algorithm for mining association rules. In: Proceeding of the international conference on VLDB, pp 487–499
33.
go back to reference Han J, Pei J, Yin Y (2000) Mining frequent patterns without candidate generation. In: Proceeding of ACM-SIGMOD, Dallas, Tx, pp 1–12 Han J, Pei J, Yin Y (2000) Mining frequent patterns without candidate generation. In: Proceeding of ACM-SIGMOD, Dallas, Tx, pp 1–12
34.
go back to reference Wu YT, An YJ, Geller J, Wu YT (2006) A data mining based genetic algorithm. In: Proceeding of IEEE workshop SEUS-WCCIA, pp 27–28 Wu YT, An YJ, Geller J, Wu YT (2006) A data mining based genetic algorithm. In: Proceeding of IEEE workshop SEUS-WCCIA, pp 27–28
35.
go back to reference Shankar S, Purusothaman T (2009) Utility sentient frequent itemset mining and association rule mining: a literature survey and comparative study. Int J Soft Comput Appl 4:81–95 Shankar S, Purusothaman T (2009) Utility sentient frequent itemset mining and association rule mining: a literature survey and comparative study. Int J Soft Comput Appl 4:81–95
36.
go back to reference Sugeno M, Tanaka K (1991) Successive identification of a fuzzy model and its applications to prediction of a complex system. Fuzzy Sets Syst 42(3):315–334MathSciNetMATHCrossRef Sugeno M, Tanaka K (1991) Successive identification of a fuzzy model and its applications to prediction of a complex system. Fuzzy Sets Syst 42(3):315–334MathSciNetMATHCrossRef
37.
go back to reference Lin SF, Cheng YC (2010) Two-strategy reinforcement evolutionary algorithm using data-mining based crossover strategy with TSK-type fuzzy controllers. Int J Innovat Comput Control 6(9):3863–3885 Lin SF, Cheng YC (2010) Two-strategy reinforcement evolutionary algorithm using data-mining based crossover strategy with TSK-type fuzzy controllers. Int J Innovat Comput Control 6(9):3863–3885
38.
go back to reference Cordon O, Herrera F, Hoffmann F, Magdalena L (2001) Genetic fuzzy systems evolutionary tuning and learning of fuzzy knowledge bases, advances in fuzzy systems-applications and theory, vol 19. World Scientific Publishing, NJ, USACrossRef Cordon O, Herrera F, Hoffmann F, Magdalena L (2001) Genetic fuzzy systems evolutionary tuning and learning of fuzzy knowledge bases, advances in fuzzy systems-applications and theory, vol 19. World Scientific Publishing, NJ, USACrossRef
39.
go back to reference Cox E (2005) Fuzzy modeling and genetic algorithms for data mining and exploration, 1st edn. Morgan Kaufman Publications, San Francisco, USAMATH Cox E (2005) Fuzzy modeling and genetic algorithms for data mining and exploration, 1st edn. Morgan Kaufman Publications, San Francisco, USAMATH
40.
go back to reference De Jong KA (1975) Analysis of the behavior of a class of genetic adaptive systems, Ph. D. Dissertation, Dep. Computer and Communication Sciences, Univ. Michigan, Ann Arbor, MI De Jong KA (1975) Analysis of the behavior of a class of genetic adaptive systems, Ph. D. Dissertation, Dep. Computer and Communication Sciences, Univ. Michigan, Ann Arbor, MI
41.
go back to reference Cowder RS (1990) Predicting the mackey-glass time series with cascade-correlation learning. In: Proceedings of the 1990 connectionist models summer school, pp. 117–123 Cowder RS (1990) Predicting the mackey-glass time series with cascade-correlation learning. In: Proceedings of the 1990 connectionist models summer school, pp. 117–123
42.
go back to reference Moriarty DE, Miikkulainen R (1996) Efficient reinforcement learning through symbiotic evolution. Mach Learn 22:11–32 Moriarty DE, Miikkulainen R (1996) Efficient reinforcement learning through symbiotic evolution. Mach Learn 22:11–32
43.
go back to reference Rabbani T, van den Heuvel FA, Vosselmann G (2006) Segmentation of point clouds using smoothness constraint. Proc ISPRS 35:248–253 Rabbani T, van den Heuvel FA, Vosselmann G (2006) Segmentation of point clouds using smoothness constraint. Proc ISPRS 35:248–253
44.
go back to reference Liu H, Yan J, Zhang D (2006) Three-dimensional surface registration: a neural network strategy. Neurocomputing 70:597–602CrossRef Liu H, Yan J, Zhang D (2006) Three-dimensional surface registration: a neural network strategy. Neurocomputing 70:597–602CrossRef
45.
go back to reference Zhang J, Ge Y, Ong SH, Chui CK, Teoh SH, Yan CH (2008) Rapid surface registration of 3D volumes using a neural network approach. Image Vis Comput 26:201–210CrossRef Zhang J, Ge Y, Ong SH, Chui CK, Teoh SH, Yan CH (2008) Rapid surface registration of 3D volumes using a neural network approach. Image Vis Comput 26:201–210CrossRef
46.
go back to reference Chetverikov D, Stepanov D, Kresk P (2005) Robust Euclidean alignment of 3D point sets: the trimmed iterative closest point algorithm. Image Vis Comput 23:299–309CrossRef Chetverikov D, Stepanov D, Kresk P (2005) Robust Euclidean alignment of 3D point sets: the trimmed iterative closest point algorithm. Image Vis Comput 23:299–309CrossRef
47.
go back to reference Liu YH (2004) Improving ICP with easy implementation for free-form surface matching. Pattern Recogn 37:211–226MATHCrossRef Liu YH (2004) Improving ICP with easy implementation for free-form surface matching. Pattern Recogn 37:211–226MATHCrossRef
48.
go back to reference Besl P, Mckay N (1992) A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell 14(2):239–256CrossRef Besl P, Mckay N (1992) A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell 14(2):239–256CrossRef
Metadata
Title
Data mining–based hierarchical cooperative coevolutionary algorithm for TSK-type neuro-fuzzy networks design
Authors
Chi-Yao Hsu
Sheng-Fuu Lin
Jyun-Wei Chang
Publication date
01-08-2013
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 2/2013
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-012-0943-0

Other articles of this Issue 2/2013

Neural Computing and Applications 2/2013 Go to the issue

Premium Partner