Skip to main content
Erschienen in: Neural Computing and Applications 3/2012

01.04.2012 | Original Article

Synthesis of neural tree models by improved breeder genetic programming

verfasst von: Feng Qi, Xiyu Liu, Yinghong Ma

Erschienen in: Neural Computing and Applications | Ausgabe 3/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Neural tree model has been successfully applied to solving a variety of interesting problems. In most previous studies, optimization of the neural tree model was divided into two steps: first structure optimization, then parameter optimization. One major problem in the evolution of structure without parameter information was noisy fitness evaluation. In this paper, an improved breeder genetic programming algorithm is proposed to the synthesis of neural tree model. The effectiveness and performance of the method are evaluated on time series prediction problems and compared with those of related methods. Simulation results show that the proposed algorithm is a potential method with better performance and effectiveness.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chen YH, Abraham A (2005) Feature selection and intrusion detection using hybrid flexible neural tree. Lecture Notes Comput Sci 3498:439–444CrossRef Chen YH, Abraham A (2005) Feature selection and intrusion detection using hybrid flexible neural tree. Lecture Notes Comput Sci 3498:439–444CrossRef
2.
Zurück zum Zitat Chen YH, Yang B, Dong J, Abraham A (2005) Time-series forecasting using flexible neural tree model. Inf Sci 174:219–235MathSciNetCrossRef Chen YH, Yang B, Dong J, Abraham A (2005) Time-series forecasting using flexible neural tree model. Inf Sci 174:219–235MathSciNetCrossRef
3.
Zurück zum Zitat Chen YH, Yang B, Dong J (2004) Evolving flexible neural networks using ant programming and PSO algorithm. In: Proceeding of international symposium on neural networks, Lecture notes on computer science, pp 211–216 Chen YH, Yang B, Dong J (2004) Evolving flexible neural networks using ant programming and PSO algorithm. In: Proceeding of international symposium on neural networks, Lecture notes on computer science, pp 211–216
4.
Zurück zum Zitat Chen YH, Yang B, Dong J (2004) Nonlinear system modeling via optimal design of nerual trees. J Neural Syst 14:125–137CrossRef Chen YH, Yang B, Dong J (2004) Nonlinear system modeling via optimal design of nerual trees. J Neural Syst 14:125–137CrossRef
5.
Zurück zum Zitat Chen YH, Yang B, Abraham A (2007) Flexible neural trees ensemble for stock index modeling. Neruocomputing 70:697–703CrossRef Chen YH, Yang B, Abraham A (2007) Flexible neural trees ensemble for stock index modeling. Neruocomputing 70:697–703CrossRef
6.
Zurück zum Zitat Chen YH, Peng L, Abraham A (2006) Exchange rate forecasting using flexible nerual trees. International symposium on neural networks, pp 518–523 Chen YH, Peng L, Abraham A (2006) Exchange rate forecasting using flexible nerual trees. International symposium on neural networks, pp 518–523
7.
Zurück zum Zitat Chen YH, Abraham A, Yang B (2007) Hybird flexible neural- tree-based intrusion detection systems. Int J Intell Syst 22:337–352MATHCrossRef Chen YH, Abraham A, Yang B (2007) Hybird flexible neural- tree-based intrusion detection systems. Int J Intell Syst 22:337–352MATHCrossRef
8.
Zurück zum Zitat Yao X, Lin Y (1997) A new evolutionary system for evolving artificial neural networks. IEEE Trans Neural Netw 8:694–713CrossRef Yao X, Lin Y (1997) A new evolutionary system for evolving artificial neural networks. IEEE Trans Neural Netw 8:694–713CrossRef
9.
Zurück zum Zitat Yao X (1999) Evolving artificial neural networks. Proc IEEE 87:1423–1447CrossRef Yao X (1999) Evolving artificial neural networks. Proc IEEE 87:1423–1447CrossRef
10.
Zurück zum Zitat Fogel DB (1995) Evolutionary computation: towards a new philosophy of machine intelligence. IEEE Press, New York Fogel DB (1995) Evolutionary computation: towards a new philosophy of machine intelligence. IEEE Press, New York
11.
Zurück zum Zitat Angeline PJ, Sauders GM, Pollack JB (1994) An evolutionary algorithm that constructs recurrent neural networks. IEEE Trans Neural Netw 5:54–65CrossRef Angeline PJ, Sauders GM, Pollack JB (1994) An evolutionary algorithm that constructs recurrent neural networks. IEEE Trans Neural Netw 5:54–65CrossRef
12.
Zurück zum Zitat Fogel DB (1995) Phenotypes, geneotypes, and operators in evolutionary computation. In: Proceeding of the IEEE international conference on evolutionary computation, Perth, Australia, IEEE Press, New York, pp 193–198 Fogel DB (1995) Phenotypes, geneotypes, and operators in evolutionary computation. In: Proceeding of the IEEE international conference on evolutionary computation, Perth, Australia, IEEE Press, New York, pp 193–198
13.
Zurück zum Zitat Zhang BT, Mühlenbein H (1993) Genetic programming of minimal neural nets using Occam’s razor. In: Forrest S (ed) Proceeding of fifth international conference on genetic algorithms, Morgan Kaufmann, pp 342–349 Zhang BT, Mühlenbein H (1993) Genetic programming of minimal neural nets using Occam’s razor. In: Forrest S (ed) Proceeding of fifth international conference on genetic algorithms, Morgan Kaufmann, pp 342–349
14.
Zurück zum Zitat Zhang BT, Mühlenbein H (1993) Evolving optimal neural networks using genetic algorithm with Occam’s razor. Complex Syst Zhang BT, Mühlenbein H (1993) Evolving optimal neural networks using genetic algorithm with Occam’s razor. Complex Syst
15.
Zurück zum Zitat Zhang BT, Mühlenbein H (1994) Synthesis of sigma-pi neural networks by the breeder genetic programming. In: Proceeding of IEEE international conference on evolutionary computation, pp 318–324 Zhang BT, Mühlenbein H (1994) Synthesis of sigma-pi neural networks by the breeder genetic programming. In: Proceeding of IEEE international conference on evolutionary computation, pp 318–324
16.
Zurück zum Zitat Zhang BT, Ohm P, Mühlenbein H (1997) Evolutionary induction of sparse neural trees. Evol Comput 5:213–236MATHCrossRef Zhang BT, Ohm P, Mühlenbein H (1997) Evolutionary induction of sparse neural trees. Evol Comput 5:213–236MATHCrossRef
17.
Zurück zum Zitat Mühlenbein H (1993) Predictive models for the breeder genetic algorithm I: continuous parameter optimization. Evol Comput 1:25–49CrossRef Mühlenbein H (1993) Predictive models for the breeder genetic algorithm I: continuous parameter optimization. Evol Comput 1:25–49CrossRef
18.
Zurück zum Zitat Eiben AE, Smith JE (2008) Introduction to evolutionary computing. Springer, Natural Computing Series (2nd) Eiben AE, Smith JE (2008) Introduction to evolutionary computing. Springer, Natural Computing Series (2nd)
19.
Zurück zum Zitat Mitchell M, Holland JH (1993) When will a genetic algorithm outperform hill climbing? In: Proceedings of the 5th international conference on genetic algorithms, Morgan Kaufmann Publishers Inc., San Francisco, pp 647–656 Mitchell M, Holland JH (1993) When will a genetic algorithm outperform hill climbing? In: Proceedings of the 5th international conference on genetic algorithms, Morgan Kaufmann Publishers Inc., San Francisco, pp 647–656
20.
Zurück zum Zitat Mühlenbein H (1992) How Genetic Algorithms really work. Mutation and hill-climbing. In: Parallel problem solving from nature PPSN II, North-Holland, Amsterdam, 15C25 Mühlenbein H (1992) How Genetic Algorithms really work. Mutation and hill-climbing. In: Parallel problem solving from nature PPSN II, North-Holland, Amsterdam, 15C25
21.
Zurück zum Zitat Box GE (1970) Time series analysis. Forecasting and control. Holden Day, San FranciscoMATH Box GE (1970) Time series analysis. Forecasting and control. Holden Day, San FranciscoMATH
22.
Zurück zum Zitat Krzysztof S (2010) Rule weights in a neuro-fuzzy system with a hierarchical domain partition. Int J Appl Math Comput Sci 20(2):337–347MATHCrossRef Krzysztof S (2010) Rule weights in a neuro-fuzzy system with a hierarchical domain partition. Int J Appl Math Comput Sci 20(2):337–347MATHCrossRef
23.
Zurück zum Zitat Tong RM (1980) The evaluation of fuzzy models derived from experimental data. Fuzzy Sets Syst 4:1–12MATHCrossRef Tong RM (1980) The evaluation of fuzzy models derived from experimental data. Fuzzy Sets Syst 4:1–12MATHCrossRef
24.
Zurück zum Zitat Xu CW, Lu YZ (1987) Fuzzy model identification and self-learning for dynamic systems. IEEE Trans Syst Man Cybern 17:683–389CrossRef Xu CW, Lu YZ (1987) Fuzzy model identification and self-learning for dynamic systems. IEEE Trans Syst Man Cybern 17:683–389CrossRef
25.
Zurück zum Zitat Lee YC, Wang EH, Shih YP (1994) A combined approach to fuzzy model iddentification. IEEE Trans Syst Man Cybern 24:736–744CrossRef Lee YC, Wang EH, Shih YP (1994) A combined approach to fuzzy model iddentification. IEEE Trans Syst Man Cybern 24:736–744CrossRef
26.
Zurück zum Zitat Lin Y, Cunningham GA (1995) A new approach to fuzzy-neural system modelling. IEEE Trans Fuzzy Syst 3:190–197CrossRef Lin Y, Cunningham GA (1995) A new approach to fuzzy-neural system modelling. IEEE Trans Fuzzy Syst 3:190–197CrossRef
27.
Zurück zum Zitat Nie J (1995) Constructing fuzzy model by self-organising counter propagation network. IEEE Trans Syst Man Cybern 25:963–970CrossRef Nie J (1995) Constructing fuzzy model by self-organising counter propagation network. IEEE Trans Syst Man Cybern 25:963–970CrossRef
28.
Zurück zum Zitat Jang JS, Sun CT, Mizutani E (1997) Neuro-fuzzy and soft computing: a computational approach to learning and machine intelligence. Prentic-Hall, Upper Saddle River Jang JS, Sun CT, Mizutani E (1997) Neuro-fuzzy and soft computing: a computational approach to learning and machine intelligence. Prentic-Hall, Upper Saddle River
29.
Zurück zum Zitat Kasabov N, Kim JS, Watts M, Gray A (1996) FuNN/2-a fuzzy neural network architecture for adaptive learning and knowledge acquisition. Inf Sci 101:155–175CrossRef Kasabov N, Kim JS, Watts M, Gray A (1996) FuNN/2-a fuzzy neural network architecture for adaptive learning and knowledge acquisition. Inf Sci 101:155–175CrossRef
30.
Zurück zum Zitat Wang LX, Mendel JM (1992) Generating fuzzy rules by learning from examples. IEEE Trans Syst Man Cybern 22:1414–1427MathSciNetCrossRef Wang LX, Mendel JM (1992) Generating fuzzy rules by learning from examples. IEEE Trans Syst Man Cybern 22:1414–1427MathSciNetCrossRef
31.
Zurück zum Zitat Rojas I, Pomares H, Luis BJ et al (2002) Time series analysis using normalized PG-RBF network with regression weights. Neurocomputing 42:267C285CrossRef Rojas I, Pomares H, Luis BJ et al (2002) Time series analysis using normalized PG-RBF network with regression weights. Neurocomputing 42:267C285CrossRef
Metadaten
Titel
Synthesis of neural tree models by improved breeder genetic programming
verfasst von
Feng Qi
Xiyu Liu
Yinghong Ma
Publikationsdatum
01.04.2012
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 3/2012
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-010-0451-z

Weitere Artikel der Ausgabe 3/2012

Neural Computing and Applications 3/2012 Zur Ausgabe

Premium Partner