Skip to main content

2015 | OriginalPaper | Buchkapitel

5. Sequential Symbolic Regression with Genetic Programming

verfasst von : Luiz Otávio V.B. Oliveira, Fernando E.B. Otero, Gisele L. Pappa, Julio Albinati

Erschienen in: Genetic Programming Theory and Practice XII

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter describes the Sequential Symbolic Regression (SSR) method, a new strategy for function approximation in symbolic regression. The SSR method is inspired by the sequential covering strategy from machine learning, but instead of sequentially reducing the size of the problem being solved, it sequentially transforms the original problem into potentially simpler problems. This transformation is performed according to the semantic distances between the desired and obtained outputs and a geometric semantic operator. The rationale behind SSR is that, after generating a suboptimal function f via symbolic regression, the output errors can be approximated by another function, in a subsequent iteration. The method was tested in eight polynomial functions, and compared with canonical genetic programming (GP) and geometric semantic genetic programming (SGP). Results showed that SSR significantly outperforms SGP and presents no statistical difference from GP. More importantly, they show the potential of the proposed approach: an effective way of applying geometric semantic operators to combine different (partial) solutions, and at the same time, avoiding the exponential growth problem arising from the use of semantic operators.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The selection of building blocks based on fitness proposed by Rosca and Ballard (1994) is an exception to the syntax-oriented selection, although there is no guarantee that different modules are solving different parts of the problem.
 
2
It is unlikely that a solution will reach (near) zero error only for a subset of the points (training cases), unless it is the optimal solution, which in this case it will reach a (near) zero error for all points.
 
Literatur
Zurück zum Zitat Angeline PJ, Pollack JB (1992) Evolutionary induction of subroutines. In: Proceedings of the 14th Annual Cognitive Science Conference, pp 236–241 Angeline PJ, Pollack JB (1992) Evolutionary induction of subroutines. In: Proceedings of the 14th Annual Cognitive Science Conference, pp 236–241
Zurück zum Zitat Angeline PJ, Pollack JB (1994) Coevolving high-level representations. In: Langton C (ed) Artificial life III. Addison-Wesley, Reading, pp 55–71 Angeline PJ, Pollack JB (1994) Coevolving high-level representations. In: Langton C (ed) Artificial life III. Addison-Wesley, Reading, pp 55–71
Zurück zum Zitat Christensen S, Oppacher F (2007) Solving the artificial ant on the Santa Fe trail problem in 20,696 fitness evaluations. In: GECCO '07: Proceedings of the 9th annual conference on Genetic and evolutionary computation, London, vol 2, pp 1574–1579 Christensen S, Oppacher F (2007) Solving the artificial ant on the Santa Fe trail problem in 20,696 fitness evaluations. In: GECCO '07: Proceedings of the 9th annual conference on Genetic and evolutionary computation, London, vol 2, pp 1574–1579
Zurück zum Zitat Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MATHMathSciNet Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MATHMathSciNet
Zurück zum Zitat Jackson D, Gibbons AP (2007) Layered learning in Boolean GP problems. In: Proceedings of the 10th European Conference on Genetic Programming, Lecture Notes in Computer Science, vol 4445, pp 148–159. Springer, Valencia Jackson D, Gibbons AP (2007) Layered learning in Boolean GP problems. In: Proceedings of the 10th European Conference on Genetic Programming, Lecture Notes in Computer Science, vol 4445, pp 148–159. Springer, Valencia
Zurück zum Zitat Keijzer M, Ryan C, Cattolico M (2004) Run transferable libraries—learning functional bias in problem domains. In: Genetic and evolutionary computation – GECCO-2004, Part II, Lecture Notes in Computer Science, vol 3103, pp 531–542. Springer, Seattle Keijzer M, Ryan C, Cattolico M (2004) Run transferable libraries—learning functional bias in problem domains. In: Genetic and evolutionary computation – GECCO-2004, Part II, Lecture Notes in Computer Science, vol 3103, pp 531–542. Springer, Seattle
Zurück zum Zitat Koza JR (1992a) Genetic programming: on the programming of computers by means of natural selection. MIT, Cambridge Koza JR (1992a) Genetic programming: on the programming of computers by means of natural selection. MIT, Cambridge
Zurück zum Zitat Koza JR (1992b) Hierarchical automatic function definition in genetic programming. In: Whitley LD (ed) Foundations of genetic algorithms 2.Morgan Kaufmann, Vail, pp 297–318 Koza JR (1992b) Hierarchical automatic function definition in genetic programming. In: Whitley LD (ed) Foundations of genetic algorithms 2.Morgan Kaufmann, Vail, pp 297–318
Zurück zum Zitat Koza JR (1994) Genetic programming II: automatic discovery of reusable programs. MIT, Cambridge Koza JR (1994) Genetic programming II: automatic discovery of reusable programs. MIT, Cambridge
Zurück zum Zitat Lee GY (1999) Genetic recursive regression for modeling and forecasting real-world chaotic time series. In: Advances in genetic programming III. MIT, Cambridge, pp 401–423 Lee GY (1999) Genetic recursive regression for modeling and forecasting real-world chaotic time series. In: Advances in genetic programming III. MIT, Cambridge, pp 401–423
Zurück zum Zitat McKay B (2000) Partial functions in fitness-shared genetic programming. In: Proceedings of the 2000 Congress on Evolutionary Computation CEC00, IEEE Press, La Jolla Marriott Hotel La Jolla, California, USA, vol 1, pp 349–356 McKay B (2000) Partial functions in fitness-shared genetic programming. In: Proceedings of the 2000 Congress on Evolutionary Computation CEC00, IEEE Press, La Jolla Marriott Hotel La Jolla, California, USA, vol 1, pp 349–356
Zurück zum Zitat Moraglio A, Krawiec K, Johnson C (2012) Geometric semantic genetic programming. In: Parallel problem solving from nature - PPSN XII, Lecture Notes in Computer Science, vol 7491, pp 21–31. Springer, Berlin Moraglio A, Krawiec K, Johnson C (2012) Geometric semantic genetic programming. In: Parallel problem solving from nature - PPSN XII, Lecture Notes in Computer Science, vol 7491, pp 21–31. Springer, Berlin
Zurück zum Zitat Otero FEB, Johnson CG (2013) Automated problem decomposition for the boolean domain with genetic programming. In: Proceedings of the 16th European Conference on Genetic Programming, Euro GP 2013, Vienna, Austria, pp 169–180 Otero FEB, Johnson CG (2013) Automated problem decomposition for the boolean domain with genetic programming. In: Proceedings of the 16th European Conference on Genetic Programming, Euro GP 2013, Vienna, Austria, pp 169–180
Zurück zum Zitat Roberts SC, Howard D, Koza JR (2001) Evolving modules in genetic programming by subtree encapsulation. In: Genetic programming, Proceedings of EuroGP'2001, Springer-Verlag, Lake Como, Italy, LNCS, vol 2038, pp 160–175 Roberts SC, Howard D, Koza JR (2001) Evolving modules in genetic programming by subtree encapsulation. In: Genetic programming, Proceedings of EuroGP'2001, Springer-Verlag, Lake Como, Italy, LNCS, vol 2038, pp 160–175
Zurück zum Zitat Rosca JP, Ballard DH (1994) Learning by adapting representations in genetic programming. In: Proceedings of the 1994 IEEE World Congress on Computational Intelligence, IEEE Press, Orlando, Florida, USA, vol 1, pp 407–412 Rosca JP, Ballard DH (1994) Learning by adapting representations in genetic programming. In: Proceedings of the 1994 IEEE World Congress on Computational Intelligence, IEEE Press, Orlando, Florida, USA, vol 1, pp 407–412
Zurück zum Zitat Spector L, Harrington K, Martin B, Helmuth T (2011a) What’s in an evolved name? the evolution of modularity via tag-based reference. In: Genetic programming theory and practice IX, Genetic and Evolutionary Computation. Springer, Ann Arbor, pp 1–16 Spector L, Harrington K, Martin B, Helmuth T (2011a) What’s in an evolved name? the evolution of modularity via tag-based reference. In: Genetic programming theory and practice IX, Genetic and Evolutionary Computation. Springer, Ann Arbor, pp 1–16
Zurück zum Zitat Spector L, Martin B, Harrington K, Helmuth T (2011b) Tag-based modules in genetic programming. In: GECCO '11: Proceedings of the 13th annual conference on genetic and evolutionary computation, ACM, Dublin, Ireland, pp 1419–1426 Spector L, Martin B, Harrington K, Helmuth T (2011b) Tag-based modules in genetic programming. In: GECCO '11: Proceedings of the 13th annual conference on genetic and evolutionary computation, ACM, Dublin, Ireland, pp 1419–1426
Zurück zum Zitat Spector L, Harrington K, Helmuth T (2012) Tag-based modularity in tree-based genetic programming. In: GECCO '12: Proceedings of the 14th international conference on Genetic and evolutionary computation conference, ACM, Philadelphia, Pennsylvania, USA, pp 815–822 Spector L, Harrington K, Helmuth T (2012) Tag-based modularity in tree-based genetic programming. In: GECCO '12: Proceedings of the 14th international conference on Genetic and evolutionary computation conference, ACM, Philadelphia, Pennsylvania, USA, pp 815–822
Zurück zum Zitat Uy NQ, Hoai NX, ONeill M, McKay RI, Galván-L&00F3#;pez E (2011) Semantically-based crossover in genetic programming: application to real-valued symbolic regression. Genet Programm Evol Mach 12(2):91–119 Uy NQ, Hoai NX, ONeill M, McKay RI, Galván-L&00F3#;pez E (2011) Semantically-based crossover in genetic programming: application to real-valued symbolic regression. Genet Programm Evol Mach 12(2):91–119
Zurück zum Zitat Vanneschi L, Castelli M, Manzoni L, Silva S (2013) A new implementation of geometric semantic GP and its application to problems in pharmacokinetics. In: Proceedings of the 16th European Conference on Genetic Programming, Euro GP 2013, Vienna, Austria, vol 7831, pp 205–216 Vanneschi L, Castelli M, Manzoni L, Silva S (2013) A new implementation of geometric semantic GP and its application to problems in pharmacokinetics. In: Proceedings of the 16th European Conference on Genetic Programming, Euro GP 2013, Vienna, Austria, vol 7831, pp 205–216
Zurück zum Zitat Vanneschi L, Castelli M, Silva S (2014) A survey of semantic methods in genetic programming. Genet Programm Evol Mach 15(2):1–20 Vanneschi L, Castelli M, Silva S (2014) A survey of semantic methods in genetic programming. Genet Programm Evol Mach 15(2):1–20
Zurück zum Zitat Walker JA, Miller JF (2008) The automatic acquisition, evolution and reuse of modules in cartesian genetic programming. IEEE Trans Evol Comput 12(4):397–417CrossRef Walker JA, Miller JF (2008) The automatic acquisition, evolution and reuse of modules in cartesian genetic programming. IEEE Trans Evol Comput 12(4):397–417CrossRef
Zurück zum Zitat White D, McDermott J, Castelli M, Manzoni L, Goldman B, Kronberger G, Jakowski W, OReilly UM, Luke S (2013) Better GP benchmarks: community survey results and proposals. Genet Programm Evol Mach 14(1):3–29CrossRef White D, McDermott J, Castelli M, Manzoni L, Goldman B, Kronberger G, Jakowski W, OReilly UM, Luke S (2013) Better GP benchmarks: community survey results and proposals. Genet Programm Evol Mach 14(1):3–29CrossRef
Metadaten
Titel
Sequential Symbolic Regression with Genetic Programming
verfasst von
Luiz Otávio V.B. Oliveira
Fernando E.B. Otero
Gisele L. Pappa
Julio Albinati
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-16030-6_5

Premium Partner