Skip to main content
Top
Published in: Neural Computing and Applications 1/2013

01-01-2013 | Cont. Dev. of Neural Compt. & Appln.

Time series forecasting by evolving artificial neural networks with genetic algorithms, differential evolution and estimation of distribution algorithm

Published in: Neural Computing and Applications | Issue 1/2013

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Time series forecasting is an important tool to support both individual and organizational decisions (e.g. planning production resources). In recent years, a large literature has evolved on the use of evolutionary artificial neural networks (EANN) in many forecasting applications. Evolving neural networks are particularly appealing because of their ability to model an unspecified nonlinear relationship between time series variables. In this work, two new approaches of a previous system, automatic design of artificial neural networks (ADANN) applied to forecast time series, are tackled. In ADANN, the automatic process to design artificial neural networks was carried out by a genetic algorithm (GA). This paper evaluates three methods to evolve neural networks architectures, one carried out with genetic algorithm, a second one carried out with differential evolution algorithm (DE) and the last one using estimation of distribution algorithms (EDA). A comparative study among these three methods with a set of referenced time series will be shown. In this paper, we also compare ADANN forecasting ability against a forecasting tool called Forecast Pro® (FP) software, using five benchmark time series. The object of this study is to try to improve the final forecasting getting an accurate system.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Makridakis S, Wheelwright S, Hyndman R (2008) Forecasting methods and applications, 2nd edn. Wiley, USA Makridakis S, Wheelwright S, Hyndman R (2008) Forecasting methods and applications, 2nd edn. Wiley, USA
2.
go back to reference Nunn I, White T (2005) The application of antigenic search techniques to time series forecasting. GECCO. In: Preparation of papers for international journal of automation and computing 13, pp 353–360 Nunn I, White T (2005) The application of antigenic search techniques to time series forecasting. GECCO. In: Preparation of papers for international journal of automation and computing 13, pp 353–360
3.
go back to reference Cortez P (2010) Sensitivity analysis for time lag selection to forecast seasonal time series using neural networks and support vector machines. In Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN 2010), pp 3694–3701, Barcelona, Spain Cortez P (2010) Sensitivity analysis for time lag selection to forecast seasonal time series using neural networks and support vector machines. In Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN 2010), pp 3694–3701, Barcelona, Spain
4.
go back to reference Crone S, Kourentzes N (2010) Feature selection for time series prediction a combined filter and wrapper approach for neural networks. Neurocomputing 73:1923–1936CrossRef Crone S, Kourentzes N (2010) Feature selection for time series prediction a combined filter and wrapper approach for neural networks. Neurocomputing 73:1923–1936CrossRef
5.
6.
go back to reference Kasabov N, Song Q (2002) Dens: Dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Trans Fuzzy Syst 10:144–154CrossRef Kasabov N, Song Q (2002) Dens: Dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Trans Fuzzy Syst 10:144–154CrossRef
7.
go back to reference Peralta J, Gutierrez G, Sanchis A (2008) Adann: automatic design of artificial neural networks. In Proceedings of the 2008 GECCO conference companion on Genetic and evolutionary computation, GECCO’08, pp 1863–1870, New York, NY, USA Peralta J, Gutierrez G, Sanchis A (2008) Adann: automatic design of artificial neural networks. In Proceedings of the 2008 GECCO conference companion on Genetic and evolutionary computation, GECCO’08, pp 1863–1870, New York, NY, USA
8.
go back to reference Hassan R, Nath B, Kirley M (2007) A fusion model of HMM, ANN and GA for stock market forecasting. Expert Systems with Applications 33:171–180CrossRef Hassan R, Nath B, Kirley M (2007) A fusion model of HMM, ANN and GA for stock market forecasting. Expert Systems with Applications 33:171–180CrossRef
9.
go back to reference Maqsood I, Khan MR, Abraham A (2007) An ensemble of neural networks for weather forecasting. Neural Comput Appl 13(2):112–122 Maqsood I, Khan MR, Abraham A (2007) An ensemble of neural networks for weather forecasting. Neural Comput Appl 13(2):112–122
10.
go back to reference Bengio S, Fessant F, Collobert D (1995) A connectionist system for medium term horizon time series prediction, In: Proc int workshop application neural networks to telecoms, pp 308–315 Bengio S, Fessant F, Collobert D (1995) A connectionist system for medium term horizon time series prediction, In: Proc int workshop application neural networks to telecoms, pp 308–315
11.
go back to reference Simon H (1998) Neural networks: a comprehensive foundation, 2nd edn. Prentice Hall, New Jersey Simon H (1998) Neural networks: a comprehensive foundation, 2nd edn. Prentice Hall, New Jersey
12.
go back to reference Ferreira TA, Vasconcelos GC, Adeodato PJ (2008) A new intelligent system methodology for time series forecasting with artificial neural networks. Neural Process Lett 28(2):113–129. doi:10.1007/s11063-008-9085-x Ferreira TA, Vasconcelos GC, Adeodato PJ (2008) A new intelligent system methodology for time series forecasting with artificial neural networks. Neural Process Lett 28(2):113–129. doi:10.​1007/​s11063-008-9085-x
13.
go back to reference Crone SF (2005) Stepwise selection of artificial neural networks models for time series prediction. Journal of Intelligent Systems, Department of Management Science Lancaster University Management School Lancaster, United Kingdom Crone SF (2005) Stepwise selection of artificial neural networks models for time series prediction. Journal of Intelligent Systems, Department of Management Science Lancaster University Management School Lancaster, United Kingdom
14.
go back to reference Zhang G, Patuwo BE, Hu MY (1998) Forecasting with artificial neural networks: the state of the art. Int J Forecast 14:35–62CrossRef Zhang G, Patuwo BE, Hu MY (1998) Forecasting with artificial neural networks: the state of the art. Int J Forecast 14:35–62CrossRef
16.
go back to reference T. Ash. Dynamic Node Creation in Backpropagation Networks ICS Report 8901, The Institute for Cognitive Science, University of California, San Diego (Saiensu-sh, 1988), 1988 T. Ash. Dynamic Node Creation in Backpropagation Networks ICS Report 8901, The Institute for Cognitive Science, University of California, San Diego (Saiensu-sh, 1988), 1988
17.
go back to reference Fogel DB, Fogel LJ, Porto VW (1990) Evolving neural network. Biol Cybern 63:487–493CrossRef Fogel DB, Fogel LJ, Porto VW (1990) Evolving neural network. Biol Cybern 63:487–493CrossRef
18.
go back to reference Gruau F (1992) Genetic synthesis of Boolean neural networks with a cell rewriting developmental process. Proceedings of COGANN-92 International Workshop on Combinations of Genetic Algorithms and Neural Networks, pp 55–74, IEEE Computer Society Press, Los Alamitos Gruau F (1992) Genetic synthesis of Boolean neural networks with a cell rewriting developmental process. Proceedings of COGANN-92 International Workshop on Combinations of Genetic Algorithms and Neural Networks, pp 55–74, IEEE Computer Society Press, Los Alamitos
19.
go back to reference Yao X, Lin Y (1997) A new evolutionary system for evolving artificial neural networks. Transactions on Neural Networks 8(3):694–713CrossRef Yao X, Lin Y (1997) A new evolutionary system for evolving artificial neural networks. Transactions on Neural Networks 8(3):694–713CrossRef
20.
go back to reference Kitano H (1990) Designing neural networks using genetic algorithms with graph generation system. Complex Systems 4:461–476MATH Kitano H (1990) Designing neural networks using genetic algorithms with graph generation system. Complex Systems 4:461–476MATH
21.
go back to reference Abraham A (2004) Meta-learning evolutionary artificial neural networks. Neurocomputing Journal 56c:1–38 Abraham A (2004) Meta-learning evolutionary artificial neural networks. Neurocomputing Journal 56c:1–38
22.
go back to reference Yao X (1993) A review of evolutionary artificial neural networks. International Journal of Intelligent Systems 8(4):539–567CrossRef Yao X (1993) A review of evolutionary artificial neural networks. International Journal of Intelligent Systems 8(4):539–567CrossRef
23.
go back to reference Cortez P, Rocha M, Neves J (2006) Time series forecasting by evolutionary neural networks. In: Rubuñal J, Dorado J (eds) Artificial Neural Networks in Real-Life Applications. chapter III. Idea Group Publishing, Hershey, pp 47–70 Cortez P, Rocha M, Neves J (2006) Time series forecasting by evolutionary neural networks. In: Rubuñal J, Dorado J (eds) Artificial Neural Networks in Real-Life Applications. chapter III. Idea Group Publishing, Hershey, pp 47–70
24.
go back to reference Niska H, Hiltunena T, Karppinenb A, Ruuskanena J Kolehmainena M (2004) Evolving the neural network model for forecasting air pollution time series. Eng Appl Artif Intell 17(2):159–167. ISSN: 0952-1976 Niska H, Hiltunena T, Karppinenb A, Ruuskanena J Kolehmainena M (2004) Evolving the neural network model for forecasting air pollution time series. Eng Appl Artif Intell 17(2):159–167. ISSN: 0952-1976
25.
go back to reference Chena Y-H, Chang F-J (2009) Evolutionary artificial neural networks for hydrological systems forecasting. J Hydrol 367(1–2):125–137. ISSN: 0022-1694 Chena Y-H, Chang F-J (2009) Evolutionary artificial neural networks for hydrological systems forecasting. J Hydrol 367(1–2):125–137. ISSN: 0022-1694
26.
go back to reference Chen Y, Yang B, Dong J (2005) Time-series prediction using a local linear wavelet neural network. Neurocomputing 69(4–6):449–465 Chen Y, Yang B, Dong J (2005) Time-series prediction using a local linear wavelet neural network. Neurocomputing 69(4–6):449–465
27.
go back to reference Rivas VM, Merelo JJ, Castillo PA, Arenas MG, Castellano, JG (2003) Evolving RBF neural networks for time-series forecasting with EvRBF. Inform Sci 165(3–4):207–220 Rivas VM, Merelo JJ, Castillo PA, Arenas MG, Castellano, JG (2003) Evolving RBF neural networks for time-series forecasting with EvRBF. Inform Sci 165(3–4):207–220
28.
go back to reference Araújo RA, Vasconselos GC, Ferreria AE (2007) Hybrid differential evolutionary system for financial time series forecasting. In: IEEE congress on evolutionary computation, pp 4329–4336 Araújo RA, Vasconselos GC, Ferreria AE (2007) Hybrid differential evolutionary system for financial time series forecasting. In: IEEE congress on evolutionary computation, pp 4329–4336
29.
go back to reference Abdul-Kader HM (2009) Neural networks training based on differential evolution algorithm compared with other architectures for weather forecasting 34. Int J Comput Sci Netw Secur 9(3):92–99 Abdul-Kader HM (2009) Neural networks training based on differential evolution algorithm compared with other architectures for weather forecasting 34. Int J Comput Sci Netw Secur 9(3):92–99
30.
go back to reference Fogel D (1998) Evolutionary Computation: Toward a New Philosophy of Machine Intelligence. Wiley-IEEE Press, New Jersey Fogel D (1998) Evolutionary Computation: Toward a New Philosophy of Machine Intelligence. Wiley-IEEE Press, New Jersey
33.
go back to reference Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley Professional, Boston. ISBN 978-0201157675MATH Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley Professional, Boston. ISBN 978-0201157675MATH
35.
go back to reference Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Global Opt 11:341–359MathSciNetMATHCrossRef Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Global Opt 11:341–359MathSciNetMATHCrossRef
36.
go back to reference Wickramasinghe W, Li X (2008) Choosing leaders for multi-objective PSO algorithms using differential evolution, in Proceedings of the seventh international conference on simulated evolution and learning (SEAL’08), Lecture Notes in Computer Science (LNCS 5361), Springer, Berlin, pp 249–258 Wickramasinghe W, Li X (2008) Choosing leaders for multi-objective PSO algorithms using differential evolution, in Proceedings of the seventh international conference on simulated evolution and learning (SEAL’08), Lecture Notes in Computer Science (LNCS 5361), Springer, Berlin, pp 249–258
37.
go back to reference Cotta C, Alba E, Sagarna R, Larrañaga P (2002) Adjusting weights in artificial neural networks using evolutionary algorithms. In: Larrañaga P, Lozano JA (eds) Estimation of distribution algorithms. A new tool for evolutionary computation. Kluwer, Dordrecht, pp 357–373 Cotta C, Alba E, Sagarna R, Larrañaga P (2002) Adjusting weights in artificial neural networks using evolutionary algorithms. In: Larrañaga P, Lozano JA (eds) Estimation of distribution algorithms. A new tool for evolutionary computation. Kluwer, Dordrecht, pp 357–373
39.
go back to reference Armstrong J (1985) Long-range forecasting. Wiley, New York Armstrong J (1985) Long-range forecasting. Wiley, New York
40.
go back to reference Andrawis R, Atiya A (2009) A new Bayesian formulation for Holt’s exponential smoothing. Journal of Forecasting 28(3):218–234MathSciNetCrossRef Andrawis R, Atiya A (2009) A new Bayesian formulation for Holt’s exponential smoothing. Journal of Forecasting 28(3):218–234MathSciNetCrossRef
42.
go back to reference Larrañaga P, Lozano JA (2001) Estimation of Distribution Algorithms. A new tool for evolutionary computation (genetic algorithms and evolutionary computation). Springer, Berlin Larrañaga P, Lozano JA (2001) Estimation of Distribution Algorithms. A new tool for evolutionary computation (genetic algorithms and evolutionary computation). Springer, Berlin
43.
go back to reference David Schaffer J, Caruana RA, Eshelman LJ (1991) Using genetic search to exploit the emergent behavior of neural networks. MIT Press, Cambridge, pp 244–248 David Schaffer J, Caruana RA, Eshelman LJ (1991) Using genetic search to exploit the emergent behavior of neural networks. MIT Press, Cambridge, pp 244–248
44.
go back to reference Peralta J, Li X, Gutierrez G, Sanchis A (2010) Time series forecasting by evolving artificial neural networks using genetic algorithms and differential evolution. In Proceedings of the 2010 WCCI conference, IJCNN-WCCI’10, pages 3999–4006, Barcelona, Spain Peralta J, Li X, Gutierrez G, Sanchis A (2010) Time series forecasting by evolving artificial neural networks using genetic algorithms and differential evolution. In Proceedings of the 2010 WCCI conference, IJCNN-WCCI’10, pages 3999–4006, Barcelona, Spain
45.
go back to reference Peralta J, Gutierrez G, Sanchis A (2010) Time series forecasting by evolving artificial neural networks using genetic algorithms and estimation of distribution algorithms. In Proceedings of the 2010 WCCI conference, IJCNN-WCCI’10, Barcelona, Spain Peralta J, Gutierrez G, Sanchis A (2010) Time series forecasting by evolving artificial neural networks using genetic algorithms and estimation of distribution algorithms. In Proceedings of the 2010 WCCI conference, IJCNN-WCCI’10, Barcelona, Spain
Metadata
Title
Time series forecasting by evolving artificial neural networks with genetic algorithms, differential evolution and estimation of distribution algorithm
Publication date
01-01-2013
Published in
Neural Computing and Applications / Issue 1/2013
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-011-0741-0

Other articles of this Issue 1/2013

Neural Computing and Applications 1/2013 Go to the issue

Premium Partner