Skip to main content
Top
Published in: Neural Processing Letters 2/2021

07-03-2021

New Results for Prediction of Chaotic Systems Using Deep Recurrent Neural Networks

Authors: José de Jesús Serrano-Pérez, Guillermo Fernández-Anaya, Salvador Carrillo-Moreno, Wen Yu

Published in: Neural Processing Letters | Issue 2/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Prediction of nonlinear and dynamic systems is a challenging task, however with the aid of machine learning techniques, particularly neural networks, is now possible to accomplish this objective. Most common neural networks used are the multilayer perceptron (MLP) and recurrent neural networks (RNN) using long-short term memory units (LSTM-RNN). In recent years, deep learning neural network models have become more relevant due the improved results they show for various tasks. In this paper the authors compare these neural network models with deep learning neural network models such as long-short term memory deep recurrent neural network (LSTM-DRNN) and gate recurrent unit deep recurrent neural network (GRU-DRNN) when presented with the task of predicting three different chaotic systems such as the Lorenz system, Rabinovich–Fabrikant and the Rossler System. The results obtained show that the deep learning neural network model GRU-DRNN has better results when predicting these three chaotic systems in terms of loss and accuracy than the two other models using less neurons and layers. These results can be very helpful to solve much more complex problems such as the control and synchronization of these chaotic systems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
3.
8.
go back to reference Chattopadhyay A, Hassanzadeh P, Subramanian D (2019) Data-driven prediction of a multi-scale Lorenz 96 chaotic system using deep learning methods: reservoir computing, ANN, and RNN-LSTM, pp 1–21. arXiv:1906.08829 Chattopadhyay A, Hassanzadeh P, Subramanian D (2019) Data-driven prediction of a multi-scale Lorenz 96 chaotic system using deep learning methods: reservoir computing, ANN, and RNN-LSTM, pp 1–21. arXiv:​1906.​08829
11.
go back to reference Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. In: EMNLP 2014—2014 Conference on empirical methods in natural language processing, proceedings of the conference, pp 1724–1734. https://doi.org/10.3115/v1/d14-1179 Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. In: EMNLP 2014—2014 Conference on empirical methods in natural language processing, proceedings of the conference, pp 1724–1734. https://​doi.​org/​10.​3115/​v1/​d14-1179
14.
go back to reference Devaney R (1992) A first course in chaotic dynamical systems? Theory and experiment. Addison-Wesley, ReadingMATH Devaney R (1992) A first course in chaotic dynamical systems? Theory and experiment. Addison-Wesley, ReadingMATH
17.
go back to reference Pamina J, Raja JB (2019) Survey on deep learning algorithms. Int J Emerg Technol Innov Eng 5(1):38–43 Pamina J, Raja JB (2019) Survey on deep learning algorithms. Int J Emerg Technol Innov Eng 5(1):38–43
20.
go back to reference Goodfellow I (2016) Deep learning. The MIT Press, CambridgeMATH Goodfellow I (2016) Deep learning. The MIT Press, CambridgeMATH
22.
go back to reference Hilborn R (2000) Chaos and nonlinear dynamics? An introduction for scientists and engineers. Oxford University Press, OxfordCrossRef Hilborn R (2000) Chaos and nonlinear dynamics? An introduction for scientists and engineers. Oxford University Press, OxfordCrossRef
26.
go back to reference Kutz M (2015) Mechanical engineers handbook. Materials and engineering mechanics. Wiley, Hoboken Kutz M (2015) Mechanical engineers handbook. Materials and engineering mechanics. Wiley, Hoboken
37.
go back to reference Pascanu R, Mikolov T, Bengio Y (2012) On the difficulty of training recurrent neural networks. In: 30th International conference on machine learning, ICML 2013 (PART 3), pp 2347–2355. arXiv:1211.5063 Pascanu R, Mikolov T, Bengio Y (2012) On the difficulty of training recurrent neural networks. In: 30th International conference on machine learning, ICML 2013 (PART 3), pp 2347–2355. arXiv:​1211.​5063
38.
go back to reference Poznyak A, Sanchez E, Perez J, Yu W (1997) Robust adaptive nonlinear system identification and trajectory tracking by dynamic neural networks. In: Proceedings of the 1997 American control conference (Cat. No. 97CH36041), vol 1. IEEE, pp 242–246. https://doi.org/10.1109/ACC.1997.611794 Poznyak A, Sanchez E, Perez J, Yu W (1997) Robust adaptive nonlinear system identification and trajectory tracking by dynamic neural networks. In: Proceedings of the 1997 American control conference (Cat. No. 97CH36041), vol 1. IEEE, pp 242–246. https://​doi.​org/​10.​1109/​ACC.​1997.​611794
39.
go back to reference Rabinovich M, Fabrikant A (1979) Stochastic self-modulation of waves in nonequilibrium media. Sov J Exp Theor Phys 50(4):311 Rabinovich M, Fabrikant A (1979) Stochastic self-modulation of waves in nonequilibrium media. Sov J Exp Theor Phys 50(4):311
40.
go back to reference Raissi M, Perdikaris P, Karniadakis GE (2018) Multistep neural networks for data-driven discovery of nonlinear dynamical systems, pp 1–19. arXiv:1801.01236 Raissi M, Perdikaris P, Karniadakis GE (2018) Multistep neural networks for data-driven discovery of nonlinear dynamical systems, pp 1–19. arXiv:​1801.​01236
42.
go back to reference Samarasinghe S (2007) Neural networks for applied sciences and engineering? From fundamentals to complex pattern recognition. Auerbach, Boca RatonMATH Samarasinghe S (2007) Neural networks for applied sciences and engineering? From fundamentals to complex pattern recognition. Auerbach, Boca RatonMATH
43.
go back to reference Scott A (2005) Encyclopedia of nonlinear science. Routledge, New YorkMATH Scott A (2005) Encyclopedia of nonlinear science. Routledge, New YorkMATH
47.
go back to reference Skansi S (2018) Introduction to deep learning? From logical calculus to artificial intelligence. Springer, ChamCrossRef Skansi S (2018) Introduction to deep learning? From logical calculus to artificial intelligence. Springer, ChamCrossRef
48.
go back to reference Strogatz S (2015) Nonlinear dynamics and chaos: with applications to physics, biology, chemistry, and engineering. Westview Press, a member of the Perseus Books Group, BoulderMATH Strogatz S (2015) Nonlinear dynamics and chaos: with applications to physics, biology, chemistry, and engineering. Westview Press, a member of the Perseus Books Group, BoulderMATH
49.
go back to reference Thompson JMT (2002) Nonlinear dynamics and chaos. Wiley, New YorkMATH Thompson JMT (2002) Nonlinear dynamics and chaos. Wiley, New YorkMATH
51.
go back to reference Weiss G, Goldberg Y, Yahav E (2018) On the practical computational power of finite precision rnns for language recognition Weiss G, Goldberg Y, Yahav E (2018) On the practical computational power of finite precision rnns for language recognition
Metadata
Title
New Results for Prediction of Chaotic Systems Using Deep Recurrent Neural Networks
Authors
José de Jesús Serrano-Pérez
Guillermo Fernández-Anaya
Salvador Carrillo-Moreno
Wen Yu
Publication date
07-03-2021
Publisher
Springer US
Published in
Neural Processing Letters / Issue 2/2021
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10466-1

Other articles of this Issue 2/2021

Neural Processing Letters 2/2021 Go to the issue