Skip to main content
Erschienen in: Neural Processing Letters 2/2021

07.03.2021

New Results for Prediction of Chaotic Systems Using Deep Recurrent Neural Networks

verfasst von: José de Jesús Serrano-Pérez, Guillermo Fernández-Anaya, Salvador Carrillo-Moreno, Wen Yu

Erschienen in: Neural Processing Letters | Ausgabe 2/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Prediction of nonlinear and dynamic systems is a challenging task, however with the aid of machine learning techniques, particularly neural networks, is now possible to accomplish this objective. Most common neural networks used are the multilayer perceptron (MLP) and recurrent neural networks (RNN) using long-short term memory units (LSTM-RNN). In recent years, deep learning neural network models have become more relevant due the improved results they show for various tasks. In this paper the authors compare these neural network models with deep learning neural network models such as long-short term memory deep recurrent neural network (LSTM-DRNN) and gate recurrent unit deep recurrent neural network (GRU-DRNN) when presented with the task of predicting three different chaotic systems such as the Lorenz system, Rabinovich–Fabrikant and the Rossler System. The results obtained show that the deep learning neural network model GRU-DRNN has better results when predicting these three chaotic systems in terms of loss and accuracy than the two other models using less neurons and layers. These results can be very helpful to solve much more complex problems such as the control and synchronization of these chaotic systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
3.
Zurück zum Zitat Azar A (2015) Chaos modeling and control systems design. Springer, ChamCrossRef Azar A (2015) Chaos modeling and control systems design. Springer, ChamCrossRef
8.
Zurück zum Zitat Chattopadhyay A, Hassanzadeh P, Subramanian D (2019) Data-driven prediction of a multi-scale Lorenz 96 chaotic system using deep learning methods: reservoir computing, ANN, and RNN-LSTM, pp 1–21. arXiv:1906.08829 Chattopadhyay A, Hassanzadeh P, Subramanian D (2019) Data-driven prediction of a multi-scale Lorenz 96 chaotic system using deep learning methods: reservoir computing, ANN, and RNN-LSTM, pp 1–21. arXiv:​1906.​08829
11.
Zurück zum Zitat Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. In: EMNLP 2014—2014 Conference on empirical methods in natural language processing, proceedings of the conference, pp 1724–1734. https://doi.org/10.3115/v1/d14-1179 Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. In: EMNLP 2014—2014 Conference on empirical methods in natural language processing, proceedings of the conference, pp 1724–1734. https://​doi.​org/​10.​3115/​v1/​d14-1179
14.
Zurück zum Zitat Devaney R (1992) A first course in chaotic dynamical systems? Theory and experiment. Addison-Wesley, ReadingMATH Devaney R (1992) A first course in chaotic dynamical systems? Theory and experiment. Addison-Wesley, ReadingMATH
17.
Zurück zum Zitat Pamina J, Raja JB (2019) Survey on deep learning algorithms. Int J Emerg Technol Innov Eng 5(1):38–43 Pamina J, Raja JB (2019) Survey on deep learning algorithms. Int J Emerg Technol Innov Eng 5(1):38–43
20.
Zurück zum Zitat Goodfellow I (2016) Deep learning. The MIT Press, CambridgeMATH Goodfellow I (2016) Deep learning. The MIT Press, CambridgeMATH
22.
Zurück zum Zitat Hilborn R (2000) Chaos and nonlinear dynamics? An introduction for scientists and engineers. Oxford University Press, OxfordCrossRef Hilborn R (2000) Chaos and nonlinear dynamics? An introduction for scientists and engineers. Oxford University Press, OxfordCrossRef
26.
Zurück zum Zitat Kutz M (2015) Mechanical engineers handbook. Materials and engineering mechanics. Wiley, Hoboken Kutz M (2015) Mechanical engineers handbook. Materials and engineering mechanics. Wiley, Hoboken
37.
Zurück zum Zitat Pascanu R, Mikolov T, Bengio Y (2012) On the difficulty of training recurrent neural networks. In: 30th International conference on machine learning, ICML 2013 (PART 3), pp 2347–2355. arXiv:1211.5063 Pascanu R, Mikolov T, Bengio Y (2012) On the difficulty of training recurrent neural networks. In: 30th International conference on machine learning, ICML 2013 (PART 3), pp 2347–2355. arXiv:​1211.​5063
38.
Zurück zum Zitat Poznyak A, Sanchez E, Perez J, Yu W (1997) Robust adaptive nonlinear system identification and trajectory tracking by dynamic neural networks. In: Proceedings of the 1997 American control conference (Cat. No. 97CH36041), vol 1. IEEE, pp 242–246. https://doi.org/10.1109/ACC.1997.611794 Poznyak A, Sanchez E, Perez J, Yu W (1997) Robust adaptive nonlinear system identification and trajectory tracking by dynamic neural networks. In: Proceedings of the 1997 American control conference (Cat. No. 97CH36041), vol 1. IEEE, pp 242–246. https://​doi.​org/​10.​1109/​ACC.​1997.​611794
39.
Zurück zum Zitat Rabinovich M, Fabrikant A (1979) Stochastic self-modulation of waves in nonequilibrium media. Sov J Exp Theor Phys 50(4):311 Rabinovich M, Fabrikant A (1979) Stochastic self-modulation of waves in nonequilibrium media. Sov J Exp Theor Phys 50(4):311
40.
Zurück zum Zitat Raissi M, Perdikaris P, Karniadakis GE (2018) Multistep neural networks for data-driven discovery of nonlinear dynamical systems, pp 1–19. arXiv:1801.01236 Raissi M, Perdikaris P, Karniadakis GE (2018) Multistep neural networks for data-driven discovery of nonlinear dynamical systems, pp 1–19. arXiv:​1801.​01236
42.
Zurück zum Zitat Samarasinghe S (2007) Neural networks for applied sciences and engineering? From fundamentals to complex pattern recognition. Auerbach, Boca RatonMATH Samarasinghe S (2007) Neural networks for applied sciences and engineering? From fundamentals to complex pattern recognition. Auerbach, Boca RatonMATH
43.
Zurück zum Zitat Scott A (2005) Encyclopedia of nonlinear science. Routledge, New YorkMATH Scott A (2005) Encyclopedia of nonlinear science. Routledge, New YorkMATH
47.
Zurück zum Zitat Skansi S (2018) Introduction to deep learning? From logical calculus to artificial intelligence. Springer, ChamCrossRef Skansi S (2018) Introduction to deep learning? From logical calculus to artificial intelligence. Springer, ChamCrossRef
48.
Zurück zum Zitat Strogatz S (2015) Nonlinear dynamics and chaos: with applications to physics, biology, chemistry, and engineering. Westview Press, a member of the Perseus Books Group, BoulderMATH Strogatz S (2015) Nonlinear dynamics and chaos: with applications to physics, biology, chemistry, and engineering. Westview Press, a member of the Perseus Books Group, BoulderMATH
49.
Zurück zum Zitat Thompson JMT (2002) Nonlinear dynamics and chaos. Wiley, New YorkMATH Thompson JMT (2002) Nonlinear dynamics and chaos. Wiley, New YorkMATH
51.
Zurück zum Zitat Weiss G, Goldberg Y, Yahav E (2018) On the practical computational power of finite precision rnns for language recognition Weiss G, Goldberg Y, Yahav E (2018) On the practical computational power of finite precision rnns for language recognition
Metadaten
Titel
New Results for Prediction of Chaotic Systems Using Deep Recurrent Neural Networks
verfasst von
José de Jesús Serrano-Pérez
Guillermo Fernández-Anaya
Salvador Carrillo-Moreno
Wen Yu
Publikationsdatum
07.03.2021
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2021
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10466-1

Weitere Artikel der Ausgabe 2/2021

Neural Processing Letters 2/2021 Zur Ausgabe

Neuer Inhalt