Skip to main content
Top

2021 | OriginalPaper | Chapter

Data Assimilation in the Latent Space of a Convolutional Autoencoder

Authors : Maddalena Amendola, Rossella Arcucci, Laetitia Mottet, César Quilodrán Casas, Shiwei Fan, Christopher Pain, Paul Linden, Yi-Ke Guo

Published in: Computational Science – ICCS 2021

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Data Assimilation (DA) is a Bayesian inference that combines the state of a dynamical system with real data collected by instruments at a given time. The goal of DA is to improve the accuracy of the dynamic system making its result as real as possible. One of the most popular technique for DA is the Kalman Filter (KF). When the dynamic system refers to a real world application, the representation of the state of a physical system usually leads to a big data problem. For these problems, KF results computationally too expensive and mandates to use of reduced order modeling techniques. In this paper we proposed a new methodology we called Latent Assimilation (LA). It consists in performing the KF in the latent space obtained by an Autoencoder with non-linear encoder functions and non-linear decoder functions. In the latent space, the dynamic system is represented by a surrogate model built by a Recurrent Neural Network. In particular, an Long Short Term Memory (LSTM) network is used to train a function which emulates the dynamic system in the latent space. The data from the dynamic model and the real data coming from the instruments are both processed through the Autoencoder. We apply the methodology to a real test case and we show that the LA has a good performance both in accuracy and in efficiency.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Arcucci, R., Pain, C., Guo, Y.: Effective variational data assimilation in air-pollution prediction. Big Data Min. Anal. 1(4), 297–307 (2018)CrossRef Arcucci, R., Pain, C., Guo, Y.: Effective variational data assimilation in air-pollution prediction. Big Data Min. Anal. 1(4), 297–307 (2018)CrossRef
2.
go back to reference Arcucci, R., Mottet, L., Pain, C., Guo, Y.: Optimal reduced space for variational data assimilation. J. Comput. Phys. 379, 51–69 (2019)MathSciNetCrossRef Arcucci, R., Mottet, L., Pain, C., Guo, Y.: Optimal reduced space for variational data assimilation. J. Comput. Phys. 379, 51–69 (2019)MathSciNetCrossRef
3.
go back to reference Arcucci, R., Zhu, J., Hu, S., Guo, Y.: Deep data assimilation: integrating deep learning with data assimilation. Appl. Sci. 11(3), 11–14 (2021). Multidisciplinary Digital Publishing InstituteCrossRef Arcucci, R., Zhu, J., Hu, S., Guo, Y.: Deep data assimilation: integrating deep learning with data assimilation. Appl. Sci. 11(3), 11–14 (2021). Multidisciplinary Digital Publishing InstituteCrossRef
4.
go back to reference Asch, M., Bocquet, M., Nodet, M.: Data Assimilation: Methods, Algorithms, and Applications. SIAM, Fundamentals of Algorithms, Philadelphia (2016)CrossRef Asch, M., Bocquet, M., Nodet, M.: Data Assimilation: Methods, Algorithms, and Applications. SIAM, Fundamentals of Algorithms, Philadelphia (2016)CrossRef
5.
go back to reference Babovic, V., Keijzer, M., Bundzel, M.: From global to local modelling: a case study in error correction of deterministic models. In: Proceedings of Fourth International Conference on Hydroinformatics (2000) Babovic, V., Keijzer, M., Bundzel, M.: From global to local modelling: a case study in error correction of deterministic models. In: Proceedings of Fourth International Conference on Hydroinformatics (2000)
6.
go back to reference Babovic, V., Caňizares, R., Jensen, H., Klinting, A.: Neural networks as routine for error updating of numerical models. J. Hydraul. Eng. 127(3), 181–193 (2001). American Society of Civil EngineersCrossRef Babovic, V., Caňizares, R., Jensen, H., Klinting, A.: Neural networks as routine for error updating of numerical models. J. Hydraul. Eng. 127(3), 181–193 (2001). American Society of Civil EngineersCrossRef
7.
go back to reference Babovic, V., Fuhrman, D.: Data assimilation of local model error forecasts in a deterministic model. Int. J. Numer. Methods Fluids 39(10), 887–918 (2002). Wiley Online LibraryCrossRef Babovic, V., Fuhrman, D.: Data assimilation of local model error forecasts in a deterministic model. Int. J. Numer. Methods Fluids 39(10), 887–918 (2002). Wiley Online LibraryCrossRef
8.
go back to reference Becker, P., Pandya, H., Gebhardt, G., Zhao, C., Taylor, J., Neumann, G.: Recurrent Kalman networks: factorized inference in high-dimensional deep feature spaces. arXiv preprint arXiv:1905.07357 (2019) Becker, P., Pandya, H., Gebhardt, G., Zhao, C., Taylor, J., Neumann, G.: Recurrent Kalman networks: factorized inference in high-dimensional deep feature spaces. arXiv preprint arXiv:​1905.​07357 (2019)
9.
go back to reference Boukabara, S., Krasnopolsky, V., Stewart, J., Maddy, E., Shahroudi, N., Hoffman, R.: Leveraging modern artificial intelligence for remote sensing and NWP: benefits and challenges. Bull. Am. Meteorol. Soc. 100(12), ES473–ES491 (2019)CrossRef Boukabara, S., Krasnopolsky, V., Stewart, J., Maddy, E., Shahroudi, N., Hoffman, R.: Leveraging modern artificial intelligence for remote sensing and NWP: benefits and challenges. Bull. Am. Meteorol. Soc. 100(12), ES473–ES491 (2019)CrossRef
10.
go back to reference Campos, R., Krasnopolsky, V., Alves, J., Penny, S.: Nonlinear wave ensemble averaging in the Gulf of Mexico using neural networks. J. Atmos. Oceanic Technol. 36(1), 113–127 (2019)CrossRef Campos, R., Krasnopolsky, V., Alves, J., Penny, S.: Nonlinear wave ensemble averaging in the Gulf of Mexico using neural networks. J. Atmos. Oceanic Technol. 36(1), 113–127 (2019)CrossRef
11.
go back to reference Cintra, R., Campos Velho, H.: Data assimilation by artificial neural networks for an atmospheric general circulation model. In: Advanced Applications for Artificial Neural Networks, p. 265. BoD-Books on Demand (2018) Cintra, R., Campos Velho, H.: Data assimilation by artificial neural networks for an atmospheric general circulation model. In: Advanced Applications for Artificial Neural Networks, p. 265. BoD-Books on Demand (2018)
12.
go back to reference Dozat, T.: Incorporating nesterov momentum into adam (2016) Dozat, T.: Incorporating nesterov momentum into adam (2016)
13.
go back to reference Dueben, P., Bauer, P.: Challenges and design choices for global weather and climate models based on machine learning. Geosci. Model Dev. 11(10), 3999–4009 (2018). Copernicus GmbHCrossRef Dueben, P., Bauer, P.: Challenges and design choices for global weather and climate models based on machine learning. Geosci. Model Dev. 11(10), 3999–4009 (2018). Copernicus GmbHCrossRef
14.
go back to reference Funahashi, K., Nakamura, Y.: Approximation of dynamical systems by continuous time recurrent neural networks. Neural Netw. 6(6), 801–806 (1993). ElsevierCrossRef Funahashi, K., Nakamura, Y.: Approximation of dynamical systems by continuous time recurrent neural networks. Neural Netw. 6(6), 801–806 (1993). ElsevierCrossRef
15.
go back to reference Gagne, D., McGovern, A., Haupt, S., Sobash, R., Williams, J., Xue, M.: Storm-based probabilistic hail forecasting with machine learning applied to convection-allowing ensembles. Weather Forecast. 32(5), 1819–1840 (2017)CrossRef Gagne, D., McGovern, A., Haupt, S., Sobash, R., Williams, J., Xue, M.: Storm-based probabilistic hail forecasting with machine learning applied to convection-allowing ensembles. Weather Forecast. 32(5), 1819–1840 (2017)CrossRef
16.
go back to reference Hannachi, A.: A primer for EOF analysis of climate data. Department of Meteorology University of Reading, pp. 1–33 (2004) Hannachi, A.: A primer for EOF analysis of climate data. Department of Meteorology University of Reading, pp. 1–33 (2004)
17.
go back to reference Hansen, P., Nagy, J., O’leary, D.: Deblurring Images: Matrices, Spectra, and Filtering, vol. 3. SIAM, Philadelphia (2006)CrossRef Hansen, P., Nagy, J., O’leary, D.: Deblurring Images: Matrices, Spectra, and Filtering, vol. 3. SIAM, Philadelphia (2006)CrossRef
18.
go back to reference Kalman, R.: A new approach to linear filtering and prediction problems. J. Basic Eng. 82(1), 35–45 (1960). American Society of Mechanical EngineersMathSciNetCrossRef Kalman, R.: A new approach to linear filtering and prediction problems. J. Basic Eng. 82(1), 35–45 (1960). American Society of Mechanical EngineersMathSciNetCrossRef
19.
go back to reference Loh, K., Omrani, P.S., van der Linden, R.: Deep learning and data assimilation for real-time production prediction in natural gas wells. arXiv preprint arXiv:1802.05141 (2018) Loh, K., Omrani, P.S., van der Linden, R.: Deep learning and data assimilation for real-time production prediction in natural gas wells. arXiv preprint arXiv:​1802.​05141 (2018)
20.
go back to reference Rasp, S., Dueben, P., Scher, S., Weyn, J., Mouatadid, S., Thuerey, N.: WeatherBench: a benchmark dataset for data-driven weather forecasting. arXiv preprint arXiv:2002.00469 (2020) Rasp, S., Dueben, P., Scher, S., Weyn, J., Mouatadid, S., Thuerey, N.: WeatherBench: a benchmark dataset for data-driven weather forecasting. arXiv preprint arXiv:​2002.​00469 (2020)
22.
go back to reference Song, J., et al.: Natural ventilation in cities: the implications of fluid mechanics. Build. Res. Inform. 46(8), 809–828 (2018). Taylor & FrancisCrossRef Song, J., et al.: Natural ventilation in cities: the implications of fluid mechanics. Build. Res. Inform. 46(8), 809–828 (2018). Taylor & FrancisCrossRef
23.
go back to reference Watter, M., Springenberg, J., Boedecker, J., Riedmiller, M.: Embed to control: a locally linear latent dynamics model for control from raw images. In: Advances in Neural Information Processing Systems, pp. 2746–2754 (2015) Watter, M., Springenberg, J., Boedecker, J., Riedmiller, M.: Embed to control: a locally linear latent dynamics model for control from raw images. In: Advances in Neural Information Processing Systems, pp. 2746–2754 (2015)
24.
go back to reference Wikle, C., Berliner, M.: A Bayesian tutorial for data assimilation. Phys. D Nonlinear Phenom. 230(1–2), 1–16 (2007). ElsevierMathSciNetCrossRef Wikle, C., Berliner, M.: A Bayesian tutorial for data assimilation. Phys. D Nonlinear Phenom. 230(1–2), 1–16 (2007). ElsevierMathSciNetCrossRef
25.
go back to reference Zhu, J., Hu, S., Arcucci, R., Xu, C., Zhu, J., Guo, Y.: Model error correction in data assimilation by integrating neural networks. Big Data Min. Anal. 2(2), 83–91 (2019). TUPCrossRef Zhu, J., Hu, S., Arcucci, R., Xu, C., Zhu, J., Guo, Y.: Model error correction in data assimilation by integrating neural networks. Big Data Min. Anal. 2(2), 83–91 (2019). TUPCrossRef
Metadata
Title
Data Assimilation in the Latent Space of a Convolutional Autoencoder
Authors
Maddalena Amendola
Rossella Arcucci
Laetitia Mottet
César Quilodrán Casas
Shiwei Fan
Christopher Pain
Paul Linden
Yi-Ke Guo
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-77977-1_30

Premium Partner