Skip to main content

2020 | OriginalPaper | Buchkapitel

Supermodeling: The Next Level of Abstraction in the Use of Data Assimilation

verfasst von : Marcin Sendera, Gregory S. Duane, Witold Dzwinel

Erschienen in: Computational Science – ICCS 2020

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Data assimilation (DA) is a key procedure that synchronizes a computer model with real observations. However, in the case of overparametrized complex systems modeling, the task of parameter-estimation through data assimilation can expand exponentially. It leads to unacceptable computational overhead, substantial inaccuracies in parameter matching, and wrong predictions. Here we define a Supermodel as a kind of ensembling scheme, which consists of a few sub-models representing various instances of the baseline model. The sub-models differ in parameter sets and are synchronized through couplings between the most sensitive dynamical variables. We demonstrate that after a short pretraining of the fully parametrized small sub-model ensemble, and then training a few latent parameters of the low-parameterized Supermodel, we can outperform in efficiency and accuracy the baseline model matched to data by a classical DA procedure.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
See the Chaos Focus Issue introduced in [11] for the origin and history of supermodeling.
 
2
Kalman filtering is equivalent to the popular 4D-Var algorithm, for a perfect model.
 
Literatur
1.
Zurück zum Zitat Andrieu, C., De Freitas, N., Doucet, A., Jordan, M.I.: An introduction to MCMC for machine learning. Mach. Learn. 50(1–2), 5–43 (2003)CrossRef Andrieu, C., De Freitas, N., Doucet, A., Jordan, M.I.: An introduction to MCMC for machine learning. Mach. Learn. 50(1–2), 5–43 (2003)CrossRef
2.
Zurück zum Zitat Asch, M., Bocquet, M., Nodet, M.: Data Assimilation: Methods, Algorithms, and Applications, vol. 11. SIAM, New Delhi (2016)CrossRef Asch, M., Bocquet, M., Nodet, M.: Data Assimilation: Methods, Algorithms, and Applications, vol. 11. SIAM, New Delhi (2016)CrossRef
4.
Zurück zum Zitat Van den Berge, L., Selten, F., Wiegerinck, W., Duane, G.: A multi-model ensemble method that combines imperfect models through learning. Earth Syst. Dynam. Discuss 1, 247–296 (2010)CrossRef Van den Berge, L., Selten, F., Wiegerinck, W., Duane, G.: A multi-model ensemble method that combines imperfect models through learning. Earth Syst. Dynam. Discuss 1, 247–296 (2010)CrossRef
5.
Zurück zum Zitat Bergemann, K., Reich, S.: A mollified ensemble kalman filter. Q. J. R. Meteorol. Soc. 136(651), 1636–1643 (2010)CrossRef Bergemann, K., Reich, S.: A mollified ensemble kalman filter. Q. J. R. Meteorol. Soc. 136(651), 1636–1643 (2010)CrossRef
6.
Zurück zum Zitat Clarté, G., Robert, C.P., Ryder, R., Stoehr, J.: Component-wise approximate Bayesian computation via gibbs-like steps. arXiv preprint arXiv:1905.13599 (2019) Clarté, G., Robert, C.P., Ryder, R., Stoehr, J.: Component-wise approximate Bayesian computation via gibbs-like steps. arXiv preprint arXiv:​1905.​13599 (2019)
7.
Zurück zum Zitat Del Moral, P., Doucet, A., Jasra, A.: An adaptive sequential monte carlo method for approximate bayesian computation. Stat. Comput. 22(5), 1009–1020 (2012)MathSciNetCrossRef Del Moral, P., Doucet, A., Jasra, A.: An adaptive sequential monte carlo method for approximate bayesian computation. Stat. Comput. 22(5), 1009–1020 (2012)MathSciNetCrossRef
8.
Zurück zum Zitat Drovandi, C., Everitt, R.G., Golightly, A., Prangle, D.: Ensemble MCMC: accelerating pseudo-marginal MCMC for state space models using the ensemble kalman filter. arXiv preprint arXiv:1906.02014 (2019) Drovandi, C., Everitt, R.G., Golightly, A., Prangle, D.: Ensemble MCMC: accelerating pseudo-marginal MCMC for state space models using the ensemble kalman filter. arXiv preprint arXiv:​1906.​02014 (2019)
9.
Zurück zum Zitat Duane, G.: Data assimilation as artificial perception and supermodeling as artificial consciousness, pp. 209–222 (2012) Duane, G.: Data assimilation as artificial perception and supermodeling as artificial consciousness, pp. 209–222 (2012)
10.
Zurück zum Zitat Duane, G.: Synchronicity from synchronized chaos. Entropy 17(3), 1701–1733 (2015)CrossRef Duane, G.: Synchronicity from synchronized chaos. Entropy 17(3), 1701–1733 (2015)CrossRef
11.
Zurück zum Zitat Duane, G., Grabow, C., Selten, F., Ghil, M.: Introduction to focus issue: synchronization in large networks and continuous media - data, models, and supermodels. Chaos: Interdisc. J. Nonlinear Sci. 27(12), 126601 (2017)CrossRef Duane, G., Grabow, C., Selten, F., Ghil, M.: Introduction to focus issue: synchronization in large networks and continuous media - data, models, and supermodels. Chaos: Interdisc. J. Nonlinear Sci. 27(12), 126601 (2017)CrossRef
12.
Zurück zum Zitat Dzwinel, W., Kłusek, A., Paszyński, M.: A concept of a prognostic system for personalized anti-tumor therapy based on supermodeling. Procedia Comput. Sci. 108, 1832–1841 (2017)CrossRef Dzwinel, W., Kłusek, A., Paszyński, M.: A concept of a prognostic system for personalized anti-tumor therapy based on supermodeling. Procedia Comput. Sci. 108, 1832–1841 (2017)CrossRef
13.
Zurück zum Zitat Dzwinel, W., Kłusek, A., Vasilyev, O.V.: Supermodeling in simulation of melanoma progression. Procedia Comput. Sci. 80, 999–1010 (2016)CrossRef Dzwinel, W., Kłusek, A., Vasilyev, O.V.: Supermodeling in simulation of melanoma progression. Procedia Comput. Sci. 80, 999–1010 (2016)CrossRef
14.
Zurück zum Zitat Fearnhead, P., Prangle, D.: Constructing summary statistics for approximate bayesian computation: semi-automatic approximate bayesian computation. J. R. Stat. Soc.: Ser. B (Stat. Methodol.) 74(3), 419–474 (2012)MathSciNetCrossRef Fearnhead, P., Prangle, D.: Constructing summary statistics for approximate bayesian computation: semi-automatic approximate bayesian computation. J. R. Stat. Soc.: Ser. B (Stat. Methodol.) 74(3), 419–474 (2012)MathSciNetCrossRef
15.
Zurück zum Zitat Ionides, E.L., Nguyen, D., Atchadé, Y., Stoev, S., King, A.A.: Inference for dynamic and latent variable models via iterated, perturbed bayes maps. Proc. Natl. Acad. Sci. 112(3), 719–724 (2015)MathSciNetCrossRef Ionides, E.L., Nguyen, D., Atchadé, Y., Stoev, S., King, A.A.: Inference for dynamic and latent variable models via iterated, perturbed bayes maps. Proc. Natl. Acad. Sci. 112(3), 719–724 (2015)MathSciNetCrossRef
16.
17.
Zurück zum Zitat Järvenpää, M., Gutmann, M.U., Pleska, A., Vehtari, A., Marttinen, P., et al.: Efficient acquisition rules for model-based approximate bayesian computation. Bayesian Anal. 14(2), 595–622 (2019)MathSciNetCrossRef Järvenpää, M., Gutmann, M.U., Pleska, A., Vehtari, A., Marttinen, P., et al.: Efficient acquisition rules for model-based approximate bayesian computation. Bayesian Anal. 14(2), 595–622 (2019)MathSciNetCrossRef
18.
Zurück zum Zitat Kalnay, E.: Atmospheric Modeling, Data Assimailation and Predictablity. Cambridge University Press, Cambridge (2003) Kalnay, E.: Atmospheric Modeling, Data Assimailation and Predictablity. Cambridge University Press, Cambridge (2003)
19.
Zurück zum Zitat Klinger, E., Rickert, D., Hasenauer, J.: pyABC: distributed, likelihood-free inference. Bioinformatics 34(20), 3591–3593 (2018)CrossRef Klinger, E., Rickert, D., Hasenauer, J.: pyABC: distributed, likelihood-free inference. Bioinformatics 34(20), 3591–3593 (2018)CrossRef
21.
Zurück zum Zitat Kypraios, T., Neal, P., Prangle, D.: A tutorial introduction to bayesian inference for stochastic epidemic models using approximate bayesian computation. Math. Biosci. 287, 42–53 (2017)MathSciNetCrossRef Kypraios, T., Neal, P., Prangle, D.: A tutorial introduction to bayesian inference for stochastic epidemic models using approximate bayesian computation. Math. Biosci. 287, 42–53 (2017)MathSciNetCrossRef
23.
Zurück zum Zitat Lukoševičius, M., Jaeger, H.: Reservoir computing approaches to recurrent neural network training. Comput. Sci. Rev. 3(3), 127–149 (2009)CrossRef Lukoševičius, M., Jaeger, H.: Reservoir computing approaches to recurrent neural network training. Comput. Sci. Rev. 3(3), 127–149 (2009)CrossRef
24.
Zurück zum Zitat Marjoram, P., Molitor, J., Plagnol, V., Tavaré, S.: Markov chain monte carlo without likelihoods. Proc. Natl. Acad. Sci. 100(26), 15324–15328 (2003)CrossRef Marjoram, P., Molitor, J., Plagnol, V., Tavaré, S.: Markov chain monte carlo without likelihoods. Proc. Natl. Acad. Sci. 100(26), 15324–15328 (2003)CrossRef
25.
Zurück zum Zitat Motesharrei, S., Rivas, J., Kalnay, E.: Human and nature dynamics (handy): modeling inequality and use of resources in the collapse or sustainability of societies. Ecol. Econ. 101, 90–102 (2014)CrossRef Motesharrei, S., Rivas, J., Kalnay, E.: Human and nature dynamics (handy): modeling inequality and use of resources in the collapse or sustainability of societies. Ecol. Econ. 101, 90–102 (2014)CrossRef
27.
Zurück zum Zitat Saltelli, A., Annoni, P., Azzini, I., Campolongo, F., Ratto, M., Tarantola, S.: Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index. Comput. Phys. Commun. 181(2), 259–270 (2010)MathSciNetCrossRef Saltelli, A., Annoni, P., Azzini, I., Campolongo, F., Ratto, M., Tarantola, S.: Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index. Comput. Phys. Commun. 181(2), 259–270 (2010)MathSciNetCrossRef
28.
Zurück zum Zitat Särkkä, S.: Bayesian Filtering and Smoothing, vol. 3. Cambridge University Press, Cambridge (2013)CrossRef Särkkä, S.: Bayesian Filtering and Smoothing, vol. 3. Cambridge University Press, Cambridge (2013)CrossRef
29.
Zurück zum Zitat Selten, F.M., Duane, G., Wiegerinck, W., Keenlyside, N., Kurths, J., Kocarev, L.: Supermodeling by combining imperfect models. Procedia Comput. Sci. 7, 261–263 (2011)CrossRef Selten, F.M., Duane, G., Wiegerinck, W., Keenlyside, N., Kurths, J., Kocarev, L.: Supermodeling by combining imperfect models. Procedia Comput. Sci. 7, 261–263 (2011)CrossRef
30.
Zurück zum Zitat Selten, F.M., Schevenhoven, F.J., Duane, G.S.: Simulating climate with a synchronization-based supermodel. Chaos: Interdisc. J. Nonlinear Sci. 27(12), 126903 (2017)MathSciNetCrossRef Selten, F.M., Schevenhoven, F.J., Duane, G.S.: Simulating climate with a synchronization-based supermodel. Chaos: Interdisc. J. Nonlinear Sci. 27(12), 126903 (2017)MathSciNetCrossRef
32.
Zurück zum Zitat Shen, M.L., Keenlyside, N., Bhatt, B., Duane, G.: Role of atmosphere-ocean interactions in super-modeling the tropical pacific climate. Chaos: Interdisc. J. Nonlinear Sci. 27(12), 126704 (2017)CrossRef Shen, M.L., Keenlyside, N., Bhatt, B., Duane, G.: Role of atmosphere-ocean interactions in super-modeling the tropical pacific climate. Chaos: Interdisc. J. Nonlinear Sci. 27(12), 126704 (2017)CrossRef
33.
Zurück zum Zitat Siwik, L., Los, M., Klusek, A., Pingali, K., Dzwinel, W., Paszynski, M.: Supermodeling of tumor dynamics with parallel isogeometric analysis solver. arXiv preprint arXiv:1912.12836 (2019) Siwik, L., Los, M., Klusek, A., Pingali, K., Dzwinel, W., Paszynski, M.: Supermodeling of tumor dynamics with parallel isogeometric analysis solver. arXiv preprint arXiv:​1912.​12836 (2019)
34.
Zurück zum Zitat Sobol, I.M.: Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates. Math. Comput. Simul. 55(1–3), 271–280 (2001)MathSciNetCrossRef Sobol, I.M.: Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates. Math. Comput. Simul. 55(1–3), 271–280 (2001)MathSciNetCrossRef
35.
Zurück zum Zitat Sunnåker, M., Busetto, A.G., Numminen, E., Corander, J., Foll, M., Dessimoz, C.: Approximate bayesian computation. PLoS Comput. Biol. 9(1), e1002803 (2013)MathSciNetCrossRef Sunnåker, M., Busetto, A.G., Numminen, E., Corander, J., Foll, M., Dessimoz, C.: Approximate bayesian computation. PLoS Comput. Biol. 9(1), e1002803 (2013)MathSciNetCrossRef
36.
Zurück zum Zitat Toni, T., Stumpf, M.P.: Simulation-based model selection for dynamical systems in systems and population biology. Bioinformatics 26(1), 104–110 (2009)CrossRef Toni, T., Stumpf, M.P.: Simulation-based model selection for dynamical systems in systems and population biology. Bioinformatics 26(1), 104–110 (2009)CrossRef
37.
Zurück zum Zitat Wiegerinck, W., Selten, F.: Attractor learning in synchronized chaotic systems in the presence of unresolved scales. Chaos: Interdisc. J. Nonlinear Sci. 27(12), 126901 (2017)MathSciNetCrossRef Wiegerinck, W., Selten, F.: Attractor learning in synchronized chaotic systems in the presence of unresolved scales. Chaos: Interdisc. J. Nonlinear Sci. 27(12), 126901 (2017)MathSciNetCrossRef
38.
Zurück zum Zitat Wiegerinck, W., Burgers, W., Selten, F.: On the limit of large couplings and weighted averaged dynamics. In: Kocarev, L. (ed.) Consensus and Synchronization in Complex Networks. UCS, pp. 257–275. Springer, Heidelberg (2013)CrossRef Wiegerinck, W., Burgers, W., Selten, F.: On the limit of large couplings and weighted averaged dynamics. In: Kocarev, L. (ed.) Consensus and Synchronization in Complex Networks. UCS, pp. 257–275. Springer, Heidelberg (2013)CrossRef
Metadaten
Titel
Supermodeling: The Next Level of Abstraction in the Use of Data Assimilation
verfasst von
Marcin Sendera
Gregory S. Duane
Witold Dzwinel
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-50433-5_11