Skip to main content

2020 | OriginalPaper | Buchkapitel

A Random Line-Search Optimization Method via Modified Cholesky Decomposition for Non-linear Data Assimilation

verfasst von : Elias D. Nino-Ruiz

Erschienen in: Computational Science – ICCS 2020

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a line-search optimization method for non-linear data assimilation via random descent directions. The iterative method works as follows: at each iteration, quadratic approximations of the Three-Dimensional-Variational (3D-Var) cost function are built about current solutions. These approximations are employed to build sub-spaces onto which analysis increments can be estimated. We sample search-directions from those sub-spaces, and for each direction, a line-search optimization method is employed to estimate its optimal step length. Current solutions are updated based on directions along which the 3D-Var cost function decreases faster. We theoretically prove the global convergence of our proposed iterative method. Experimental tests are performed by using the Lorenz-96 model, and for reference, we employ a Maximum-Likelihood-Ensemble-Filter (MLEF) whose ensemble size doubles that of our implementation. The results reveal that, as the degree of observational operators increases, the use of additional directions can improve the accuracy of results in terms of \(\ell _2\)-norm of errors, and even more, our numerical results outperform those of the employed MLEF implementation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Nino-Ruiz, E.D., Guzman-Reyes, L.G., Beltran-Arrieta, R.: An adjoint-free four-dimensional variational data assimilation method via a modified Cholesky decomposition and an iterative Woodbury matrix formula. Nonlinear Dyn. 99(3), 2441–2457 (2020)CrossRef Nino-Ruiz, E.D., Guzman-Reyes, L.G., Beltran-Arrieta, R.: An adjoint-free four-dimensional variational data assimilation method via a modified Cholesky decomposition and an iterative Woodbury matrix formula. Nonlinear Dyn. 99(3), 2441–2457 (2020)CrossRef
3.
Zurück zum Zitat Evensen, G.: The ensemble Kalman filter: theoretical formulation and practical implementation. Ocean Dyn. 53(4), 343–367 (2003)CrossRef Evensen, G.: The ensemble Kalman filter: theoretical formulation and practical implementation. Ocean Dyn. 53(4), 343–367 (2003)CrossRef
4.
Zurück zum Zitat Stroud, J.R., Katzfuss, M., Wikle, C.K.: A Bayesian adaptive ensemble Kalman filter for sequential state and parameter estimation. Mon. Weather Rev. 146(1), 373–386 (2018)CrossRef Stroud, J.R., Katzfuss, M., Wikle, C.K.: A Bayesian adaptive ensemble Kalman filter for sequential state and parameter estimation. Mon. Weather Rev. 146(1), 373–386 (2018)CrossRef
5.
Zurück zum Zitat Greybush, S.J., Kalnay, E., Miyoshi, T., Ide, K., Hunt, B.R.: Balance and ensemble Kalman filter localization techniques. Mon. Weather Rev. 139(2), 511–522 (2011)CrossRef Greybush, S.J., Kalnay, E., Miyoshi, T., Ide, K., Hunt, B.R.: Balance and ensemble Kalman filter localization techniques. Mon. Weather Rev. 139(2), 511–522 (2011)CrossRef
6.
Zurück zum Zitat Nino-Ruiz, E.D., Sandu, A., Deng, X.: An ensemble Kalman filter implementation based on modified Cholesky decomposition for inverse covariance matrix estimation. SIAM J. Sci. Comput. 40(2), A867–A886 (2018)MathSciNetCrossRef Nino-Ruiz, E.D., Sandu, A., Deng, X.: An ensemble Kalman filter implementation based on modified Cholesky decomposition for inverse covariance matrix estimation. SIAM J. Sci. Comput. 40(2), A867–A886 (2018)MathSciNetCrossRef
7.
Zurück zum Zitat Bickel, P.J., Levina, E., et al.: Regularized estimation of large covariance matrices. Ann. Statist. 36(1), 199–227 (2008)MathSciNetCrossRef Bickel, P.J., Levina, E., et al.: Regularized estimation of large covariance matrices. Ann. Statist. 36(1), 199–227 (2008)MathSciNetCrossRef
8.
Zurück zum Zitat Nino-Ruiz, E.: A matrix-free posterior ensemble Kalman filter implementation based on a modified Cholesky decomposition. Atmosphere 8(7), 125 (2017)CrossRef Nino-Ruiz, E.: A matrix-free posterior ensemble Kalman filter implementation based on a modified Cholesky decomposition. Atmosphere 8(7), 125 (2017)CrossRef
9.
Zurück zum Zitat Zupanski, M.: Maximum likelihood ensemble filter: theoretical aspects. Mon. Weather Rev. 133(6), 1710–1726 (2005)CrossRef Zupanski, M.: Maximum likelihood ensemble filter: theoretical aspects. Mon. Weather Rev. 133(6), 1710–1726 (2005)CrossRef
10.
Zurück zum Zitat Zupanski, D., Zupanski, M.: Model error estimation employing an ensemble data assimilation approach. Mon. Weather Rev. 134(5), 1337–1354 (2006)CrossRef Zupanski, D., Zupanski, M.: Model error estimation employing an ensemble data assimilation approach. Mon. Weather Rev. 134(5), 1337–1354 (2006)CrossRef
11.
Zurück zum Zitat Savard, G., Gauvin, J.: The steepest descent direction for the nonlinear bilevel programming problem. Oper. Res. Lett. 15(5), 265–272 (1994)MathSciNetCrossRef Savard, G., Gauvin, J.: The steepest descent direction for the nonlinear bilevel programming problem. Oper. Res. Lett. 15(5), 265–272 (1994)MathSciNetCrossRef
12.
Zurück zum Zitat Pan, V.Y., Branham, S., Rosholt, R.E., Zheng, A.-L.: Newton’s iteration for structured matrices. In: Fast Reliable Algorithms for Matrices with Structure, pp. 189–210. SIAM (1999) Pan, V.Y., Branham, S., Rosholt, R.E., Zheng, A.-L.: Newton’s iteration for structured matrices. In: Fast Reliable Algorithms for Matrices with Structure, pp. 189–210. SIAM (1999)
13.
14.
Zurück zum Zitat Knoll, D.A., Keyes, D.E.: Jacobian-free Newton-Krylov methods: a survey of approaches and applications. J. Comput. Phys. 193(2), 357–397 (2004)MathSciNetCrossRef Knoll, D.A., Keyes, D.E.: Jacobian-free Newton-Krylov methods: a survey of approaches and applications. J. Comput. Phys. 193(2), 357–397 (2004)MathSciNetCrossRef
15.
Zurück zum Zitat Hosseini, S., Huang, W., Yousefpour, R.: Line search algorithms for locally Lipschitz functions on Riemannian manifolds. SIAM J. Optim. 28(1), 596–619 (2018)MathSciNetCrossRef Hosseini, S., Huang, W., Yousefpour, R.: Line search algorithms for locally Lipschitz functions on Riemannian manifolds. SIAM J. Optim. 28(1), 596–619 (2018)MathSciNetCrossRef
16.
Zurück zum Zitat Conn, A.R., Gould, N.I.M., Toint, Ph.L.: Trust region methods, vol. 1. SIAM (2000) Conn, A.R., Gould, N.I.M., Toint, Ph.L.: Trust region methods, vol. 1. SIAM (2000)
17.
Zurück zum Zitat Shi, Z.-J.: Convergence of line search methods for unconstrained optimization. Appl. Math. Comput. 157(2), 393–405 (2004)MathSciNetMATH Shi, Z.-J.: Convergence of line search methods for unconstrained optimization. Appl. Math. Comput. 157(2), 393–405 (2004)MathSciNetMATH
18.
Zurück zum Zitat Zhou, W., Akrotirianakis, I.G., Yektamaram, S., Griffin, J.D.: A matrix-free line-search algorithm for nonconvex optimization. Optim. Methods Softw. 34, 1–24 (2017)MathSciNetCrossRef Zhou, W., Akrotirianakis, I.G., Yektamaram, S., Griffin, J.D.: A matrix-free line-search algorithm for nonconvex optimization. Optim. Methods Softw. 34, 1–24 (2017)MathSciNetCrossRef
19.
Zurück zum Zitat Dunn, J.C.: Newton’s method and the Goldstein step-length rule for constrained minimization problems. SIAM J. Control Optim. 18(6), 659–674 (1980)MathSciNetCrossRef Dunn, J.C.: Newton’s method and the Goldstein step-length rule for constrained minimization problems. SIAM J. Control Optim. 18(6), 659–674 (1980)MathSciNetCrossRef
20.
Zurück zum Zitat Dai, Y.-H., Yuan, Y.: A nonlinear conjugate gradient method with a strong global convergence property. SIAM J. Optim. 10(1), 177–182 (1999)MathSciNetCrossRef Dai, Y.-H., Yuan, Y.: A nonlinear conjugate gradient method with a strong global convergence property. SIAM J. Optim. 10(1), 177–182 (1999)MathSciNetCrossRef
21.
Zurück zum Zitat Ravindran, A., Reklaitis, G.V., Ragsdell, K.M.: Engineering Optimization: Methods and Applications. Wiley, Hoboken (2006)CrossRef Ravindran, A., Reklaitis, G.V., Ragsdell, K.M.: Engineering Optimization: Methods and Applications. Wiley, Hoboken (2006)CrossRef
22.
Zurück zum Zitat Nino-Ruiz, E.D., Yang, X.-S.: Improved Tabu Search and Simulated Annealing methods for nonlinear data assimilation. Appl. Soft Comput. 83, 105624 (2019)CrossRef Nino-Ruiz, E.D., Yang, X.-S.: Improved Tabu Search and Simulated Annealing methods for nonlinear data assimilation. Appl. Soft Comput. 83, 105624 (2019)CrossRef
23.
Zurück zum Zitat Nino-Ruiz, E.D., Beltran-Arrieta, R., Mancilla Herrera, A.M.: Efficient matrix-free ensemble Kalman filter implementations: accounting for localization. In: Kalman Filters - Theory for Advanced Applications. InTech, February 2018 Nino-Ruiz, E.D., Beltran-Arrieta, R., Mancilla Herrera, A.M.: Efficient matrix-free ensemble Kalman filter implementations: accounting for localization. In: Kalman Filters - Theory for Advanced Applications. InTech, February 2018
24.
Zurück zum Zitat Nino-Ruiz, E.D., Cheng, H., Beltran, R.: A robust non-Gaussian data assimilation method for highly non-linear models. Atmosphere 9(4), 126 (2018)CrossRef Nino-Ruiz, E.D., Cheng, H., Beltran, R.: A robust non-Gaussian data assimilation method for highly non-linear models. Atmosphere 9(4), 126 (2018)CrossRef
25.
Zurück zum Zitat Gottwald, G.A., Melbourne, I.: Testing for chaos in deterministic systems with noise. Phys. D Nonlinear Phenom. 212(1–2), 100–110 (2005)MathSciNetCrossRef Gottwald, G.A., Melbourne, I.: Testing for chaos in deterministic systems with noise. Phys. D Nonlinear Phenom. 212(1–2), 100–110 (2005)MathSciNetCrossRef
26.
Zurück zum Zitat Karimi, A., Paul, M.R.: Extensive chaos in the Lorenz-96 model. Chaos Interdiscip. J. Nonlinear Sci. 20(4), 043105 (2010)CrossRef Karimi, A., Paul, M.R.: Extensive chaos in the Lorenz-96 model. Chaos Interdiscip. J. Nonlinear Sci. 20(4), 043105 (2010)CrossRef
27.
Zurück zum Zitat Wilks, D.S.: Comparison of ensemble-MOS methods in the Lorenz’96 setting. Meteorol. Appl. 13(3), 243–256 (2006)CrossRef Wilks, D.S.: Comparison of ensemble-MOS methods in the Lorenz’96 setting. Meteorol. Appl. 13(3), 243–256 (2006)CrossRef
28.
Zurück zum Zitat Fertig, E.J., Harlim, J., Hunt, B.R.: A comparative study of 4D-VAR and a 4D ensemble Kalman filter: perfect model simulations with Lorenz-96. Tellus A 59(1), 96–100 (2007)CrossRef Fertig, E.J., Harlim, J., Hunt, B.R.: A comparative study of 4D-VAR and a 4D ensemble Kalman filter: perfect model simulations with Lorenz-96. Tellus A 59(1), 96–100 (2007)CrossRef
Metadaten
Titel
A Random Line-Search Optimization Method via Modified Cholesky Decomposition for Non-linear Data Assimilation
verfasst von
Elias D. Nino-Ruiz
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-50426-7_15