Skip to main content

2020 | OriginalPaper | Buchkapitel

Preconditioned Subspace Descent Methods for the Solution of Nonlinear Systems of Equations

verfasst von : Igor Kaporin

Erschienen in: Optimization and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nonlinear least squares type iterative solver for f(x) = 0 is considered based on successive solution of orthogonal projections of the linearized equation on a sequence of appropriately chosen low-dimensional subspaces. The bases of the latter are constructed using only the first-order derivatives of the function. The techniques based on the concept of the limiting stepsize along normalized direction (developed earlier by the author) is used to guarantee the monotone decrease of the nonlinear residual norm. The results of numerical testing are presented, including not only small-sized standard test problems, but also larger and harder examples, such as algebraic problems associated with canonical decomposition of dense and sparse 3D tensors as well as finite-difference discretizations of 2D nonlinear boundary problems for 2nd order partial differential equations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Armijo, L.: Minimization of functions having Lipschitz continuous first partial derivatives. Pac. J. Math. 16(1), 1–3 (1966)MathSciNetMATHCrossRef Armijo, L.: Minimization of functions having Lipschitz continuous first partial derivatives. Pac. J. Math. 16(1), 1–3 (1966)MathSciNetMATHCrossRef
2.
Zurück zum Zitat Bellavia, S., Bertaccini, D., Morini, B.: Nonsymmetric preconditioner updates in Newton-Krylov methods for nonlinear systems. SIAM J. Sci. Comput. 33(5), 2595–2619 (2011)MathSciNetMATHCrossRef Bellavia, S., Bertaccini, D., Morini, B.: Nonsymmetric preconditioner updates in Newton-Krylov methods for nonlinear systems. SIAM J. Sci. Comput. 33(5), 2595–2619 (2011)MathSciNetMATHCrossRef
3.
Zurück zum Zitat Bellavia, S., Gratton, S., Riccietti, E.: A Levenberg-Marquardt method for large nonlinear least-squares problems with dynamic accuracy in functions and gradients. Numer. Math. 140(3), 791–825 (2018)MathSciNetMATHCrossRef Bellavia, S., Gratton, S., Riccietti, E.: A Levenberg-Marquardt method for large nonlinear least-squares problems with dynamic accuracy in functions and gradients. Numer. Math. 140(3), 791–825 (2018)MathSciNetMATHCrossRef
4.
Zurück zum Zitat Bellavia, S., Morini, B.: Strong local convergence properties of adaptive regularized methods for nonlinear least squares. IMA J. Numer. Anal. 35(2), 947–968 (2015)MathSciNetMATHCrossRef Bellavia, S., Morini, B.: Strong local convergence properties of adaptive regularized methods for nonlinear least squares. IMA J. Numer. Anal. 35(2), 947–968 (2015)MathSciNetMATHCrossRef
6.
Zurück zum Zitat Brent, R.P.: Algorithms for matrix multiplication (No. STAN-CS-70-157). Stanford Univ. CA Dept. of Computer Science (1970) Brent, R.P.: Algorithms for matrix multiplication (No. STAN-CS-70-157). Stanford Univ. CA Dept. of Computer Science (1970)
8.
Zurück zum Zitat Kaporin, I.E.: Estimating global convergence of inexact Newton methods via limiting step size along normalized direction. Rep 9329, Department of Mathematics, Catholic University of Nijmegen, Nijmegen, The Netherlands, 8p., July 1993 Kaporin, I.E.: Estimating global convergence of inexact Newton methods via limiting step size along normalized direction. Rep 9329, Department of Mathematics, Catholic University of Nijmegen, Nijmegen, The Netherlands, 8p., July 1993
9.
Zurück zum Zitat Kaporin, I.E.: The use of preconditioned Krylov subspaces in conjugate gradient type methods for the solution of nonlinear least square problems. (Russian) Vestnik Mosk. Univ., Ser. 15 (Computational Math. and Cybernetics), No. 3, 26–31 (1995) Kaporin, I.E.: The use of preconditioned Krylov subspaces in conjugate gradient type methods for the solution of nonlinear least square problems. (Russian) Vestnik Mosk. Univ., Ser. 15 (Computational Math. and Cybernetics), No. 3, 26–31 (1995)
10.
Zurück zum Zitat Kaporin, I.E., Axelsson, O.: On a class of nonlinear equation solvers based on the residual norm reduction over a sequence of affine subspaces. SIAM J. Sci. Comput. 16(1), 228–249 (1994)MathSciNetMATHCrossRef Kaporin, I.E., Axelsson, O.: On a class of nonlinear equation solvers based on the residual norm reduction over a sequence of affine subspaces. SIAM J. Sci. Comput. 16(1), 228–249 (1994)MathSciNetMATHCrossRef
11.
Zurück zum Zitat Kazeev, V.A., Tyrtyshnikov, E.E.: Structure of the Hessian matrix and an economical implementation of Newton’s method in the problem of canonical approximation of tensors. Comput. Math. Math. Phys. 50(6), 927–945 (2010)MathSciNetMATHCrossRef Kazeev, V.A., Tyrtyshnikov, E.E.: Structure of the Hessian matrix and an economical implementation of Newton’s method in the problem of canonical approximation of tensors. Comput. Math. Math. Phys. 50(6), 927–945 (2010)MathSciNetMATHCrossRef
12.
Zurück zum Zitat Laderman, J.D.: A noncommutative algorithm for multiplying 3 x 3 matrices using 23 multiplications. Bull. Am. Math. Soc. 82(1), 126–128 (1976)MathSciNetMATHCrossRef Laderman, J.D.: A noncommutative algorithm for multiplying 3 x 3 matrices using 23 multiplications. Bull. Am. Math. Soc. 82(1), 126–128 (1976)MathSciNetMATHCrossRef
13.
Zurück zum Zitat Luksan, L., Matonoha, C., Vlcek, J.: Problems for nonlinear least squares and nonlinear equations. Technical Report V-1259. ICS AS CR, Prague, 36 s (2018) Luksan, L., Matonoha, C., Vlcek, J.: Problems for nonlinear least squares and nonlinear equations. Technical Report V-1259. ICS AS CR, Prague, 36 s (2018)
14.
Zurück zum Zitat More, J.J., Garbow, B.S., Hillstrom, K.E.: Testing unconstrained optimization software. Argonne National Laboratory, Applied Mathematics Division, Technical Memorandum No. 324, 96 pp. July 1978 More, J.J., Garbow, B.S., Hillstrom, K.E.: Testing unconstrained optimization software. Argonne National Laboratory, Applied Mathematics Division, Technical Memorandum No. 324, 96 pp. July 1978
15.
Zurück zum Zitat Oseledets, I.V., Savostyanov, D.V.: Minimization methods for approximating tensors and their comparison. Comput. Math. Math. Phys. 46(10), 1641–1650 (2006)MathSciNetCrossRef Oseledets, I.V., Savostyanov, D.V.: Minimization methods for approximating tensors and their comparison. Comput. Math. Math. Phys. 46(10), 1641–1650 (2006)MathSciNetCrossRef
16.
Zurück zum Zitat Sterck, H.D., Winlaw, M.: A nonlinearly preconditioned conjugate gradient algorithm for rank-R canonical tensor approximation. Numer. Linear Algebra Appl. 22(3), 410–432 (2015)MathSciNetMATHCrossRef Sterck, H.D., Winlaw, M.: A nonlinearly preconditioned conjugate gradient algorithm for rank-R canonical tensor approximation. Numer. Linear Algebra Appl. 22(3), 410–432 (2015)MathSciNetMATHCrossRef
17.
Zurück zum Zitat Sterck, H.D., Miller, K.: An adaptive algebraic multigrid algorithm for low-rank canonical tensor decomposition. SIAM J. Sci. Comput. 35(1), B1–B24 (2013)MathSciNetMATHCrossRef Sterck, H.D., Miller, K.: An adaptive algebraic multigrid algorithm for low-rank canonical tensor decomposition. SIAM J. Sci. Comput. 35(1), B1–B24 (2013)MathSciNetMATHCrossRef
19.
Zurück zum Zitat Tichavsky, P., Phan, A.H., Cichocki, A.: Numerical CP decomposition of some difficult tensors. J. Comput. Appl. Math. 317, 362–370 (2017)MathSciNetMATHCrossRef Tichavsky, P., Phan, A.H., Cichocki, A.: Numerical CP decomposition of some difficult tensors. J. Comput. Appl. Math. 317, 362–370 (2017)MathSciNetMATHCrossRef
20.
Zurück zum Zitat Toint, Ph.L.: Some numerical results using a sparse matrix updating formula in unconstrained optimization. Math. Comput. 32(143), 839–851 (1978)MathSciNetMATHCrossRef Toint, Ph.L.: Some numerical results using a sparse matrix updating formula in unconstrained optimization. Math. Comput. 32(143), 839–851 (1978)MathSciNetMATHCrossRef
21.
Zurück zum Zitat Yuan, Y.X.: Recent advances in numerical methods for nonlinear equations and nonlinear least squares. Numer. algebra, Control Optim. 1(1), 15–34 (2011)MathSciNetMATHCrossRef Yuan, Y.X.: Recent advances in numerical methods for nonlinear equations and nonlinear least squares. Numer. algebra, Control Optim. 1(1), 15–34 (2011)MathSciNetMATHCrossRef
Metadaten
Titel
Preconditioned Subspace Descent Methods for the Solution of Nonlinear Systems of Equations
verfasst von
Igor Kaporin
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-38603-0_13