Skip to main content

2016 | OriginalPaper | Buchkapitel

9. Conjugate Direction Methods

verfasst von : David G. Luenberger, Yinyu Ye

Erschienen in: Linear and Nonlinear Programming

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Conjugate direction methods can be regarded as being somewhat intermediate between the method of steepest descent and Newton’s method. They are motivated by the desire to accelerate the typically slow convergence associated with steepest descent while avoiding the information requirements associated with the evaluation, storage, and inversion of the Hessian (or at least solution of a corresponding system of equations) as required by Newton’s method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
[A7]
Zurück zum Zitat H.A. Antosiewicz, W.C. Rheinboldt, Numerical analysis and functional analysis, in Survey of Numerical Analysis, ed. by J. Todd, Chap. 14 (McGraw-Hill, New York, 1962) H.A. Antosiewicz, W.C. Rheinboldt, Numerical analysis and functional analysis, in Survey of Numerical Analysis, ed. by J. Todd, Chap. 14 (McGraw-Hill, New York, 1962)
[B8]
Zurück zum Zitat F.S. Beckman, The solution of linear equations by the conjugate gradient method, in Mathematical Methods for Digital Computers, ed. by A. Ralston, H.S. Wilf, vol. 1 (Wiley, New York, 1960) F.S. Beckman, The solution of linear equations by the conjugate gradient method, in Mathematical Methods for Digital Computers, ed. by A. Ralston, H.S. Wilf, vol. 1 (Wiley, New York, 1960)
[C4]
Zurück zum Zitat A. Cohen, Rate of convergence for root finding and optimization algorithms. Ph.D. dissertation, University of California, Berkeley, 1970 A. Cohen, Rate of convergence for root finding and optimization algorithms. Ph.D. dissertation, University of California, Berkeley, 1970
[D1]
Zurück zum Zitat J.W. Daniel, The conjugate gradient method for linear and nonlinear operator equations. SIAM J. Numer. Anal. 4(1), 10–26 (1967)CrossRef J.W. Daniel, The conjugate gradient method for linear and nonlinear operator equations. SIAM J. Numer. Anal. 4(1), 10–26 (1967)CrossRef
[F1]
Zurück zum Zitat D.K. Faddeev, V.N. Faddeeva, Computational Methods of Linear Algebra (W. H. Freeman, San Francisco, CA, 1963) D.K. Faddeev, V.N. Faddeeva, Computational Methods of Linear Algebra (W. H. Freeman, San Francisco, CA, 1963)
[F9]
Zurück zum Zitat R. Fletcher, Practical Methods of Optimization 1: Unconstrained Optimization (Wiley, Chichester, 1980) R. Fletcher, Practical Methods of Optimization 1: Unconstrained Optimization (Wiley, Chichester, 1980)
[F12]
Zurück zum Zitat R. Fletcher, C.M. Reeves, Function minimization by conjugate gradients. Comput. J. 7, 149–154 (1964)CrossRef R. Fletcher, C.M. Reeves, Function minimization by conjugate gradients. Comput. J. 7, 149–154 (1964)CrossRef
[F14]
Zurück zum Zitat G.E. Forsythe, On the asymptotic directions of the s-dimensional optimum gradient method. Numer. Math. 11, 57–76 (1968)CrossRef G.E. Forsythe, On the asymptotic directions of the s-dimensional optimum gradient method. Numer. Math. 11, 57–76 (1968)CrossRef
[H7]
Zurück zum Zitat M.R. Hestenes, The conjugate gradient method for solving linear systems, in Proceeding of Symposium in Applied Mathematics, vol. VI, Numerical Analysis (McGraw-Hill, New York 1956), pp. 83–102 M.R. Hestenes, The conjugate gradient method for solving linear systems, in Proceeding of Symposium in Applied Mathematics, vol. VI, Numerical Analysis (McGraw-Hill, New York 1956), pp. 83–102
[H9]
Zurück zum Zitat M.R. Hestenes, Conjugate-Direction Methods in Optimization (Springer, Berlin, 1980)CrossRef M.R. Hestenes, Conjugate-Direction Methods in Optimization (Springer, Berlin, 1980)CrossRef
[H10]
Zurück zum Zitat M.R. Hestenes, E.L. Stiefel, Methods of conjugate gradients for solving linear systems. J. Res. Natl. Bur. Stand. Sect. B 49, 409–436 (1952)CrossRef M.R. Hestenes, E.L. Stiefel, Methods of conjugate gradients for solving linear systems. J. Res. Natl. Bur. Stand. Sect. B 49, 409–436 (1952)CrossRef
[L8]
Zurück zum Zitat D.G. Luenberger, Optimization by Vector Space Methods (Wiley, New York, 1969) D.G. Luenberger, Optimization by Vector Space Methods (Wiley, New York, 1969)
[L9]
Zurück zum Zitat D.G. Luenberger, Hyperbolic pairs in the method of conjugate gradients. SIAM J. Appl. Math. 17(6), 1263–1267 (1969)CrossRef D.G. Luenberger, Hyperbolic pairs in the method of conjugate gradients. SIAM J. Appl. Math. 17(6), 1263–1267 (1969)CrossRef
[L11]
Zurück zum Zitat D. G. Luenberger, The conjugate residual method for constrained minimization problems. SIAM J. Numer. Anal. 7(3), 390–398 (1970)CrossRef D. G. Luenberger, The conjugate residual method for constrained minimization problems. SIAM J. Numer. Anal. 7(3), 390–398 (1970)CrossRef
[L13]
Zurück zum Zitat D.G. Luenberger, Convergence rate of a penalty-function scheme. J. Optim. Theory Appl. 7(1), 39–51 (1971)CrossRef D.G. Luenberger, Convergence rate of a penalty-function scheme. J. Optim. Theory Appl. 7(1), 39–51 (1971)CrossRef
[P4]
Zurück zum Zitat E. Polak, Computational Methods in Optimization: A Unified Approach (Academic, New York, 1971) E. Polak, Computational Methods in Optimization: A Unified Approach (Academic, New York, 1971)
[P5]
Zurück zum Zitat E. Polak, G. Ribiere, Note sur la Convergence de Methods de Directions Conjugres. Revue Francaise Informat. Recherche Operationnelle 16, 35–43 (1969) E. Polak, G. Ribiere, Note sur la Convergence de Methods de Directions Conjugres. Revue Francaise Informat. Recherche Operationnelle 16, 35–43 (1969)
[P6]
Zurück zum Zitat M.J.D. Powell, An efficient method for finding the minimum of a function of several variables without calculating derivatives. Comput. J. 7, 155–162 (1964)CrossRef M.J.D. Powell, An efficient method for finding the minimum of a function of several variables without calculating derivatives. Comput. J. 7, 155–162 (1964)CrossRef
[S2]
Zurück zum Zitat B. Shah, R. Buehler, O. Kempthorne, Some algorithms for minimizing a function of several variables. J. Soc. Ind. Appl. Math. 12, 74–92 (1964)CrossRef B. Shah, R. Buehler, O. Kempthorne, Some algorithms for minimizing a function of several variables. J. Soc. Ind. Appl. Math. 12, 74–92 (1964)CrossRef
[S10]
Zurück zum Zitat E.L. Stiefel, Kernel polynomials in linear algebra and their numerical applications. Nat. Bur. Stand. Appl. Math. Ser. 49, 1–22 (1958) E.L. Stiefel, Kernel polynomials in linear algebra and their numerical applications. Nat. Bur. Stand. Appl. Math. Ser. 49, 1–22 (1958)
[V6]
Zurück zum Zitat Y.V. Vorobyev, Methods of Moments in Applied Mathematics (Gordon and Breach, New York, 1965) Y.V. Vorobyev, Methods of Moments in Applied Mathematics (Gordon and Breach, New York, 1965)
[W5]
Zurück zum Zitat P. Wolfe, Methods of nonlinear programming (Chap. 6), in Nonlinear Programming, ed. by J. Abadie. Interscience (Wiley, New York, 1967), pp. 97–131 P. Wolfe, Methods of nonlinear programming (Chap. 6), in Nonlinear Programming, ed. by J. Abadie. Interscience (Wiley, New York, 1967), pp. 97–131
Metadaten
Titel
Conjugate Direction Methods
verfasst von
David G. Luenberger
Yinyu Ye
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-18842-3_9

Premium Partner