Skip to main content
SpringerLink
Log in

Global Convergence of the Broyden's Class of Quasi-Newton Methods with Nonmonotone Linesearch

  • Original Papers
  • Published:
Acta Mathematicae Applicatae Sinica Aims and scope Submit manuscript

Abstract

In this paper, the Broyden class of quasi-Newton methods for unconstrained optimization is investigated. Non-monotone linesearch procedure is introduced, which is combined with the Broyden's class. Under the convexity assumption on objective function, the global convergence of the Broyden's class is proved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Byrd, R.H., Liu, D.C, Nocedal, J. On the behavior of Broyden's class of quasi-Newton methods. Technical Report NAM 01, Department of Electrical Engineering and Computer Science, North-Western University, 1990

  2. Byrd, R.H., Nocedal, J. A tool for the analysis of quasi-Newton methods with application to unconstrained minimization. SIAM Journal on Numerical Analysis, 26: 727–739 (1989)

    Article  MATH  MathSciNet  Google Scholar 

  3. Byrd, R.H., Nocedal, J., Yuan, Y. Global convergence of a class of quasi-Newton methods on convex problems. SIAM Journal on Numerical Analysis, 24: 1171–1189 (1987)

    Article  MATH  MathSciNet  Google Scholar 

  4. Dennis, Jr.J.E., Mor´e, J.J. Quasi-Newton method, motivation and theory. SIAM Review, 19: 46–89 (1977)

    Article  MATH  MathSciNet  Google Scholar 

  5. Fletcher, R. Practical method of optimization, 2nd ed. John Wiley & Sons, New York, 1987

  6. Grippo, L., Lampariello, F., Lucidi, S. A nonmonotone line search technique for Newton's method. SIAM Journal on Numerical Analysis, 23: 707–716 (1986)

    Article  MATH  MathSciNet  Google Scholar 

  7. Han, J.Y., Liu, G.H. Global convergence analysis of a new non-monotone BFGS algorithm on convex objective functions. Computational Optimization and Applications, 7: 277–289 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  8. Ke, X.W. Convergence of the preconvex part of Broyden's family. Jouranl of Beijing Normal University, 31(1): 6–10 (1995)

    MATH  MathSciNet  Google Scholar 

  9. Liu, G.H., Han, J.Y, Sun, D.F. Global convergence of the BFGS algorithm with non-monotone linesearch. Optimizition, 34: 147–159 (1995)

    MATH  Google Scholar 

  10. Pearson, J.D. Variable metric methods of minimization. The Computer Journal, 12: 171–178 (1969)

    Article  MATH  MathSciNet  Google Scholar 

  11. Powell, M.J.D. Some global convergence properties of a variable metric algorithm for minimization without exact line searches. In: Cottle, R.W., Lemke, C.E. eds., Nonlinear Programming, SIAM-AMS Proceeding Vol. IX, SIAM publications, Philadelphia, 1997, 53–72

  12. Toint, Ph.L. A non-monotone trust region algorithm for nonlinear optimization subject to convex constraints. Mathematical Programming, 77: 69–94 (1997)

    Article  MathSciNet  Google Scholar 

  13. Yuan, Y. Numerical methods for nonlinear programming. Shanghai Scientific and Technical Publishers, Shanghai, 1993 (in Chinese)

  14. Zhang, Y., Tewarson, R.P. Quasi-Newton algorithms with updates from the preconvex part of Broyden's family. IMA Journal on Numerical Analysis, 8: 487–509 (1988)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Applied Mathematics, Academy of Mathematics and System Sciences, Chinese Academy of Sciences, Beijing, 100080, China

    Da-chuan Xu

Authors
  1. Da-chuan Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Da-chuan Xu.

Additional information

Partly supported by the National Natural Sciences Foundation of China (No. 19731001), Natural 973 Information Technology and High-Performance Software Program of China (No. G1998030401) and K. C. Wong Education Foundation, Hong Kong.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Xu, Dc. Global Convergence of the Broyden's Class of Quasi-Newton Methods with Nonmonotone Linesearch. Acta Mathematicae Applicatae Sinica, English Series 19, 19–24 (2003). https://doi.org/10.1007/s10255-003-0076-4

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10255-003-0076-4

Keywords

2000 MR Subject Classification

Search

Navigation