Skip to main content
Top
Published in: Journal of Applied Mathematics and Computing 1-2/2015

01-06-2015 | Original Research

An efficient implementation of a trust region method for box constrained optimization

Authors: Hamid Esmaeili, Morteza Kimiaei

Published in: Journal of Applied Mathematics and Computing | Issue 1-2/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The present research deals with a trust-region-based procedure to solve box constrained optimization problems. Our procedure takes the advantage of the compact limited memory BFGS update formula together with an adaptive radius strategy. This adaptive technique leads to decreasing the number of solved subproblems and the total number of iterations, while utilizing the structure of limited memory quasi-Newton formula helps us to handle large-scale problems. Using classical assumptions, we prove that our method is a global convergence to first-order stationary points. Preliminary numerical experiments indicate that our new approach is considerably promising to solve box constrained optimization problems, especially for large-scale ones.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ahookhosh, M., Amini, K.: A nonmonotone trust region method with adaptive radius for unconstrained optimization problems. Comput. Math. Appl. 60, 411–422 (2010)CrossRefMATHMathSciNet Ahookhosh, M., Amini, K.: A nonmonotone trust region method with adaptive radius for unconstrained optimization problems. Comput. Math. Appl. 60, 411–422 (2010)CrossRefMATHMathSciNet
2.
go back to reference Birgin, E.G., Martínez, J.M., Raydan, M.: Nonmonotone spectral projected gradient methods on convex sets. SIAM J. Optim. 10, 1196–1121 (2000)CrossRefMATHMathSciNet Birgin, E.G., Martínez, J.M., Raydan, M.: Nonmonotone spectral projected gradient methods on convex sets. SIAM J. Optim. 10, 1196–1121 (2000)CrossRefMATHMathSciNet
3.
go back to reference Birgin, E.G., Martínez, J.M., Raydan, M.: Algorithm 813: SPGsoftware for convex-constrained optimization. ACM Trans. Math. Softw. 27, 340–349 (2001)CrossRefMATH Birgin, E.G., Martínez, J.M., Raydan, M.: Algorithm 813: SPGsoftware for convex-constrained optimization. ACM Trans. Math. Softw. 27, 340–349 (2001)CrossRefMATH
5.
go back to reference Burke, J.V., Xu, L.: An active set \(\ell _{\infty }\)-trust region algorithm for box constrained optimization. Department of Mathematics, University of Washington, Seattle, Technical Report preprint (2007) Burke, J.V., Xu, L.: An active set \(\ell _{\infty }\)-trust region algorithm for box constrained optimization. Department of Mathematics, University of Washington, Seattle, Technical Report preprint (2007)
6.
go back to reference Byrd, R., Nocedal, J., Schnabel, R.: Representation of quasi-Newton matrices and their use in limited memory methods. Math. Progr. 63, 129–156 (1994)CrossRefMATHMathSciNet Byrd, R., Nocedal, J., Schnabel, R.: Representation of quasi-Newton matrices and their use in limited memory methods. Math. Progr. 63, 129–156 (1994)CrossRefMATHMathSciNet
7.
go back to reference Byrd, R.H., Lu, P., Nocedal, J., Zhu, C.: A limited memory algorithm for bunded constrained optimization. SIAM J. Sci. Stat. Comput. 16, 1190–1208 (1995)CrossRefMATHMathSciNet Byrd, R.H., Lu, P., Nocedal, J., Zhu, C.: A limited memory algorithm for bunded constrained optimization. SIAM J. Sci. Stat. Comput. 16, 1190–1208 (1995)CrossRefMATHMathSciNet
8.
go back to reference Conn, A.R., Gould, N.I.M., Toint, PhL: Testing a class of methods for solving minimization problems with simple bounded on the variables. Math. Comput. 50, 399–430 (1988)CrossRefMATHMathSciNet Conn, A.R., Gould, N.I.M., Toint, PhL: Testing a class of methods for solving minimization problems with simple bounded on the variables. Math. Comput. 50, 399–430 (1988)CrossRefMATHMathSciNet
9.
go back to reference Conn, A.R., Gould, N.I.M., Toint, PhL: Trust-region methods. Society for Industrial and Applied Mathematics, SIAM, Philadelphia (2000)CrossRefMATH Conn, A.R., Gould, N.I.M., Toint, PhL: Trust-region methods. Society for Industrial and Applied Mathematics, SIAM, Philadelphia (2000)CrossRefMATH
10.
go back to reference Dolan, E.D., Moré, J.J.: Benchmarking optimization software with performance profiles. Math. Progr. 91, 201–213 (2002)CrossRefMATH Dolan, E.D., Moré, J.J.: Benchmarking optimization software with performance profiles. Math. Progr. 91, 201–213 (2002)CrossRefMATH
11.
go back to reference Gould, N.I.M., Orban, D., Sartenaer, A., Toint, PhL: Sentesivity of trust region algorithms to their parameters. A Q. J. Oper. Res. 3, 227–241 (2005)CrossRefMATHMathSciNet Gould, N.I.M., Orban, D., Sartenaer, A., Toint, PhL: Sentesivity of trust region algorithms to their parameters. A Q. J. Oper. Res. 3, 227–241 (2005)CrossRefMATHMathSciNet
12.
go back to reference Li, D.H., Fukushima, M.: A modified BFGS method and its global convergence in nonconvex minimization. J. Comput. Appl. Math. 129, 15–35 (2001)CrossRefMATHMathSciNet Li, D.H., Fukushima, M.: A modified BFGS method and its global convergence in nonconvex minimization. J. Comput. Appl. Math. 129, 15–35 (2001)CrossRefMATHMathSciNet
13.
go back to reference Lukšan L., Matonoha C., Vlček J.: Modified CUTE problems for sparse unconstrained optimization, Techical Report, NO. 1081, ICS AS CR, Nov (2010) Lukšan L., Matonoha C., Vlček J.: Modified CUTE problems for sparse unconstrained optimization, Techical Report, NO. 1081, ICS AS CR, Nov (2010)
14.
go back to reference Lukšan, L., Vlček, J.: Sparse test problems for unconstrained optimization, Techical Report, NO. 1064, ICS AS CR, Nov (2003) Lukšan, L., Vlček, J.: Sparse test problems for unconstrained optimization, Techical Report, NO. 1064, ICS AS CR, Nov (2003)
15.
16.
go back to reference Powell, M.J.D.: Convergence properties of a class minimization algorithm. In: Mangasarian, O.L., Meyer, R.R., Robinson, S.M. (eds.) Nonlinear programming 2, pp. 1–27. Academic Press, New York (1975)CrossRef Powell, M.J.D.: Convergence properties of a class minimization algorithm. In: Mangasarian, O.L., Meyer, R.R., Robinson, S.M. (eds.) Nonlinear programming 2, pp. 1–27. Academic Press, New York (1975)CrossRef
17.
go back to reference Rockafellar, R.T.: Convex analysis. Princeton University Press, Princeton (1970)MATH Rockafellar, R.T.: Convex analysis. Princeton University Press, Princeton (1970)MATH
18.
go back to reference Nocedal, J., Wright, S.J.: Numerical optimization. Springer, New York (2006)MATH Nocedal, J., Wright, S.J.: Numerical optimization. Springer, New York (2006)MATH
19.
go back to reference Nocedal, J., Yuan, Y.: Combining trust region and line search techniques. In: Yuan, Y. (ed.) Advanced in nonliear programming, pp. 153–175. Kluwer Academic Publishers, Dordrecht (1996) Nocedal, J., Yuan, Y.: Combining trust region and line search techniques. In: Yuan, Y. (ed.) Advanced in nonliear programming, pp. 153–175. Kluwer Academic Publishers, Dordrecht (1996)
20.
go back to reference Sartenaer, A.: Automatic determination of an initial trust region in nonlinear programming. SIAM J. Sci. Comput. 18, 1788–1803 (1997)CrossRefMATHMathSciNet Sartenaer, A.: Automatic determination of an initial trust region in nonlinear programming. SIAM J. Sci. Comput. 18, 1788–1803 (1997)CrossRefMATHMathSciNet
22.
go back to reference Simantiraki, E.M., Shanno, D.F.: An infeasible-interior-point method for linear complementarity problems. Siam J. Optim. 7, 620–640 (1997)CrossRefMATHMathSciNet Simantiraki, E.M., Shanno, D.F.: An infeasible-interior-point method for linear complementarity problems. Siam J. Optim. 7, 620–640 (1997)CrossRefMATHMathSciNet
23.
25.
go back to reference Zarantonello, E.H.: Projections on convex sets in Hilbert space and spectral theory. In: Contributions to nonlinear functional analysis, Academic Press, 237–424 (1971) Zarantonello, E.H.: Projections on convex sets in Hilbert space and spectral theory. In: Contributions to nonlinear functional analysis, Academic Press, 237–424 (1971)
26.
go back to reference Zhang, X.S., Zhang, J.L., Liao, L.Z.: An adaptive trust region method and its convergence. Sci. China 45, 620–631 (2002)MATHMathSciNet Zhang, X.S., Zhang, J.L., Liao, L.Z.: An adaptive trust region method and its convergence. Sci. China 45, 620–631 (2002)MATHMathSciNet
Metadata
Title
An efficient implementation of a trust region method for box constrained optimization
Authors
Hamid Esmaeili
Morteza Kimiaei
Publication date
01-06-2015
Publisher
Springer Berlin Heidelberg
Published in
Journal of Applied Mathematics and Computing / Issue 1-2/2015
Print ISSN: 1598-5865
Electronic ISSN: 1865-2085
DOI
https://doi.org/10.1007/s12190-014-0815-0

Other articles of this Issue 1-2/2015

Journal of Applied Mathematics and Computing 1-2/2015 Go to the issue

Premium Partner