Skip to main content

2016 | OriginalPaper | Buchkapitel

New Conjugate Gradient Algorithms Based on New Conjugacy Condition

verfasst von : Gonglin Yuan, Gaohui Peng

Erschienen in: Cloud Computing and Security

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The nonlinear conjugate gradient (CG) algorithm is one of the most effective line search algorithms for optimization problems due to its simplicity and low memory requirements, particularly for large-scale problems. However, the results of the new conjugacy conditions are very limited. In this paper, we will propose a new conjugacy condition and two CG formulas. Global convergence is achieved for these algorithms, and numerical results are reported for Benchmark problems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Dai, Y.: A nonmonotone conjugate gradient algorithm for unconstrained optimization. J. Syst. Sci. Complex. 15, 139–145 (2002)MathSciNetMATH Dai, Y.: A nonmonotone conjugate gradient algorithm for unconstrained optimization. J. Syst. Sci. Complex. 15, 139–145 (2002)MathSciNetMATH
2.
3.
Zurück zum Zitat Dai, Z.F., Tian, B.S.: Global convergence of some modified PRP nonlinear conjugate gradient methods. Optim. Let. 5, 1–16 (2010)MathSciNet Dai, Z.F., Tian, B.S.: Global convergence of some modified PRP nonlinear conjugate gradient methods. Optim. Let. 5, 1–16 (2010)MathSciNet
4.
Zurück zum Zitat Dai, Y., Yuan, Y.: A nonlinear conjugate gradient with a strong global convergence properties. SIAM J. Optim. 10, 177–182 (2000)CrossRefMATH Dai, Y., Yuan, Y.: A nonlinear conjugate gradient with a strong global convergence properties. SIAM J. Optim. 10, 177–182 (2000)CrossRefMATH
5.
Zurück zum Zitat Dai, Y., Yuan, Y.: Nonlinear Conjugate Gradient Methods. Shanghai Scientific and Technical Publishers, Shanghai (1998) Dai, Y., Yuan, Y.: Nonlinear Conjugate Gradient Methods. Shanghai Scientific and Technical Publishers, Shanghai (1998)
6.
Zurück zum Zitat Fletcher, R.: Practical Method of Optimization: Unconstrained Optimization, vol. 1, 2nd edn. Wiley, New York (1997) Fletcher, R.: Practical Method of Optimization: Unconstrained Optimization, vol. 1, 2nd edn. Wiley, New York (1997)
8.
Zurück zum Zitat Grippo, L., Luidi, S.: A globally convergent version of the Polak-Ribi\(\grave{e}\)re gradient method. Math. Program. 78, 375–391 (1997) Grippo, L., Luidi, S.: A globally convergent version of the Polak-Ribi\(\grave{e}\)re gradient method. Math. Program. 78, 375–391 (1997)
9.
Zurück zum Zitat Gibert, J.C., Nocedal, J.: Global convergence properties of conugate gradient methods for optimization. SIAM J. Optim. 2, 21–42 (1992)MathSciNetCrossRef Gibert, J.C., Nocedal, J.: Global convergence properties of conugate gradient methods for optimization. SIAM J. Optim. 2, 21–42 (1992)MathSciNetCrossRef
10.
Zurück zum Zitat Hager, W.W., Zhang, H.: A new conjugate gradient method with guaranteed descent and an efficient line search. SIAM J. Optim. 16, 170–192 (2005)MathSciNetCrossRefMATH Hager, W.W., Zhang, H.: A new conjugate gradient method with guaranteed descent and an efficient line search. SIAM J. Optim. 16, 170–192 (2005)MathSciNetCrossRefMATH
11.
Zurück zum Zitat Hager, W.W., Zhang, H.: Algorithm 851: \(CG_DESCENT\), a conjugate gradient method with guaranteed descent. ACM Trans. Math. Softw. 32, 113–137 (2006)MathSciNetCrossRefMATH Hager, W.W., Zhang, H.: Algorithm 851: \(CG_DESCENT\), a conjugate gradient method with guaranteed descent. ACM Trans. Math. Softw. 32, 113–137 (2006)MathSciNetCrossRefMATH
12.
Zurück zum Zitat Hager, W.W., Zhang, H.: A survey of nonlinear conjugate gradient methods. Pacif. J. Optim. 2, 35–58 (2006)MathSciNetMATH Hager, W.W., Zhang, H.: A survey of nonlinear conjugate gradient methods. Pacif. J. Optim. 2, 35–58 (2006)MathSciNetMATH
13.
Zurück zum Zitat Li, J., Li, X., Yang, B., Sun, X.: Segmentation-based image copy-move forgery detection scheme. IEEE Trans. Inf. Forensics Secur. 10, 507–518 (2015)CrossRef Li, J., Li, X., Yang, B., Sun, X.: Segmentation-based image copy-move forgery detection scheme. IEEE Trans. Inf. Forensics Secur. 10, 507–518 (2015)CrossRef
15.
16.
Zurück zum Zitat Pan, Z., Zhang, Y., Kwong, S.: Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans. Broadcast. (2015). doi:10.1109/TBC.2015.2419824 Pan, Z., Zhang, Y., Kwong, S.: Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans. Broadcast. (2015). doi:10.​1109/​TBC.​2015.​2419824
17.
Zurück zum Zitat Hestenes, M.R., Stiefel, E.: Method of conjugate gradient for solving linear equations. J. Res. Nat. Bur. Stand. 49, 409–436 (1952)MathSciNetCrossRefMATH Hestenes, M.R., Stiefel, E.: Method of conjugate gradient for solving linear equations. J. Res. Nat. Bur. Stand. 49, 409–436 (1952)MathSciNetCrossRefMATH
18.
Zurück zum Zitat Li, G., Tang, C., Wei, Z.: New conjugacy condition and related new conjugate gradient methods for unconstrained optimization problems. J. Comput. Appl. Math. 202, 532–539 (2007)MathSciNetCrossRefMATH Li, G., Tang, C., Wei, Z.: New conjugacy condition and related new conjugate gradient methods for unconstrained optimization problems. J. Comput. Appl. Math. 202, 532–539 (2007)MathSciNetCrossRefMATH
19.
Zurück zum Zitat Liu, Y., Storey, C.: Effcient generalized conjugate gradient algorithms, Part 1: theory. J. Optim. Theor. Appl. 69, 17–41 (1992) Liu, Y., Storey, C.: Effcient generalized conjugate gradient algorithms, Part 1: theory. J. Optim. Theor. Appl. 69, 17–41 (1992)
20.
Zurück zum Zitat Polak, E., Ribiere, G.: Note sur la xonvergence de directions conjugees Rev. Francaise informat Recherche Operatinelle, 3e Annee, vol. 16, pp. 35–43 (1969) Polak, E., Ribiere, G.: Note sur la xonvergence de directions conjugees Rev. Francaise informat Recherche Operatinelle, 3e Annee, vol. 16, pp. 35–43 (1969)
21.
Zurück zum Zitat Polyak, B.T.: The conjugate gradient method in extreme problems. USSR Comput. Math. Math. Phys. 9, 94–112 (1969)CrossRefMATH Polyak, B.T.: The conjugate gradient method in extreme problems. USSR Comput. Math. Math. Phys. 9, 94–112 (1969)CrossRefMATH
22.
Zurück zum Zitat Powell, M.J.D.: Nonconvex minimization calculations and the conjugate gradient method. In: Griffiths, D.F. (ed.) Numerical Analysis. Lecture Notes in Mathematics, vol. 1066, pp. 122–141. Spinger, Heidelberg (1984)CrossRef Powell, M.J.D.: Nonconvex minimization calculations and the conjugate gradient method. In: Griffiths, D.F. (ed.) Numerical Analysis. Lecture Notes in Mathematics, vol. 1066, pp. 122–141. Spinger, Heidelberg (1984)CrossRef
23.
Zurück zum Zitat Powell, M.J.D.: Convergence properties of algorithm for nonlinearoptimization. SIAM Rev. 28, 487–500 (1986)MathSciNetCrossRef Powell, M.J.D.: Convergence properties of algorithm for nonlinearoptimization. SIAM Rev. 28, 487–500 (1986)MathSciNetCrossRef
24.
Zurück zum Zitat Siva Sathya, S., Radhika, M.V.: Convergence of nomadic genetic algorithm on benchmark mathematical functions. Appl. Soft Comput. 13, 2759–2766 (2013)CrossRef Siva Sathya, S., Radhika, M.V.: Convergence of nomadic genetic algorithm on benchmark mathematical functions. Appl. Soft Comput. 13, 2759–2766 (2013)CrossRef
25.
Zurück zum Zitat Wei, Z., Li, G., Qi, L.: New nonlinear conjugate gradient formulas for large-scale unconstrained optimization problems. Appl. Math. Comput. 179, 407–430 (2006)MathSciNetMATH Wei, Z., Li, G., Qi, L.: New nonlinear conjugate gradient formulas for large-scale unconstrained optimization problems. Appl. Math. Comput. 179, 407–430 (2006)MathSciNetMATH
26.
Zurück zum Zitat Wei, Z., Yao, S., Liu, L.: The convergence properties of some new conjugate gradient methods. Appl. Math. Comput. 183, 1341–1350 (2006)MathSciNetMATH Wei, Z., Yao, S., Liu, L.: The convergence properties of some new conjugate gradient methods. Appl. Math. Comput. 183, 1341–1350 (2006)MathSciNetMATH
27.
Zurück zum Zitat Yabe, H., Takano, M.: Global convergence properties of nonlinear conjugate gradient methods with modified secant condition. Comput. Optim. Appl. 28, 203–225 (2004)MathSciNetCrossRefMATH Yabe, H., Takano, M.: Global convergence properties of nonlinear conjugate gradient methods with modified secant condition. Comput. Optim. Appl. 28, 203–225 (2004)MathSciNetCrossRefMATH
28.
Zurück zum Zitat Yu, G.H.: Nonlinear self-scaling conjugate gradient methods for large-scale optimization problems. Doctor’s Degree thesis, Sun Yat-Sen University (2007) Yu, G.H.: Nonlinear self-scaling conjugate gradient methods for large-scale optimization problems. Doctor’s Degree thesis, Sun Yat-Sen University (2007)
29.
Zurück zum Zitat Yuan, G.L.: Modified nonlinear conjugate gradient methods with sufficient descent property for large-scale optimization problems. Optim. Lett. 3, 11–21 (2009)MathSciNetCrossRefMATH Yuan, G.L.: Modified nonlinear conjugate gradient methods with sufficient descent property for large-scale optimization problems. Optim. Lett. 3, 11–21 (2009)MathSciNetCrossRefMATH
30.
Zurück zum Zitat Yuan, Y.X.: Analysis on the conjugate gradient method. Optim. Methods Softw. 2, 19–29 (1993)CrossRef Yuan, Y.X.: Analysis on the conjugate gradient method. Optim. Methods Softw. 2, 19–29 (1993)CrossRef
32.
Zurück zum Zitat Yuan, G.L., Lu, X.W., Wei, Z.X.: A conjugate gradient method with descent direction for unconstrained optimization. J. Comput. Appl. Math. 233, 519–530 (2009)MathSciNetCrossRefMATH Yuan, G.L., Lu, X.W., Wei, Z.X.: A conjugate gradient method with descent direction for unconstrained optimization. J. Comput. Appl. Math. 233, 519–530 (2009)MathSciNetCrossRefMATH
33.
Zurück zum Zitat Yuan, Y.X., Sun, W.Y.: Theory and Methods of Optimization. Science Press of China, Beijing (1999) Yuan, Y.X., Sun, W.Y.: Theory and Methods of Optimization. Science Press of China, Beijing (1999)
34.
Zurück zum Zitat Yuan, G.L., Wei, Z.X., Zhao, Q.M.: A modified Polak-Ribière-Polyak conjugate gradient algorithm for large-scale optimization problems. IIE Trans. 46, 397–413 (2014)CrossRef Yuan, G.L., Wei, Z.X., Zhao, Q.M.: A modified Polak-Ribière-Polyak conjugate gradient algorithm for large-scale optimization problems. IIE Trans. 46, 397–413 (2014)CrossRef
35.
Zurück zum Zitat Zhang, J.Z., Deng, N.Y., Chen, L.H.: New quasi-Newton equation and related methods for unconstrained optimization. J. Optim. Theory Appl. 102, 147–167 (1999)MathSciNetCrossRefMATH Zhang, J.Z., Deng, N.Y., Chen, L.H.: New quasi-Newton equation and related methods for unconstrained optimization. J. Optim. Theory Appl. 102, 147–167 (1999)MathSciNetCrossRefMATH
36.
Zurück zum Zitat Zhang, L., Zhou, W., Li, D.: A descent modified Polak-Ribière-Polyak conjugate method and its global convergence. IMA J. Num. Anal. 26, 629–649 (2006)MathSciNetCrossRefMATH Zhang, L., Zhou, W., Li, D.: A descent modified Polak-Ribière-Polyak conjugate method and its global convergence. IMA J. Num. Anal. 26, 629–649 (2006)MathSciNetCrossRefMATH
37.
Zurück zum Zitat Zoutendijk, G.: Nonlinear programming computational methods. In: Abadie, J. (ed.) Integer and Nonlinear Programming, pp. 37–86. North Holland, Amsterdam (1970) Zoutendijk, G.: Nonlinear programming computational methods. In: Abadie, J. (ed.) Integer and Nonlinear Programming, pp. 37–86. North Holland, Amsterdam (1970)
Metadaten
Titel
New Conjugate Gradient Algorithms Based on New Conjugacy Condition
verfasst von
Gonglin Yuan
Gaohui Peng
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-48674-1_44