Skip to main content
Erschienen in: Journal of Applied Mathematics and Computing 6/2022

28.03.2022 | Original Research

Two modified conjugate gradient methods for unconstrained optimization with applications in image restoration problems

verfasst von: Guodong Ma, Hui Lin, Wenhui Jin, Daolan Han

Erschienen in: Journal of Applied Mathematics and Computing | Ausgabe 6/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The conjugate gradient methods (CGMs) are very effective iterative methods for solving unconstrained optimization problems. In this paper, the second inequality of the strong Wolfe line search is used to modify the conjugate parameters of the PRP and HS methods, and thereby two efficient conjugate parameters are presented. Under basic assumptions, we prove that the two modified CGMs satisfy sufficient descent condition and converge globally for unconstrained optimization problems. Finally, to verify the effectiveness of our presented methods, we perform medium-large-scale numerical experiments for the normal unconstrained optimization and image restoration problems. The numerical results show the encouraging efficiency and applicability of the proposed methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hestenes, M.R., Stiefel, E.: Method of conjugate gradient for solving linear equations. J. Res. Natl. Bureau. Stand. 49, 409–436 (1952)CrossRefMATH Hestenes, M.R., Stiefel, E.: Method of conjugate gradient for solving linear equations. J. Res. Natl. Bureau. Stand. 49, 409–436 (1952)CrossRefMATH
3.
Zurück zum Zitat Polak, E., Ribière, G.: Note surla convergence de directions conjugèes. Rev. Fr. Inf. Rech. Oper. 3(1), 35–43 (1969)MATH Polak, E., Ribière, G.: Note surla convergence de directions conjugèes. Rev. Fr. Inf. Rech. Oper. 3(1), 35–43 (1969)MATH
4.
Zurück zum Zitat Polyak, B.T.: The conjugate gradient method in extreme problems. USSR Comput. Math. Math. Phys. 9, 94–112 (1969)CrossRefMATH Polyak, B.T.: The conjugate gradient method in extreme problems. USSR Comput. Math. Math. Phys. 9, 94–112 (1969)CrossRefMATH
5.
Zurück zum Zitat Dai, Y.H., Yuan, Y.X.: A nonlinear conjugate gradient with a strong global convergence property. SIAM J. Optim. 10(1), 177–182 (1999)MathSciNetCrossRefMATH Dai, Y.H., Yuan, Y.X.: A nonlinear conjugate gradient with a strong global convergence property. SIAM J. Optim. 10(1), 177–182 (1999)MathSciNetCrossRefMATH
6.
Zurück zum Zitat Wei, Z.X., Yao, S.W., Liu, L.Y.: The convergence properties of some new conjugate gradient methods. Appl. Math. Comput. 183, 1341–1350 (2006)MathSciNetMATH Wei, Z.X., Yao, S.W., Liu, L.Y.: The convergence properties of some new conjugate gradient methods. Appl. Math. Comput. 183, 1341–1350 (2006)MathSciNetMATH
7.
Zurück zum Zitat Yao, S.W., Wei, Z.X., Huang, H.: A note about WYL’s conjugate gradient method and its application. Appl. Math. Comput. 191, 381–388 (2007)MathSciNetMATH Yao, S.W., Wei, Z.X., Huang, H.: A note about WYL’s conjugate gradient method and its application. Appl. Math. Comput. 191, 381–388 (2007)MathSciNetMATH
8.
Zurück zum Zitat Huang, H., Wei, Z.X., Yao, S.W.: The proof of the sufficient descent condition of the Wei-Yao-Liu conjugate gradient method under the strong Wolfe-Powell line search. Appl. Math. Comput. 189, 1241–1245 (2007)MathSciNetMATH Huang, H., Wei, Z.X., Yao, S.W.: The proof of the sufficient descent condition of the Wei-Yao-Liu conjugate gradient method under the strong Wolfe-Powell line search. Appl. Math. Comput. 189, 1241–1245 (2007)MathSciNetMATH
9.
Zurück zum Zitat Zhang, L.: An imporoved Wei–Yao–Liu nonlinear conjugate gradient method for optimization computation. Appl. Math. Comput. 215, 2269–2274 (2009)MathSciNetMATH Zhang, L.: An imporoved Wei–Yao–Liu nonlinear conjugate gradient method for optimization computation. Appl. Math. Comput. 215, 2269–2274 (2009)MathSciNetMATH
10.
Zurück zum Zitat Dai, Z.F., Wen, F.H.: Another improved Wei–Yao–Liu nonlinear conjugate gradient method with sufficient descent property. Appl. Math. Comput. 218, 7421–7430 (2012)MathSciNetMATH Dai, Z.F., Wen, F.H.: Another improved Wei–Yao–Liu nonlinear conjugate gradient method with sufficient descent property. Appl. Math. Comput. 218, 7421–7430 (2012)MathSciNetMATH
11.
Zurück zum Zitat Yuan, G.L., Zhang, M.J.: A modified Hestenes–Stiefel conjugate gradient algorithm for large-scale optimization. Numer. Func. Anal. Opt. 34(8), 914–937 (2013)MathSciNetCrossRefMATH Yuan, G.L., Zhang, M.J.: A modified Hestenes–Stiefel conjugate gradient algorithm for large-scale optimization. Numer. Func. Anal. Opt. 34(8), 914–937 (2013)MathSciNetCrossRefMATH
12.
Zurück zum Zitat Dai, Y.H., Kou, C.X.: A nonlinear conjugate gradient algorithm with an optimal property and an improved Wolfe line search. SIAM J. Optim. 23, 296–320 (2013)MathSciNetCrossRefMATH Dai, Y.H., Kou, C.X.: A nonlinear conjugate gradient algorithm with an optimal property and an improved Wolfe line search. SIAM J. Optim. 23, 296–320 (2013)MathSciNetCrossRefMATH
13.
Zurück zum Zitat Li, M., Liu, H.W., Liu, Z.X.: A new family of conjugate gradient methods for unconstrained optimization. J. Appl. Math. Comput. 58, 219–234 (2018)MathSciNetCrossRefMATH Li, M., Liu, H.W., Liu, Z.X.: A new family of conjugate gradient methods for unconstrained optimization. J. Appl. Math. Comput. 58, 219–234 (2018)MathSciNetCrossRefMATH
14.
Zurück zum Zitat Jian, J.B., Chen, Q., Jiang, X.Z., Zeng, Y.F., Yin, J.H.: A new spectral conjugate gradient method for large-scale unconstrained optimization. Optim. Methods Softw. 32(3), 503–515 (2017)MathSciNetCrossRefMATH Jian, J.B., Chen, Q., Jiang, X.Z., Zeng, Y.F., Yin, J.H.: A new spectral conjugate gradient method for large-scale unconstrained optimization. Optim. Methods Softw. 32(3), 503–515 (2017)MathSciNetCrossRefMATH
15.
Zurück zum Zitat Jiang, X.Z., Jian, J.B.: Improved Fletcher–Reeves and Dai–Yuan conjugate gradient methods with the strong Wolfe line search. J. Comput. Appl. Math. 328, 525–534 (2019)MathSciNetCrossRefMATH Jiang, X.Z., Jian, J.B.: Improved Fletcher–Reeves and Dai–Yuan conjugate gradient methods with the strong Wolfe line search. J. Comput. Appl. Math. 328, 525–534 (2019)MathSciNetCrossRefMATH
18.
19.
Zurück zum Zitat Gilbert, J.C., Nocedal, J.: Global convergence properties of conjugate gradient methods for optimization. SIAM J. Optim. 2(1), 21–42 (1992)MathSciNetCrossRefMATH Gilbert, J.C., Nocedal, J.: Global convergence properties of conjugate gradient methods for optimization. SIAM J. Optim. 2(1), 21–42 (1992)MathSciNetCrossRefMATH
20.
Zurück zum Zitat Zoutendijk, G.: Nonlinear programming, computational methods. In: Abadie, J. (Ed.) Integer and nonlinear programming. Amsterdam, North-holland, pp 37–86 (1970) Zoutendijk, G.: Nonlinear programming, computational methods. In: Abadie, J. (Ed.) Integer and nonlinear programming. Amsterdam, North-holland, pp 37–86 (1970)
21.
Zurück zum Zitat Morè, J.J., Garbow, B.S.: Hillstrome KE testing unconstrained optimization software. ACM Trans. Math. Softw. 7, 17–41 (1981)CrossRefMATH Morè, J.J., Garbow, B.S.: Hillstrome KE testing unconstrained optimization software. ACM Trans. Math. Softw. 7, 17–41 (1981)CrossRefMATH
22.
Zurück zum Zitat Bongartz, I., Conn, A.R., Gould, N., Toint, P.L.: CUTE: constrained and unconstrained testing environment. ACM. Trans. Math. Softw. 21, 123–160 (1995)CrossRefMATH Bongartz, I., Conn, A.R., Gould, N., Toint, P.L.: CUTE: constrained and unconstrained testing environment. ACM. Trans. Math. Softw. 21, 123–160 (1995)CrossRefMATH
23.
24.
Zurück zum Zitat Chan, R.H., Ho, C.W., Nikolova, M.: Salt-and-pepper noise removal by median-type noise detectors and detail preserving regularization. IEEE Trans. Image Process. 14(10), 1479–1485 (2005)CrossRef Chan, R.H., Ho, C.W., Nikolova, M.: Salt-and-pepper noise removal by median-type noise detectors and detail preserving regularization. IEEE Trans. Image Process. 14(10), 1479–1485 (2005)CrossRef
25.
Zurück zum Zitat Cai, J.F., Chan, R., Morini, B.: Minimization of an edge-preserving regularization functional by conjugate gradient type methods, image processing based on partial differential equations, pp. 109–122. Springer, Berlin, Heidelberg (2007) Cai, J.F., Chan, R., Morini, B.: Minimization of an edge-preserving regularization functional by conjugate gradient type methods, image processing based on partial differential equations, pp. 109–122. Springer, Berlin, Heidelberg (2007)
26.
Zurück zum Zitat Yu, G.H., Huang, J.H., Zhou, Y.: A descent spectral conjugate gradient method for impulse noise removal. Appl. Math. Lett. 23(5), 555–560 (2010)MathSciNetCrossRefMATH Yu, G.H., Huang, J.H., Zhou, Y.: A descent spectral conjugate gradient method for impulse noise removal. Appl. Math. Lett. 23(5), 555–560 (2010)MathSciNetCrossRefMATH
28.
Zurück zum Zitat Yuan, G.L., Wei, Z.X., Li, G.Y.: A modified Polak–Ribiére–Polyak conjugate gradient algorithm for nonsmooth convex programs. J. Comput. Appl. Math. 255, 86–96 (2014)MathSciNetCrossRefMATH Yuan, G.L., Wei, Z.X., Li, G.Y.: A modified Polak–Ribiére–Polyak conjugate gradient algorithm for nonsmooth convex programs. J. Comput. Appl. Math. 255, 86–96 (2014)MathSciNetCrossRefMATH
29.
Zurück zum Zitat Hwang, H., Haddad, R.A.: Adaptive median filters: new algorithms and results. IEEE Trans. Image Process. 4(4), 499–502 (1995)CrossRef Hwang, H., Haddad, R.A.: Adaptive median filters: new algorithms and results. IEEE Trans. Image Process. 4(4), 499–502 (1995)CrossRef
30.
Zurück zum Zitat Bovik, A.: Handbook of image and video processing. Academic Press, San Diego (2000)MATH Bovik, A.: Handbook of image and video processing. Academic Press, San Diego (2000)MATH
Metadaten
Titel
Two modified conjugate gradient methods for unconstrained optimization with applications in image restoration problems
verfasst von
Guodong Ma
Hui Lin
Wenhui Jin
Daolan Han
Publikationsdatum
28.03.2022
Verlag
Springer Berlin Heidelberg
Erschienen in
Journal of Applied Mathematics and Computing / Ausgabe 6/2022
Print ISSN: 1598-5865
Elektronische ISSN: 1865-2085
DOI
https://doi.org/10.1007/s12190-022-01725-y

Weitere Artikel der Ausgabe 6/2022

Journal of Applied Mathematics and Computing 6/2022 Zur Ausgabe

Premium Partner