Skip to main content

02.04.2024 | Original Research

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

verfasst von: Xianzhen Jiang, Zefeng Huang, Huihui Yang

Erschienen in: Journal of Applied Mathematics and Computing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The conjugate gradient projection method is one of the most effective methods for solving large-scale nonlinear monotone convex constrained equations. In this paper, a new search direction with restart procedure is proposed, and a self-adjusting line search criterion is improved, then a three-term conjugate gradient projection method is designed to solve the large-scale nonlinear monotone convex constrained equations and image restorations. Without using the Lipschitz continuity of these equations, the presented method is proved to be globally convergent. Moreover, its R-linear convergence rate is attained under Lipschitz continuity and the usual assumptions. Finally, large-scale numerical experiments for the convex constraint equations and image restorations have been performed, which show that the new method is effective.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zhao, Y.B., Li, D.: Monotonicity of fixed point and normal mapping associated with variational inequality and is applications. SIAM J. Optim. 11(4), 962–973 (2001)MathSciNetCrossRef Zhao, Y.B., Li, D.: Monotonicity of fixed point and normal mapping associated with variational inequality and is applications. SIAM J. Optim. 11(4), 962–973 (2001)MathSciNetCrossRef
2.
Zurück zum Zitat Dirkse, S.P., Ferris, M.C.: MCPLIB: A collection of nonlinear mixed complementarity problems. Optim. Methods Softw. 5(4), 319–345 (2012)CrossRef Dirkse, S.P., Ferris, M.C.: MCPLIB: A collection of nonlinear mixed complementarity problems. Optim. Methods Softw. 5(4), 319–345 (2012)CrossRef
3.
Zurück zum Zitat Yang, L.F., Luo, J.Y., Xu, Y., Zhang, Z.R., Dong, Z.Y.: A distributed dual consensus ADMM based on partition for DC-DOPF with carbon emission trading. IEEE Trans. Ind. Inform. 16(3), 1858–1872 (2020)CrossRef Yang, L.F., Luo, J.Y., Xu, Y., Zhang, Z.R., Dong, Z.Y.: A distributed dual consensus ADMM based on partition for DC-DOPF with carbon emission trading. IEEE Trans. Ind. Inform. 16(3), 1858–1872 (2020)CrossRef
4.
Zurück zum Zitat Xiao, Y.H., Wang, Q.Y., Hu, Q.J.: Non-smooth equations based method for \(\ell _1\)-norm problems with applications to compressed sensing. Nonlinear Anal. 74(11), 3570–3577 (2011)MathSciNetCrossRef Xiao, Y.H., Wang, Q.Y., Hu, Q.J.: Non-smooth equations based method for \(\ell _1\)-norm problems with applications to compressed sensing. Nonlinear Anal. 74(11), 3570–3577 (2011)MathSciNetCrossRef
5.
Zurück zum Zitat Wood, A.J., Wollenberg, B.F.: Power Generation, Operation, and Control. Wiley, New York (1996) Wood, A.J., Wollenberg, B.F.: Power Generation, Operation, and Control. Wiley, New York (1996)
6.
Zurück zum Zitat Ortega, J.M., Rheinboldt, W.C.: Iterative Solution of Nonlinear Equation in Several Variables. Acadamic Press, New York (1970) Ortega, J.M., Rheinboldt, W.C.: Iterative Solution of Nonlinear Equation in Several Variables. Acadamic Press, New York (1970)
7.
Zurück zum Zitat Hestenes, M.R., Stiefel, E.: Method of conjugate gradient for solving linear equations. J. Res. Natl. Bur. Stand. 49, 409–436 (1952)CrossRef Hestenes, M.R., Stiefel, E.: Method of conjugate gradient for solving linear equations. J. Res. Natl. Bur. Stand. 49, 409–436 (1952)CrossRef
8.
9.
Zurück zum Zitat Dai, Y.H.: Nonlinear conjugate gradient methods. Wiley Encyclopedia of Operations Research and Management Science. (2010) Dai, Y.H.: Nonlinear conjugate gradient methods. Wiley Encyclopedia of Operations Research and Management Science. (2010)
10.
Zurück zum Zitat Polak, E., Ribière, G.: Note sur la convergence de directions conjugées. Rev. Fr. Inform. Rech. Oper. 16(3), 35-43 (1969) (in French) Polak, E., Ribière, G.: Note sur la convergence de directions conjugées. Rev. Fr. Inform. Rech. Oper. 16(3), 35-43 (1969) (in French)
11.
Zurück zum Zitat Polyak, B.T.: The conjugate gradient method in extreme problems. USSR Comput. Math. Math. Phys. 9, 94–112 (1969)CrossRef Polyak, B.T.: The conjugate gradient method in extreme problems. USSR Comput. Math. Math. Phys. 9, 94–112 (1969)CrossRef
12.
Zurück zum Zitat Fletcher, R.: Unconstrained Optimization. Practical Methods of Optimization, vol. 1. Wiley, New York. (1987) Fletcher, R.: Unconstrained Optimization. Practical Methods of Optimization, vol. 1. Wiley, New York. (1987)
13.
Zurück zum Zitat Liu, Y., Storey, C.: Efficient generalized conjugate gradient algorithms, part 1: theory. J. Optim. Theory and Appl. 69(1), 129–137 (1991)MathSciNetCrossRef Liu, Y., Storey, C.: Efficient generalized conjugate gradient algorithms, part 1: theory. J. Optim. Theory and Appl. 69(1), 129–137 (1991)MathSciNetCrossRef
14.
Zurück zum Zitat Dai, Y.H., Yuan, Y.X.: A nonlinear conjugate gradient method with a strong global convergence property. SIAM J. Optim. 10(1), 177–182 (1999)MathSciNetCrossRef Dai, Y.H., Yuan, Y.X.: A nonlinear conjugate gradient method with a strong global convergence property. SIAM J. Optim. 10(1), 177–182 (1999)MathSciNetCrossRef
15.
Zurück zum Zitat Sun, D.F., Woinersley, R.S., Qi, H.D.: A feasible semismooth asymptotically Newton method for mixed complementarity problems. Math. Program. 94(1), 167–187 (2002)MathSciNetCrossRef Sun, D.F., Woinersley, R.S., Qi, H.D.: A feasible semismooth asymptotically Newton method for mixed complementarity problems. Math. Program. 94(1), 167–187 (2002)MathSciNetCrossRef
16.
Zurück zum Zitat Wang, C.W., Wang, Y.J., Xu, C.L.: A projection method for a system of nonlinear monotone equations with convex constraints. Math. Methods Oper. Res. 66(1), 33–46 (2007)MathSciNetCrossRef Wang, C.W., Wang, Y.J., Xu, C.L.: A projection method for a system of nonlinear monotone equations with convex constraints. Math. Methods Oper. Res. 66(1), 33–46 (2007)MathSciNetCrossRef
17.
Zurück zum Zitat Qi, L.Q., Tong, X.J., Li, D.H.: Active-set projected trust-region algorithm for box-constrained nonsmooth equations. J. Optim. Theory Appl. 120(3), 601–625 (2004)MathSciNetCrossRef Qi, L.Q., Tong, X.J., Li, D.H.: Active-set projected trust-region algorithm for box-constrained nonsmooth equations. J. Optim. Theory Appl. 120(3), 601–625 (2004)MathSciNetCrossRef
18.
Zurück zum Zitat Yu, Z.S., Lin, J., Sun, J., Xiao, Y.H., Liu, L.Y., Li, Z.H.: Spectral gradient projection method for monotone nonlinear equations with convex constraints. Appl. Numer. Math. 59(10), 2416–2423 (2009)MathSciNetCrossRef Yu, Z.S., Lin, J., Sun, J., Xiao, Y.H., Liu, L.Y., Li, Z.H.: Spectral gradient projection method for monotone nonlinear equations with convex constraints. Appl. Numer. Math. 59(10), 2416–2423 (2009)MathSciNetCrossRef
19.
Zurück zum Zitat Zhang, L., Zhou, W.J.: Spectral gradient projection method for solving nonlinear monotone equations. J. Comput. Appl. Math. 196(2), 478–484 (2006)MathSciNetCrossRef Zhang, L., Zhou, W.J.: Spectral gradient projection method for solving nonlinear monotone equations. J. Comput. Appl. Math. 196(2), 478–484 (2006)MathSciNetCrossRef
20.
Zurück zum Zitat Yin, J.H., Jian, J.B., Jiang, X.Z., Liu, M.X., Wang, L.Z.: A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications. Numer. Algorithms. 88(1), 389–418 (2021)MathSciNetCrossRef Yin, J.H., Jian, J.B., Jiang, X.Z., Liu, M.X., Wang, L.Z.: A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications. Numer. Algorithms. 88(1), 389–418 (2021)MathSciNetCrossRef
21.
Zurück zum Zitat Sabi’u, J., Shah, A., Waziri, M.Y.: Two optimal Hager-Zhang conjugate gradient methods for solving monotone nonlinear equations. Appl. Numer. Math. 153, 217–233 (2020)MathSciNetCrossRef Sabi’u, J., Shah, A., Waziri, M.Y.: Two optimal Hager-Zhang conjugate gradient methods for solving monotone nonlinear equations. Appl. Numer. Math. 153, 217–233 (2020)MathSciNetCrossRef
22.
Zurück zum Zitat Sabi’u, J., Shah, A.: An efficient three-term conjugate gradient-type algorithm for monotone nonlinear equations. RAIRO-Oper. Res. 55, S1113–S1127 (2021)MathSciNetCrossRef Sabi’u, J., Shah, A.: An efficient three-term conjugate gradient-type algorithm for monotone nonlinear equations. RAIRO-Oper. Res. 55, S1113–S1127 (2021)MathSciNetCrossRef
23.
Zurück zum Zitat Sabi’u, J., Shah, A., Waziri, M.Y.: A modified Hager-Zhang conjugate gradient method with optimal choices for solving monotone nonlinear equations. Int. J. Comput. Math. 99(2), 332–354 (2022)MathSciNetCrossRef Sabi’u, J., Shah, A., Waziri, M.Y.: A modified Hager-Zhang conjugate gradient method with optimal choices for solving monotone nonlinear equations. Int. J. Comput. Math. 99(2), 332–354 (2022)MathSciNetCrossRef
24.
Zurück zum Zitat ur Rehman, M., Sabi’u, J., Sohaib, M., et al.: A projection-based derivative free DFP approach for solving system of nonlinear convex constrained monotone equations with image restoration applications. J. Appl. Math. Comput. 69(5), 3645-3673 (2023) ur Rehman, M., Sabi’u, J., Sohaib, M., et al.: A projection-based derivative free DFP approach for solving system of nonlinear convex constrained monotone equations with image restoration applications. J. Appl. Math. Comput. 69(5), 3645-3673 (2023)
25.
Zurück zum Zitat Ahmed, K., Waziri, M.Y., Halilu. A.S., et al.: Another Hager-Zhang-type method via singular-value study for constrained monotone equations with application. Numer. Algorithms. 1-41 (2023) Ahmed, K., Waziri, M.Y., Halilu. A.S., et al.: Another Hager-Zhang-type method via singular-value study for constrained monotone equations with application. Numer. Algorithms. 1-41 (2023)
26.
27.
Zurück zum Zitat Beale, E.M.: A Derivation of Conjugate Gradients. Academic Press, London (1972) Beale, E.M.: A Derivation of Conjugate Gradients. Academic Press, London (1972)
28.
Zurück zum Zitat Kou, C.X., Dai, Y.H.: A modified self-scaling memoryless Broyden-Fletcher-Goldfarb-Shanno method for unconstrained optimization. J. Optim. Theory Appl. 165(1), 209–224 (2015)MathSciNetCrossRef Kou, C.X., Dai, Y.H.: A modified self-scaling memoryless Broyden-Fletcher-Goldfarb-Shanno method for unconstrained optimization. J. Optim. Theory Appl. 165(1), 209–224 (2015)MathSciNetCrossRef
29.
Zurück zum Zitat Narushima, Y., Yabe, H., Ford, J.A.: A three-term conjugate gradient method with sufficient descent property for unconstrained optimization SIAM. J. Optim. 21(1), 212–230 (2011)MathSciNet Narushima, Y., Yabe, H., Ford, J.A.: A three-term conjugate gradient method with sufficient descent property for unconstrained optimization SIAM. J. Optim. 21(1), 212–230 (2011)MathSciNet
30.
Zurück zum Zitat Jiang, X.Z., Liao, W., Yin, J.H., Jian, J.B.: A new family of hybrid three-term conjugate gradient methods with applications in image restoration. Numer. Algorithms. 91, 161–191 (2022)MathSciNetCrossRef Jiang, X.Z., Liao, W., Yin, J.H., Jian, J.B.: A new family of hybrid three-term conjugate gradient methods with applications in image restoration. Numer. Algorithms. 91, 161–191 (2022)MathSciNetCrossRef
31.
Zurück zum Zitat Jiang, X.Z., Yang, H.H., Jian, J.B., Wu, X.D.: Two families of hybrid conjugate gradient methods with restart procedures and their applications. Optim. Method. Soft. 38(5), 947–974 (2023)MathSciNetCrossRef Jiang, X.Z., Yang, H.H., Jian, J.B., Wu, X.D.: Two families of hybrid conjugate gradient methods with restart procedures and their applications. Optim. Method. Soft. 38(5), 947–974 (2023)MathSciNetCrossRef
32.
Zurück zum Zitat Jiang, X.Z., Ye, X.M., Huang, Z.F., Liu, M.X.: A family of hybrid conjugate gradient method with restart procedure for unconstrained optimizations and image restorations. Comput. Oper. Res. 159, 106341 (2023)MathSciNetCrossRef Jiang, X.Z., Ye, X.M., Huang, Z.F., Liu, M.X.: A family of hybrid conjugate gradient method with restart procedure for unconstrained optimizations and image restorations. Comput. Oper. Res. 159, 106341 (2023)MathSciNetCrossRef
33.
Zurück zum Zitat Jiang, X.Z., Zhu, Y.H., Jian, J.B.: Two efficient nonlinear conjugate gradient methods with restart procedures and their applications in image restoration. Nonlinear Dyn. 111(6), 5469–5498 (2023)CrossRef Jiang, X.Z., Zhu, Y.H., Jian, J.B.: Two efficient nonlinear conjugate gradient methods with restart procedures and their applications in image restoration. Nonlinear Dyn. 111(6), 5469–5498 (2023)CrossRef
34.
Zurück zum Zitat Jian, J.B., Han, L., Jiang, X.Z.: A hybrid conjugate gradient method with descent property for unconstrained optimization. Appl. Math. Model. 39(3–4), 1281–1290 (2015)MathSciNetCrossRef Jian, J.B., Han, L., Jiang, X.Z.: A hybrid conjugate gradient method with descent property for unconstrained optimization. Appl. Math. Model. 39(3–4), 1281–1290 (2015)MathSciNetCrossRef
35.
Zurück zum Zitat Sun, M., Liu, J.: New hybrid conjugate gradient projection method for the convex constrained equations. Calcolo. 53(3), 399–411 (2016)MathSciNetCrossRef Sun, M., Liu, J.: New hybrid conjugate gradient projection method for the convex constrained equations. Calcolo. 53(3), 399–411 (2016)MathSciNetCrossRef
36.
Zurück zum Zitat Li, Q., Li, D.H.: A class of derivative-free methods for large-scale nonlinear monotone equations. IMA J. Numer. Anal. 31(4), 1625–1635 (2011)MathSciNetCrossRef Li, Q., Li, D.H.: A class of derivative-free methods for large-scale nonlinear monotone equations. IMA J. Numer. Anal. 31(4), 1625–1635 (2011)MathSciNetCrossRef
37.
Zurück zum Zitat Amini, K., Kamandi, A.: A new line search strategy for finding separating hyperplane in projection-based methods. Numer. Algorithms. 70(3), 559–570 (2015)MathSciNetCrossRef Amini, K., Kamandi, A.: A new line search strategy for finding separating hyperplane in projection-based methods. Numer. Algorithms. 70(3), 559–570 (2015)MathSciNetCrossRef
38.
Zurück zum Zitat Liu, P.J., Jian, J.B., Jiang, X.Z.: A new conjugate gradient projection method for convex constrained nonlinear equations. Complexity. 2020 (2020) Liu, P.J., Jian, J.B., Jiang, X.Z.: A new conjugate gradient projection method for convex constrained nonlinear equations. Complexity. 2020 (2020)
39.
Zurück zum Zitat Zarantonello, E.H.: Projections on Convex Sets in Hilbert Space and Spectral Theory. Academic Press, New York (1971) Zarantonello, E.H.: Projections on Convex Sets in Hilbert Space and Spectral Theory. Academic Press, New York (1971)
40.
Zurück zum Zitat Gao, P.T., He, C.J., Liu, Y.: An adaptive family of projection methods for constrained monotone nonlinear equations with applications. Appl. Math. Comput. 359, 1–16 (2019)MathSciNet Gao, P.T., He, C.J., Liu, Y.: An adaptive family of projection methods for constrained monotone nonlinear equations with applications. Appl. Math. Comput. 359, 1–16 (2019)MathSciNet
41.
Zurück zum Zitat Mor\(\acute{e}\), J.J., Garbow, B.S., Hillstrom, K.E: Testing unconstrained optimization software, ACM Trans. Math. Softw. 7(1) 17-41 (1981) Mor\(\acute{e}\), J.J., Garbow, B.S., Hillstrom, K.E: Testing unconstrained optimization software, ACM Trans. Math. Softw. 7(1) 17-41 (1981)
42.
Zurück zum Zitat Dolan, E.D., Moré, J.J.: Benchmarking optimization software with performance profiles. Math. Program. 91, 201–213 (2002)MathSciNetCrossRef Dolan, E.D., Moré, J.J.: Benchmarking optimization software with performance profiles. Math. Program. 91, 201–213 (2002)MathSciNetCrossRef
43.
Zurück zum Zitat Figueiredo, M.A.T., Nowak, R.D., Wright, S.J.: Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems. IEEE J. Sel. Top. Signal Process. 1(4), 586–597 (2007)CrossRef Figueiredo, M.A.T., Nowak, R.D., Wright, S.J.: Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems. IEEE J. Sel. Top. Signal Process. 1(4), 586–597 (2007)CrossRef
44.
Zurück zum Zitat Xiao, Y.H., Wang, Q.Y., Hu, Q.J.: Non-smooth equations based method for \(\ell _1\)-norm problems with applications to compressed sensing. Nonlinear Anal. 74(11), 3570–3577 (2011)MathSciNetCrossRef Xiao, Y.H., Wang, Q.Y., Hu, Q.J.: Non-smooth equations based method for \(\ell _1\)-norm problems with applications to compressed sensing. Nonlinear Anal. 74(11), 3570–3577 (2011)MathSciNetCrossRef
45.
Zurück zum Zitat Pang, J.S.: Inexact Newton methods for the nonlinear complementarity problem. Math. Program. 36(1), 54–71 (1986)MathSciNetCrossRef Pang, J.S.: Inexact Newton methods for the nonlinear complementarity problem. Math. Program. 36(1), 54–71 (1986)MathSciNetCrossRef
46.
Zurück zum Zitat Xiao, Y.H., Zhu, H.: A conjugate gradient method to solve convex constrained monotone equations with applications in compressive sensing. J. Math. Anal. Appl. 405(1), 310–319 (2013)MathSciNetCrossRef Xiao, Y.H., Zhu, H.: A conjugate gradient method to solve convex constrained monotone equations with applications in compressive sensing. J. Math. Anal. Appl. 405(1), 310–319 (2013)MathSciNetCrossRef
47.
Zurück zum Zitat Gonzales, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice Hall, Englewood (2008) Gonzales, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice Hall, Englewood (2008)
Metadaten
Titel
A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations
verfasst von
Xianzhen Jiang
Zefeng Huang
Huihui Yang
Publikationsdatum
02.04.2024
Verlag
Springer Berlin Heidelberg
Erschienen in
Journal of Applied Mathematics and Computing
Print ISSN: 1598-5865
Elektronische ISSN: 1865-2085
DOI
https://doi.org/10.1007/s12190-024-02044-0

Premium Partner