Skip to main content
Top
Published in: Numerical Algorithms 4/2023

17-12-2022 | Original Paper

A unified convergence analysis of the derivative-free projection-based method for constrained nonlinear monotone equations

Authors: Yigui Ou, Lin Li

Published in: Numerical Algorithms | Issue 4/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we propose a general framework that provides a unified convergence analysis of the derivative-free projection-based method (DFPM) for solving large-scale constrained nonlinear monotone equations. The new results provide a complete picture on the convergence guarantees of DFPM and cover the existing relevant convergence results as special cases. Preliminary numerical experiment results are also reported to show the numerical performance of six line search schemes used in the existing DFPM.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Meintjes, K., Morgan, A.P.: A methodology for solving chemical equilibrium systems. Appl. Math. Comput. 22, 333–361 (1987)MathSciNetMATH Meintjes, K., Morgan, A.P.: A methodology for solving chemical equilibrium systems. Appl. Math. Comput. 22, 333–361 (1987)MathSciNetMATH
2.
go back to reference Wood, A.J., Wollenberg, B.F.: Power Generations, Operations, and Control. Wiley, New York (1996) Wood, A.J., Wollenberg, B.F.: Power Generations, Operations, and Control. Wiley, New York (1996)
3.
go back to reference Prajna, S., Parrilo, P.A., Rantzer, A.: Nonlinear control synthesis by convex optimization. IEEE Trans. Autom. Control 49, 310–314 (2004)MathSciNetCrossRefMATH Prajna, S., Parrilo, P.A., Rantzer, A.: Nonlinear control synthesis by convex optimization. IEEE Trans. Autom. Control 49, 310–314 (2004)MathSciNetCrossRefMATH
4.
go back to reference Figueiredo, M.A.T., Nowak, R.D., Wright, S.J.: Gradient projection for sparse reconstruction: application to compressed sensing and other inverse problems. IEEE Journal of Selected Topics in Signal Processing 1, 586–597 (2007)CrossRef Figueiredo, M.A.T., Nowak, R.D., Wright, S.J.: Gradient projection for sparse reconstruction: application to compressed sensing and other inverse problems. IEEE Journal of Selected Topics in Signal Processing 1, 586–597 (2007)CrossRef
5.
go back to reference Dirkse, S.P., Ferris, M.C.: MCPLIB: a collection of nonlinear mixed complementarity problems. Opt. Methods Softw. 5, 319–345 (2012)CrossRef Dirkse, S.P., Ferris, M.C.: MCPLIB: a collection of nonlinear mixed complementarity problems. Opt. Methods Softw. 5, 319–345 (2012)CrossRef
6.
go back to reference Ou, Y.G., Li, J.Y.: A new derivative-free SCG-type projection method for nonlinear monotone equations with convex constraints. J. Appl. Math. Comput. 56, 195–216 (2018)MathSciNetCrossRefMATH Ou, Y.G., Li, J.Y.: A new derivative-free SCG-type projection method for nonlinear monotone equations with convex constraints. J. Appl. Math. Comput. 56, 195–216 (2018)MathSciNetCrossRefMATH
7.
go back to reference Ou, Y.G., Xu, W.J.: A unified derivative-free projection method model for large-scale nonlinear equations with convex constraints. Journal of Industrial and Management Optimization 18, 3539–3560 (2022)MathSciNetCrossRefMATH Ou, Y.G., Xu, W.J.: A unified derivative-free projection method model for large-scale nonlinear equations with convex constraints. Journal of Industrial and Management Optimization 18, 3539–3560 (2022)MathSciNetCrossRefMATH
8.
go back to reference Sun, M., Tian, M.Y.: A class of derivative-free CG projection methods for nonsmooth equations with an application to the LASSO problem. Bulletin of the Iranian Mathematical Society 46, 183–205 (2020)MathSciNetCrossRefMATH Sun, M., Tian, M.Y.: A class of derivative-free CG projection methods for nonsmooth equations with an application to the LASSO problem. Bulletin of the Iranian Mathematical Society 46, 183–205 (2020)MathSciNetCrossRefMATH
9.
go back to reference Amini, K., Kamandi, A.: A new line search strategy for finding separating hyperplane in projection-based methods. Numer. Algo. 70, 559–570 (2015)MathSciNetCrossRefMATH Amini, K., Kamandi, A.: A new line search strategy for finding separating hyperplane in projection-based methods. Numer. Algo. 70, 559–570 (2015)MathSciNetCrossRefMATH
10.
go back to reference Liu, J.K., Lu, Z.L., Xu, J.L., Wu, S., Tu, Z.W.: An efficient projection-based algorithm without Lipschitz continuity for large-scale nonlinear pseudo-monotone equations. J. Comput. Appl. Math 403, 113822 (2022)MathSciNetCrossRefMATH Liu, J.K., Lu, Z.L., Xu, J.L., Wu, S., Tu, Z.W.: An efficient projection-based algorithm without Lipschitz continuity for large-scale nonlinear pseudo-monotone equations. J. Comput. Appl. Math 403, 113822 (2022)MathSciNetCrossRefMATH
11.
go back to reference Abdullahi, H., Awasthi, A.K., Waziri M.Y., et al.: Descent three-term DY-type conjugate gradient methods for constrained monotone equations with application. Comp. Appl. Math. 41, 32 (2022)MathSciNetCrossRefMATH Abdullahi, H., Awasthi, A.K., Waziri M.Y., et al.: Descent three-term DY-type conjugate gradient methods for constrained monotone equations with application. Comp. Appl. Math. 41, 32 (2022)MathSciNetCrossRefMATH
12.
go back to reference Gao, P.T., Wang, T., Liu, X.L., Wu, Y.F.: An efficient three-term conjugate gradient-based algorithm involving spectral quotient for solving convex constrained monotone nonlinear equations with applications. Comput. Appl. Math. 41, 89 (2022)MathSciNetCrossRefMATH Gao, P.T., Wang, T., Liu, X.L., Wu, Y.F.: An efficient three-term conjugate gradient-based algorithm involving spectral quotient for solving convex constrained monotone nonlinear equations with applications. Comput. Appl. Math. 41, 89 (2022)MathSciNetCrossRefMATH
13.
go back to reference Yin, J.H., Jian, J.B., Jiang, X.Z.: A spectral gradient projection algorithm for convex constrained nonsmooth equations based on an adaptive line search. Mathematica Numerica Sinica (Chinese) 42, 457–471 (2020)MathSciNetMATH Yin, J.H., Jian, J.B., Jiang, X.Z.: A spectral gradient projection algorithm for convex constrained nonsmooth equations based on an adaptive line search. Mathematica Numerica Sinica (Chinese) 42, 457–471 (2020)MathSciNetMATH
14.
go back to reference Ibrahim, A.H., Poom, K., Hassan, B.A., Abubakar, A.B., Abubakar, J.: A derivative-free three-term Hestenes-Stiefel type method for constrained nonlinear equations and image restoration. Int. J. Comput. Math. 99, 1041–1065 (2022)MathSciNetCrossRefMATH Ibrahim, A.H., Poom, K., Hassan, B.A., Abubakar, A.B., Abubakar, J.: A derivative-free three-term Hestenes-Stiefel type method for constrained nonlinear equations and image restoration. Int. J. Comput. Math. 99, 1041–1065 (2022)MathSciNetCrossRefMATH
15.
go back to reference Koorapetse, M., Kaelo, P., Lekoko, S., Diphofu, T.: A derivative-free RMIL conjugate gradient projection method for convex constrained nonlinear monotone equations with applications in compressive sensing. Appl. Numer. Math. 165, 431–441 (2021)MathSciNetCrossRefMATH Koorapetse, M., Kaelo, P., Lekoko, S., Diphofu, T.: A derivative-free RMIL conjugate gradient projection method for convex constrained nonlinear monotone equations with applications in compressive sensing. Appl. Numer. Math. 165, 431–441 (2021)MathSciNetCrossRefMATH
16.
go back to reference Abubakar, A.B., Sabiu, J., Kumam, P., Shah, A.: Solving nonlinear monotone operator equations via modified SR1 update. J. Appl. Math. Comput. 67, 343–373 (2021)MathSciNetCrossRefMATH Abubakar, A.B., Sabiu, J., Kumam, P., Shah, A.: Solving nonlinear monotone operator equations via modified SR1 update. J. Appl. Math. Comput. 67, 343–373 (2021)MathSciNetCrossRefMATH
17.
go back to reference Halilu, A.S., Majumder, A., Waziri, M.Y., Awwal, A.M., Ahmed, K.: On solving double direction methods for convex constrained monotone nonlinear equations with image restoration. Comput. Appl. Math. 40, 239 (2021)MathSciNetCrossRefMATH Halilu, A.S., Majumder, A., Waziri, M.Y., Awwal, A.M., Ahmed, K.: On solving double direction methods for convex constrained monotone nonlinear equations with image restoration. Comput. Appl. Math. 40, 239 (2021)MathSciNetCrossRefMATH
19.
go back to reference Yin, J.H., Jian, J.B., Jiang, X.Z., et al.: A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications. Numer. Algo. 88, 389–418 (2021)MathSciNetCrossRefMATH Yin, J.H., Jian, J.B., Jiang, X.Z., et al.: A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications. Numer. Algo. 88, 389–418 (2021)MathSciNetCrossRefMATH
20.
go back to reference Guo, J., Wan, Z.: A modified spectral PRP conjugate gradient projection method for solving large-scale monotone equations and its applications in compressing sensing, Mathematical Problems in Engineering, Volume 2019, Article ID 5261830 (2019) Guo, J., Wan, Z.: A modified spectral PRP conjugate gradient projection method for solving large-scale monotone equations and its applications in compressing sensing, Mathematical Problems in Engineering, Volume 2019, Article ID 5261830 (2019)
21.
go back to reference Liu, P.J., Shao, H., Wang, Y., Wu, X.Y.: A three-term CGPM-based algorithm without Lipschitz continuity for constrained nonlinear monotone equations with applications. Appl. Numer. Math. 175, 98–107 (2022)MathSciNetCrossRefMATH Liu, P.J., Shao, H., Wang, Y., Wu, X.Y.: A three-term CGPM-based algorithm without Lipschitz continuity for constrained nonlinear monotone equations with applications. Appl. Numer. Math. 175, 98–107 (2022)MathSciNetCrossRefMATH
22.
go back to reference Jian, J.B., Yin, J.H., Tang, C.M., Han, D.L.: A family of inertial derivative-free projection methods for constrained nonlinear pseudo-monotone equations with applications. Comput. Appl. Math. 41, 309 (2022)MathSciNetCrossRefMATH Jian, J.B., Yin, J.H., Tang, C.M., Han, D.L.: A family of inertial derivative-free projection methods for constrained nonlinear pseudo-monotone equations with applications. Comput. Appl. Math. 41, 309 (2022)MathSciNetCrossRefMATH
23.
go back to reference Yin, J.H., Jian, J.B., Jiang, X.Z., Wu, X.D.: A family of inertial-relaxed DFPM-based algorithms for solving large-scale monotone nonlinear equations with application to sparse signal restoration. J. Comput. Appl. Math. 419, 114674 (2023)MathSciNetCrossRefMATH Yin, J.H., Jian, J.B., Jiang, X.Z., Wu, X.D.: A family of inertial-relaxed DFPM-based algorithms for solving large-scale monotone nonlinear equations with application to sparse signal restoration. J. Comput. Appl. Math. 419, 114674 (2023)MathSciNetCrossRefMATH
24.
go back to reference Bertsekas, D.P.: Constrainted Optimization and Lagrange Multiplier Methods. Academic Press, New York (1982)MATH Bertsekas, D.P.: Constrainted Optimization and Lagrange Multiplier Methods. Academic Press, New York (1982)MATH
25.
go back to reference Sun, W.Y., Yuan, Y.X.: Optimization Theory and Methods: Nonlinear Programming Springer Optimization and Its Applications, vol. 1. Springer, New York (2006) Sun, W.Y., Yuan, Y.X.: Optimization Theory and Methods: Nonlinear Programming Springer Optimization and Its Applications, vol. 1. Springer, New York (2006)
26.
go back to reference Polyak, B.T.: Introduction to Optimization, Optimization Software Incorporation. Publications Division, New York (1987) Polyak, B.T.: Introduction to Optimization, Optimization Software Incorporation. Publications Division, New York (1987)
27.
go back to reference Koorapetse, M., Kaelo, P.: A new three-term conjugate gradient-based projection method for solving large-scale nonlinear monotone equations. Math. Model. Anal. 24, 550–563 (2019)MathSciNetCrossRef Koorapetse, M., Kaelo, P.: A new three-term conjugate gradient-based projection method for solving large-scale nonlinear monotone equations. Math. Model. Anal. 24, 550–563 (2019)MathSciNetCrossRef
28.
go back to reference Dolan, E.D., More, J.J.: Benchmarking optimization software with performance profiles. Mathematical programming 91, 201–213 (2002)MathSciNetCrossRefMATH Dolan, E.D., More, J.J.: Benchmarking optimization software with performance profiles. Mathematical programming 91, 201–213 (2002)MathSciNetCrossRefMATH
Metadata
Title
A unified convergence analysis of the derivative-free projection-based method for constrained nonlinear monotone equations
Authors
Yigui Ou
Lin Li
Publication date
17-12-2022
Publisher
Springer US
Published in
Numerical Algorithms / Issue 4/2023
Print ISSN: 1017-1398
Electronic ISSN: 1572-9265
DOI
https://doi.org/10.1007/s11075-022-01483-9

Other articles of this Issue 4/2023

Numerical Algorithms 4/2023 Go to the issue

Premium Partner