Skip to main content
Top
Published in: Numerical Algorithms 1/2021

04-03-2020 | Original Paper

Switching preconditioners using a hybrid approach for linear systems arising from interior point methods for linear programming

Authors: Petra Maria Bartmeyer, Silvana Bocanegra, Aurelio Ribeiro Leite Oliveira

Published in: Numerical Algorithms | Issue 1/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In general, interior point methods are successful in solving large-scale linear programming problems. Their effectiveness is determined by how fast they calculate each solution of a linear system. When solving large-scale linear systems, iterative methods are useful options since they require slightly more computational memory in each iteration and preserve the sparsity pattern of the matrix system. In this context, a common choice is the conjugate gradient method using a preconditioning strategy. Choosing a single preconditioner that fits well during all iterations of the optimization method is not an easy task, because the distribution of the eigenvalues of the system matrix may vary significantly from the first to the last iterations. In order to simplify this task, one can use different preconditioners in different iterations, in a hybrid preconditioner strategy. In the case of symmetric positive definite systems, the Controlled Cholesky Factorization achieves excellent performance for the first interior point iterations, whereas the Splitting preconditioner is very useful in the last iterations. However, since we apply a hybrid approach combining both preconditioners, it is necessary to decide when using each preconditioner. This paper addresses the critical issue of choosing between the two preconditioners of the hybrid strategy by using the condition number of the matrix system. The Ritz values obtained from the conjugate gradient method provide an approximation to the eigenvalues, which offers an estimate of the condition number. The main contribution of this research is a new heuristic to switching the preconditioners based on the estimated condition number. Numerical results for large-scale problems show that our choice to change the preconditioners adds both speed and robustness to a hybrid approach that combines the Controlled Cholesky Factorization and the Splitting preconditioner.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference Bocanegra, S., Campos, F.F., Oliveira, A.R.: Using a hybrid preconditioner for solving large-scale linear systems arising from interior point methods. Comput. Optim. Appl. 36(2-3), 149–164 (2007)MathSciNetMATHCrossRef Bocanegra, S., Campos, F.F., Oliveira, A.R.: Using a hybrid preconditioner for solving large-scale linear systems arising from interior point methods. Comput. Optim. Appl. 36(2-3), 149–164 (2007)MathSciNetMATHCrossRef
4.
go back to reference Bocanegra, S., Castro, J., Oliveira, A.R.: Improving an interior-point approach for large block-angular problems by hybrid preconditioners. Eur. J. Oper. Res. 231(2), 263–273 (2013)MathSciNetMATHCrossRef Bocanegra, S., Castro, J., Oliveira, A.R.: Improving an interior-point approach for large block-angular problems by hybrid preconditioners. Eur. J. Oper. Res. 231(2), 263–273 (2013)MathSciNetMATHCrossRef
5.
go back to reference Cafieri, S., D’Apuzzo, M., De Simone, V., di Serafino, D.: Stopping criteria for inner iterations in inexact potential reduction methods: a computational study. Comput. Optim. Appl. 36(2-3), 165–193 (2007)MathSciNetMATHCrossRef Cafieri, S., D’Apuzzo, M., De Simone, V., di Serafino, D.: Stopping criteria for inner iterations in inexact potential reduction methods: a computational study. Comput. Optim. Appl. 36(2-3), 165–193 (2007)MathSciNetMATHCrossRef
6.
go back to reference Campos, F.F., Birkett, N.R.C.: An efficient solver for multi-right hand side linear systems based on the CCCG(η) method with applications to implicit time-dependent partial differential equations. SIAM J. Sci. Comput. 19(1), 126–138 (1998)MathSciNetMATHCrossRef Campos, F.F., Birkett, N.R.C.: An efficient solver for multi-right hand side linear systems based on the CCCG(η) method with applications to implicit time-dependent partial differential equations. SIAM J. Sci. Comput. 19(1), 126–138 (1998)MathSciNetMATHCrossRef
7.
go back to reference Carden, R.L., Embree, M.: Ritz value localization for non-hermitian matrices. SIAM Journal on Matrix Analysis and Applications 33(4), 1320–1338 (2012)MathSciNetMATHCrossRef Carden, R.L., Embree, M.: Ritz value localization for non-hermitian matrices. SIAM Journal on Matrix Analysis and Applications 33(4), 1320–1338 (2012)MathSciNetMATHCrossRef
8.
go back to reference Casacio, L., Lyra, C., Oliveira, A., Castro, C.O.: Improving the preconditioning of linear systems from interior point methods. Computers & Operations Research 85, 129–138 (2017)MathSciNetMATHCrossRef Casacio, L., Lyra, C., Oliveira, A., Castro, C.O.: Improving the preconditioning of linear systems from interior point methods. Computers & Operations Research 85, 129–138 (2017)MathSciNetMATHCrossRef
9.
go back to reference Casacio, L., Oliveira, A.R.L., Lyra, C.: Using groups in the splitting preconditioner computation for interior point methods. 4OR Q. J. Oper. Res. 16, 401–410 (2018)MATHCrossRef Casacio, L., Oliveira, A.R.L., Lyra, C.: Using groups in the splitting preconditioner computation for interior point methods. 4OR Q. J. Oper. Res. 16, 401–410 (2018)MATHCrossRef
10.
go back to reference Czyzyk, J., Mehrotra, S., Wagner, M., Wright, S.J.: PCx: An interior-point code for linear programming. Optimization Methods and Software 11(1-4), 397–430 (1999)MathSciNetMATHCrossRef Czyzyk, J., Mehrotra, S., Wagner, M., Wright, S.J.: PCx: An interior-point code for linear programming. Optimization Methods and Software 11(1-4), 397–430 (1999)MathSciNetMATHCrossRef
11.
go back to reference D’Apuzzo, M., De Simone, V., Di Serafino, D.: On mutual impact of numerical linear algebra and large-scale optimization with focus on interior point methods. Comput. Optim. Appl. 45(2), 283–310 (2010)MathSciNetMATHCrossRef D’Apuzzo, M., De Simone, V., Di Serafino, D.: On mutual impact of numerical linear algebra and large-scale optimization with focus on interior point methods. Comput. Optim. Appl. 45(2), 283–310 (2010)MathSciNetMATHCrossRef
12.
13.
go back to reference Fan, K.: Maximum properties and inequalities for the eigenvalues of completely continuous operators. Proc. Natl. Acad. Sci. 37(11), 760–766 (1951)MathSciNetMATHCrossRef Fan, K.: Maximum properties and inequalities for the eigenvalues of completely continuous operators. Proc. Natl. Acad. Sci. 37(11), 760–766 (1951)MathSciNetMATHCrossRef
14.
go back to reference Ghidini, C., Oliveira, A., Sorensen, D.: Computing a hybrid preconditioner approach to solve the linear systems arising from interior point methods for linear programming using the gradient conjugate method. Annals of Management Science 3, 45–66 (2014)CrossRef Ghidini, C., Oliveira, A., Sorensen, D.: Computing a hybrid preconditioner approach to solve the linear systems arising from interior point methods for linear programming using the gradient conjugate method. Annals of Management Science 3, 45–66 (2014)CrossRef
15.
go back to reference Ghidini, C.T., Oliveira, A., Silva, J., Velazco, M.: Combining a hybrid preconditioner and a optimal adjustment algorithm to accelerate the convergence of interior point methods. Linear Algebra Appl. 436(5), 1267–1284 (2012)MathSciNetMATHCrossRef Ghidini, C.T., Oliveira, A., Silva, J., Velazco, M.: Combining a hybrid preconditioner and a optimal adjustment algorithm to accelerate the convergence of interior point methods. Linear Algebra Appl. 436(5), 1267–1284 (2012)MathSciNetMATHCrossRef
16.
go back to reference Golub, G.H., Van Loan, C.F.: Matrix computations. JHU Press (2012) Golub, G.H., Van Loan, C.F.: Matrix computations. JHU Press (2012)
18.
go back to reference Hestenes, M.R., Stiefel, E.: Methods of conjugate gradients for solving linear systems, vol. 49 NBS (1952) Hestenes, M.R., Stiefel, E.: Methods of conjugate gradients for solving linear systems, vol. 49 NBS (1952)
19.
go back to reference Jia, Z., Stewart, G.: An analysis of the Rayleigh–Ritz method for approximating eigenspaces. Math. Comput. 70(234), 637–647 (2001)MathSciNetMATHCrossRef Jia, Z., Stewart, G.: An analysis of the Rayleigh–Ritz method for approximating eigenspaces. Math. Comput. 70(234), 637–647 (2001)MathSciNetMATHCrossRef
20.
21.
go back to reference Kardani, O., Lyamin, A., Krabbenhøft, K.: Application of a GPU-accelerated hybrid preconditioned conjugate gradient approach for large 3D problems in computational geomechanics. Computers & Mathematics with Applications 69(10), 1114–1131 (2015)MathSciNetMATHCrossRef Kardani, O., Lyamin, A., Krabbenhøft, K.: Application of a GPU-accelerated hybrid preconditioned conjugate gradient approach for large 3D problems in computational geomechanics. Computers & Mathematics with Applications 69(10), 1114–1131 (2015)MathSciNetMATHCrossRef
22.
go back to reference Lanczos, C.: An iteration method for the solution of the eigenvalue problem of linear differential and integral operators. United States Governm. Press Office Los Angeles, CA (1950) Lanczos, C.: An iteration method for the solution of the eigenvalue problem of linear differential and integral operators. United States Governm. Press Office Los Angeles, CA (1950)
23.
24.
go back to reference Maros, I., Mészáros, C.: A repository of convex quadratic programming problems. Optimization Methods and Software 11(1-4), 671–681 (1999)MathSciNetMATHCrossRef Maros, I., Mészáros, C.: A repository of convex quadratic programming problems. Optimization Methods and Software 11(1-4), 671–681 (1999)MathSciNetMATHCrossRef
26.
go back to reference Meijerink, J., van der Vorst, H.A.: An iterative solution method for linear systems of which the coefficient matrix is a symmetric M-matrix. Mathematics of Computation 31(137), 148–162 (1977)MathSciNetMATH Meijerink, J., van der Vorst, H.A.: An iterative solution method for linear systems of which the coefficient matrix is a symmetric M-matrix. Mathematics of Computation 31(137), 148–162 (1977)MathSciNetMATH
27.
go back to reference Oliveira, A.R.L., Sorensen, D.C.: A new class of preconditioners for large-scale linear systems from interior point methods for linear programming. Linear Algebra and its Applications 394, 1–24 (2005)MathSciNetMATHCrossRef Oliveira, A.R.L., Sorensen, D.C.: A new class of preconditioners for large-scale linear systems from interior point methods for linear programming. Linear Algebra and its Applications 394, 1–24 (2005)MathSciNetMATHCrossRef
29.
go back to reference Suñagua, P., Oliveira, A.R.: A new approach for finding a basis for the splitting preconditioner for linear systems from interior point methods. Comput. Optim. Appl. 111–127 (2017) Suñagua, P., Oliveira, A.R.: A new approach for finding a basis for the splitting preconditioner for linear systems from interior point methods. Comput. Optim. Appl. 111–127 (2017)
30.
go back to reference Teng, Z., Lu, L., Li, R.C.: Accuracy of Rayleigh—Ritz approximations. Tech. rep., Department of Mathematics, The University of Texas, Arlington (2015) Teng, Z., Lu, L., Li, R.C.: Accuracy of Rayleigh—Ritz approximations. Tech. rep., Department of Mathematics, The University of Texas, Arlington (2015)
31.
go back to reference Velazco, M., Oliveira, A.R., Campos, F.: A note on hybrid preconditioners for large-scale normal equations arising from interior-point methods. Optimization Methods & Software 25(2), 321–332 (2010)MathSciNetMATHCrossRef Velazco, M., Oliveira, A.R., Campos, F.: A note on hybrid preconditioners for large-scale normal equations arising from interior-point methods. Optimization Methods & Software 25(2), 321–332 (2010)MathSciNetMATHCrossRef
33.
go back to reference Wright, S.J.: Primal-dual interior-point methods. SIAM (1997) Wright, S.J.: Primal-dual interior-point methods. SIAM (1997)
Metadata
Title
Switching preconditioners using a hybrid approach for linear systems arising from interior point methods for linear programming
Authors
Petra Maria Bartmeyer
Silvana Bocanegra
Aurelio Ribeiro Leite Oliveira
Publication date
04-03-2020
Publisher
Springer US
Published in
Numerical Algorithms / Issue 1/2021
Print ISSN: 1017-1398
Electronic ISSN: 1572-9265
DOI
https://doi.org/10.1007/s11075-020-00893-x

Other articles of this Issue 1/2021

Numerical Algorithms 1/2021 Go to the issue

Premium Partner