Skip to main content
Erschienen in: Journal of Scientific Computing 1/2021

01.01.2021

Two New Variants of the Simpler Block GMRES Method with Vector Deflation and Eigenvalue Deflation for Multiple Linear Systems

verfasst von: Azita Tajaddini, Gang Wu, Farid Saberi-Movahed, Najmeh Azizizadeh

Erschienen in: Journal of Scientific Computing | Ausgabe 1/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, two effective methods based on the simpler block GMRES method are established in order to solve the linear systems of equations with multiple right-hand sides. The first method is derived from the simpler block GMRES method with vector deflation restarting (SBGMRES-DR). The second method is constructed from a combination of SBGMRES-DR with the eigenvalue deflation technique, which is called the deflated simpler block GMRES method with vector deflation restarting (D-SBGMRES-DR). To be more specific, SBGMRES-DR is capable of removing linearly or almost linearly dependent vectors created by the block Arnoldi process. On the other hand, D-SBGMRES-DR not only deletes linearly or almost linearly dependent vectors but also retains harmonic Ritz vectors associated with the smallest harmonic Ritz values in magnitude, and adds them to the new search subspace at the time of restart. Finally, a wide range of practical experiments are carried out to assess the efficiency of the proposed methods. The numerical results indicate that the D-SBGMRES-DR method outperforms the compared methods with respect to the number of matrix–vector products and the computational time.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abdaoui, l, Elbouyahyaoui, L., Heyouni, M.: The simpler block CMRH method for linear systems. Numer. Algorithms 84, 1265–1293 (2020)MathSciNetMATHCrossRef Abdaoui, l, Elbouyahyaoui, L., Heyouni, M.: The simpler block CMRH method for linear systems. Numer. Algorithms 84, 1265–1293 (2020)MathSciNetMATHCrossRef
2.
Zurück zum Zitat Al Daas, H., Grigori, L., Hénon, P., Ricoux, P.: Enlarged GMRES for solving linear systems with one or multiple right-hand sides. IMA J. Numer. Anal. 39, 1924–1956 (2019)MathSciNetMATHCrossRef Al Daas, H., Grigori, L., Hénon, P., Ricoux, P.: Enlarged GMRES for solving linear systems with one or multiple right-hand sides. IMA J. Numer. Anal. 39, 1924–1956 (2019)MathSciNetMATHCrossRef
3.
Zurück zum Zitat Bloch, J.C., Breu, T., Frommer, A., Heybrock, S., Schaefer, K., Wettig, T.: Short-recurrence Krylov subspace methods for the overlap Dirac operator at nonzero chemical potential. Comput. Phys. Commun. 181(8), 1378–1387 (2010)MathSciNetMATHCrossRef Bloch, J.C., Breu, T., Frommer, A., Heybrock, S., Schaefer, K., Wettig, T.: Short-recurrence Krylov subspace methods for the overlap Dirac operator at nonzero chemical potential. Comput. Phys. Commun. 181(8), 1378–1387 (2010)MathSciNetMATHCrossRef
4.
Zurück zum Zitat Bloch, J.C., Heybrock, S.: A nested Krylov subspace method to compute the sign function of large complex matrices. Comput. Phys. Commun. 182(4), 878–889 (2011)MATHCrossRef Bloch, J.C., Heybrock, S.: A nested Krylov subspace method to compute the sign function of large complex matrices. Comput. Phys. Commun. 182(4), 878–889 (2011)MATHCrossRef
5.
Zurück zum Zitat Boojhawon, R., Bhuruth, M.: Restarted simpler GMRES augmented with harmonic ritz vectors. Future Gener. Comput. Syst. 20(3), 389–397 (2004)MATHCrossRef Boojhawon, R., Bhuruth, M.: Restarted simpler GMRES augmented with harmonic ritz vectors. Future Gener. Comput. Syst. 20(3), 389–397 (2004)MATHCrossRef
6.
Zurück zum Zitat Bouyouli, R., Jbilou, K., Sadaka, R., Sadok, H.: Convergence properties of some block Krylov subspace methods for multiple linear systems. J. Comput. Appl. Math. 196, 498–511 (2006)MathSciNetMATHCrossRef Bouyouli, R., Jbilou, K., Sadaka, R., Sadok, H.: Convergence properties of some block Krylov subspace methods for multiple linear systems. J. Comput. Appl. Math. 196, 498–511 (2006)MathSciNetMATHCrossRef
7.
Zurück zum Zitat Calandra, H., Gratton, S., Lago, R., Vasseur, X., Carvalho, L.M.: A modified block flexible GMRES method with deflation at each iteration for the solution of non-Hermitian linear systems with multiple right-hand sides. SIAM J. Sci. Comput. 35(5), S345–S367 (2013)MathSciNetMATHCrossRef Calandra, H., Gratton, S., Lago, R., Vasseur, X., Carvalho, L.M.: A modified block flexible GMRES method with deflation at each iteration for the solution of non-Hermitian linear systems with multiple right-hand sides. SIAM J. Sci. Comput. 35(5), S345–S367 (2013)MathSciNetMATHCrossRef
8.
Zurück zum Zitat Calandra, H., Gratton, S., Langou, J., Pinel, X., Vasseur, X.: Flexible variants of block restarted GMRES methods with application to geophysics. SIAM J. Sci. Comput. 34(2), A714–A736 (2012)MathSciNetMATHCrossRef Calandra, H., Gratton, S., Langou, J., Pinel, X., Vasseur, X.: Flexible variants of block restarted GMRES methods with application to geophysics. SIAM J. Sci. Comput. 34(2), A714–A736 (2012)MathSciNetMATHCrossRef
9.
Zurück zum Zitat Carpentieri, B., Jing, Y.-F., Huang, T.-Z.: The BiCOR and CORS iterative algorithms for solving nonsymmetric linear systems. SIAM J. Sci. Comput. 33(5), 3020–3036 (2011)MathSciNetMATHCrossRef Carpentieri, B., Jing, Y.-F., Huang, T.-Z.: The BiCOR and CORS iterative algorithms for solving nonsymmetric linear systems. SIAM J. Sci. Comput. 33(5), 3020–3036 (2011)MathSciNetMATHCrossRef
10.
Zurück zum Zitat Chen, G., Jia, Z.X.: Theoretical and numerical comparisons of GMRES and WZ-GMRES. Comput. Math. Appl. 47(8–9), 1335–1350 (2004)MathSciNetMATHCrossRef Chen, G., Jia, Z.X.: Theoretical and numerical comparisons of GMRES and WZ-GMRES. Comput. Math. Appl. 47(8–9), 1335–1350 (2004)MathSciNetMATHCrossRef
11.
Zurück zum Zitat Clough, R.W., Penzien, J.: Structural Dynamics. McGrowHill Inc, New York (1975)MATH Clough, R.W., Penzien, J.: Structural Dynamics. McGrowHill Inc, New York (1975)MATH
12.
Zurück zum Zitat Davis, T.A., Hu, Y.: The University of Florida sparse matrix collection. ACM Trans. Math. Softw. (TOMS) 38(1), 1 (2011)MathSciNetMATH Davis, T.A., Hu, Y.: The University of Florida sparse matrix collection. ACM Trans. Math. Softw. (TOMS) 38(1), 1 (2011)MathSciNetMATH
13.
Zurück zum Zitat Elbouyahyaoui, L., Heyouni, M., Tajaddini, A., Saberi-Movahed, F.: On restarted and deflated block FOM and GMRES methods for sequences of shifted linear systems. Numer. Algorithms 25, 1–43 (2020) Elbouyahyaoui, L., Heyouni, M., Tajaddini, A., Saberi-Movahed, F.: On restarted and deflated block FOM and GMRES methods for sequences of shifted linear systems. Numer. Algorithms 25, 1–43 (2020)
14.
Zurück zum Zitat Erlangga, Y.A., Vuik, C., Oosterlee, C.W.: On a class of preconditioners for solving the Helmholtz equation. Appl. Numer. Math. 50, 409–425 (2004)MathSciNetMATHCrossRef Erlangga, Y.A., Vuik, C., Oosterlee, C.W.: On a class of preconditioners for solving the Helmholtz equation. Appl. Numer. Math. 50, 409–425 (2004)MathSciNetMATHCrossRef
15.
Zurück zum Zitat Freund, R.W.: Krylov-subspace methods for reduced-order modeling in circuit simulation. J. Comput. Appl. Math. 123(1–2), 395–421 (2000)MathSciNetMATHCrossRef Freund, R.W.: Krylov-subspace methods for reduced-order modeling in circuit simulation. J. Comput. Appl. Math. 123(1–2), 395–421 (2000)MathSciNetMATHCrossRef
16.
Zurück zum Zitat Frommer, A., Lund, K., Szyld, D.B.: Block Krylov subspace methods for functions of matrices. Electron. Trans. Numer. Anal. 47, 100–126 (2017)MathSciNetMATH Frommer, A., Lund, K., Szyld, D.B.: Block Krylov subspace methods for functions of matrices. Electron. Trans. Numer. Anal. 47, 100–126 (2017)MathSciNetMATH
17.
Zurück zum Zitat Frommer, A., Lund, K., Szyld, D.B.: Block Krylov subspace methods for functions of matrices II: modified block FOM. SIAM J. Matrix Anal. Appl. 4(2), 804–837 (2020)MathSciNetMATHCrossRef Frommer, A., Lund, K., Szyld, D.B.: Block Krylov subspace methods for functions of matrices II: modified block FOM. SIAM J. Matrix Anal. Appl. 4(2), 804–837 (2020)MathSciNetMATHCrossRef
18.
Zurück zum Zitat Giraud, L., Gratton, S., Pinel, X., Vasseur, X.: Flexible GMRES with deflated restarting. SIAM J. Sci. Comput. 32(4), 1858–1878 (2010)MathSciNetMATHCrossRef Giraud, L., Gratton, S., Pinel, X., Vasseur, X.: Flexible GMRES with deflated restarting. SIAM J. Sci. Comput. 32(4), 1858–1878 (2010)MathSciNetMATHCrossRef
19.
Zurück zum Zitat Golub, G.H., Van Loan, C.F.: Matrix Computations, 4th edn. The Johns Hopkins University Press, Baltimore (2013)MATHCrossRef Golub, G.H., Van Loan, C.F.: Matrix Computations, 4th edn. The Johns Hopkins University Press, Baltimore (2013)MATHCrossRef
20.
Zurück zum Zitat Gu, G.-D., Cao, Z.-H.: A block GMRES method augmented with eigenvectors. Appl. Math. Comput. 121(2–3), 271–289 (2001)MathSciNetMATH Gu, G.-D., Cao, Z.-H.: A block GMRES method augmented with eigenvectors. Appl. Math. Comput. 121(2–3), 271–289 (2001)MathSciNetMATH
21.
Zurück zum Zitat Gutknecht, M.H.: Block Krylov space methods for linear systems with multiple right-hand sides: an introduction. In: Siddiqi, A., Duff, I., Christensen, O. (eds.) Modern Mathematical Models, Methods and Algorithms for Real World Systems, pp. 420–447. Anamaya Publishers, New Delhi (2006) Gutknecht, M.H.: Block Krylov space methods for linear systems with multiple right-hand sides: an introduction. In: Siddiqi, A., Duff, I., Christensen, O. (eds.) Modern Mathematical Models, Methods and Algorithms for Real World Systems, pp. 420–447. Anamaya Publishers, New Delhi (2006)
22.
Zurück zum Zitat Heyouni, M., Essai, A.: Matrix Krylov subspace methods for linear systems with multiple right-hand sides. Numer. Algorithms 40, 137–156 (2005)MathSciNetMATHCrossRef Heyouni, M., Essai, A.: Matrix Krylov subspace methods for linear systems with multiple right-hand sides. Numer. Algorithms 40, 137–156 (2005)MathSciNetMATHCrossRef
23.
Zurück zum Zitat Jbilou, K., Messaoudi, A., Sadok, H.: Global FOM and GMRES algorithms for matrix equations. Appl. Numer. Math. 31(1), 49–63 (1999)MathSciNetMATHCrossRef Jbilou, K., Messaoudi, A., Sadok, H.: Global FOM and GMRES algorithms for matrix equations. Appl. Numer. Math. 31(1), 49–63 (1999)MathSciNetMATHCrossRef
26.
Zurück zum Zitat J. Langou. Iterative Methods for Solving Linear Systems with Multiple Right-hand Sides. Ph.D. thesis, Ph. D. dissertation, INSA Toulouse (2003) J. Langou. Iterative Methods for Solving Linear Systems with Multiple Right-hand Sides. Ph.D. thesis, Ph. D. dissertation, INSA Toulouse (2003)
27.
Zurück zum Zitat Liu, H., Zhong, B.: Simpler block GMRES for nonsymmetric systems with multiple right-hand sides. Electron. Trans. Numer. Anal. 30, 1–9 (2008)MathSciNetMATH Liu, H., Zhong, B.: Simpler block GMRES for nonsymmetric systems with multiple right-hand sides. Electron. Trans. Numer. Anal. 30, 1–9 (2008)MathSciNetMATH
28.
Zurück zum Zitat Meng, J., Zhu, P.-Y., Li, H.-B.: A block GCROT(\(m, k\)) method for linear systems with multiple right-hand sides. J. Comput. Appl. Math. 255, 544–554 (2014)MathSciNetMATHCrossRef Meng, J., Zhu, P.-Y., Li, H.-B.: A block GCROT(\(m, k\)) method for linear systems with multiple right-hand sides. J. Comput. Appl. Math. 255, 544–554 (2014)MathSciNetMATHCrossRef
29.
Zurück zum Zitat Meng, J., Zhu, P.-Y., Li, H.-B., Gu, X.-M.: A deflated block flexible GMRES-DR method for linear systems with multiple right-hand sides. Electron. Trans. Numer. Anal. 41, 478–496 (2014)MathSciNetMATH Meng, J., Zhu, P.-Y., Li, H.-B., Gu, X.-M.: A deflated block flexible GMRES-DR method for linear systems with multiple right-hand sides. Electron. Trans. Numer. Anal. 41, 478–496 (2014)MathSciNetMATH
31.
Zurück zum Zitat Rashedi, S., Ebadi, G., Birk, S., Frommer, A.: On short recurrence Krylov type methods for linear systems with many right-hand sides. J. Comput. Appl. Math. 300, 18–29 (2016)MathSciNetMATHCrossRef Rashedi, S., Ebadi, G., Birk, S., Frommer, A.: On short recurrence Krylov type methods for linear systems with many right-hand sides. J. Comput. Appl. Math. 300, 18–29 (2016)MathSciNetMATHCrossRef
32.
Zurück zum Zitat Robbé, M., Sadkane, M.: Exact and inexact breakdowns in the block GMRES method. Linear Algebra Appl. 419(1), 265–285 (2006)MathSciNetMATHCrossRef Robbé, M., Sadkane, M.: Exact and inexact breakdowns in the block GMRES method. Linear Algebra Appl. 419(1), 265–285 (2006)MathSciNetMATHCrossRef
33.
Zurück zum Zitat Saad, Y.: Iterative Methods for Sparse Linear Systems, vol. 82. SIAM, Philadelphia (2003)MATHCrossRef Saad, Y.: Iterative Methods for Sparse Linear Systems, vol. 82. SIAM, Philadelphia (2003)MATHCrossRef
34.
Zurück zum Zitat Sakurai, T., Tadano, H., Kuramashi, Y.: Application of block Krylov subspace algorithms to the Wilson–Dirac equation with multiple right-hand sides in lattice QCD. Comput. Phys. Commun. 181(1), 113–117 (2010)MathSciNetMATHCrossRef Sakurai, T., Tadano, H., Kuramashi, Y.: Application of block Krylov subspace algorithms to the Wilson–Dirac equation with multiple right-hand sides in lattice QCD. Comput. Phys. Commun. 181(1), 113–117 (2010)MathSciNetMATHCrossRef
35.
Zurück zum Zitat Simoncini, V., Gallopoulos, E.: An iterative method for nonsymmetric systems with multiple right-hand sides. SIAM J. Sci. Comput. 16(4), 917–933 (1995)MathSciNetMATHCrossRef Simoncini, V., Gallopoulos, E.: An iterative method for nonsymmetric systems with multiple right-hand sides. SIAM J. Sci. Comput. 16(4), 917–933 (1995)MathSciNetMATHCrossRef
36.
Zurück zum Zitat Simoncini, V., Gallopoulos, E.: A hybrid block GMRES method for nonsymmetric systems with multiple right-hand sides. J. Comput. Appl. Math. 66(1–2), 457–469 (1996)MathSciNetMATHCrossRef Simoncini, V., Gallopoulos, E.: A hybrid block GMRES method for nonsymmetric systems with multiple right-hand sides. J. Comput. Appl. Math. 66(1–2), 457–469 (1996)MathSciNetMATHCrossRef
37.
Zurück zum Zitat Soudais, P.: Iterative solution of a 3D scattering problem from arbitrary shaped multidielectric and multiconducting bodies. IEEE Trans. Antennas Propag. 42(7), 954–959 (1994)CrossRef Soudais, P.: Iterative solution of a 3D scattering problem from arbitrary shaped multidielectric and multiconducting bodies. IEEE Trans. Antennas Propag. 42(7), 954–959 (1994)CrossRef
38.
Zurück zum Zitat Sun, D.-L., Carpentieri, B., Huang, T.-Z., Jing, Y.-F.: A spectrally preconditioned and initially deflated variant of the restarted block GMRES method for solving multiple right-hand sides linear systems. Int. J. Mech. Sci. 144, 775–787 (2018)CrossRef Sun, D.-L., Carpentieri, B., Huang, T.-Z., Jing, Y.-F.: A spectrally preconditioned and initially deflated variant of the restarted block GMRES method for solving multiple right-hand sides linear systems. Int. J. Mech. Sci. 144, 775–787 (2018)CrossRef
39.
Zurück zum Zitat Sun, D.-L., Huang, T.-Z., Carpentieri, B., Jing, Y.-F.: A new shifted block GMRES method with inexact breakdowns for solving multi-shifted and multiple right-hand sides linear systems. J. Sci. Comput. 78(2), 746–769 (2019)MathSciNetMATHCrossRef Sun, D.-L., Huang, T.-Z., Carpentieri, B., Jing, Y.-F.: A new shifted block GMRES method with inexact breakdowns for solving multi-shifted and multiple right-hand sides linear systems. J. Sci. Comput. 78(2), 746–769 (2019)MathSciNetMATHCrossRef
40.
Zurück zum Zitat Sun, D.-L., Huang, T.-Z., Carpentieri, B., Jing, Y.-F.: Flexible and deflated variants of the block shifted GMRES method. J. Comput. Appl. Math. 345, 168–183 (2019)MathSciNetMATHCrossRef Sun, D.-L., Huang, T.-Z., Carpentieri, B., Jing, Y.-F.: Flexible and deflated variants of the block shifted GMRES method. J. Comput. Appl. Math. 345, 168–183 (2019)MathSciNetMATHCrossRef
42.
Zurück zum Zitat Wu, Q., Bao, L., Lin, Y.: Residual-based simpler block GMRES for nonsymmetric linear systems with multiple right-hand sides. Adv. Math. Phys. 2018, 1369707 (2018)MathSciNetMATHCrossRef Wu, Q., Bao, L., Lin, Y.: Residual-based simpler block GMRES for nonsymmetric linear systems with multiple right-hand sides. Adv. Math. Phys. 2018, 1369707 (2018)MathSciNetMATHCrossRef
43.
Zurück zum Zitat Xiang, Y.-F., Jing, Y.-F., Huang, T.-Z.: A new projected variant of the deflated block conjugate gradient method. J. Sci. Comput. 80, 1116–1138 (2019)MathSciNetMATHCrossRef Xiang, Y.-F., Jing, Y.-F., Huang, T.-Z.: A new projected variant of the deflated block conjugate gradient method. J. Sci. Comput. 80, 1116–1138 (2019)MathSciNetMATHCrossRef
44.
45.
Zurück zum Zitat Zhong, H.-X., Gu, X.-M.: A flexible and adaptive simpler GMRES with deflated restarting for shifted linear systems. Comput. Math. Appl. 78(3), 997–1007 (2019)MathSciNetMATHCrossRef Zhong, H.-X., Gu, X.-M.: A flexible and adaptive simpler GMRES with deflated restarting for shifted linear systems. Comput. Math. Appl. 78(3), 997–1007 (2019)MathSciNetMATHCrossRef
46.
Zurück zum Zitat Zhong, H.-X., Wu, G., Chen, G.-L.: A flexible and adaptive simpler block GMRES with deflated restarting for linear systems with multiple right-hand sides. J. Comput. Appl. Math. 282, 139–156 (2015)MathSciNetMATHCrossRef Zhong, H.-X., Wu, G., Chen, G.-L.: A flexible and adaptive simpler block GMRES with deflated restarting for linear systems with multiple right-hand sides. J. Comput. Appl. Math. 282, 139–156 (2015)MathSciNetMATHCrossRef
Metadaten
Titel
Two New Variants of the Simpler Block GMRES Method with Vector Deflation and Eigenvalue Deflation for Multiple Linear Systems
verfasst von
Azita Tajaddini
Gang Wu
Farid Saberi-Movahed
Najmeh Azizizadeh
Publikationsdatum
01.01.2021
Verlag
Springer US
Erschienen in
Journal of Scientific Computing / Ausgabe 1/2021
Print ISSN: 0885-7474
Elektronische ISSN: 1573-7691
DOI
https://doi.org/10.1007/s10915-020-01376-w

Weitere Artikel der Ausgabe 1/2021

Journal of Scientific Computing 1/2021 Zur Ausgabe