Skip to main content
Erschienen in: Calcolo 2/2021

01.06.2021

On the global convergence of the block Jacobi method for the positive definite generalized eigenvalue problem

verfasst von: Vjeran Hari

Erschienen in: Calcolo | Ausgabe 2/2021

Einloggen, um Zugang zu erhalten

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The paper proves the global convergence of a general block Jacobi method for the generalized eigenvalue problem \(\mathbf {A}x=\lambda \mathbf {B}x\) with symmetric matrices \(\mathbf {A}\), \(\mathbf {B}\) such that \(\mathbf {B}\) is positive definite. The proof is made for a large class of generalized serial strategies that includes important serial and parallel strategies. The sequence of matrix pairs generated by the block method converges to \((\varvec{\varLambda } , \mathbf {I})\) where \(\varvec{\varLambda }\) is a diagonal matrix of the eigenvalues of the initial matrix pair \((\mathbf {A},\mathbf {B})\) and \(\mathbf {I}\) is the identity matrix. First, the convergence to diagonal form is proved. After that several conditions are imposed to ensure the global convergence of the block method.
Literatur
1.
Zurück zum Zitat Hari, V., Begović Kovač, E.: Convergence of the cyclic and quasi-cyclic block Jacobi methods. Electron. Trans. Numer. Anal. 46, 107–147 (2017)MathSciNetMATH Hari, V., Begović Kovač, E.: Convergence of the cyclic and quasi-cyclic block Jacobi methods. Electron. Trans. Numer. Anal. 46, 107–147 (2017)MathSciNetMATH
2.
Zurück zum Zitat Demmel, W.J., Veselić, K.: Jacobi’s method is more accurate than QR. SIAM J. Matrix Anal. Appl. 13, 1204–1245 (1992)MathSciNetCrossRef Demmel, W.J., Veselić, K.: Jacobi’s method is more accurate than QR. SIAM J. Matrix Anal. Appl. 13, 1204–1245 (1992)MathSciNetCrossRef
3.
Zurück zum Zitat Slapničar, I.: Accurate symmetric eigenreduction by a Jacobi method. Ph.D. thesis, University of Hagen (1992) Slapničar, I.: Accurate symmetric eigenreduction by a Jacobi method. Ph.D. thesis, University of Hagen (1992)
4.
Zurück zum Zitat Drmač, Z.: Implementation of Jacobi rotations for accurate singular value computation in floating-point arithmetic. SIAM J. Sci. Stat. Comp. 18(4), 1200–1222 (1997)MathSciNetCrossRef Drmač, Z.: Implementation of Jacobi rotations for accurate singular value computation in floating-point arithmetic. SIAM J. Sci. Stat. Comp. 18(4), 1200–1222 (1997)MathSciNetCrossRef
5.
Zurück zum Zitat Demmel, W.J., Gu, M., Eisenstat, S., Slapničar, I., Veselić, K., Drmač, Z.: Computing the singular value decomposition with high relative accuracy. Linear Algebra Appl. 299, 21–80 (1999)MathSciNetCrossRef Demmel, W.J., Gu, M., Eisenstat, S., Slapničar, I., Veselić, K., Drmač, Z.: Computing the singular value decomposition with high relative accuracy. Linear Algebra Appl. 299, 21–80 (1999)MathSciNetCrossRef
6.
Zurück zum Zitat Slapničar, I.: Highly accurate symmetric eigenvalue decomposition and hyperbolic SVD. Linear Algebra Appl. 358, 387–424 (2002)MathSciNetCrossRef Slapničar, I.: Highly accurate symmetric eigenvalue decomposition and hyperbolic SVD. Linear Algebra Appl. 358, 387–424 (2002)MathSciNetCrossRef
7.
Zurück zum Zitat Dopico, F.M., Molera, J.M., Moro, J.: An orthogonal high relative accuracy algorithm for the symmetric eigenproblem. SIAM J. Matrix Anal. Appl. 25(2), 301–351 (2003)MathSciNetCrossRef Dopico, F.M., Molera, J.M., Moro, J.: An orthogonal high relative accuracy algorithm for the symmetric eigenproblem. SIAM J. Matrix Anal. Appl. 25(2), 301–351 (2003)MathSciNetCrossRef
8.
Zurück zum Zitat Matejaš, J.: Accuracy of the Jacobi method on scaled diagonally dominant symmetric matrices. SIAM J. Matrix Anal. Appl. 31(1), 133–153 (2009)MathSciNetCrossRef Matejaš, J.: Accuracy of the Jacobi method on scaled diagonally dominant symmetric matrices. SIAM J. Matrix Anal. Appl. 31(1), 133–153 (2009)MathSciNetCrossRef
9.
Zurück zum Zitat Matejaš, J., Hari, V.: On high relative accuracy of the Kogbetliantz method. Linear Algebra Appl. 464, 100–129 (2015)MathSciNetCrossRef Matejaš, J., Hari, V.: On high relative accuracy of the Kogbetliantz method. Linear Algebra Appl. 464, 100–129 (2015)MathSciNetCrossRef
11.
Zurück zum Zitat de Rijk, P.P.M.: A one-sided Jacobi algorithm for computing the singular-value decomposition on a vector computer. SIAM J. Sci. Stat. Comp. 10(2), 359–371 (1989)MathSciNetCrossRef de Rijk, P.P.M.: A one-sided Jacobi algorithm for computing the singular-value decomposition on a vector computer. SIAM J. Sci. Stat. Comp. 10(2), 359–371 (1989)MathSciNetCrossRef
12.
13.
Zurück zum Zitat Hari, V., Veselić, K.: On Jacobi methods for singular value decompositions. SIAM J. Sci. Stat. Comput. 8(5), 741–754 (1987)MathSciNetCrossRef Hari, V., Veselić, K.: On Jacobi methods for singular value decompositions. SIAM J. Sci. Stat. Comput. 8(5), 741–754 (1987)MathSciNetCrossRef
14.
Zurück zum Zitat Eberlein, P.J., Park, H.: Efficient implementation of Jacobi algorithms and Jacobi sets on distributed memory architectures. J. Parallel Distrib. Comput. 8, 358–366 (1990)CrossRef Eberlein, P.J., Park, H.: Efficient implementation of Jacobi algorithms and Jacobi sets on distributed memory architectures. J. Parallel Distrib. Comput. 8, 358–366 (1990)CrossRef
15.
Zurück zum Zitat Hari, V., Zadelj-Martić, V.: Parallelizing the Kogbetliantz method: a first attempt. JNAIAM 2(1–2), 49–66 (2007)MathSciNetMATH Hari, V., Zadelj-Martić, V.: Parallelizing the Kogbetliantz method: a first attempt. JNAIAM 2(1–2), 49–66 (2007)MathSciNetMATH
16.
Zurück zum Zitat Drmač, Z.: A posteriori computation of the singular vectors in a preconditioned Jacobi SVD algorithm. IMA J. Numer. Anal. 19, 191–213 (1999)MathSciNetCrossRef Drmač, Z.: A posteriori computation of the singular vectors in a preconditioned Jacobi SVD algorithm. IMA J. Numer. Anal. 19, 191–213 (1999)MathSciNetCrossRef
18.
Zurück zum Zitat Drmač, Z., Veselić, K.: New fast and accurate Jacobi SVD algorithm I. SIAM J. Matrix Anal. Appl. 29(4), 1322–1342 (2007)MathSciNetCrossRef Drmač, Z., Veselić, K.: New fast and accurate Jacobi SVD algorithm I. SIAM J. Matrix Anal. Appl. 29(4), 1322–1342 (2007)MathSciNetCrossRef
19.
Zurück zum Zitat Drmač, Z., Veselić, K.: New fast and accurate Jacobi SVD algorithm II. SIAM J. Matrix Anal. Appl. 29(4), 1343–1362 (2007)MathSciNetCrossRef Drmač, Z., Veselić, K.: New fast and accurate Jacobi SVD algorithm II. SIAM J. Matrix Anal. Appl. 29(4), 1343–1362 (2007)MathSciNetCrossRef
20.
Zurück zum Zitat Bečka, M., Okša, G., Vajtersic, M.: Parallel Block-Jacobi SVD Methods. In: Berry, M., et al. (eds.) High-Performance Scientific Computing, pp. 185–197. Springer, London (2012)CrossRef Bečka, M., Okša, G., Vajtersic, M.: Parallel Block-Jacobi SVD Methods. In: Berry, M., et al. (eds.) High-Performance Scientific Computing, pp. 185–197. Springer, London (2012)CrossRef
21.
Zurück zum Zitat Bečka, M., Okša, G., Vajtersic, M.: New dynamic orderings for the parallel one-sided block-Jacobi SVD algorithm. Parallel Process. Lett. 25(2), 1–19 (2015)MathSciNetCrossRef Bečka, M., Okša, G., Vajtersic, M.: New dynamic orderings for the parallel one-sided block-Jacobi SVD algorithm. Parallel Process. Lett. 25(2), 1–19 (2015)MathSciNetCrossRef
22.
Zurück zum Zitat Novaković, J., Singer, S., Singer, S.: Blocking and parallelization of the Hari-Zimmermann variant of the Falk-Langemeyer algorithm for the generalized SVD. Parallel Comput. 49, 136–152 (2015)MathSciNetCrossRef Novaković, J., Singer, S., Singer, S.: Blocking and parallelization of the Hari-Zimmermann variant of the Falk-Langemeyer algorithm for the generalized SVD. Parallel Comput. 49, 136–152 (2015)MathSciNetCrossRef
25.
Zurück zum Zitat Hari, V.: Convergence of a block-oriented quasi-cyclic Jacobi method. SIAM J. Matrix Anal. Appl. 29(2), 349–369 (2007)MathSciNetCrossRef Hari, V.: Convergence of a block-oriented quasi-cyclic Jacobi method. SIAM J. Matrix Anal. Appl. 29(2), 349–369 (2007)MathSciNetCrossRef
26.
Zurück zum Zitat Drmač, Z.: A global convergence proof for cyclic Jacobi methods with block rotations. SIAM J. Matrix Anal. Appl. 31(3), 1329–1350 (2009)MathSciNetCrossRef Drmač, Z.: A global convergence proof for cyclic Jacobi methods with block rotations. SIAM J. Matrix Anal. Appl. 31(3), 1329–1350 (2009)MathSciNetCrossRef
27.
Zurück zum Zitat Hari, V., Singer, S., Singer, S.: Block-oriented \(J\)-Jacobi methods for hermitian matrices. Lin. Alg. and Its Appl. 433(8–10), 1491–1512 (2010)MathSciNetCrossRef Hari, V., Singer, S., Singer, S.: Block-oriented \(J\)-Jacobi methods for hermitian matrices. Lin. Alg. and Its Appl. 433(8–10), 1491–1512 (2010)MathSciNetCrossRef
28.
Zurück zum Zitat Bujanović, Z.: Drmač, Z: A contribution to the theory and practice of the block Kogbetliantz method for computing the SVD. BIT 52(4), 827–849 (2012)MathSciNetCrossRef Bujanović, Z.: Drmač, Z: A contribution to the theory and practice of the block Kogbetliantz method for computing the SVD. BIT 52(4), 827–849 (2012)MathSciNetCrossRef
29.
Zurück zum Zitat Hari, V., Singer, S., Singer, S.: Full block \(J\)-Jacobi method for hermitian matrices. Linear Algebra Appl. 444, 1–27 (2014)MathSciNetCrossRef Hari, V., Singer, S., Singer, S.: Full block \(J\)-Jacobi method for hermitian matrices. Linear Algebra Appl. 444, 1–27 (2014)MathSciNetCrossRef
30.
31.
Zurück zum Zitat Okša, G., Yamamoto, Y., Vajteršic, M.: Asymptotic quadratic convergence of the serial block-Jacobi EVD algorithm for Hermitian matrices. Numer. Math. 136(4), 1071–1095 (2017)MathSciNetCrossRef Okša, G., Yamamoto, Y., Vajteršic, M.: Asymptotic quadratic convergence of the serial block-Jacobi EVD algorithm for Hermitian matrices. Numer. Math. 136(4), 1071–1095 (2017)MathSciNetCrossRef
33.
Zurück zum Zitat Luk, F., Park, H.: On the equivalence and convergence of parallel Jacobi SVD algorithms. IEEE Tran. Comp. 38(6), 806–811 (1989)CrossRef Luk, F., Park, H.: On the equivalence and convergence of parallel Jacobi SVD algorithms. IEEE Tran. Comp. 38(6), 806–811 (1989)CrossRef
35.
Zurück zum Zitat Shroff, G., Schreiber, R.: On the convergence of the cyclic Jacobi method for parallel block orderings. SIAM J. Matrix Anal. Appl. 10, 326–346 (1989)MathSciNetCrossRef Shroff, G., Schreiber, R.: On the convergence of the cyclic Jacobi method for parallel block orderings. SIAM J. Matrix Anal. Appl. 10, 326–346 (1989)MathSciNetCrossRef
36.
37.
Zurück zum Zitat Drmač, Z.: A Tangent Algorithm for Computing the Generalized Singular Value Decomposition. SIAM J. Numer. Anal. 35(5), 1804–1832 (1998)MathSciNetCrossRef Drmač, Z.: A Tangent Algorithm for Computing the Generalized Singular Value Decomposition. SIAM J. Numer. Anal. 35(5), 1804–1832 (1998)MathSciNetCrossRef
38.
Zurück zum Zitat Falk, S., Langemeyer, P.: Das Jacobische Rotations-Verfahren für reel symmetrische Matrizen-Paare I. II. Elektronische Datenverarbeitung 7, 30–34 (1960)MATH Falk, S., Langemeyer, P.: Das Jacobische Rotations-Verfahren für reel symmetrische Matrizen-Paare I. II. Elektronische Datenverarbeitung 7, 30–34 (1960)MATH
39.
Zurück zum Zitat Slapničar, I., Hari, V.: On the quadratic convergence of the Falk-Langemeyer method for definite matrix pairs. SIAM J. Matrix Anal. Appl. 12(1), 84–114 (1991)MathSciNetCrossRef Slapničar, I., Hari, V.: On the quadratic convergence of the Falk-Langemeyer method for definite matrix pairs. SIAM J. Matrix Anal. Appl. 12(1), 84–114 (1991)MathSciNetCrossRef
40.
Zurück zum Zitat Forsythe, G.E., Henrici, P.: The cyclic Jacobi method for computing the principal values of a complex matrix. Trans. Am. Math. Soc. 94, 1–23 (1960)MathSciNetCrossRef Forsythe, G.E., Henrici, P.: The cyclic Jacobi method for computing the principal values of a complex matrix. Trans. Am. Math. Soc. 94, 1–23 (1960)MathSciNetCrossRef
41.
Zurück zum Zitat Eberlein, P.J.: A Jacobi method for automatic computation of eigenvalues and eigenvectors of an arbitrary matrix. Siam J. 10, 74–88 (1962)MathSciNetMATH Eberlein, P.J.: A Jacobi method for automatic computation of eigenvalues and eigenvectors of an arbitrary matrix. Siam J. 10, 74–88 (1962)MathSciNetMATH
42.
Zurück zum Zitat Eberlein, P.J., Boothroyd, J.: Solution to the eigenproblem by a norm-reducing Jacobi-type method. Numer. Math. 11, 1–12 (1968)CrossRef Eberlein, P.J., Boothroyd, J.: Solution to the eigenproblem by a norm-reducing Jacobi-type method. Numer. Math. 11, 1–12 (1968)CrossRef
45.
Zurück zum Zitat Hari, V.: On cyclic Jacobi methods for the positive definite generalized eigenvalue problem. Ph.D. thesis, University of Hagen (1984) Hari, V.: On cyclic Jacobi methods for the positive definite generalized eigenvalue problem. Ph.D.  thesis, University of Hagen (1984)
46.
Zurück zum Zitat Mascarenhas, W.: On the convergence of the Jacobi method for arbitrary orderings. SIAM J. Matrix Anal. Appl. 16(4), 1197–1206 (1995)MathSciNetCrossRef Mascarenhas, W.: On the convergence of the Jacobi method for arbitrary orderings. SIAM J. Matrix Anal. Appl. 16(4), 1197–1206 (1995)MathSciNetCrossRef
Metadaten
Titel
On the global convergence of the block Jacobi method for the positive definite generalized eigenvalue problem
verfasst von
Vjeran Hari
Publikationsdatum
01.06.2021
Verlag
Springer International Publishing
Erschienen in
Calcolo / Ausgabe 2/2021
Print ISSN: 0008-0624
Elektronische ISSN: 1126-5434
DOI
https://doi.org/10.1007/s10092-021-00415-8

Weitere Artikel der Ausgabe 2/2021

Calcolo 2/2021 Zur Ausgabe