Skip to main content
Top

2021 | OriginalPaper | Chapter

A Note on the Sensitivity of Generic Approximate Sparse Pseudoinverse Matrix for Solving Linear Least Squares Problems

Authors : A. D. Lipitakis, G. A. Gravvanis, C. K. Filelis-Papadopoulos, D. Anagnostopoulos

Published in: Advances in Parallel & Distributed Processing, and Applications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

During the last decades, research efforts have been focused on the derivation of effective explicit preconditioned iterative methods. In this manuscript, we review the Explicit Preconditioned Conjugate Gradient Least Squares method, based on generic sparse approximate pseudoinverses, in conjunction with approximate pseudoinverse sparsity patterns, based on the modified row-threshold incomplete QR factorization techniques. Additionally, modified Moore-Penrose conditions are presented, and theoretical estimates for the sensitivity of the generic approximate sparse pseudoinverses are derived. Finally, numerical results concerning the generic approximate sparse pseudoinverses by solving characteristic model problems are given. The theoretical estimates were in qualitative agreement with the numerical results.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference M. Arioli, I.S. Duff, Preconditioning linear least-squares problems by identifying a basis matrix. SIAM J. Sci. Comput. 37(5), S544–S561 (2015)MathSciNetCrossRef M. Arioli, I.S. Duff, Preconditioning linear least-squares problems by identifying a basis matrix. SIAM J. Sci. Comput. 37(5), S544–S561 (2015)MathSciNetCrossRef
2.
go back to reference M. Arioli, I.S. Duff, P.P. de Rijk, On the augmented system approach to sparse least-squares problems. Numer. Math. 55(6), 667–684 (1989)MathSciNetCrossRef M. Arioli, I.S. Duff, P.P. de Rijk, On the augmented system approach to sparse least-squares problems. Numer. Math. 55(6), 667–684 (1989)MathSciNetCrossRef
3.
go back to reference Z.Z. Bai, I.S. Duff, A.J. Wathen, A class of incomplete orthogonal factorization methods I: Methods and theories. BIT Numer. Mathem. 41(1), 53–70 (2001)MathSciNetCrossRef Z.Z. Bai, I.S. Duff, A.J. Wathen, A class of incomplete orthogonal factorization methods I: Methods and theories. BIT Numer. Mathem. 41(1), 53–70 (2001)MathSciNetCrossRef
4.
go back to reference M. Benzi, M. Tuma, A robust preconditioner with low memory requirements for large sparse least squares problems. SIAM J. Sci. Comput. 25(2), 499–512 (2003)MathSciNetCrossRef M. Benzi, M. Tuma, A robust preconditioner with low memory requirements for large sparse least squares problems. SIAM J. Sci. Comput. 25(2), 499–512 (2003)MathSciNetCrossRef
5.
go back to reference A. Bjorck, Component-wise perturbation analysis and error bounds for linear least squares solutions. BIT Numer. Math. 31(2), 237–244 (1991)MathSciNetCrossRef A. Bjorck, Component-wise perturbation analysis and error bounds for linear least squares solutions. BIT Numer. Math. 31(2), 237–244 (1991)MathSciNetCrossRef
6.
go back to reference A. Bjorck, Numerical Methods for Least Squares Problems (SIAM, 1996) A. Bjorck, Numerical Methods for Least Squares Problems (SIAM, 1996)
7.
go back to reference A. Bjorck, T. Elfving, Accelerated projection methods for computing pseudoinverse solutions of systems of linear equations. BIT Num. Math. 19(2), 145–163 (1979)MathSciNetCrossRef A. Bjorck, T. Elfving, Accelerated projection methods for computing pseudoinverse solutions of systems of linear equations. BIT Num. Math. 19(2), 145–163 (1979)MathSciNetCrossRef
8.
go back to reference R. Bramley, A. Sameh, Row projection methods for large nonsymmetric linear systems. SIAM J. Sci. Stat. Comput. 13(1), 168–193 (1992)MathSciNetCrossRef R. Bramley, A. Sameh, Row projection methods for large nonsymmetric linear systems. SIAM J. Sci. Stat. Comput. 13(1), 168–193 (1992)MathSciNetCrossRef
9.
go back to reference R. Bru, J. Marin, J. Mas, M. Tuma, Preconditioned iterative methods for solving linear least squares problems. SIAM J. Sci. Comput. 36(4), A2002–A2022 (2014)MathSciNetCrossRef R. Bru, J. Marin, J. Mas, M. Tuma, Preconditioned iterative methods for solving linear least squares problems. SIAM J. Sci. Comput. 36(4), A2002–A2022 (2014)MathSciNetCrossRef
10.
go back to reference E. Chow, A priori sparsity patterns for parallel sparse approximate inverse preconditioners. SIAM J. Sci. Comput. 21(5), 1804–1822 (2000)MathSciNetCrossRef E. Chow, A priori sparsity patterns for parallel sparse approximate inverse preconditioners. SIAM J. Sci. Comput. 21(5), 1804–1822 (2000)MathSciNetCrossRef
11.
go back to reference T.A. Davis, Y. Hu, The University of Florida sparse matrix collection. ACM Trans. Math. Softw. 38(1), 1–25 (2011)MathSciNetMATH T.A. Davis, Y. Hu, The University of Florida sparse matrix collection. ACM Trans. Math. Softw. 38(1), 1–25 (2011)MathSciNetMATH
12.
go back to reference C.K. Filelis-Papadopoulos, G.A. Gravvanis, Hybrid multilevel solution of sparse least-squares linear systems. Eng. Comput. 34(8), 2752–2766 (2017)CrossRef C.K. Filelis-Papadopoulos, G.A. Gravvanis, Hybrid multilevel solution of sparse least-squares linear systems. Eng. Comput. 34(8), 2752–2766 (2017)CrossRef
13.
go back to reference C. Filelis-Papadopoulos, G.A. Gravvanis, E.A. Lipitakis, A note on the convergence rate of a class of approximate sparse inverse matrix methods, in Proceedings of the 20th Pan-Hellenic Conference on Informatics, Art. No 11 (ACM, 2016), pp. 1–6 C. Filelis-Papadopoulos, G.A. Gravvanis, E.A. Lipitakis, A note on the convergence rate of a class of approximate sparse inverse matrix methods, in Proceedings of the 20th Pan-Hellenic Conference on Informatics, Art. No 11 (ACM, 2016), pp. 1–6
14.
go back to reference G.H. Golub, C.F. Van Loan, Matrix Computations, 4th edn. (The Johns Hopkins University Press, Baltimore, 2013)MATH G.H. Golub, C.F. Van Loan, Matrix Computations, 4th edn. (The Johns Hopkins University Press, Baltimore, 2013)MATH
15.
go back to reference G.A. Gravvanis, The rate of convergence of explicit approximate inverse preconditioning. Int. J. Comput. Math. 60(1-2), 77–89 (1996)CrossRef G.A. Gravvanis, The rate of convergence of explicit approximate inverse preconditioning. Int. J. Comput. Math. 60(1-2), 77–89 (1996)CrossRef
16.
go back to reference G.A. Gravvanis, Explicit approximate inverse preconditioning techniques. Arch. Comput. Meth. Eng. 9(4), 371–402 (2002)CrossRef G.A. Gravvanis, Explicit approximate inverse preconditioning techniques. Arch. Comput. Meth. Eng. 9(4), 371–402 (2002)CrossRef
17.
18.
go back to reference G.A. Gravvanis, C.K. Filelis-Papadopoulos, E.A. Lipitakis, A note on the comparison of a class of preconditioned iterative methods, in 2012 16th Panhellenic Conference on Informatics (IEEE, 2012), pp. 204–210 G.A. Gravvanis, C.K. Filelis-Papadopoulos, E.A. Lipitakis, A note on the comparison of a class of preconditioned iterative methods, in 2012 16th Panhellenic Conference on Informatics (IEEE, 2012), pp. 204–210
19.
go back to reference G.A. Gravvanis, C. Filelis-Papadopoulos, E.A. Lipitakis, On numerical modeling performance of generalized preconditioned methods, in Proceedings of the 6th Balkan Conference in Informatics (ACM, 2013), pp. 23–30 G.A. Gravvanis, C. Filelis-Papadopoulos, E.A. Lipitakis, On numerical modeling performance of generalized preconditioned methods, in Proceedings of the 6th Balkan Conference in Informatics (ACM, 2013), pp. 23–30
20.
go back to reference M. Hegland, On the computation of breeding values, in CONPAR 90 – VAPP IV (Springer, 1990), pp. 232–242 M. Hegland, On the computation of breeding values, in CONPAR 90 – VAPP IV (Springer, 1990), pp. 232–242
21.
22.
go back to reference A. Jennings, M. Ajiz, Incomplete methods for solving A TAx=b. SIAM J. Sci. Stat. Comput. 5(4), 978–987 (1984)CrossRef A. Jennings, M. Ajiz, Incomplete methods for solving A TAx=b. SIAM J. Sci. Stat. Comput. 5(4), 978–987 (1984)CrossRef
23.
go back to reference S. Kharchenko, L.Y. Kolotilina, A.A. Nikishin, A.Y. Yeremin, A robust AINV-type method for constructing sparse approximate inverse preconditioners in factored form. Numer. Linear Algebra Appl. 8(3), 165–179 (2001)MathSciNetCrossRef S. Kharchenko, L.Y. Kolotilina, A.A. Nikishin, A.Y. Yeremin, A robust AINV-type method for constructing sparse approximate inverse preconditioners in factored form. Numer. Linear Algebra Appl. 8(3), 165–179 (2001)MathSciNetCrossRef
24.
go back to reference N. Li, Y. Saad, MIQR, a multilevel incomplete QR preconditioner for large sparse least-squares problems. SIAM J. on Matrix Analysis and Applications 28(2), 524–550 (2006)MathSciNetCrossRef N. Li, Y. Saad, MIQR, a multilevel incomplete QR preconditioner for large sparse least-squares problems. SIAM J. on Matrix Analysis and Applications 28(2), 524–550 (2006)MathSciNetCrossRef
25.
go back to reference A.D. Lipitakis, C.K. Filelis-Papadopoulos, G.A. Gravvanis, D. Anagnostopoulos, A note on parallel approximate pseudoinverse matrix techniques for solving linear least squares problems. J. Comput. Sci. 41(101092) (2020) A.D. Lipitakis, C.K. Filelis-Papadopoulos, G.A. Gravvanis, D. Anagnostopoulos, A note on parallel approximate pseudoinverse matrix techniques for solving linear least squares problems. J. Comput. Sci. 41(101092) (2020)
26.
go back to reference A.D.E. Lipitakis, C.K. Filelis-Papadopoulos, G.A. Gravvanis, D. Anagnostopoulos, A class of generic approximate sparse pseudoinverse matrix technique based on incomplete QR factorization. submitted (2019) A.D.E. Lipitakis, C.K. Filelis-Papadopoulos, G.A. Gravvanis, D. Anagnostopoulos, A class of generic approximate sparse pseudoinverse matrix technique based on incomplete QR factorization. submitted (2019)
27.
go back to reference A.T. Papadopoulos, I.S. Duff, A.J. Wathen, A class of incomplete orthogonal factorization methods. II: Implementation and results. BIT Numer. Math. 45(1), 159–179 (2005)MATH A.T. Papadopoulos, I.S. Duff, A.J. Wathen, A class of incomplete orthogonal factorization methods. II: Implementation and results. BIT Numer. Math. 45(1), 159–179 (2005)MATH
28.
go back to reference R. Penrose, A generalized inverse for matrices, in Mathematical Proceedings of the Cambridge Philosophical Society, vol. 51 (Cambridge University Press, 1955), pp. 406–413 R. Penrose, A generalized inverse for matrices, in Mathematical Proceedings of the Cambridge Philosophical Society, vol. 51 (Cambridge University Press, 1955), pp. 406–413
29.
go back to reference J. Scott, M. Tuma, On positive semidefinite modification schemes for incomplete Cholesky factorization. SIAM J. Sci. Comput. 36(2), A609–A633 (2014)MathSciNetCrossRef J. Scott, M. Tuma, On positive semidefinite modification schemes for incomplete Cholesky factorization. SIAM J. Sci. Comput. 36(2), A609–A633 (2014)MathSciNetCrossRef
30.
go back to reference X. Wang, K.A. Gallivan, R. Bramley, CIMGS : An incomplete orthogonal factorization preconditioner. SIAM J. Sci. Comput. 18(2), 516–536 (1997)MathSciNetCrossRef X. Wang, K.A. Gallivan, R. Bramley, CIMGS : An incomplete orthogonal factorization preconditioner. SIAM J. Sci. Comput. 18(2), 516–536 (1997)MathSciNetCrossRef
Metadata
Title
A Note on the Sensitivity of Generic Approximate Sparse Pseudoinverse Matrix for Solving Linear Least Squares Problems
Authors
A. D. Lipitakis
G. A. Gravvanis
C. K. Filelis-Papadopoulos
D. Anagnostopoulos
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-69984-0_21