Skip to main content
Top
Published in: BIT Numerical Mathematics 1/2021

20-08-2020

Verified inclusions for a nearest matrix of specified rank deficiency via a generalization of Wedin’s \(\sin (\theta )\) theorem

Authors: Marko Lange, Siegfried M. Rump

Published in: BIT Numerical Mathematics | Issue 1/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

For an \(m \times n\) matrix A, the mathematical property that the rank of A is equal to r for \(0< r < \min (m,n)\) is an ill-posed problem. In this note we show that, regardless of this circumstance, it is possible to solve the strongly related problem of computing a nearby matrix with at least rank deficiency k in a mathematically rigorous way and using only floating-point arithmetic. Given an integer k and a real or complex matrix A, square or rectangular, we first present a verification algorithm to compute a narrow interval matrix \(\varDelta \) with the property that there exists a matrix within \(A-\varDelta \) with at least rank deficiency k. Subsequently, we extend this algorithm for computing an inclusion for a specific perturbation E with that property but also a minimal distance with respect to any unitarily invariant norm. For this purpose, we generalize Wedin’s \(\sin (\theta )\) theorem by removing its orthogonality assumption. The corresponding result is the singular vector space counterpart to Davis and Kahan’s generalized \(\sin (\theta )\) theorem for eigenspaces. The presented verification methods use only standard floating-point operations and are completely rigorous including all possible rounding errors and/or data dependencies.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Footnotes
1
The extra parameter zero in the call of https://static-content.springer.com/image/art%3A10.1007%2Fs10543-020-00827-y/MediaObjects/10543_2020_827_Figa_HTML.gif indicates to compute the economy-size singular value decomposition.
 
2
Note that the typecast of S(I,I) to interval forces all operations in the last line to be to be interval operations, so that Delta0 is an inclusion for the desired quantity.
 
3
In previous releases of Matlab https://static-content.springer.com/image/art%3A10.1007%2Fs10543-020-00827-y/MediaObjects/10543_2020_827_Figo_HTML.gif would be replaced by https://static-content.springer.com/image/art%3A10.1007%2Fs10543-020-00827-y/MediaObjects/10543_2020_827_Figp_HTML.gif .
 
4
The entries of a Hadamard matrix H of order n are in \(\lbrace -1, 1 \rbrace \) such that \(\frac{1}{n}H^TH\) is the identity matrix. It is known that the order n must be a multiple of 4 for \(n \ge 4\), and a famous conjecture states that there exists a Hadamard matrix for all multiples of 4.
 
Literature
1.
go back to reference Bailey, D.H.: A Fortran 90-based multiprecision system. ACM Trans. Math. Softw. 21(4), 379–387 (1995)CrossRef Bailey, D.H.: A Fortran 90-based multiprecision system. ACM Trans. Math. Softw. 21(4), 379–387 (1995)CrossRef
2.
go back to reference Davis, C., Kahan, W.M.: The rotation of eigenvectors by a perturbation. III. SIAM J. Numer. Anal. 7(1), 1–46 (1970)MathSciNetCrossRef Davis, C., Kahan, W.M.: The rotation of eigenvectors by a perturbation. III. SIAM J. Numer. Anal. 7(1), 1–46 (1970)MathSciNetCrossRef
3.
go back to reference Demmel, J., Ahrens, P., Nguyen, H.D.: Efficient reproducible floating point summation and blas. Technical Report UCB/EECS-2016-121, EECS Department, University of California, Berkeley (2016) Demmel, J., Ahrens, P., Nguyen, H.D.: Efficient reproducible floating point summation and blas. Technical Report UCB/EECS-2016-121, EECS Department, University of California, Berkeley (2016)
4.
go back to reference Fousse, L., Hanrot, G., Lefèvre, V., Pelissier, P., Zimmermann, P.: MPFR: a multiple-precision binary floating-point library with correct rounding. ACM Trans. Math. Softw. 33(2), 2007 (2007)MathSciNetCrossRef Fousse, L., Hanrot, G., Lefèvre, V., Pelissier, P., Zimmermann, P.: MPFR: a multiple-precision binary floating-point library with correct rounding. ACM Trans. Math. Softw. 33(2), 2007 (2007)MathSciNetCrossRef
5.
go back to reference Golub, G.H., Van Loan, C.F.: Matrix Computations, 4th edn. The Johns Hopkins University Press, Baltimore (2013)MATH Golub, G.H., Van Loan, C.F.: Matrix Computations, 4th edn. The Johns Hopkins University Press, Baltimore (2013)MATH
6.
go back to reference Hadamard, J.: Sur les problèmes aux dérivées partielles et leur signification physique. Princeton Univ. Bull. 13, 49–52 (1902) Hadamard, J.: Sur les problèmes aux dérivées partielles et leur signification physique. Princeton Univ. Bull. 13, 49–52 (1902)
7.
go back to reference Higham, N.J.: Accuracy and Stability of Numerical Algorithms, Volume 80 of Other Titles in Applied Mathematics. Society for Industrial & Applied Mathematics (SIAM), Philadelphia (2002)CrossRef Higham, N.J.: Accuracy and Stability of Numerical Algorithms, Volume 80 of Other Titles in Applied Mathematics. Society for Industrial & Applied Mathematics (SIAM), Philadelphia (2002)CrossRef
8.
go back to reference Higham, N.J., Mary, T.: A new approach to probabilistic rounding error analysis. SIAM J. Sci. Comput. 41(5), A2815–A2835 (2019)MathSciNetCrossRef Higham, N.J., Mary, T.: A new approach to probabilistic rounding error analysis. SIAM J. Sci. Comput. 41(5), A2815–A2835 (2019)MathSciNetCrossRef
10.
go back to reference Horn, R.A., Johnson, C.R.: Matrix Analysis, 1st edn. Cambridge University Press, New York (1991)CrossRef Horn, R.A., Johnson, C.R.: Matrix Analysis, 1st edn. Cambridge University Press, New York (1991)CrossRef
11.
go back to reference IEEE. IEEE standard for binary floating-point arithmetic. ANSI/IEEE Std 754-1985, pp. 1–20 (1985) IEEE. IEEE standard for binary floating-point arithmetic. ANSI/IEEE Std 754-1985, pp. 1–20 (1985)
12.
go back to reference IEEE. IEEE standard for floating-point arithmetic. IEEE Std 754-2019 (Revision of IEEE 754-2008), pp. 1–84 (2019) IEEE. IEEE standard for floating-point arithmetic. IEEE Std 754-2019 (Revision of IEEE 754-2008), pp. 1–84 (2019)
13.
go back to reference Jézéquel, F., Chesneaux, J.-M.: CADNA: a library for estimating round-off error propagation. Comput. Phys. Commun. 178(12), 933–955 (2008)CrossRef Jézéquel, F., Chesneaux, J.-M.: CADNA: a library for estimating round-off error propagation. Comput. Phys. Commun. 178(12), 933–955 (2008)CrossRef
14.
go back to reference Johansson, F.: Arb: A C library for ball arithmetic. ACM Commun. Comput. Algebra 47(3/4), 166–169 (2014)CrossRef Johansson, F.: Arb: A C library for ball arithmetic. ACM Commun. Comput. Algebra 47(3/4), 166–169 (2014)CrossRef
15.
go back to reference Kahan, W.M.: A survey of error analysis. In: Freiman, C.V., Griffith, J.E., Rosenfeld, J.L. (eds.) 7th IFIP Congress, Ljubljana, Amsterdam, Netherlands. North-Holland, Amsterdam (1971) Kahan, W.M.: A survey of error analysis. In: Freiman, C.V., Griffith, J.E., Rosenfeld, J.L. (eds.) 7th IFIP Congress, Ljubljana, Amsterdam, Netherlands. North-Holland, Amsterdam (1971)
16.
go back to reference Kanzawa, Y., Oishi, S.: Calculating bifurcation points with guaranteed accuracy. IEICE Trans. Fundam. E82–A(6), 1055–1061 (1999) Kanzawa, Y., Oishi, S.: Calculating bifurcation points with guaranteed accuracy. IEICE Trans. Fundam. E82–A(6), 1055–1061 (1999)
17.
go back to reference Kanzawa, Y., Oishi, S.: Imperfect singular solutions of nonlinear equations and a numerical method of proving their existence. IEICE Trans. Fundam E82–A(6), 1062–1069 (1999) Kanzawa, Y., Oishi, S.: Imperfect singular solutions of nonlinear equations and a numerical method of proving their existence. IEICE Trans. Fundam E82–A(6), 1062–1069 (1999)
18.
go back to reference Kearfott, R.B., Nakao, M.T., Neumaier, A., Rump, S.M., Shary, S.P., Van Hentenryck, P.: Standardized notation in interval analysis. Comput. Technol. 15(1), 7–13 (2010)MATH Kearfott, R.B., Nakao, M.T., Neumaier, A., Rump, S.M., Shary, S.P., Van Hentenryck, P.: Standardized notation in interval analysis. Comput. Technol. 15(1), 7–13 (2010)MATH
19.
go back to reference Lange, M.: Residual bounds for some or all singular values. Linear Algebra Appl. 464, 28–37 (2015). Special issue on eigenvalue problemsMathSciNetCrossRef Lange, M.: Residual bounds for some or all singular values. Linear Algebra Appl. 464, 28–37 (2015). Special issue on eigenvalue problemsMathSciNetCrossRef
20.
go back to reference Li, N., Zhi, L.: Verified error bounds for isolated singular solutions of polynomial systems. SIAM J. Numer. Anal. 52(4), 1623–1640 (2014)MathSciNetCrossRef Li, N., Zhi, L.: Verified error bounds for isolated singular solutions of polynomial systems. SIAM J. Numer. Anal. 52(4), 1623–1640 (2014)MathSciNetCrossRef
22.
go back to reference Miyajima, S., Ogita, T., Oishi, S.: Fast verification for respective eigenvalues of symmetric matrix. In: Ganzha, V.G., Mayr, E.W., Vorozhtsov, E.V. (eds.) Computer Algebra in Scientific Computing, pp. 306–317. Springer Berlin Heidelberg, Berlin (2005)CrossRef Miyajima, S., Ogita, T., Oishi, S.: Fast verification for respective eigenvalues of symmetric matrix. In: Ganzha, V.G., Mayr, E.W., Vorozhtsov, E.V. (eds.) Computer Algebra in Scientific Computing, pp. 306–317. Springer Berlin Heidelberg, Berlin (2005)CrossRef
23.
go back to reference Mukunoki, D., Ogita, T., Ozaki, K.: Reproducible BLAS routines with tunable accuracy using Ozaki scheme for many-core architectures. In: Wyrzykowski, R., Deelman, E., Dongarra, J., Karczewski, K. (eds.) Parallel Processing and Applied Mathematics, pp. 516–527. Springer Nature, Cham (2020)CrossRef Mukunoki, D., Ogita, T., Ozaki, K.: Reproducible BLAS routines with tunable accuracy using Ozaki scheme for many-core architectures. In: Wyrzykowski, R., Deelman, E., Dongarra, J., Karczewski, K. (eds.) Parallel Processing and Applied Mathematics, pp. 516–527. Springer Nature, Cham (2020)CrossRef
24.
go back to reference Nakatsukasa, Y.: Accuracy of singular vectors obtained by projection-based svd methods. BIT Numer. Math. 57(4), 1137–1152 (2017)MathSciNetCrossRef Nakatsukasa, Y.: Accuracy of singular vectors obtained by projection-based svd methods. BIT Numer. Math. 57(4), 1137–1152 (2017)MathSciNetCrossRef
25.
go back to reference Neumaier, A.: Rundungsfehleranalyse einiger Verfahren zur Summation endlicher Summen. Z. Angew. Math. Mech. 54(1), 39–51 (1974)MathSciNetCrossRef Neumaier, A.: Rundungsfehleranalyse einiger Verfahren zur Summation endlicher Summen. Z. Angew. Math. Mech. 54(1), 39–51 (1974)MathSciNetCrossRef
26.
go back to reference Neumaier, A.: Interval Methods for Systems of Equations. Encyclopedia of Mathematics and its Applications. Cambridge University Press, Cambridge (1991)CrossRef Neumaier, A.: Interval Methods for Systems of Equations. Encyclopedia of Mathematics and its Applications. Cambridge University Press, Cambridge (1991)CrossRef
27.
28.
go back to reference Oishi, S., Ichihara, K., Kashiwagi, M., Kimura, T., Liu, X., Masai, H., Morikura, Y., Ogita, T., Ozaki, K., Rump, S.M., Sekine, K., Takayasu, A., Yamanaka, N.: Principle of Verified Numerical Computations. Corona, Tokyo (2018). [in Japanese] Oishi, S., Ichihara, K., Kashiwagi, M., Kimura, T., Liu, X., Masai, H., Morikura, Y., Ogita, T., Ozaki, K., Rump, S.M., Sekine, K., Takayasu, A., Yamanaka, N.: Principle of Verified Numerical Computations. Corona, Tokyo (2018). [in Japanese]
29.
go back to reference Parlett, B.N.: The Symmetric Eigenvalue Problem, volume 20 of Classics in Applied Mathematics. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, USA, unabridged, corr. republication of the work 1st publ. by Prentice-Hall edition (1998) Parlett, B.N.: The Symmetric Eigenvalue Problem, volume 20 of Classics in Applied Mathematics. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, USA, unabridged, corr. republication of the work 1st publ. by Prentice-Hall edition (1998)
30.
31.
go back to reference Rump, S.M.: INTLAB–INTerval LABoratory. In: Csendes, T. (ed.) Developments in Reliable Computing, pp. 77–104. Springer Netherlands, Dordrecht (1999)CrossRef Rump, S.M.: INTLAB–INTerval LABoratory. In: Csendes, T. (ed.) Developments in Reliable Computing, pp. 77–104. Springer Netherlands, Dordrecht (1999)CrossRef
32.
go back to reference Rump, S.M.: Verification methods: rigorous results using floating-point arithmetic. Acta Numer. 19, 287–449 (2010)MathSciNetCrossRef Rump, S.M.: Verification methods: rigorous results using floating-point arithmetic. Acta Numer. 19, 287–449 (2010)MathSciNetCrossRef
33.
go back to reference Rump, S.M.: Verified bounds for singular values, in particular for the spectral norm of a matrix and its inverse. BIT Numer. Math. 51(2), 367–384 (2011)MathSciNetCrossRef Rump, S.M.: Verified bounds for singular values, in particular for the spectral norm of a matrix and its inverse. BIT Numer. Math. 51(2), 367–384 (2011)MathSciNetCrossRef
34.
35.
go back to reference Rump, S.M., Graillat, S.: Verified error bounds for multiple roots of systems of nonlinear equations. Numer. Algorithms 54(3), 359–377 (2010)MathSciNetCrossRef Rump, S.M., Graillat, S.: Verified error bounds for multiple roots of systems of nonlinear equations. Numer. Algorithms 54(3), 359–377 (2010)MathSciNetCrossRef
36.
go back to reference Rump, S.M., Ogita, T., Oishi, S.: Accurate floating-point summation part I: Faithful rounding. SIAM J. Sci. Comput. 31(1), 189–224 (2008)MathSciNetCrossRef Rump, S.M., Ogita, T., Oishi, S.: Accurate floating-point summation part I: Faithful rounding. SIAM J. Sci. Comput. 31(1), 189–224 (2008)MathSciNetCrossRef
37.
38.
go back to reference Shewchuk, J.R.: Adaptive precision floating-point arithmetic and fast robust geometric predicates. Discrete Comput. Geom. 18(3), 305–363 (1997)MathSciNetCrossRef Shewchuk, J.R.: Adaptive precision floating-point arithmetic and fast robust geometric predicates. Discrete Comput. Geom. 18(3), 305–363 (1997)MathSciNetCrossRef
39.
go back to reference Stewart, G.W.: Perturbation theory for the singular value decomposition. Technical report, University of Maryland at College Park, USA (1990) Stewart, G.W.: Perturbation theory for the singular value decomposition. Technical report, University of Maryland at College Park, USA (1990)
40.
go back to reference Vignes, J.: A stochastic arithmetic for reliable scientific computation. MATHCS 35(3), 233–261 (1993)MathSciNet Vignes, J.: A stochastic arithmetic for reliable scientific computation. MATHCS 35(3), 233–261 (1993)MathSciNet
41.
go back to reference von Neumann, J.: Some matrix-inequalities and metrization of matrix-space. Tomsk Univ. Rev. 1, 286–300 (1937) von Neumann, J.: Some matrix-inequalities and metrization of matrix-space. Tomsk Univ. Rev. 1, 286–300 (1937)
42.
go back to reference Weber, H., Werner, W.: On the accurate determination of nonisolated solutions of nonlinear equations. Computing 26(4), 315–326 (1981)MathSciNetCrossRef Weber, H., Werner, W.: On the accurate determination of nonisolated solutions of nonlinear equations. Computing 26(4), 315–326 (1981)MathSciNetCrossRef
43.
go back to reference Wedin, P.Å.: Perturbation bounds in connection with singular value decomposition. BIT Numer. Math. 12(1), 99–111 (1972)MathSciNetCrossRef Wedin, P.Å.: Perturbation bounds in connection with singular value decomposition. BIT Numer. Math. 12(1), 99–111 (1972)MathSciNetCrossRef
Metadata
Title
Verified inclusions for a nearest matrix of specified rank deficiency via a generalization of Wedin’s theorem
Authors
Marko Lange
Siegfried M. Rump
Publication date
20-08-2020
Publisher
Springer Netherlands
Published in
BIT Numerical Mathematics / Issue 1/2021
Print ISSN: 0006-3835
Electronic ISSN: 1572-9125
DOI
https://doi.org/10.1007/s10543-020-00827-y

Other articles of this Issue 1/2021

BIT Numerical Mathematics 1/2021 Go to the issue

Premium Partner