Skip to main content

2012 | OriginalPaper | Buchkapitel

Divergence Measures and Means of Symmetric Positive-Definite Matrices

verfasst von : Maher Moakher

Erschienen in: New Developments in the Visualization and Processing of Tensor Fields

Verlag: Springer Berlin Heidelberg

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The importance of symmetric positive-definite matrices can hardly be exaggerated as they play fundamental roles in many disciplines such as mathematics, numerical analysis, probability and statistics, engineering, and biological and social sciences. On the other hand, in the last few years there has been a renewed interest in developing the theory of means of symmetric positive-definite matrices. In this work we present several divergence functions for measuring closeness between symmetric positive-definite matrices. We then study the invariance properties of these divergence functions as well as the matrix means based on them. We show that the means based on the various divergence functions of a finite collection of symmetric positive-definite matrices are bounded below by their harmonic mean and above by their arithmetic mean. Furthermore, the means based on the studied divergence functions of two symmetric positive-definite matrices are given in closed forms. In particular, we show that the mean based on the Bhattacharyya divergence function of a pair of symmetric positive-definite matrices coincides with their geometric mean.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
We use the fact that if \(P,Q \in \mathcal{P}(n)\) are such that P ≤ Q, then \(I \leq {P}^{-\frac{1} {2} }Q{P}^{-\frac{1} {2} }\). Form which it follows that all eigenvalues of \({P}^{-\frac{1} {2} }Q{P}^{-\frac{1} {2} }\) are bigger than one and hence \(\det P \leq \det Q\).
 
Literatur
1.
Zurück zum Zitat Ando, T.: Concavity of certain maps of positive definite matrices and applications to Hadamard products. Linear Algebra Appl. 26, 203–241 (1979) Ando, T.: Concavity of certain maps of positive definite matrices and applications to Hadamard products. Linear Algebra Appl. 26, 203–241 (1979)
2.
Zurück zum Zitat Ando, T., Li, C.K., Mathias, R.: Geometric means. Linear Algebra Appl. 385, 305–334 (2004) Ando, T., Li, C.K., Mathias, R.: Geometric means. Linear Algebra Appl. 385, 305–334 (2004)
3.
Zurück zum Zitat Arsigny, V., Fillard, P., Pennec, X., Ayache, N.: Log-Euclidean metrics for fast and simple calculus on diffusion tensors. Magn. Reson. Med. 56, 411–421 (2006) Arsigny, V., Fillard, P., Pennec, X., Ayache, N.: Log-Euclidean metrics for fast and simple calculus on diffusion tensors. Magn. Reson. Med. 56, 411–421 (2006)
4.
Zurück zum Zitat Bhatia, R., Holbrook, J.: Riemannian geometry and matrix geometric means. Linear Algebra Appl. 413(2–3), 594–618 (2006) Bhatia, R., Holbrook, J.: Riemannian geometry and matrix geometric means. Linear Algebra Appl. 413(2–3), 594–618 (2006)
5.
Zurück zum Zitat Bhattacharyya, A.: On a measure of divergence between two statistical populations defined by their probability distributions. Bull. Calcutta Math. Soc. 35, 99–109 (1943) Bhattacharyya, A.: On a measure of divergence between two statistical populations defined by their probability distributions. Bull. Calcutta Math. Soc. 35, 99–109 (1943)
6.
Zurück zum Zitat Bini, D., Iannazzo, B.: A note on computing matrix geometric means. Adv. Comput. Math. 35(2–4), pp. 175–192 (2011) Bini, D., Iannazzo, B.: A note on computing matrix geometric means. Adv. Comput. Math. 35(2–4), pp. 175–192 (2011)
7.
Zurück zum Zitat Bregman, L.M.: The relaxation method of finding the common point of convex sets and its application to the solutions of problems in convex programming. U.S.S.R. Comput. Math. Math. Phys. 7(3), 200–217 (1967) Bregman, L.M.: The relaxation method of finding the common point of convex sets and its application to the solutions of problems in convex programming. U.S.S.R. Comput. Math. Math. Phys. 7(3), 200–217 (1967)
8.
Zurück zum Zitat Jeffreys, H.: An invariant form for the prior probability in estimation problems. Proc. R. Soc. Lond. A 186, 453–461 (1946) Jeffreys, H.: An invariant form for the prior probability in estimation problems. Proc. R. Soc. Lond. A 186, 453–461 (1946)
9.
Zurück zum Zitat Kailath, T.: The divergence and Bhattacharyya distance measures in signal selection. IEEE Trans. Commun. Technol. 15(1), 52–68 (1967) Kailath, T.: The divergence and Bhattacharyya distance measures in signal selection. IEEE Trans. Commun. Technol. 15(1), 52–68 (1967)
10.
Zurück zum Zitat Kullback, S., Leibler, R.A.: On information and sufficiency. Ann. Math. Stat. 22(1), 79–86 (1951) Kullback, S., Leibler, R.A.: On information and sufficiency. Ann. Math. Stat. 22(1), 79–86 (1951)
11.
Zurück zum Zitat Lenglet, C., Rousson, M., Deriche, R., Faugeras, O.: Statistics on the manifold of multivariate normal distributions: theory and application to diffusion tensor MRI processing. J. Math. Imaging Vis. 25, 423–444 (2006) Lenglet, C., Rousson, M., Deriche, R., Faugeras, O.: Statistics on the manifold of multivariate normal distributions: theory and application to diffusion tensor MRI processing. J. Math. Imaging Vis. 25, 423–444 (2006)
12.
Zurück zum Zitat Lin, J.: Divergence measures based on the Shanon entropy. IEEE Trans. Inf. Theory 37(1), 145–151 (1991) Lin, J.: Divergence measures based on the Shanon entropy. IEEE Trans. Inf. Theory 37(1), 145–151 (1991)
13.
Zurück zum Zitat Mahalanobis, P.C.: On tests and measures of group divergence. J. Asiatic Soc. Bengal 26(4), 541–588 (1930) Mahalanobis, P.C.: On tests and measures of group divergence. J. Asiatic Soc. Bengal 26(4), 541–588 (1930)
14.
Zurück zum Zitat Menéndez, M.L., Pardo, J.A., Pardo, L., Pardo, M.C.: The Jensen-Shannon divergence. J. Frankl. Inst. 334(2), 307–318 (1997) Menéndez, M.L., Pardo, J.A., Pardo, L., Pardo, M.C.: The Jensen-Shannon divergence. J. Frankl. Inst. 334(2), 307–318 (1997)
15.
Zurück zum Zitat Moakher, M.: A differential-geometric approach to the geometric mean of symmetric positive-definite matrices. SIAM J. Matrix Anal. Appl. 26(3), 735–747 (2005) Moakher, M.: A differential-geometric approach to the geometric mean of symmetric positive-definite matrices. SIAM J. Matrix Anal. Appl. 26(3), 735–747 (2005)
16.
Zurück zum Zitat Moakher, M.: On the averaging of symmetric positive-definite tensors. J. Elast. 82, 273–296 (2006) Moakher, M.: On the averaging of symmetric positive-definite tensors. J. Elast. 82, 273–296 (2006)
17.
Zurück zum Zitat Moakher, M., Batchelor, P.G.: The symmetric space of positive definite tensors: from geometry to applications and visualization. In: Weickert, J., Hagen, H. (eds.) Visualization and Processing of Tensor Fields, Chapter 17, pp. 285–298. Springer, Berlin (2006) Moakher, M., Batchelor, P.G.: The symmetric space of positive definite tensors: from geometry to applications and visualization. In: Weickert, J., Hagen, H. (eds.) Visualization and Processing of Tensor Fields, Chapter 17, pp. 285–298. Springer, Berlin (2006)
18.
Zurück zum Zitat Peeters, T.H.J.M., Rodrigues, P.R., Vilanova, A., ter Haar Romeny, B.M.: Analysis of distance/similarity measures for diffusion tensor imaging. In: Laidlaw, D., Weickert, J. (eds.) Visualization and Processing of Tensor Fields: Advances and Perspectives, pp. 113–136. Springer, Berlin (2009) Peeters, T.H.J.M., Rodrigues, P.R., Vilanova, A., ter Haar Romeny, B.M.: Analysis of distance/similarity measures for diffusion tensor imaging. In: Laidlaw, D., Weickert, J. (eds.) Visualization and Processing of Tensor Fields: Advances and Perspectives, pp. 113–136. Springer, Berlin (2009)
19.
Zurück zum Zitat Petz, D., Temesi, R.: Means of positive numbers and matrices. SIAM J. Matrix Anal. Appl. 27, 712–720 (2005) Petz, D., Temesi, R.: Means of positive numbers and matrices. SIAM J. Matrix Anal. Appl. 27, 712–720 (2005)
20.
Zurück zum Zitat Rockafellar, R.T.: Convex Analysis. Princeton Landmarks in Mathematics and Physics. Princeton University Press, Princeton (1997) Rockafellar, R.T.: Convex Analysis. Princeton Landmarks in Mathematics and Physics. Princeton University Press, Princeton (1997)
21.
Zurück zum Zitat Wang, Z., Vemuri, B.C.: DTI segmentation using an information theoretic tensor dissimilarity measure. IEEE Trans. Med. Imaging 24(10), 1267–1277 (2005) Wang, Z., Vemuri, B.C.: DTI segmentation using an information theoretic tensor dissimilarity measure. IEEE Trans. Med. Imaging 24(10), 1267–1277 (2005)
22.
Zurück zum Zitat Ziyan, U., Sabuncu, M.R., Grimson, W.E.L., Westin, C.-F.: Consistency clustering: A robust algorithm for group-wise registration, segmentation and automatic atlas construction in diffusion MRI. Int. J. Comput. Vis. 85, 279–290 (2009) Ziyan, U., Sabuncu, M.R., Grimson, W.E.L., Westin, C.-F.: Consistency clustering: A robust algorithm for group-wise registration, segmentation and automatic atlas construction in diffusion MRI. Int. J. Comput. Vis. 85, 279–290 (2009)
Metadaten
Titel
Divergence Measures and Means of Symmetric Positive-Definite Matrices
verfasst von
Maher Moakher
Copyright-Jahr
2012
Verlag
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-27343-8_16