Skip to main content
Top

2019 | OriginalPaper | Chapter

Warped Riemannian Metrics for Location-Scale Models

Authors : Salem Said, Lionel Bombrun, Yannick Berthoumieu

Published in: Geometric Structures of Information

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The present contribution shows that warped Riemannian metrics, a class of Riemannian metrics which play a prominent role in Riemannian geometry, are also of fundamental importance in information geometry. Precisely, the starting point is a new theorem, which states that the Rao–Fisher information metric of any location-scale model, defined on a Riemannian manifold, is a warped Riemannian metric, whenever this model is invariant under the action of some Lie group. This theorem is a valuable tool in finding the expression of the Rao–Fisher information metric of location-scale models defined on high-dimensional Riemannian manifolds. Indeed, a warped Riemannian metric is fully determined by only two functions of a single variable, irrespective of the dimension of the underlying Riemannian manifold. Starting from this theorem, several original results are obtained. The expression of the Rao–Fisher information metric of the Riemannian Gaussian model is provided, for the first time in the literature. A generalised definition of the Mahalanobis distance is introduced, which is applicable to any location-scale model defined on a Riemannian manifold. The solution of the geodesic equation, as well as an explicit construction of Riemannian Brownian motion, are obtained, for any Rao–Fisher information metric defined in terms of warped Riemannian metrics. Finally, using a mixture of analytical and numerical computations, it is shown that the parameter space of the von Mises–Fisher model of n-dimensional directional data, when equipped with its Rao–Fisher information metric, becomes a Hadamard manifold, a simply-connected complete Riemannian manifold of negative sectional curvature, for \(n = 2,\ldots ,8\). Hopefully, in upcoming work, this will be proved for any value of n.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Absil, P.A., Mahony, R., Sepulchre, R.: Optimization Algorithms on Matrix Manifolds. Princeton University Press, Princeton (2008)CrossRef Absil, P.A., Mahony, R., Sepulchre, R.: Optimization Algorithms on Matrix Manifolds. Princeton University Press, Princeton (2008)CrossRef
2.
go back to reference Amari, S.I.: Natural gradient works efficiently in learning. Neural Comput. 10(2), 251–276 (1998)CrossRef Amari, S.I.: Natural gradient works efficiently in learning. Neural Comput. 10(2), 251–276 (1998)CrossRef
3.
go back to reference Amari, S., Nagaoka, H.: Methods of Information Geometry. American Mathematical Society, Providence (2000)MATH Amari, S., Nagaoka, H.: Methods of Information Geometry. American Mathematical Society, Providence (2000)MATH
4.
go back to reference Arnaudon, M.: Semi-martingales dans les espaces homogènes. Annales de l’I.H.P 29(3), 269–288 (1993)MATH Arnaudon, M.: Semi-martingales dans les espaces homogènes. Annales de l’I.H.P 29(3), 269–288 (1993)MATH
5.
go back to reference Arnaudon, M., Miclo, L.: A stochastic algorithm finding generalized means on compact manifolds. Stochastic. Process. Appl. 124(10), 3463–3479 (2014)MathSciNetCrossRef Arnaudon, M., Miclo, L.: A stochastic algorithm finding generalized means on compact manifolds. Stochastic. Process. Appl. 124(10), 3463–3479 (2014)MathSciNetCrossRef
7.
go back to reference Ay, N., Jost, J., Lê, H.V., Schwachhöfer, L.: Information geometry and sufficient statistics. Probab. Theory Relat. Fields 162(1), 327–364 (2015)MathSciNetCrossRef Ay, N., Jost, J., Lê, H.V., Schwachhöfer, L.: Information geometry and sufficient statistics. Probab. Theory Relat. Fields 162(1), 327–364 (2015)MathSciNetCrossRef
8.
10.
go back to reference Berthoumieu, Y., Bombrun, L., Said, S.: Classification approach based on the product of Riemannian manifolds from Gaussian parameterization space. In: International Conference on Image Processing (ICIP) (2017) Berthoumieu, Y., Bombrun, L., Said, S.: Classification approach based on the product of Riemannian manifolds from Gaussian parameterization space. In: International Conference on Image Processing (ICIP) (2017)
11.
13.
go back to reference Chavel, I.: Riemannian Geometry, A Modern Introduction. Cambridge University Press, Cambridge (2006)CrossRef Chavel, I.: Riemannian Geometry, A Modern Introduction. Cambridge University Press, Cambridge (2006)CrossRef
14.
go back to reference Cheng, G., Vemuri, B.C.: A novel dynamic system in the space of SPD matrices with applications to appearance tracking. SIAM J. Imaging Sci. 6(1), 592–615 (2013)MathSciNetCrossRef Cheng, G., Vemuri, B.C.: A novel dynamic system in the space of SPD matrices with applications to appearance tracking. SIAM J. Imaging Sci. 6(1), 592–615 (2013)MathSciNetCrossRef
15.
go back to reference Chentsov, N.N.: Statistical Decision Rules and Optimal Inference. American Mathematical Society, Providence (1982)MATH Chentsov, N.N.: Statistical Decision Rules and Optimal Inference. American Mathematical Society, Providence (1982)MATH
16.
go back to reference Chikuse, Y.: Statistics on Special Manifolds. Lecture Notes in Statistics, 174. Springer Science+Business Media, LLC (2003)CrossRef Chikuse, Y.: Statistics on Special Manifolds. Lecture Notes in Statistics, 174. Springer Science+Business Media, LLC (2003)CrossRef
18.
19.
go back to reference Emery, M.: Stochastic Calculus in Manifolds. Springer, Berlin (1980) Emery, M.: Stochastic Calculus in Manifolds. Springer, Berlin (1980)
20.
go back to reference Estrade, A.: Exponentielle stochastique et intégrale multiplicative discontinues. Annales de l’I.H.P. 28(1), 107–129 (1992) Estrade, A.: Exponentielle stochastique et intégrale multiplicative discontinues. Annales de l’I.H.P. 28(1), 107–129 (1992)
21.
go back to reference Gallavotti, G.: The Elements of Mechanics. Springer Science+Business Media, LLC, New York (1983)CrossRef Gallavotti, G.: The Elements of Mechanics. Springer Science+Business Media, LLC, New York (1983)CrossRef
22.
go back to reference Helgason, S.: Differential Geometry and Symmetric Spaces. Academic Press, New York (1962)MATH Helgason, S.: Differential Geometry and Symmetric Spaces. Academic Press, New York (1962)MATH
23.
go back to reference Hsu, E.P.: Stochastic Analysis on Manifolds. American Mathematical Society, Providence (2002)CrossRef Hsu, E.P.: Stochastic Analysis on Manifolds. American Mathematical Society, Providence (2002)CrossRef
24.
go back to reference Ikeda, N., Watanabe, S.: Stochastic Differential Equations and Diffusion Processes. North-Holland Publishing Company, Amsterdam (1981)MATH Ikeda, N., Watanabe, S.: Stochastic Differential Equations and Diffusion Processes. North-Holland Publishing Company, Amsterdam (1981)MATH
25.
go back to reference Kallenberg, O.: Foundations of Modern Probability, 2nd edn. Springer, New York (2001)MATH Kallenberg, O.: Foundations of Modern Probability, 2nd edn. Springer, New York (2001)MATH
26.
go back to reference Kloeden, P.E., Platen, E.: Numerical Solution of Stochastic Differential Equations. Springer, New York (2011)MATH Kloeden, P.E., Platen, E.: Numerical Solution of Stochastic Differential Equations. Springer, New York (2011)MATH
27.
go back to reference Knapp, A.W.: Lie Groups Beyond an Introduction, 2nd edn. Birkhauser, Boston (2002)MATH Knapp, A.W.: Lie Groups Beyond an Introduction, 2nd edn. Birkhauser, Boston (2002)MATH
28.
go back to reference Lang, S.: Introduction to Linear Algebra, 2nd edn. Springer, New York (1986)CrossRef Lang, S.: Introduction to Linear Algebra, 2nd edn. Springer, New York (1986)CrossRef
29.
go back to reference Lee, J.M.: Introduction to Smooth Manifolds, 2nd edn. Springer Science+Business Media, New York (2012)CrossRef Lee, J.M.: Introduction to Smooth Manifolds, 2nd edn. Springer Science+Business Media, New York (2012)CrossRef
30.
go back to reference Lehmann, E.L., Romano, J.P.: Testing Statistical Hypotheses, 3rd edn. Springer Science+Business Media Inc, New York (2005)MATH Lehmann, E.L., Romano, J.P.: Testing Statistical Hypotheses, 3rd edn. Springer Science+Business Media Inc, New York (2005)MATH
31.
go back to reference Liao, E.: Lévy Processes on Lie Groups. Cambridge University Press, Cambridge (2004)CrossRef Liao, E.: Lévy Processes on Lie Groups. Cambridge University Press, Cambridge (2004)CrossRef
32.
go back to reference Luenbeger, D.G.: Linear and Nonlinear Programming, 2nd edn. Addison-Wesley publishing company, Reading (1973) Luenbeger, D.G.: Linear and Nonlinear Programming, 2nd edn. Addison-Wesley publishing company, Reading (1973)
33.
go back to reference Mardia, K.V., Jupp, P.E.: Directional Statistics. Wiley, Chichester (2002)MATH Mardia, K.V., Jupp, P.E.: Directional Statistics. Wiley, Chichester (2002)MATH
34.
go back to reference Marsden, J.E., Ratiu, T.: Manifolds, Tensor Analysis, and Applications. Springer Publishing Company Inc., New York (2001)MATH Marsden, J.E., Ratiu, T.: Manifolds, Tensor Analysis, and Applications. Springer Publishing Company Inc., New York (2001)MATH
36.
go back to reference McLachlan, G.J.: Discriminant Analysis and Statistical Pattern Recognition. Wiley, Hoboken (2004)MATH McLachlan, G.J.: Discriminant Analysis and Statistical Pattern Recognition. Wiley, Hoboken (2004)MATH
37.
go back to reference Ollivier, Y., Arnold, L., Auger, A., Hansen, N.: Information geometric optimization algorithms: a unifying picture via invariance principles. J. Mach. Learn. Res. 18(18), 1–65 (2017)MathSciNetMATH Ollivier, Y., Arnold, L., Auger, A., Hansen, N.: Information geometric optimization algorithms: a unifying picture via invariance principles. J. Mach. Learn. Res. 18(18), 1–65 (2017)MathSciNetMATH
38.
go back to reference O’Neill, B.: Semi-Riemannian Geometry with Applications to Relativity. Academic Press, San Diego (1983)MATH O’Neill, B.: Semi-Riemannian Geometry with Applications to Relativity. Academic Press, San Diego (1983)MATH
39.
go back to reference Pennec, X., Fillard, P., Ayache, N.: A Riemannian framework for tensor computing. Int. J. Comput. Vision 66(1), 41–66 (2006)CrossRef Pennec, X., Fillard, P., Ayache, N.: A Riemannian framework for tensor computing. Int. J. Comput. Vision 66(1), 41–66 (2006)CrossRef
40.
go back to reference Petersen, P.: Riemannian Geometry, 2nd edn. Springer Science+Business Media, LLC, New York (2006)MATH Petersen, P.: Riemannian Geometry, 2nd edn. Springer Science+Business Media, LLC, New York (2006)MATH
41.
go back to reference Said, S., Bombrun, L., Berthoumieu, Y., Manton, J.H.: Riemannian Gaussian distributions on the space of symmetric positive definite matrices. IEEE. Trans. Inf. Theory 63(4), 2153–2170 (2017)MathSciNetCrossRef Said, S., Bombrun, L., Berthoumieu, Y., Manton, J.H.: Riemannian Gaussian distributions on the space of symmetric positive definite matrices. IEEE. Trans. Inf. Theory 63(4), 2153–2170 (2017)MathSciNetCrossRef
42.
go back to reference Said, S., Hajri, H., Bombrun, L., Vemuri, B.C.: Gaussian distributions on Riemannian symmetric spaces: statistical learning with structured covariance matrices. IEEE. Trans. Inf. Theory 64(2), 752–772 (2018)MathSciNetCrossRef Said, S., Hajri, H., Bombrun, L., Vemuri, B.C.: Gaussian distributions on Riemannian symmetric spaces: statistical learning with structured covariance matrices. IEEE. Trans. Inf. Theory 64(2), 752–772 (2018)MathSciNetCrossRef
43.
go back to reference Spanier, E.H.: Algebraic Topology. Springer, New York (1966)MATH Spanier, E.H.: Algebraic Topology. Springer, New York (1966)MATH
44.
go back to reference Terras, A.: Harmonic Analysis on Symmetric Spaces and Applications, vol. II. Springer, New York (1988)CrossRef Terras, A.: Harmonic Analysis on Symmetric Spaces and Applications, vol. II. Springer, New York (1988)CrossRef
46.
go back to reference Watson, G.N.: A Treatise on the Theory of Bessel Functions. Cambridge University Press, Cambridge (1922)MATH Watson, G.N.: A Treatise on the Theory of Bessel Functions. Cambridge University Press, Cambridge (1922)MATH
47.
go back to reference Wierstra, D., Schaul, T., Glasmachers, T., Sun, Y., Peters, J., Schmidhuber, J.: Natural evolution strategies. J. Mach. Learn. Res. 15(1), 949–980 (2014)MathSciNetMATH Wierstra, D., Schaul, T., Glasmachers, T., Sun, Y., Peters, J., Schmidhuber, J.: Natural evolution strategies. J. Mach. Learn. Res. 15(1), 949–980 (2014)MathSciNetMATH
48.
go back to reference Young, G.A., Smith, R.L.: Essentials of Statistical Inference. Cambridge University Press, Cambridge (2005)CrossRef Young, G.A., Smith, R.L.: Essentials of Statistical Inference. Cambridge University Press, Cambridge (2005)CrossRef
49.
go back to reference Zanini, P., Said, S., Congedo, M., Berthoumieu, Y., Jutten, C.: Parameter estimates of Riemannian Gaussian distributions in the manifold of covariance matrices. In: Sensor Array and Multichannel Signal Processsing Workshop (SAM) (2016) Zanini, P., Said, S., Congedo, M., Berthoumieu, Y., Jutten, C.: Parameter estimates of Riemannian Gaussian distributions in the manifold of covariance matrices. In: Sensor Array and Multichannel Signal Processsing Workshop (SAM) (2016)
50.
go back to reference Zanini, P., Said, S., Berthoumieu, Y., Congedo, M., Jutten, C.: Riemannian online algorithm for estimating mixture model parameters. In: Geometric Science of Information (GSI) (2017) Zanini, P., Said, S., Berthoumieu, Y., Congedo, M., Jutten, C.: Riemannian online algorithm for estimating mixture model parameters. In: Geometric Science of Information (GSI) (2017)
Metadata
Title
Warped Riemannian Metrics for Location-Scale Models
Authors
Salem Said
Lionel Bombrun
Yannick Berthoumieu
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-02520-5_10