Skip to main content
Top

2018 | OriginalPaper | Chapter

Variational Wasserstein Clustering

Authors : Liang Mi, Wen Zhang, Xianfeng Gu, Yalin Wang

Published in: Computer Vision – ECCV 2018

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We propose a new clustering method based on optimal transportation. We discuss the connection between optimal transportation and k-means clustering, solve optimal transportation with the variational principle, and investigate the use of power diagrams as transportation plans for aggregating arbitrary domains into a fixed number of clusters. We drive cluster centroids through the target domain while maintaining the minimum clustering energy by adjusting the power diagram. Thus, we simultaneously pursue clustering and the Wasserstein distance between the centroids and the target domain, resulting in a measure-preserving mapping. We demonstrate the use of our method in domain adaptation, remeshing, and learning representations on synthetic and real data.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Forgy, E.W.: Cluster analysis of multivariate data: efficiency versus interpretability of classifications. Biometrics 21, 768–769 (1965) Forgy, E.W.: Cluster analysis of multivariate data: efficiency versus interpretability of classifications. Biometrics 21, 768–769 (1965)
5.
go back to reference Cuturi, M., Doucet, A.: Fast computation of wasserstein barycenters. In: International Conference on Machine Learning, pp. 685–693 (2014) Cuturi, M., Doucet, A.: Fast computation of wasserstein barycenters. In: International Conference on Machine Learning, pp. 685–693 (2014)
6.
go back to reference Solomon, J., et al.: Convolutional wasserstein distances: efficient optimal transportation on geometric domains. ACM Trans. Graph. (TOG) 34(4), 66 (2015)CrossRef Solomon, J., et al.: Convolutional wasserstein distances: efficient optimal transportation on geometric domains. ACM Trans. Graph. (TOG) 34(4), 66 (2015)CrossRef
7.
go back to reference Ye, J., Wu, P., Wang, J.Z., Li, J.: Fast discrete distribution clustering using Wasserstein barycenter with sparse support. IEEE Trans. Signal Process. 65(9), 2317–2332 (2017)MathSciNetCrossRef Ye, J., Wu, P., Wang, J.Z., Li, J.: Fast discrete distribution clustering using Wasserstein barycenter with sparse support. IEEE Trans. Signal Process. 65(9), 2317–2332 (2017)MathSciNetCrossRef
8.
go back to reference Ho, N., Nguyen, X., Yurochkin, M., Bui, H.H., Huynh, V., Phung, D.: Multilevel clustering via Wasserstein means (2017). arXiv preprint arXiv:1706.03883 Ho, N., Nguyen, X., Yurochkin, M., Bui, H.H., Huynh, V., Phung, D.: Multilevel clustering via Wasserstein means (2017). arXiv preprint arXiv:​1706.​03883
9.
go back to reference Gu, X., Luo, F., Sun, J., Yau, S.T.: Variational principles for minkowski type problems, discrete optimal transport, and discrete monge-ampere equations (2013). arXiv preprint arXiv:1302.5472 Gu, X., Luo, F., Sun, J., Yau, S.T.: Variational principles for minkowski type problems, discrete optimal transport, and discrete monge-ampere equations (2013). arXiv preprint arXiv:​1302.​5472
10.
go back to reference Courty, N., Flamary, R., Habrard, A., Rakotomamonjy, A.: Joint distribution optimal transportation for domain adaptation. In: Advances in Neural Information Processing Systems, pp. 3733–3742 (2017) Courty, N., Flamary, R., Habrard, A., Rakotomamonjy, A.: Joint distribution optimal transportation for domain adaptation. In: Advances in Neural Information Processing Systems, pp. 3733–3742 (2017)
11.
go back to reference Monge, G.: Mémoire sur la théorie des déblais et des remblais. Histoire de l’Académie Royale des Sciences de Paris (1781) Monge, G.: Mémoire sur la théorie des déblais et des remblais. Histoire de l’Académie Royale des Sciences de Paris (1781)
12.
13.
go back to reference Cuturi, M.: Sinkhorn distances: lightspeed computation of optimal transport. In: Advances in neural information processing systems, pp. 2292–2300 (2013) Cuturi, M.: Sinkhorn distances: lightspeed computation of optimal transport. In: Advances in neural information processing systems, pp. 2292–2300 (2013)
14.
go back to reference Brenier, Y.: Polar factorization and monotone rearrangement of vector-valued functions. Commun. Pure Appl. Math. 44(4), 375–417 (1991)MathSciNetCrossRef Brenier, Y.: Polar factorization and monotone rearrangement of vector-valued functions. Commun. Pure Appl. Math. 44(4), 375–417 (1991)MathSciNetCrossRef
15.
go back to reference Mérigot, Q.: A multiscale approach to optimal transport. In: Computer Graphics Forum, vol. 30, pp. 1583–1592. Wiley Online Library (2011) Mérigot, Q.: A multiscale approach to optimal transport. In: Computer Graphics Forum, vol. 30, pp. 1583–1592. Wiley Online Library (2011)
16.
go back to reference Lévy, B.: A numerical algorithm for l2 semi-discrete optimal transport in 3d. ESAIM Math. Model. Numer. Anal. 49(6), 1693–1715 (2015)MathSciNetCrossRef Lévy, B.: A numerical algorithm for l2 semi-discrete optimal transport in 3d. ESAIM Math. Model. Numer. Anal. 49(6), 1693–1715 (2015)MathSciNetCrossRef
17.
go back to reference Givens, C.R., Shortt, R.M.: A class of wasserstein metrics for probability distributions. Mich. Math. J. 31(2), 231–240 (1984)MathSciNetCrossRef Givens, C.R., Shortt, R.M.: A class of wasserstein metrics for probability distributions. Mich. Math. J. 31(2), 231–240 (1984)MathSciNetCrossRef
18.
go back to reference Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)CrossRef Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)CrossRef
19.
go back to reference Ling, H., Okada, K.: An efficient earth mover’s distance algorithm for robust histogram comparison. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 840–853 (2007)CrossRef Ling, H., Okada, K.: An efficient earth mover’s distance algorithm for robust histogram comparison. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 840–853 (2007)CrossRef
20.
go back to reference Lee, K., Xu, W., Fan, F., Tu, Z.: Wasserstein introspective neural networks. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018 Lee, K., Xu, W., Fan, F., Tu, Z.: Wasserstein introspective neural networks. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018
21.
go back to reference Arjovsky, M., Chintala, S., Bottou, L.: Wasserstein generative adversarial networks. In: International Conference on Machine Learning, pp. 214–223 (2017) Arjovsky, M., Chintala, S., Bottou, L.: Wasserstein generative adversarial networks. In: International Conference on Machine Learning, pp. 214–223 (2017)
22.
go back to reference Frogner, C., Zhang, C., Mobahi, H., Araya, M., Poggio, T.A.: Learning with a Wasserstein loss. In: Advances in Neural Information Processing Systems, pp. 2053–2061 (2015) Frogner, C., Zhang, C., Mobahi, H., Araya, M., Poggio, T.A.: Learning with a Wasserstein loss. In: Advances in Neural Information Processing Systems, pp. 2053–2061 (2015)
23.
go back to reference Gibbs, A.L., Su, F.E.: On choosing and bounding probability metrics. Int. Stat. Rev. 70(3), 419–435 (2002)CrossRef Gibbs, A.L., Su, F.E.: On choosing and bounding probability metrics. Int. Stat. Rev. 70(3), 419–435 (2002)CrossRef
24.
go back to reference Applegate, D., Dasu, T., Krishnan, S., Urbanek, S.: Unsupervised clustering of multidimensional distributions using earth mover distance. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 636–644. ACM (2011) Applegate, D., Dasu, T., Krishnan, S., Urbanek, S.: Unsupervised clustering of multidimensional distributions using earth mover distance. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 636–644. ACM (2011)
25.
go back to reference Villani, C.: Topics in Optimal Transportation, no. 58. American Mathematical Society (2003) Villani, C.: Topics in Optimal Transportation, no. 58. American Mathematical Society (2003)
26.
go back to reference Alexandrov, A.D.: Convex Polyhedra. Springer Science & Business Media (2005) Alexandrov, A.D.: Convex Polyhedra. Springer Science & Business Media (2005)
27.
28.
go back to reference Gu, X.D., Yau, S.T.: Computational Conformal Geometry. International Press Somerville, Mass, USA (2008)MATH Gu, X.D., Yau, S.T.: Computational Conformal Geometry. International Press Somerville, Mass, USA (2008)MATH
29.
go back to reference Wang, Y., Gu, X., Chan, T.F., Thompson, P.M., Yau, S.T.: Volumetric harmonic brain mapping. In: 2004 IEEE International Symposium on Biomedical Imaging: Nano to Macro, pp. 1275–1278. IEEE (2004) Wang, Y., Gu, X., Chan, T.F., Thompson, P.M., Yau, S.T.: Volumetric harmonic brain mapping. In: 2004 IEEE International Symposium on Biomedical Imaging: Nano to Macro, pp. 1275–1278. IEEE (2004)
30.
go back to reference Rycroft, C.: Voro++: a three-dimensional Voronoi cell library in c++ (2009) Rycroft, C.: Voro++: a three-dimensional Voronoi cell library in c++ (2009)
32.
go back to reference Arthur, D., Vassilvitskii, S.: k-means++: the advantages of careful seeding. In: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms. Society for Industrial and Applied Mathematics, pp. 1027–1035 (2007) Arthur, D., Vassilvitskii, S.: k-means++: the advantages of careful seeding. In: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms. Society for Industrial and Applied Mathematics, pp. 1027–1035 (2007)
33.
go back to reference Shewchuk, J.R.: Delaunay refinement algorithms for triangular mesh generation. Comput. Geom. 22(1–3), 21–74 (2002)MathSciNetCrossRef Shewchuk, J.R.: Delaunay refinement algorithms for triangular mesh generation. Comput. Geom. 22(1–3), 21–74 (2002)MathSciNetCrossRef
34.
go back to reference Fabri, A., Pion, S.: Cgal: the computational geometry algorithms library. In: Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 538–539. ACM (2009) Fabri, A., Pion, S.: Cgal: the computational geometry algorithms library. In: Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 538–539. ACM (2009)
35.
go back to reference Goes, F.d., Memari, P., Mullen, P., Desbrun, M.: Weighted triangulations for geometry processing. ACM Trans. Graph. (TOG) 33(3), 28 (2014)CrossRef Goes, F.d., Memari, P., Mullen, P., Desbrun, M.: Weighted triangulations for geometry processing. ACM Trans. Graph. (TOG) 33(3), 28 (2014)CrossRef
37.
go back to reference Si, H., TetGen, A.: A Quality Tetrahedral Mesh Generator and Three-dimensional Delaunay Triangulator, p. 81. Weierstrass Institute for Applied Analysis and Stochastic, Berlin, Germany (2006) Si, H., TetGen, A.: A Quality Tetrahedral Mesh Generator and Three-dimensional Delaunay Triangulator, p. 81. Weierstrass Institute for Applied Analysis and Stochastic, Berlin, Germany (2006)
38.
go back to reference Fox, N.C., Freeborough, P.A.: Brain atrophy progression measured from registered serial mri: validation and application to alzheimer’s disease. J. Magn. Reson. Imaging 7(6), 1069–1075 (1997)CrossRef Fox, N.C., Freeborough, P.A.: Brain atrophy progression measured from registered serial mri: validation and application to alzheimer’s disease. J. Magn. Reson. Imaging 7(6), 1069–1075 (1997)CrossRef
Metadata
Title
Variational Wasserstein Clustering
Authors
Liang Mi
Wen Zhang
Xianfeng Gu
Yalin Wang
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-01267-0_20

Premium Partner