Skip to main content

2018 | OriginalPaper | Buchkapitel

Variational Wasserstein Clustering

verfasst von : Liang Mi, Wen Zhang, Xianfeng Gu, Yalin Wang

Erschienen in: Computer Vision – ECCV 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We propose a new clustering method based on optimal transportation. We discuss the connection between optimal transportation and k-means clustering, solve optimal transportation with the variational principle, and investigate the use of power diagrams as transportation plans for aggregating arbitrary domains into a fixed number of clusters. We drive cluster centroids through the target domain while maintaining the minimum clustering energy by adjusting the power diagram. Thus, we simultaneously pursue clustering and the Wasserstein distance between the centroids and the target domain, resulting in a measure-preserving mapping. We demonstrate the use of our method in domain adaptation, remeshing, and learning representations on synthetic and real data.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Forgy, E.W.: Cluster analysis of multivariate data: efficiency versus interpretability of classifications. Biometrics 21, 768–769 (1965) Forgy, E.W.: Cluster analysis of multivariate data: efficiency versus interpretability of classifications. Biometrics 21, 768–769 (1965)
4.
5.
Zurück zum Zitat Cuturi, M., Doucet, A.: Fast computation of wasserstein barycenters. In: International Conference on Machine Learning, pp. 685–693 (2014) Cuturi, M., Doucet, A.: Fast computation of wasserstein barycenters. In: International Conference on Machine Learning, pp. 685–693 (2014)
6.
Zurück zum Zitat Solomon, J., et al.: Convolutional wasserstein distances: efficient optimal transportation on geometric domains. ACM Trans. Graph. (TOG) 34(4), 66 (2015)CrossRef Solomon, J., et al.: Convolutional wasserstein distances: efficient optimal transportation on geometric domains. ACM Trans. Graph. (TOG) 34(4), 66 (2015)CrossRef
7.
Zurück zum Zitat Ye, J., Wu, P., Wang, J.Z., Li, J.: Fast discrete distribution clustering using Wasserstein barycenter with sparse support. IEEE Trans. Signal Process. 65(9), 2317–2332 (2017)MathSciNetCrossRef Ye, J., Wu, P., Wang, J.Z., Li, J.: Fast discrete distribution clustering using Wasserstein barycenter with sparse support. IEEE Trans. Signal Process. 65(9), 2317–2332 (2017)MathSciNetCrossRef
8.
Zurück zum Zitat Ho, N., Nguyen, X., Yurochkin, M., Bui, H.H., Huynh, V., Phung, D.: Multilevel clustering via Wasserstein means (2017). arXiv preprint arXiv:1706.03883 Ho, N., Nguyen, X., Yurochkin, M., Bui, H.H., Huynh, V., Phung, D.: Multilevel clustering via Wasserstein means (2017). arXiv preprint arXiv:​1706.​03883
9.
Zurück zum Zitat Gu, X., Luo, F., Sun, J., Yau, S.T.: Variational principles for minkowski type problems, discrete optimal transport, and discrete monge-ampere equations (2013). arXiv preprint arXiv:1302.5472 Gu, X., Luo, F., Sun, J., Yau, S.T.: Variational principles for minkowski type problems, discrete optimal transport, and discrete monge-ampere equations (2013). arXiv preprint arXiv:​1302.​5472
10.
Zurück zum Zitat Courty, N., Flamary, R., Habrard, A., Rakotomamonjy, A.: Joint distribution optimal transportation for domain adaptation. In: Advances in Neural Information Processing Systems, pp. 3733–3742 (2017) Courty, N., Flamary, R., Habrard, A., Rakotomamonjy, A.: Joint distribution optimal transportation for domain adaptation. In: Advances in Neural Information Processing Systems, pp. 3733–3742 (2017)
11.
Zurück zum Zitat Monge, G.: Mémoire sur la théorie des déblais et des remblais. Histoire de l’Académie Royale des Sciences de Paris (1781) Monge, G.: Mémoire sur la théorie des déblais et des remblais. Histoire de l’Académie Royale des Sciences de Paris (1781)
12.
Zurück zum Zitat Kantorovich, L.V.: On the translocation of masses. Dokl. Akad. Nauk SSSR. 37, 199–201 (1942)MathSciNetMATH Kantorovich, L.V.: On the translocation of masses. Dokl. Akad. Nauk SSSR. 37, 199–201 (1942)MathSciNetMATH
13.
Zurück zum Zitat Cuturi, M.: Sinkhorn distances: lightspeed computation of optimal transport. In: Advances in neural information processing systems, pp. 2292–2300 (2013) Cuturi, M.: Sinkhorn distances: lightspeed computation of optimal transport. In: Advances in neural information processing systems, pp. 2292–2300 (2013)
14.
Zurück zum Zitat Brenier, Y.: Polar factorization and monotone rearrangement of vector-valued functions. Commun. Pure Appl. Math. 44(4), 375–417 (1991)MathSciNetCrossRef Brenier, Y.: Polar factorization and monotone rearrangement of vector-valued functions. Commun. Pure Appl. Math. 44(4), 375–417 (1991)MathSciNetCrossRef
15.
Zurück zum Zitat Mérigot, Q.: A multiscale approach to optimal transport. In: Computer Graphics Forum, vol. 30, pp. 1583–1592. Wiley Online Library (2011) Mérigot, Q.: A multiscale approach to optimal transport. In: Computer Graphics Forum, vol. 30, pp. 1583–1592. Wiley Online Library (2011)
16.
Zurück zum Zitat Lévy, B.: A numerical algorithm for l2 semi-discrete optimal transport in 3d. ESAIM Math. Model. Numer. Anal. 49(6), 1693–1715 (2015)MathSciNetCrossRef Lévy, B.: A numerical algorithm for l2 semi-discrete optimal transport in 3d. ESAIM Math. Model. Numer. Anal. 49(6), 1693–1715 (2015)MathSciNetCrossRef
17.
Zurück zum Zitat Givens, C.R., Shortt, R.M.: A class of wasserstein metrics for probability distributions. Mich. Math. J. 31(2), 231–240 (1984)MathSciNetCrossRef Givens, C.R., Shortt, R.M.: A class of wasserstein metrics for probability distributions. Mich. Math. J. 31(2), 231–240 (1984)MathSciNetCrossRef
18.
Zurück zum Zitat Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)CrossRef Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)CrossRef
19.
Zurück zum Zitat Ling, H., Okada, K.: An efficient earth mover’s distance algorithm for robust histogram comparison. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 840–853 (2007)CrossRef Ling, H., Okada, K.: An efficient earth mover’s distance algorithm for robust histogram comparison. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 840–853 (2007)CrossRef
20.
Zurück zum Zitat Lee, K., Xu, W., Fan, F., Tu, Z.: Wasserstein introspective neural networks. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018 Lee, K., Xu, W., Fan, F., Tu, Z.: Wasserstein introspective neural networks. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018
21.
Zurück zum Zitat Arjovsky, M., Chintala, S., Bottou, L.: Wasserstein generative adversarial networks. In: International Conference on Machine Learning, pp. 214–223 (2017) Arjovsky, M., Chintala, S., Bottou, L.: Wasserstein generative adversarial networks. In: International Conference on Machine Learning, pp. 214–223 (2017)
22.
Zurück zum Zitat Frogner, C., Zhang, C., Mobahi, H., Araya, M., Poggio, T.A.: Learning with a Wasserstein loss. In: Advances in Neural Information Processing Systems, pp. 2053–2061 (2015) Frogner, C., Zhang, C., Mobahi, H., Araya, M., Poggio, T.A.: Learning with a Wasserstein loss. In: Advances in Neural Information Processing Systems, pp. 2053–2061 (2015)
23.
Zurück zum Zitat Gibbs, A.L., Su, F.E.: On choosing and bounding probability metrics. Int. Stat. Rev. 70(3), 419–435 (2002)CrossRef Gibbs, A.L., Su, F.E.: On choosing and bounding probability metrics. Int. Stat. Rev. 70(3), 419–435 (2002)CrossRef
24.
Zurück zum Zitat Applegate, D., Dasu, T., Krishnan, S., Urbanek, S.: Unsupervised clustering of multidimensional distributions using earth mover distance. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 636–644. ACM (2011) Applegate, D., Dasu, T., Krishnan, S., Urbanek, S.: Unsupervised clustering of multidimensional distributions using earth mover distance. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 636–644. ACM (2011)
25.
Zurück zum Zitat Villani, C.: Topics in Optimal Transportation, no. 58. American Mathematical Society (2003) Villani, C.: Topics in Optimal Transportation, no. 58. American Mathematical Society (2003)
26.
Zurück zum Zitat Alexandrov, A.D.: Convex Polyhedra. Springer Science & Business Media (2005) Alexandrov, A.D.: Convex Polyhedra. Springer Science & Business Media (2005)
27.
Zurück zum Zitat Aurenhammer, F.: Power diagrams: properties, algorithms and applications. SIAM J. Comput. 16(1), 78–96 (1987)MathSciNetCrossRef Aurenhammer, F.: Power diagrams: properties, algorithms and applications. SIAM J. Comput. 16(1), 78–96 (1987)MathSciNetCrossRef
28.
Zurück zum Zitat Gu, X.D., Yau, S.T.: Computational Conformal Geometry. International Press Somerville, Mass, USA (2008)MATH Gu, X.D., Yau, S.T.: Computational Conformal Geometry. International Press Somerville, Mass, USA (2008)MATH
29.
Zurück zum Zitat Wang, Y., Gu, X., Chan, T.F., Thompson, P.M., Yau, S.T.: Volumetric harmonic brain mapping. In: 2004 IEEE International Symposium on Biomedical Imaging: Nano to Macro, pp. 1275–1278. IEEE (2004) Wang, Y., Gu, X., Chan, T.F., Thompson, P.M., Yau, S.T.: Volumetric harmonic brain mapping. In: 2004 IEEE International Symposium on Biomedical Imaging: Nano to Macro, pp. 1275–1278. IEEE (2004)
30.
Zurück zum Zitat Rycroft, C.: Voro++: a three-dimensional Voronoi cell library in c++ (2009) Rycroft, C.: Voro++: a three-dimensional Voronoi cell library in c++ (2009)
32.
Zurück zum Zitat Arthur, D., Vassilvitskii, S.: k-means++: the advantages of careful seeding. In: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms. Society for Industrial and Applied Mathematics, pp. 1027–1035 (2007) Arthur, D., Vassilvitskii, S.: k-means++: the advantages of careful seeding. In: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms. Society for Industrial and Applied Mathematics, pp. 1027–1035 (2007)
33.
Zurück zum Zitat Shewchuk, J.R.: Delaunay refinement algorithms for triangular mesh generation. Comput. Geom. 22(1–3), 21–74 (2002)MathSciNetCrossRef Shewchuk, J.R.: Delaunay refinement algorithms for triangular mesh generation. Comput. Geom. 22(1–3), 21–74 (2002)MathSciNetCrossRef
34.
Zurück zum Zitat Fabri, A., Pion, S.: Cgal: the computational geometry algorithms library. In: Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 538–539. ACM (2009) Fabri, A., Pion, S.: Cgal: the computational geometry algorithms library. In: Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 538–539. ACM (2009)
35.
Zurück zum Zitat Goes, F.d., Memari, P., Mullen, P., Desbrun, M.: Weighted triangulations for geometry processing. ACM Trans. Graph. (TOG) 33(3), 28 (2014)CrossRef Goes, F.d., Memari, P., Mullen, P., Desbrun, M.: Weighted triangulations for geometry processing. ACM Trans. Graph. (TOG) 33(3), 28 (2014)CrossRef
36.
37.
Zurück zum Zitat Si, H., TetGen, A.: A Quality Tetrahedral Mesh Generator and Three-dimensional Delaunay Triangulator, p. 81. Weierstrass Institute for Applied Analysis and Stochastic, Berlin, Germany (2006) Si, H., TetGen, A.: A Quality Tetrahedral Mesh Generator and Three-dimensional Delaunay Triangulator, p. 81. Weierstrass Institute for Applied Analysis and Stochastic, Berlin, Germany (2006)
38.
Zurück zum Zitat Fox, N.C., Freeborough, P.A.: Brain atrophy progression measured from registered serial mri: validation and application to alzheimer’s disease. J. Magn. Reson. Imaging 7(6), 1069–1075 (1997)CrossRef Fox, N.C., Freeborough, P.A.: Brain atrophy progression measured from registered serial mri: validation and application to alzheimer’s disease. J. Magn. Reson. Imaging 7(6), 1069–1075 (1997)CrossRef
Metadaten
Titel
Variational Wasserstein Clustering
verfasst von
Liang Mi
Wen Zhang
Xianfeng Gu
Yalin Wang
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01267-0_20