Skip to main content

2017 | OriginalPaper | Buchkapitel

A Fast MBO Scheme for Multiclass Data Classification

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We describe a new variant of the MBO scheme for solving the semi-supervised data classification problem on a weighted graph. The scheme is based on the minimization of the graph heat content energy. The resulting algorithms guarantee dissipation of the graph heat content energy for an extremely wide class of weight matrices. As a result, our method is both flexible and unconditionally stable. Experimental results on benchmark machine learning datasets show that our approach matches or exceeds the performance of current state-of-the-art variational methods while being considerably faster.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Alberti, G., Bellettini, G.: A non-local anisotropic model for phase transitions: asymptotic behavior of rescaled energies. Eur. J. Appl. Math. 9, 261–284 (1998)CrossRefMATH Alberti, G., Bellettini, G.: A non-local anisotropic model for phase transitions: asymptotic behavior of rescaled energies. Eur. J. Appl. Math. 9, 261–284 (1998)CrossRefMATH
2.
Zurück zum Zitat Bresson, X., Chan, T., Tai, X., Szlam, A.: Multi-class trans- ductive learning based on l1 relaxations of cheeger cut and mumford-shah-potts model. J. Math. Imaging Vis. 49(1), 191–201 (2013)CrossRefMATH Bresson, X., Chan, T., Tai, X., Szlam, A.: Multi-class trans- ductive learning based on l1 relaxations of cheeger cut and mumford-shah-potts model. J. Math. Imaging Vis. 49(1), 191–201 (2013)CrossRefMATH
3.
Zurück zum Zitat Cheeger, J.: A lower bound for the smallest eigenvalue of the Laplacian. In: Problems in Analysis, pp. 195–199 (1970) Cheeger, J.: A lower bound for the smallest eigenvalue of the Laplacian. In: Problems in Analysis, pp. 195–199 (1970)
4.
Zurück zum Zitat Coifman, R.R., Lafon, S., Lee, A.B., Maggioni, M., Nadler, B., Warner, F., Zucker, S.W.: Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. PNAS 102, 7426–7431 (2005)CrossRef Coifman, R.R., Lafon, S., Lee, A.B., Maggioni, M., Nadler, B., Warner, F., Zucker, S.W.: Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. PNAS 102, 7426–7431 (2005)CrossRef
5.
Zurück zum Zitat Elsey, M., Esedo\(\bar{\text{g}}\)lu, S.: Threshold dynamics for anisotropic surface energies. Technical report, UM (2016). Under review Elsey, M., Esedo\(\bar{\text{g}}\)lu, S.: Threshold dynamics for anisotropic surface energies. Technical report, UM (2016). Under review
6.
Zurück zum Zitat Esedo\(\bar{\text{ g }}\)lu, S., Otto, F.: Threshold dynamics for networks with arbitrary surface tensions. Commun. Pure Appl. Math. 68(5), 808–864 (2015) Esedo\(\bar{\text{ g }}\)lu, S., Otto, F.: Threshold dynamics for networks with arbitrary surface tensions. Commun. Pure Appl. Math. 68(5), 808–864 (2015)
7.
Zurück zum Zitat Esedo\(\bar{\text{ g }}\)lu, S., Tsai, Y.-H.: Threshold dynamics for the piecewise constant Mumford-Shah functional. J. Comput. Phys. 211(1), 367–384 (2006) Esedo\(\bar{\text{ g }}\)lu, S., Tsai, Y.-H.: Threshold dynamics for the piecewise constant Mumford-Shah functional. J. Comput. Phys. 211(1), 367–384 (2006)
8.
Zurück zum Zitat Esedo\(\bar{\text{ g }}\)lu, S., Jacobs, M.: Convolution kernels, and stability of threshold dynamics methods. Technical report, University of Michigan (2016) Esedo\(\bar{\text{ g }}\)lu, S., Jacobs, M.: Convolution kernels, and stability of threshold dynamics methods. Technical report, University of Michigan (2016)
9.
Zurück zum Zitat Garcia-Cardona, C., Merkurjev, E., Bertozzi, A.L., Flenner, A., Percus, A.G.: Multiclass data segmentation using diffuse interface methods on graphs. IEEE Trans. Pattern Anal. Mach. Intell. 36(8), 1600–1613 (2014)CrossRefMATH Garcia-Cardona, C., Merkurjev, E., Bertozzi, A.L., Flenner, A., Percus, A.G.: Multiclass data segmentation using diffuse interface methods on graphs. IEEE Trans. Pattern Anal. Mach. Intell. 36(8), 1600–1613 (2014)CrossRefMATH
10.
Zurück zum Zitat Hein, M., Setzer, S.: Beyond spectral clustering - tight relaxations of balanced graph cuts. In: Advances in Neural Information Processing Systems 24 (NIPS) (2011) Hein, M., Setzer, S.: Beyond spectral clustering - tight relaxations of balanced graph cuts. In: Advances in Neural Information Processing Systems 24 (NIPS) (2011)
11.
Zurück zum Zitat Kaynak, C.: Methods of combining multiple classifiers and their applications to handwritten digit recognition. Master’s thesis, Institute of Graduate Studies in Science and Engineering, Bogazici University (1995) Kaynak, C.: Methods of combining multiple classifiers and their applications to handwritten digit recognition. Master’s thesis, Institute of Graduate Studies in Science and Engineering, Bogazici University (1995)
12.
Zurück zum Zitat Malik, J., Shi, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 888–905 (2000)CrossRef Malik, J., Shi, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 888–905 (2000)CrossRef
13.
Zurück zum Zitat Merkurjev, E., Bertozzi, A., Chung, F.: A semi-supervised heat kernel pagerank MBO algorithm for data classification (2016, submitted) Merkurjev, E., Bertozzi, A., Chung, F.: A semi-supervised heat kernel pagerank MBO algorithm for data classification (2016, submitted)
14.
Zurück zum Zitat Merriman, B., Bence, J.K., Osher, S.J.: Diffusion generated motion by mean curvature. In: Taylor, J. (ed.) Proceedings of the Computational Crystal Growers Workshop, pp. 73–83. AMS (1992) Merriman, B., Bence, J.K., Osher, S.J.: Diffusion generated motion by mean curvature. In: Taylor, J. (ed.) Proceedings of the Computational Crystal Growers Workshop, pp. 73–83. AMS (1992)
15.
Zurück zum Zitat Miranda, M., Pallara, D., Paronetto, F., Preunkert, M.: Short-time heat flow and functions of bounded variation in \({\mathbb{R}}^N\). Ann. Fac. Sci. Toulouse Math. 16(1), 125–145 (2007)MathSciNetCrossRefMATH Miranda, M., Pallara, D., Paronetto, F., Preunkert, M.: Short-time heat flow and functions of bounded variation in \({\mathbb{R}}^N\). Ann. Fac. Sci. Toulouse Math. 16(1), 125–145 (2007)MathSciNetCrossRefMATH
16.
Zurück zum Zitat Mumford, D., Shah, J.: Optimal approximations by piecewise smooth functions and associated variational problems. Commun. Pure Appl. Math. 42, 577–685 (1989)MathSciNetCrossRefMATH Mumford, D., Shah, J.: Optimal approximations by piecewise smooth functions and associated variational problems. Commun. Pure Appl. Math. 42, 577–685 (1989)MathSciNetCrossRefMATH
17.
Zurück zum Zitat Nene, S.A., Nayar, S.K., Murase, H.: Columbia object image library (coil-100). Technical report, Columbia University (1996) Nene, S.A., Nayar, S.K., Murase, H.: Columbia object image library (coil-100). Technical report, Columbia University (1996)
18.
Zurück zum Zitat Zien, A., Chapelle, O., Scholkopf, B.: Semi-Supervised Learning. The MIT Press, Cambridge (2006) Zien, A., Chapelle, O., Scholkopf, B.: Semi-Supervised Learning. The MIT Press, Cambridge (2006)
19.
Zurück zum Zitat Scherzer, O. (ed.): Handbook of Mathematical Methods in Imaging. Springer, Heidelberg (2011)MATH Scherzer, O. (ed.): Handbook of Mathematical Methods in Imaging. Springer, Heidelberg (2011)MATH
20.
Zurück zum Zitat Yin, K., Tai, X.-Y., Osher, S.J.: An effective region force for some variational models for learning and clustering. Technical report, UCLA (2016) Yin, K., Tai, X.-Y., Osher, S.J.: An effective region force for some variational models for learning and clustering. Technical report, UCLA (2016)
21.
Zurück zum Zitat Yu, S.X., Shi, J.: Multiclass spectral clustering. In: Ninth IEEE International Coference on Computer Vision, vol. 1, pp. 313–319, October 2003 Yu, S.X., Shi, J.: Multiclass spectral clustering. In: Ninth IEEE International Coference on Computer Vision, vol. 1, pp. 313–319, October 2003
22.
Zurück zum Zitat Zelnik-Manor, L., Perona, P.: Self-tuning spectral clustering. In: Advances in Neural Information Processing Systems (2004) Zelnik-Manor, L., Perona, P.: Self-tuning spectral clustering. In: Advances in Neural Information Processing Systems (2004)
Metadaten
Titel
A Fast MBO Scheme for Multiclass Data Classification
verfasst von
Matt Jacobs
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-58771-4_27

Premium Partner