Skip to main content
Top
Published in: Neural Computing and Applications 4/2010

01-06-2010 | Original Article

A general graph-based semi-supervised learning with novel class discovery

Published in: Neural Computing and Applications | Issue 4/2010

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we propose a general graph-based semi-supervised learning algorithm. The core idea of our algorithm is to not only achieve the goal of semi-supervised learning, but also to discover the latent novel class in the data, which may be unlabeled by the user. Based on the normalized weights evaluated on data graph, our algorithm is able to output the probabilities of data points belonging to the labeled classes or the novel class. We also give the theoretical interpretations for the algorithm from three viewpoints on graph, i.e., regularization framework, label propagation, and Markov random walks. Experiments on toy examples and several benchmark datasets illustrate the effectiveness of our algorithm.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Zhu XJ (2006) Semi-supervised learning literature survey, Technical Report Computer Sciences 1530, University of Wisconsin-Madison Zhu XJ (2006) Semi-supervised learning literature survey, Technical Report Computer Sciences 1530, University of Wisconsin-Madison
2.
go back to reference Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: A geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7:2399–2434MathSciNet Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: A geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7:2399–2434MathSciNet
3.
go back to reference Blum A, Chawla S (2001) Learning from labeled and unlabeled data using graph mincuts. In: ICML, pp 19–26 Blum A, Chawla S (2001) Learning from labeled and unlabeled data using graph mincuts. In: ICML, pp 19–26
4.
go back to reference Joachims T (1999) Transductive inference for text classification using support vector machines. In: ICML, pp 200–209 Joachims T (1999) Transductive inference for text classification using support vector machines. In: ICML, pp 200–209
5.
go back to reference Szummer M, Jaakkola T (2001) Partially labeled classification with markov random walks. In: NIPS, pp 945–952 Szummer M, Jaakkola T (2001) Partially labeled classification with markov random walks. In: NIPS, pp 945–952
6.
go back to reference Chapelle O, Schölkopf B, Zien A (2006) Semi-supervised learning. MIT Press, Cambridge Chapelle O, Schölkopf B, Zien A (2006) Semi-supervised learning. MIT Press, Cambridge
7.
go back to reference Seeger M (2000) Learning with labeled and unlabeled data, Technical report, The University of Edinburgh Seeger M (2000) Learning with labeled and unlabeled data, Technical report, The University of Edinburgh
8.
go back to reference Belkin M, Matveeva I, Niyogi P (2004) Regularization and semi-supervised learning on large graphs. In: COLT, pp 624–638 Belkin M, Matveeva I, Niyogi P (2004) Regularization and semi-supervised learning on large graphs. In: COLT, pp 624–638
9.
go back to reference Chung FRK (1997) Spectral graph theory. In: CBMS regional conference series in mathematics, No. 92, American Mathematical Society Chung FRK (1997) Spectral graph theory. In: CBMS regional conference series in mathematics, No. 92, American Mathematical Society
10.
go back to reference Zhou D, Bousquet O, Lal TN, Weston J, Schölkopf B (2004) Learning with local and global consistency. In: NIPS Zhou D, Bousquet O, Lal TN, Weston J, Schölkopf B (2004) Learning with local and global consistency. In: NIPS
11.
go back to reference Zhu X, Ghahramani Z, Lafferty JD (2003) Semi-supervised learning using Gaussian fields and harmonic functions. In: ICML, pp 912–919 Zhu X, Ghahramani Z, Lafferty JD (2003) Semi-supervised learning using Gaussian fields and harmonic functions. In: ICML, pp 912–919
12.
go back to reference Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans PAMI 22(8):888–905 Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans PAMI 22(8):888–905
13.
go back to reference Zhou D, Schölkopf B (2004) Learning from labeled and unlabeled data using random walks. In: DAGM-symposium, pp 237–244 Zhou D, Schölkopf B (2004) Learning from labeled and unlabeled data using random walks. In: DAGM-symposium, pp 237–244
14.
go back to reference Chapelle O, Zien A (2005) Semi-supervised classification by low density separation. In: The tenth international workshop on artificial intelligence and statistics Chapelle O, Zien A (2005) Semi-supervised classification by low density separation. In: The tenth international workshop on artificial intelligence and statistics
15.
go back to reference Chapelle O, Weston J, Schölkopf B (2002) Cluster kernels for semi-supervised learning. In: NIPS, pp 585–592 Chapelle O, Weston J, Schölkopf B (2002) Cluster kernels for semi-supervised learning. In: NIPS, pp 585–592
16.
go back to reference Spielman DA, Teng SH (2004) Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems. In: Annual ACM symposium on theory of computing Spielman DA, Teng SH (2004) Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems. In: Annual ACM symposium on theory of computing
Metadata
Title
A general graph-based semi-supervised learning with novel class discovery
Publication date
01-06-2010
Published in
Neural Computing and Applications / Issue 4/2010
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-009-0305-8

Other articles of this Issue 4/2010

Neural Computing and Applications 4/2010 Go to the issue

Premium Partner