Skip to main content

2016 | OriginalPaper | Buchkapitel

10. Case Study of Network-Based Semi-Supervised Learning: Stochastic Competitive-Cooperative Learning in Networks

verfasst von : Thiago Christiano Silva, Liang Zhao

Erschienen in: Machine Learning in Complex Networks

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Information reaches us at a remarkable speed and the amount of data it brings is unprecedented. In many situations, only a small subset of data items can be effectively labeled. This is because the labeling process is often expensive, time consuming, and requires intensive human involvement. As a result, partially labeled data sets are more frequently encountered. In order to get a better characterization of partially labeled data sets, semi-supervised classifiers are designed to learn from both labeled and unlabeled data. It has turned out to be a new topic of machine learning research that has received increasing attention in the past years. In this chapter, the semi-supervised classification with focus on methods based on complex networks is explored. In special, the particle competition model that we have introduced in the previous chapter is adapted to this new learning paradigm. Specifically, this enhancement is achieved by introducing the idea of cooperation among the particles and by changing the inner mechanisms of the original algorithm so as to fit it into a semi-supervised environment. In contrast to the unsupervised learning model, where the particles are randomly spawned in the network because no prior analysis of the groups is available, the semi-supervised learning version does have some external knowledge by definition. This knowledge is represented by the labeled data items, usually offered as a small fraction of the entire data set. In this scenario, the objective is to propagate the labels from the labeled set to the unlabeled set. Likewise the previous chapter, a mathematical formalization of the model, as well as a theoretical analysis, is also provided. A great portion of this analysis is based on the model that we have studied in the last chapter. A validation is also presented linking the numerical and theoretical results. An application in imperfect data learning is also presented, where the particle competition model is employed to detect and prevent error propagation in the learning process due to noisy or wrongly labeled data .

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The indirect competition among particles occurs by the accumulated domination levels of each vertex and by the particles’ movement policy.
 
Literatur
1.
Zurück zum Zitat Amini, M.R., Gallinari, P.: Semi-supervised learning with explicit misclassification modeling. In: Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI), pp. 555–560. Morgan Kaufmann, San Francisco (2003) Amini, M.R., Gallinari, P.: Semi-supervised learning with explicit misclassification modeling. In: Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI), pp. 555–560. Morgan Kaufmann, San Francisco (2003)
2.
Zurück zum Zitat Amini, M.R., Gallinari, P.: Semi-supervised learning with an imperfect supervisor. Knowl. Inf. Syst. 8(4), 385–413 (2005)CrossRef Amini, M.R., Gallinari, P.: Semi-supervised learning with an imperfect supervisor. Knowl. Inf. Syst. 8(4), 385–413 (2005)CrossRef
3.
Zurück zum Zitat Breve, F., Zhao, L., Quiles, M.G., Pedrycz, W., Liu, J.: Particles competition and cooperation in networks for semi-supervised learning. IEEE Trans. Data Knowl. Eng. 24, 1686–1698 (2010)CrossRef Breve, F., Zhao, L., Quiles, M.G., Pedrycz, W., Liu, J.: Particles competition and cooperation in networks for semi-supervised learning. IEEE Trans. Data Knowl. Eng. 24, 1686–1698 (2010)CrossRef
4.
Zurück zum Zitat Breve, F.A., Zhao, L., Quiles, M.G.: Particle competition and cooperation for semi-supervised learning with label noise. Neurocomputing 160, 63–72 (2015)CrossRef Breve, F.A., Zhao, L., Quiles, M.G.: Particle competition and cooperation for semi-supervised learning with label noise. Neurocomputing 160, 63–72 (2015)CrossRef
5.
Zurück zum Zitat Chapelle, O., Schölkopf, B., Zien, A. (eds.): Semi-supervised learning. Adaptive Computation and Machine Learning. MIT, Cambridge (2006) Chapelle, O., Schölkopf, B., Zien, A. (eds.): Semi-supervised learning. Adaptive Computation and Machine Learning. MIT, Cambridge (2006)
6.
Zurück zum Zitat Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetMATH Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetMATH
7.
Zurück zum Zitat Lichman, M.: UCI Machine Learning, Repository University of California, Irvine, School of Information and Computer Sciences, University of California, Irvine (2013) Lichman, M.: UCI Machine Learning, Repository University of California, Irvine, School of Information and Computer Sciences, University of California, Irvine (2013)
8.
Zurück zum Zitat Hartono, P., Hashimoto, S.: Learning from imperfect data. Appl. Soft Comput. 7(1), 353–363 (2007)CrossRef Hartono, P., Hashimoto, S.: Learning from imperfect data. Appl. Soft Comput. 7(1), 353–363 (2007)CrossRef
9.
Zurück zum Zitat Lancichinetti, A., Fortunato, S., Radicchi, F.: Benchmark graphs for testing community detection algorithms. Phys. Rev. E 78(4), 046110(1–5) (2008) Lancichinetti, A., Fortunato, S., Radicchi, F.: Benchmark graphs for testing community detection algorithms. Phys. Rev. E 78(4), 046110(1–5) (2008)
10.
Zurück zum Zitat Silva, T.C., Zhao, L.: Detecting error propagation via competitive learning. Procedia Comput. Sci. 13, 37–42 (2012)CrossRef Silva, T.C., Zhao, L.: Detecting error propagation via competitive learning. Procedia Comput. Sci. 13, 37–42 (2012)CrossRef
11.
Zurück zum Zitat Silva, T.C., Zhao, L.: Network-based stochastic semisupervised learning. IEEE Trans. Neural Netw. Learn. Syst. 23(3), 451–466 (2012)CrossRef Silva, T.C., Zhao, L.: Network-based stochastic semisupervised learning. IEEE Trans. Neural Netw. Learn. Syst. 23(3), 451–466 (2012)CrossRef
12.
Zurück zum Zitat Silva, T.C., Zhao, L.: Detecting and preventing error propagation via competitive learning. Neural Netw. 41, 70–84 (2013)CrossRefMATH Silva, T.C., Zhao, L.: Detecting and preventing error propagation via competitive learning. Neural Netw. 41, 70–84 (2013)CrossRefMATH
13.
Zurück zum Zitat Wang, F., Zhang, C.: Label propagation through linear neighborhoods. IEEE Trans. Knowl. Data Eng. 20(1), 55–67 (2008)CrossRef Wang, F., Zhang, C.: Label propagation through linear neighborhoods. IEEE Trans. Knowl. Data Eng. 20(1), 55–67 (2008)CrossRef
14.
Zurück zum Zitat Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Schölkopf, B.: Learning with local and global consistency. In: Advances in Neural Information Processing Systems, vol. 16, pp. 321–328. MIT, Cambridge (2004) Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Schölkopf, B.: Learning with local and global consistency. In: Advances in Neural Information Processing Systems, vol. 16, pp. 321–328. MIT, Cambridge (2004)
Metadaten
Titel
Case Study of Network-Based Semi-Supervised Learning: Stochastic Competitive-Cooperative Learning in Networks
verfasst von
Thiago Christiano Silva
Liang Zhao
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-17290-3_10