Skip to main content

2016 | OriginalPaper | Buchkapitel

Semi-supervised Support Vector Machines - A Genetic Algorithm Approach

verfasst von : Gergana Lazarova

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Semi-supervised learning combines both labeled and unlabeled examples in order to find better future predictions. Semi-supervised support vector machines (SSSVM) present a non-convex optimization problem. In this paper a genetic algorithm is used to optimize the non-convex error - GSSSVM. It is experimented with multiple datasets and the performance of the genetic algorithm is compared to its supervised equivalent and shows very good results. A tailor-made modification of the genetic algorithm is also proposed which uses less unlabeled examples – the closest neighbors of the labeled instances.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chapelle, O., Schölkopf, B., Zien, A.: Semi-supervised Learning. MIT Press, Cambridge (2006)CrossRef Chapelle, O., Schölkopf, B., Zien, A.: Semi-supervised Learning. MIT Press, Cambridge (2006)CrossRef
2.
Zurück zum Zitat Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the eleventh Annual Conference on Computational Learning Theory, pp. 92–100 (1998) Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the eleventh Annual Conference on Computational Learning Theory, pp. 92–100 (1998)
3.
Zurück zum Zitat Tang, F., Brennan, S., Zhao, Q., Tao, H.: Co-tracking using semi-supervised support vector machines. In: IEEE 11th International Conference on Computer Vision ICCV 2007, vol. 14, pp. 1–8 (2007) Tang, F., Brennan, S., Zhao, Q., Tao, H.: Co-tracking using semi-supervised support vector machines. In: IEEE 11th International Conference on Computer Vision ICCV 2007, vol. 14, pp. 1–8 (2007)
4.
Zurück zum Zitat Chapelle, O., Vapnik, V., Bousquet, O., Mukherjee, S.: Choosing multiple parameters for support vector machines. Mach. Learn. 46, 131–159 (2002)CrossRefMATH Chapelle, O., Vapnik, V., Bousquet, O., Mukherjee, S.: Choosing multiple parameters for support vector machines. Mach. Learn. 46, 131–159 (2002)CrossRefMATH
5.
Zurück zum Zitat Brefeld, U., Scheffer, T.: Co-EM support vector learning. In: Proceedings of the Twenty-First International Conference on Machine learning, p. 16 (2004) Brefeld, U., Scheffer, T.: Co-EM support vector learning. In: Proceedings of the Twenty-First International Conference on Machine learning, p. 16 (2004)
6.
Zurück zum Zitat Bennett, K., Demiriz, A.: Semi-supervised support vector machines. Adv. Neural Inf. Process. Syst. 368–374 (1999) Bennett, K., Demiriz, A.: Semi-supervised support vector machines. Adv. Neural Inf. Process. Syst. 368–374 (1999)
7.
Zurück zum Zitat Fung, G., Mangasarian, O.: Semi-supervised support vector machines for unlabeled data classification. Optim. Methods Softw. 15, 29–44 (2001)CrossRefMATH Fung, G., Mangasarian, O.: Semi-supervised support vector machines for unlabeled data classification. Optim. Methods Softw. 15, 29–44 (2001)CrossRefMATH
8.
Zurück zum Zitat Chapelle, O., Sindhwani, V., Keerthi, S.S.: Optimization techniques for semi-supervised support vector machines. J. Mach. Learn. Res. 9, 203–233 (2008)MATH Chapelle, O., Sindhwani, V., Keerthi, S.S.: Optimization techniques for semi-supervised support vector machines. J. Mach. Learn. Res. 9, 203–233 (2008)MATH
9.
Zurück zum Zitat Zhu, X., Goldberg, A.: Introduction to Semi-supervised Learning: Synthesis Lectures on Artificial Intelligence and Machine Learning. Morgan and Claypool Publishers, San Rafael (2009) Zhu, X., Goldberg, A.: Introduction to Semi-supervised Learning: Synthesis Lectures on Artificial Intelligence and Machine Learning. Morgan and Claypool Publishers, San Rafael (2009)
10.
Zurück zum Zitat Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, Cambridge (1998)MATH Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, Cambridge (1998)MATH
11.
Zurück zum Zitat Golberg, D.: Genetic algorithms in search, optimization, and machine learning. Addison wesley, Boston (1989) Golberg, D.: Genetic algorithms in search, optimization, and machine learning. Addison wesley, Boston (1989)
12.
Zurück zum Zitat Whiteley, D.: Applying genetic algorithms to neural network problems. Neural Netw. 1, 230 (1988)CrossRef Whiteley, D.: Applying genetic algorithms to neural network problems. Neural Netw. 1, 230 (1988)CrossRef
13.
Zurück zum Zitat Bache, K., Lichman, M.: UCI Machine Learning Repository (2013) Bache, K., Lichman, M.: UCI Machine Learning Repository (2013)
14.
Zurück zum Zitat Farquhar, J., Hardoon, D., Meng, H., Shawe-taylor, J., Szedmak, S.: Two view learning: SVM-2K, theory and practice. In: Advances in neural information processing systems, pp. 355–362 (2005) Farquhar, J., Hardoon, D., Meng, H., Shawe-taylor, J., Szedmak, S.: Two view learning: SVM-2K, theory and practice. In: Advances in neural information processing systems, pp. 355–362 (2005)
15.
Zurück zum Zitat Lazarova, G.: Semi-supervised image segmentation. In: Agre, G., Hitzler, P., Krisnadhi, A.A., Kuznetsov, S.O. (eds.) Artificial Intelligence: Methodology, Systems, and Applications. Lecture Notes in Computer Science, vol. 8722, pp. 59–68. Springer, Heidelberg (2014) Lazarova, G.: Semi-supervised image segmentation. In: Agre, G., Hitzler, P., Krisnadhi, A.A., Kuznetsov, S.O. (eds.) Artificial Intelligence: Methodology, Systems, and Applications. Lecture Notes in Computer Science, vol. 8722, pp. 59–68. Springer, Heidelberg (2014)
16.
Zurück zum Zitat Lazarova, G.: Semi-supervised Multi-view Sentiment Analysis. In: Núñez, M., Nguyen, N.T., Camacho, D., Trawiński, B. (eds.) Computational Collective Intelligence 2015. Lecture Notes in Computer Science, vol. 9329, pp. 181–190. Springer, Heidelberg (2014)CrossRef Lazarova, G.: Semi-supervised Multi-view Sentiment Analysis. In: Núñez, M., Nguyen, N.T., Camacho, D., Trawiński, B. (eds.) Computational Collective Intelligence 2015. Lecture Notes in Computer Science, vol. 9329, pp. 181–190. Springer, Heidelberg (2014)CrossRef
17.
Zurück zum Zitat Joachims, T.: Transductive inference for text classification using support vector machines. In: ICML, pp. 200–209 (1999) Joachims, T.: Transductive inference for text classification using support vector machines. In: ICML, pp. 200–209 (1999)
18.
Zurück zum Zitat Chapelle, O., Zien, A.: Semi-supervised classification by low density separation. In: AISTATS, pp. 57–64 (2005) Chapelle, O., Zien, A.: Semi-supervised classification by low density separation. In: AISTATS, pp. 57–64 (2005)
19.
Zurück zum Zitat Chapelle, O., Chi, M., Zien A.: A continuation method for semi-supervised SVMs. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 185–192 (2006) Chapelle, O., Chi, M., Zien A.: A continuation method for semi-supervised SVMs. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 185–192 (2006)
20.
Zurück zum Zitat Sindhwani, V., Keerthi, S.S., Chapelle, O.: Deterministic annealing for semi-supervised kernel machines. In Proceedings of the 23rd International Conference on Machine Learning, pp. 841–848 (2006) Sindhwani, V., Keerthi, S.S., Chapelle, O.: Deterministic annealing for semi-supervised kernel machines. In Proceedings of the 23rd International Conference on Machine Learning, pp. 841–848 (2006)
21.
Zurück zum Zitat Chapelle, O., Sindhwani, V., Keerthi, S.: Branch and bound for semi-supervised support vector machines. In: Advances in Neural Information Processing Systems, pp. 217–224 (2006) Chapelle, O., Sindhwani, V., Keerthi, S.: Branch and bound for semi-supervised support vector machines. In: Advances in Neural Information Processing Systems, pp. 217–224 (2006)
Metadaten
Titel
Semi-supervised Support Vector Machines - A Genetic Algorithm Approach
verfasst von
Gergana Lazarova
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46672-9_28