Skip to main content
Top
Published in: Wireless Personal Communications 1/2018

05-02-2018

Weighted Least Squares Support Vector Machine for Semi-supervised Classification

Authors: Zhanwei Liu, Houquan Liu, Zhikai Zhao

Published in: Wireless Personal Communications | Issue 1/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The recently proposed semi-supervised least squares support vector machine (SLS-SVM), extends support vector machine (SVM) to semi-supervised learning field. However, the support value in SLS-SVM is not zero and the solution is lack of sparseness. To overcome this drawback, a weighted semi-supervised SLS-SVM (WSLS-SVM) is proposed in this paper, where the impact of labeled and unlabeled samples can be controlled by weighting the corresponding error. It is basically a pruning method according to the sorted weight of estimation error. To solve the proposed classifier, an efficient progressive learning algorithm is presented to reduce the iteration. Experimental results on several benchmarks data sets confirm the sparseness and the effectiveness of the proposed method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Hirai, H., Murota, K., & Rikitoku, M. (2017). Electric network classifiers for semi-supervised learning on graphs. Journal of the Operations Research Society of Japan, 50(3), 219–232.MathSciNetCrossRef Hirai, H., Murota, K., & Rikitoku, M. (2017). Electric network classifiers for semi-supervised learning on graphs. Journal of the Operations Research Society of Japan, 50(3), 219–232.MathSciNetCrossRef
2.
go back to reference Chapelle, O., Sindhwani, V., & Keerthi, S. S. (2008). Optimization techniques for semi-supervised support vector machines. Journal of Machine Learning Research, 9(1), 203–233.MATH Chapelle, O., Sindhwani, V., & Keerthi, S. S. (2008). Optimization techniques for semi-supervised support vector machines. Journal of Machine Learning Research, 9(1), 203–233.MATH
3.
go back to reference Li, Y. F., & Zhou, Z. H. (2015). Towards making unlabeled data never hurt. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(1), 175–188.CrossRef Li, Y. F., & Zhou, Z. H. (2015). Towards making unlabeled data never hurt. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(1), 175–188.CrossRef
4.
go back to reference Li, Y. F., Tsang, I. W., Kwok, J. T., et al. (2013). Convex and scalable weakly labeled SVMs. Journal of Machine Learning Research, 14(1), 2151–2188.MathSciNetMATH Li, Y. F., Tsang, I. W., Kwok, J. T., et al. (2013). Convex and scalable weakly labeled SVMs. Journal of Machine Learning Research, 14(1), 2151–2188.MathSciNetMATH
5.
go back to reference Singla, A., Patra, S., & Bruzzone, L. (2014). A novel classification technique based on progressive transductive SVM learning. Pattern Recognition Letters, 42(1), 101–106.CrossRef Singla, A., Patra, S., & Bruzzone, L. (2014). A novel classification technique based on progressive transductive SVM learning. Pattern Recognition Letters, 42(1), 101–106.CrossRef
6.
go back to reference Tian, Y., & Luo, J. (2017). A new branch-and-bound approach to semi-supervised support vector machine. Soft Computing, 21(1), 245–254.MathSciNetCrossRef Tian, Y., & Luo, J. (2017). A new branch-and-bound approach to semi-supervised support vector machine. Soft Computing, 21(1), 245–254.MathSciNetCrossRef
7.
go back to reference Bai, Y., & Yan, X. (2016). Conic relaxations for semi-supervised support vector machines. Journal of Optimization Theory and Applications, 169(1), 299–313.MathSciNetCrossRef Bai, Y., & Yan, X. (2016). Conic relaxations for semi-supervised support vector machines. Journal of Optimization Theory and Applications, 169(1), 299–313.MathSciNetCrossRef
8.
go back to reference Adankon, M. M., & Cheriet, M. (2010). Genetic algorithm–based training for semi-supervised SVM. Neural Computing and Applications, 19(8), 1197–1206.CrossRef Adankon, M. M., & Cheriet, M. (2010). Genetic algorithm–based training for semi-supervised SVM. Neural Computing and Applications, 19(8), 1197–1206.CrossRef
9.
go back to reference Gieseke, F., Airola, A., Pahikkala, T., et al. (2014). Fast and simple gradient-based optimization for semi-supervised support vector machines. Neurocomputing, 123(1), 23–32.CrossRef Gieseke, F., Airola, A., Pahikkala, T., et al. (2014). Fast and simple gradient-based optimization for semi-supervised support vector machines. Neurocomputing, 123(1), 23–32.CrossRef
10.
go back to reference Reddy, I. S., Shevade, S., & Murty, M. N. (2011). A fast quasi-Newton method for semi-supervised SVM. Pattern Recognition, 44(10), 2305–2313.CrossRef Reddy, I. S., Shevade, S., & Murty, M. N. (2011). A fast quasi-Newton method for semi-supervised SVM. Pattern Recognition, 44(10), 2305–2313.CrossRef
11.
go back to reference Gestel, T., Suykens, J., et al. (2004). Benchmarking least squares support vector machine classifiers. Machine Learning, 54(1), 5–32.CrossRef Gestel, T., Suykens, J., et al. (2004). Benchmarking least squares support vector machine classifiers. Machine Learning, 54(1), 5–32.CrossRef
12.
go back to reference Adankon, M. M., Cheriet, M., & Biem, A. (2009). Semisupervised least squares support vector machine. IEEE Transactions on Neural Networks, 20(12), 1858.CrossRef Adankon, M. M., Cheriet, M., & Biem, A. (2009). Semisupervised least squares support vector machine. IEEE Transactions on Neural Networks, 20(12), 1858.CrossRef
13.
go back to reference Zhang, R., Wang, W., Ma, Y., et al. (2009). Least square transduction support vector machine. Neural Process Letters, 29(2), 133–142.CrossRef Zhang, R., Wang, W., Ma, Y., et al. (2009). Least square transduction support vector machine. Neural Process Letters, 29(2), 133–142.CrossRef
14.
go back to reference Ding, S., Hua, X., & Yu, J. (2014). An overview on nonparallel hyperplane support vector machine algorithms. Neural Computing and Applications, 25(5), 975–982.CrossRef Ding, S., Hua, X., & Yu, J. (2014). An overview on nonparallel hyperplane support vector machine algorithms. Neural Computing and Applications, 25(5), 975–982.CrossRef
15.
go back to reference Yang, L., Yang, S., Zhang, R., et al. (2014). Sparse least square support vector machine via coupled compressive pruning. Neurocomputing, 131(9), 77–86.CrossRef Yang, L., Yang, S., Zhang, R., et al. (2014). Sparse least square support vector machine via coupled compressive pruning. Neurocomputing, 131(9), 77–86.CrossRef
16.
go back to reference Jiao, L., Bo, L., & Wang, L. (2007). Fast sparse approximation for least square support vector machine. IEEE Transactions on Neural Networks, 18(3), 685–697.CrossRef Jiao, L., Bo, L., & Wang, L. (2007). Fast sparse approximation for least square support vector machine. IEEE Transactions on Neural Networks, 18(3), 685–697.CrossRef
Metadata
Title
Weighted Least Squares Support Vector Machine for Semi-supervised Classification
Authors
Zhanwei Liu
Houquan Liu
Zhikai Zhao
Publication date
05-02-2018
Publisher
Springer US
Published in
Wireless Personal Communications / Issue 1/2018
Print ISSN: 0929-6212
Electronic ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-018-5478-y

Other articles of this Issue 1/2018

Wireless Personal Communications 1/2018 Go to the issue