Skip to main content
Erschienen in: Neural Computing and Applications 5/2014

01.10.2014 | Original Article

ν-Nonparallel support vector machine for pattern classification

verfasst von: Yingjie Tian, Qin Zhang, Dalian Liu

Erschienen in: Neural Computing and Applications | Ausgabe 5/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a novel nonparallel hyperplane classifier, named ν-nonparallel support vector machine (ν-NPSVM), for binary classification. Based on our recently proposed method, i.e., nonparallel support vector machine (NPSVM), which has been proved superior to the twin support vector machines, ν-NPSVM is parameterized by the quantity ν to let ones effectively control the number of support vectors. By combining the ν-support vector classification and the ν-support vector regression together to construct the primal problems, ν-NPSVM inherits the advantages of ν-support vector machine so that enables us to eliminate one of the other free parameters of the NPSVM: the accuracy parameter ε and the regularization constant C. We describe the algorithm, give some theoretical results concerning the meaning and the choice of ν, and also report the experimental results on lots of data sets to show the effectiveness of our method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cortes C, Vapnik VN (1995) Support-vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik VN (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
2.
Zurück zum Zitat Vapnik VN (1996) The nature of statistical learning theory. Springer, New York Vapnik VN (1996) The nature of statistical learning theory. Springer, New York
3.
Zurück zum Zitat Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH
4.
Zurück zum Zitat Burges C (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2:121–167CrossRef Burges C (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2:121–167CrossRef
5.
Zurück zum Zitat Deng NY, Tian YJ, Zhang CH (2012) Support vector machines: optimization based theory, algorithms, and extensions. Chapman and Hall/CRC, London Deng NY, Tian YJ, Zhang CH (2012) Support vector machines: optimization based theory, algorithms, and extensions. Chapman and Hall/CRC, London
6.
Zurück zum Zitat Trafalis TB, Ince H (2000) Support vector machine for regression and applications to financial forecasting. In: Proceedings of IEEE-INNSENNS international joint conference neural networks, vol 6, pp 348–353 Trafalis TB, Ince H (2000) Support vector machine for regression and applications to financial forecasting. In: Proceedings of IEEE-INNSENNS international joint conference neural networks, vol 6, pp 348–353
7.
Zurück zum Zitat Li S, Kwok JT, Zhu H, Wang Y (2003) Texture classification using the support vector machines. Pattern Recogn 36(12):2883–2893CrossRefMATH Li S, Kwok JT, Zhu H, Wang Y (2003) Texture classification using the support vector machines. Pattern Recogn 36(12):2883–2893CrossRefMATH
8.
Zurück zum Zitat Wu YC, Lee YS, Yang JC (2008) Robust and efficient multiclass SVM models for phrase pattern recognition. Pattern Recogn 41(9):2874–2889CrossRefMATH Wu YC, Lee YS, Yang JC (2008) Robust and efficient multiclass SVM models for phrase pattern recognition. Pattern Recogn 41(9):2874–2889CrossRefMATH
9.
Zurück zum Zitat Isa D, Lee LH, Kallimani VP, RajKumar R (2008) Text document preprocessing with the Bayes formula for classification using the support vector machine. IEEE Trans Knowl Data Eng 20(9):1264–1272CrossRef Isa D, Lee LH, Kallimani VP, RajKumar R (2008) Text document preprocessing with the Bayes formula for classification using the support vector machine. IEEE Trans Knowl Data Eng 20(9):1264–1272CrossRef
10.
Zurück zum Zitat Karsten MB (2011) Kernel methods in bioinformatics. Handb Stat Bioinform Part 3:317–334 Karsten MB (2011) Kernel methods in bioinformatics. Handb Stat Bioinform Part 3:317–334
11.
Zurück zum Zitat Wang XY, Wang T, Bu J (2011) Color image segmentation using pixel wise support vector machine classification. Pattern Recogn 44(4):777–787CrossRefMATH Wang XY, Wang T, Bu J (2011) Color image segmentation using pixel wise support vector machine classification. Pattern Recogn 44(4):777–787CrossRefMATH
12.
Zurück zum Zitat Khan N, Ksantini R, Ahmad I, Boufama B (2012) A novel SVM+ NDA model for classification with an application to face recognition. Pattern Recogn 45(1):66–79CrossRefMATH Khan N, Ksantini R, Ahmad I, Boufama B (2012) A novel SVM+ NDA model for classification with an application to face recognition. Pattern Recogn 45(1):66–79CrossRefMATH
13.
Zurück zum Zitat Mangasarian OL, Wild EW (2006) Multisurface proximal support vector classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef Mangasarian OL, Wild EW (2006) Multisurface proximal support vector classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef
14.
Zurück zum Zitat Jayadeva RK, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRef Jayadeva RK, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRef
15.
Zurück zum Zitat Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29(13):1842–1848CrossRef Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29(13):1842–1848CrossRef
16.
Zurück zum Zitat Khemchandani R, Jayadeva RK, Chandra S (2009) Optimal kernel selection in twin support vector machines. Optim Lett 3(1):77–88MathSciNetCrossRefMATH Khemchandani R, Jayadeva RK, Chandra S (2009) Optimal kernel selection in twin support vector machines. Optim Lett 3(1):77–88MathSciNetCrossRefMATH
17.
Zurück zum Zitat Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef
18.
Zurück zum Zitat Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef
19.
Zurück zum Zitat Shao YH, Deng NY (2013) A novel margin-based twin support vector machine with unity norm hyperplanes. Neural Comput Appl 22:1627–1635CrossRef Shao YH, Deng NY (2013) A novel margin-based twin support vector machine with unity norm hyperplanes. Neural Comput Appl 22:1627–1635CrossRef
20.
Zurück zum Zitat Shao Y-H, Deng N-Y (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121CrossRefMATH Shao Y-H, Deng N-Y (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121CrossRefMATH
21.
Zurück zum Zitat Peng XJ (2010) Tsvr: An efficient twin support vector machine for regression. Neural Netw 23(3):365–372CrossRef Peng XJ (2010) Tsvr: An efficient twin support vector machine for regression. Neural Netw 23(3):365–372CrossRef
23.
Zurück zum Zitat Qi ZQ, Tian YJ, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53CrossRefMATH Qi ZQ, Tian YJ, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53CrossRefMATH
24.
Zurück zum Zitat Qi ZQ, Tian YJ, Shi Y (2012) Twin support vector machine with universum data. Neural Netw 36:112–119CrossRefMATH Qi ZQ, Tian YJ, Shi Y (2012) Twin support vector machine with universum data. Neural Netw 36:112–119CrossRefMATH
25.
Zurück zum Zitat Qi ZQ, Tian YJ, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46:305–316CrossRefMATH Qi ZQ, Tian YJ, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46:305–316CrossRefMATH
26.
Zurück zum Zitat Qi ZQ, Tian YJ, Shi Y (2013) Structural twin support vector machine for classification. Knowl-Based Syst 43:74–81CrossRef Qi ZQ, Tian YJ, Shi Y (2013) Structural twin support vector machine for classification. Knowl-Based Syst 43:74–81CrossRef
27.
Zurück zum Zitat Tian YJ, Shi Y, Liu XH (2012) Recent advances on support vector machines research. Technol Econ Dev Econ 18:5–33CrossRef Tian YJ, Shi Y, Liu XH (2012) Recent advances on support vector machines research. Technol Econ Dev Econ 18:5–33CrossRef
31.
Zurück zum Zitat Platt J (2000) Fast training of support vector machines using sequential minimal optimization. In: Schölkopf B, Burges CJC, Smola AJ (eds) Advances in kernel methods—support vector learning. MIT Press, Cambridge Platt J (2000) Fast training of support vector machines using sequential minimal optimization. In: Schölkopf B, Burges CJC, Smola AJ (eds) Advances in kernel methods—support vector learning. MIT Press, Cambridge
32.
Zurück zum Zitat Williamson RC, Scholkopf B, Smola A, Bartlett PL (2000) New support vector algorithms. Neural Comput 12:1207–1245CrossRef Williamson RC, Scholkopf B, Smola A, Bartlett PL (2000) New support vector algorithms. Neural Comput 12:1207–1245CrossRef
Metadaten
Titel
ν-Nonparallel support vector machine for pattern classification
verfasst von
Yingjie Tian
Qin Zhang
Dalian Liu
Publikationsdatum
01.10.2014
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 5/2014
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-014-1575-3

Weitere Artikel der Ausgabe 5/2014

Neural Computing and Applications 5/2014 Zur Ausgabe