Skip to main content
Erschienen in: Neural Computing and Applications 7-8/2013

01.06.2013 | Original Article

A novel margin-based twin support vector machine with unity norm hyperplanes

verfasst von: Yuan-Hai Shao, Nai-Yang Deng

Erschienen in: Neural Computing and Applications | Ausgabe 7-8/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

For classification problems, twin support vector machine (TWSVM) determines two nonparallel hyperplanes by solving two related SVM-type problems. TWSVM classifies binary patterns by the proximity of it to one of the two nonparallel hyperplanes. Thus, to calculate the distance of a pattern from the hyperplane, we need the unity norm of the normal vector of the hyperplane. But in the formulation of TWSVM, these equality constraints were not considered. In this paper, we consider unity norm constraints by using Euclidean norm and add a regularization term with the idea of maximizing some margin in TWSVM and propose a novel margin-based twin support vector machines with unity norm hyperplanes (UNH-MTSVM). We solved UNH-MTSVM by Newton’s method, and the solution is updated by conjugate gradient method. The performance of both the linear and nonlinear UNH-MTSVM is verified experimentally on several bench mark and synthetic datasets. Experimental results show the effectiveness of our methods in both computation time and classification accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cortes C, Vapnik VN (1995) Support vector networks. Mach Learn 20:273–297MATH Cortes C, Vapnik VN (1995) Support vector networks. Mach Learn 20:273–297MATH
2.
Zurück zum Zitat Burges C (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 2:121–167CrossRef Burges C (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 2:121–167CrossRef
3.
Zurück zum Zitat Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH
4.
Zurück zum Zitat Deng NY, Tian YJ, Zhang CH (2012) Support vector machines: theory, algorithms, and extensions. CRC Press, Boca Raton Deng NY, Tian YJ, Zhang CH (2012) Support vector machines: theory, algorithms, and extensions. CRC Press, Boca Raton
5.
Zurück zum Zitat Noble WS (2004) Kernel methods in computational biology. In: Support vector machine applications in computational biology, MIT Press, Cambridge, pp 71–92 Noble WS (2004) Kernel methods in computational biology. In: Support vector machine applications in computational biology, MIT Press, Cambridge, pp 71–92
6.
Zurück zum Zitat Lee S, Verri A (2002) Pattern recognition with support vector machines. In: First international workshop, Springer, Niagara Falls, Canada Lee S, Verri A (2002) Pattern recognition with support vector machines. In: First international workshop, Springer, Niagara Falls, Canada
7.
Zurück zum Zitat Ince H, Trafalis TB (2002) Support vector machine for regression and applications to financial forecasting, In: International joint conference on neural networks, Como, Italy, IEEE-INNS-ENNS Ince H, Trafalis TB (2002) Support vector machine for regression and applications to financial forecasting, In: International joint conference on neural networks, Como, Italy, IEEE-INNS-ENNS
9.
Zurück zum Zitat Mangasarian OL, Wild EW (2006) Multisurface proximal support vector classification via generalize deigenvalues. IEEE Trans Pattern Anal Machine Intell 28(1):69–74CrossRef Mangasarian OL, Wild EW (2006) Multisurface proximal support vector classification via generalize deigenvalues. IEEE Trans Pattern Anal Machine Intell 28(1):69–74CrossRef
10.
Zurück zum Zitat Jayadeva, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRef Jayadeva, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRef
11.
Zurück zum Zitat Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef
12.
Zurück zum Zitat Shao YH, Deng NY (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121MATHCrossRef Shao YH, Deng NY (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121MATHCrossRef
13.
Zurück zum Zitat Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29(13):1842–1848CrossRef Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29(13):1842–1848CrossRef
14.
15.
Zurück zum Zitat Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef
16.
Zurück zum Zitat Ghorai S, Mukherjee A, Dutta PK (2009) Nonparallel plane proximal classifier. Signal Process 89(4):510–522MATHCrossRef Ghorai S, Mukherjee A, Dutta PK (2009) Nonparallel plane proximal classifier. Signal Process 89(4):510–522MATHCrossRef
17.
Zurück zum Zitat Peng X (2010) A ν-twin support vector machine (ν-TSVM) classifier and its geometric algorithms. Inf Sci 180:3863–3875MATHCrossRef Peng X (2010) A ν-twin support vector machine (ν-TSVM) classifier and its geometric algorithms. Inf Sci 180:3863–3875MATHCrossRef
18.
Zurück zum Zitat Ghorai S, Hossian SJ, Mukherjee A, Dutta PK (2010) Unity norm twin support vector machine classifier. In: India Conference (INDICON), India, pp 1–4 Ghorai S, Hossian SJ, Mukherjee A, Dutta PK (2010) Unity norm twin support vector machine classifier. In: India Conference (INDICON), India, pp 1–4
19.
Zurück zum Zitat Ghorai S, Hossain SJ, Mukherjee A, Dutta PK (2010) Newton’s method for nonparallel plane proximal classifier. Signal Process 90:93–104MATHCrossRef Ghorai S, Hossain SJ, Mukherjee A, Dutta PK (2010) Newton’s method for nonparallel plane proximal classifier. Signal Process 90:93–104MATHCrossRef
20.
Zurück zum Zitat Peng X (2010) TSVR: an efficient twin support vector machine for regression. Neural Netw 23(3):365–372CrossRef Peng X (2010) TSVR: an efficient twin support vector machine for regression. Neural Netw 23(3):365–372CrossRef
23.
Zurück zum Zitat Nocedal J, Wright S (2006) Numerical optimization, (Chapter16). 2nd edn. Springer, Berlin Nocedal J, Wright S (2006) Numerical optimization, (Chapter16). 2nd edn. Springer, Berlin
24.
Zurück zum Zitat Bertsekas DP (1999) Nonlinear programming. 2nd edn. Athena Scientific, BelmontMATH Bertsekas DP (1999) Nonlinear programming. 2nd edn. Athena Scientific, BelmontMATH
25.
26.
27.
Zurück zum Zitat Bertsekas DP (1999) Nonlinear programming. 2nd edn. Athena Scientific, BelmontMATH Bertsekas DP (1999) Nonlinear programming. 2nd edn. Athena Scientific, BelmontMATH
28.
Zurück zum Zitat Lee YJ, Hsieh WF, Huang CM (2005) ε-SSVR: a smooth support vector machine for ε-insensitive regression. IEEE Trans Knowl Data Eng 17(5):678–685CrossRef Lee YJ, Hsieh WF, Huang CM (2005) ε-SSVR: a smooth support vector machine for ε-insensitive regression. IEEE Trans Knowl Data Eng 17(5):678–685CrossRef
29.
Zurück zum Zitat Burges C (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 2:1–43CrossRef Burges C (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 2:1–43CrossRef
30.
Zurück zum Zitat Schölkopf B, Smola A (2002) Learning with kernels. MIT Press, Cambridge Schölkopf B, Smola A (2002) Learning with kernels. MIT Press, Cambridge
31.
Zurück zum Zitat Lee Y, Mangasarian OL (2000) RSVM: reduced support vector machines. Data Mining Institute, Computer Science Department, University of Wisconsin, Madison, WI, Technical Report 00-07 Lee Y, Mangasarian OL (2000) RSVM: reduced support vector machines. Data Mining Institute, Computer Science Department, University of Wisconsin, Madison, WI, Technical Report 00-07
32.
Zurück zum Zitat Lin KM, Lin CJ (2003) A study on reduced support vector machines. IEEE Trans Neural Netw 14(6):1449–1459CrossRef Lin KM, Lin CJ (2003) A study on reduced support vector machines. IEEE Trans Neural Netw 14(6):1449–1459CrossRef
33.
Zurück zum Zitat Lee Y, Huang SY (2007) Reduced support vector machines: a statistical theory. IEEE Trans Neural Netw 18(1):1–13CrossRef Lee Y, Huang SY (2007) Reduced support vector machines: a statistical theory. IEEE Trans Neural Netw 18(1):1–13CrossRef
36.
Zurück zum Zitat Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New York Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New York
Metadaten
Titel
A novel margin-based twin support vector machine with unity norm hyperplanes
verfasst von
Yuan-Hai Shao
Nai-Yang Deng
Publikationsdatum
01.06.2013
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 7-8/2013
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-012-0894-5

Weitere Artikel der Ausgabe 7-8/2013

Neural Computing and Applications 7-8/2013 Zur Ausgabe