Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 5/2016

01.10.2016 | Original Article

Multiple recursive projection twin support vector machine for multi-class classification

verfasst von: Chun-Na Li, Yun-Feng Huang, He-Ji Wu, Yuan-Hai Shao, Zhi-Min Yang

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 5/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

For multi-class classification problem, a novel multiple projection twin support vector machine (Multi-PTSVM) is proposed. Our Multi-PTSVM solves \(K\) quadratic programming problems (QPPs) to obtain \(K\) projection axes, which is similar to binary PTSVM, but the regularization terms and recursive procedure are introduced for each class, which improve the generalization ability greatly. Comparisons against the Multi-SVM, Multi-TWSVM, Multi-GEPSVM, and our Multi-PTSVM on both synthetic and benchmark datasets indicate that our Multi-PTSVM has its advantages.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
2.
Zurück zum Zitat Arun Kumar M, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef Arun Kumar M, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef
3.
Zurück zum Zitat Bishop CM (2006) Pattern recognition and machine learning. Springer, New YorkMATH Bishop CM (2006) Pattern recognition and machine learning. Springer, New YorkMATH
5.
Zurück zum Zitat Chang CC, Lin CJ (2011) A library for support vector machines. ACM Trans Intell Syst Technol 2:1–27 Chang CC, Lin CJ (2011) A library for support vector machines. ACM Trans Intell Syst Technol 2:1–27
6.
Zurück zum Zitat Chen WJ, Shao YH, Hong N (2014) Laplacian smooth twin support vector machine for semi-supervised classification. Int J Mach Learn Cybern 5(3):459–468CrossRef Chen WJ, Shao YH, Hong N (2014) Laplacian smooth twin support vector machine for semi-supervised classification. Int J Mach Learn Cybern 5(3):459–468CrossRef
7.
Zurück zum Zitat Chen X, Yang J, Ye Q, Liang J (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655CrossRefMATH Chen X, Yang J, Ye Q, Liang J (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655CrossRefMATH
8.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297MATH
9.
Zurück zum Zitat Deng NY, Tian YJ, Zhang CH (2012) Support vector machines: theory, algorithms, and extensions. CRC Press, Boca RatonMATH Deng NY, Tian YJ, Zhang CH (2012) Support vector machines: theory, algorithms, and extensions. CRC Press, Boca RatonMATH
10.
Zurück zum Zitat Ding S, Hua X (2014) Recursive least squares projection twin support vector machines for nonlinear classification. Neurocomputing 130:3–9CrossRef Ding S, Hua X (2014) Recursive least squares projection twin support vector machines for nonlinear classification. Neurocomputing 130:3–9CrossRef
11.
Zurück zum Zitat Ghorai S, Mukherjee A, Dutta PK (2009) Nonparallel plane proximal classifier. Signal Process 89(4):510–522CrossRefMATH Ghorai S, Mukherjee A, Dutta PK (2009) Nonparallel plane proximal classifier. Signal Process 89(4):510–522CrossRefMATH
12.
Zurück zum Zitat Jayadeva R, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRefMATH Jayadeva R, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRefMATH
13.
14.
Zurück zum Zitat Lee Y, Lin Y, Wahba G (2004) Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data. J Am Stat Assoc 99(465):67–81MathSciNetCrossRefMATH Lee Y, Lin Y, Wahba G (2004) Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data. J Am Stat Assoc 99(465):67–81MathSciNetCrossRefMATH
15.
Zurück zum Zitat Mangasarian OL, Wild EW (2006) Multisurface proximal support vector classification via generalize eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef Mangasarian OL, Wild EW (2006) Multisurface proximal support vector classification via generalize eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef
16.
Zurück zum Zitat Nene SA, Nayar SK, Murase H (1996) Columbia object image library (coil-20). In: Technical Report CUCS-005-96, Columbia University, New York Nene SA, Nayar SK, Murase H (1996) Columbia object image library (coil-20). In: Technical Report CUCS-005-96, Columbia University, New York
17.
Zurück zum Zitat Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRefMATH Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRefMATH
18.
Zurück zum Zitat Qi Z, Tian YJ, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53CrossRefMATH Qi Z, Tian YJ, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53CrossRefMATH
19.
Zurück zum Zitat Qi Z, Tian YJ, Shi Y (2012) Twin support vector machine with universum data. Neural Netw 36:112–119CrossRefMATH Qi Z, Tian YJ, Shi Y (2012) Twin support vector machine with universum data. Neural Netw 36:112–119CrossRefMATH
20.
Zurück zum Zitat Scholkopf B, Smola A (2002) Learning with Kernels. MIT Press, MA CambridgeMATH Scholkopf B, Smola A (2002) Learning with Kernels. MIT Press, MA CambridgeMATH
21.
Zurück zum Zitat Schwenker F (2000) Hierarchical support vector machines for multi-class pattern recognition. In: Knowledge-based intelligent engineering systems and allied technologies, pp 561–565 Schwenker F (2000) Hierarchical support vector machines for multi-class pattern recognition. In: Knowledge-based intelligent engineering systems and allied technologies, pp 561–565
22.
Zurück zum Zitat Shao YH, Chen WJ, Deng NY (2014) Nonparallel hyperplane support vector machine for binary classification problems. Inf Sci 263(1):22–35MathSciNetCrossRefMATH Shao YH, Chen WJ, Deng NY (2014) Nonparallel hyperplane support vector machine for binary classification problems. Inf Sci 263(1):22–35MathSciNetCrossRefMATH
23.
Zurück zum Zitat Shao YH, Chen WJ, Zhang JJ, Wang Z, Deng NY (2014) An efficient weighted lagrangian twin support vector machine for imbalanced data classification. Pattern Recogn 47(9):3158–3167CrossRefMATH Shao YH, Chen WJ, Zhang JJ, Wang Z, Deng NY (2014) An efficient weighted lagrangian twin support vector machine for imbalanced data classification. Pattern Recogn 47(9):3158–3167CrossRefMATH
24.
Zurück zum Zitat Shao YH, Chen WJ, Zhang JJ, Wang Z, Deng NY (2014) An efficient weighted lagrangian twin support vector machine for imbalanced data classification. Pattern Recogn 47:3158–3167CrossRefMATH Shao YH, Chen WJ, Zhang JJ, Wang Z, Deng NY (2014) An efficient weighted lagrangian twin support vector machine for imbalanced data classification. Pattern Recogn 47:3158–3167CrossRefMATH
25.
Zurück zum Zitat Shao YH, Deng NY (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121CrossRefMATH Shao YH, Deng NY (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121CrossRefMATH
26.
Zurück zum Zitat Shao YH, Deng NY, Chen WJ (2013) A proximal classifier with consistency. Knowl Based Syst 49:171–178CrossRef Shao YH, Deng NY, Chen WJ (2013) A proximal classifier with consistency. Knowl Based Syst 49:171–178CrossRef
27.
Zurück zum Zitat Shao YH, Deng NY, Chen WJ, Wang Z (2013) Improved generalized eigenvalue proximal support vector machine. IEEE Signal Process Lett 20(3):213–216CrossRef Shao YH, Deng NY, Chen WJ, Wang Z (2013) Improved generalized eigenvalue proximal support vector machine. IEEE Signal Process Lett 20(3):213–216CrossRef
28.
Zurück zum Zitat Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307CrossRefMATH Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307CrossRefMATH
29.
Zurück zum Zitat Shao YH, Wang Z, Chen WJ, Deng NY (2013) A regularization for the projection twin support vector machine. Knowl Based Syst 37:203–210CrossRef Shao YH, Wang Z, Chen WJ, Deng NY (2013) A regularization for the projection twin support vector machine. Knowl Based Syst 37:203–210CrossRef
30.
Zurück zum Zitat Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef
31.
Zurück zum Zitat Sun L, Mu WS, Qi B, Zhou ZJ (2014) A new privacy-preserving proximal support vector machine for classification of vertically partitioned data. Int J Mach Learn Cybern doi:10.1007/s13042-014-0245-1 Sun L, Mu WS, Qi B, Zhou ZJ (2014) A new privacy-preserving proximal support vector machine for classification of vertically partitioned data. Int J Mach Learn Cybern doi:10.​1007/​s13042-014-0245-1
32.
Zurück zum Zitat Tao Q, Chu D, Wang J (2008) Recursive support vector machines for dimensionality reduction. IEEE Trans Neural Netw 19(1):189–193CrossRef Tao Q, Chu D, Wang J (2008) Recursive support vector machines for dimensionality reduction. IEEE Trans Neural Netw 19(1):189–193CrossRef
34.
Zurück zum Zitat Tian YJ, Qi ZQ, Ju XC, Shi Y, Liu X (2013) Nonparallel support vector machines for pattern classification. IEEE Trans Cybern 44(7):1067–1079CrossRef Tian YJ, Qi ZQ, Ju XC, Shi Y, Liu X (2013) Nonparallel support vector machines for pattern classification. IEEE Trans Cybern 44(7):1067–1079CrossRef
35.
Zurück zum Zitat Wang XZ, He Q, Chen DG, Yeung D (2005) A genetic algorithm for solving the inverse problem of support vector machines. Neurocomputing 68:225–238CrossRef Wang XZ, He Q, Chen DG, Yeung D (2005) A genetic algorithm for solving the inverse problem of support vector machines. Neurocomputing 68:225–238CrossRef
36.
Zurück zum Zitat Wang XZ, Lu SX, Zhai JH (2008) Fast fuzzy multi-category svm based on support vector domain description. Int J Pattern Recogn Artif Intell 22(1):109–120CrossRef Wang XZ, Lu SX, Zhai JH (2008) Fast fuzzy multi-category svm based on support vector domain description. Int J Pattern Recogn Artif Intell 22(1):109–120CrossRef
37.
Zurück zum Zitat Weston J, Watkins C (1998) Multi-class support vector machines. In: Technical Report CSD-TR-98-04, Department of Computer Science, Royal Holloway, University of London, Egham Weston J, Watkins C (1998) Multi-class support vector machines. In: Technical Report CSD-TR-98-04, Department of Computer Science, Royal Holloway, University of London, Egham
38.
Zurück zum Zitat Xiang C, Fan XA, Lee TH (2006) Face recognition using recursive fisher linear discriminant. IEEE Trans Image Process 15(8):2097–2105CrossRef Xiang C, Fan XA, Lee TH (2006) Face recognition using recursive fisher linear discriminant. IEEE Trans Image Process 15(8):2097–2105CrossRef
39.
Zurück zum Zitat Xue H, Chen S, Yang Q (2009) Discriminatively regularized least-squares classification. Pattern Recogn 42(1):93–104CrossRefMATH Xue H, Chen S, Yang Q (2009) Discriminatively regularized least-squares classification. Pattern Recogn 42(1):93–104CrossRefMATH
40.
Zurück zum Zitat Yang ZX, Shao YH, Zhang XS (2012) Multiple birth support vector machine for multi-class classification. Neural Comput Appl 1–9 Yang ZX, Shao YH, Zhang XS (2012) Multiple birth support vector machine for multi-class classification. Neural Comput Appl 1–9
41.
Zurück zum Zitat Ye Q, Zhao C, Ye N, Chen, Y (2010) Multi-weight vector projection support vector machines. Pattern Recogn Lett 31(13):2006–2011 Ye Q, Zhao C, Ye N, Chen, Y (2010) Multi-weight vector projection support vector machines. Pattern Recogn Lett 31(13):2006–2011
42.
Zurück zum Zitat Ye QL, Zhao CX, Zhang HF, Chen XB (2012) Recursive “concave–convex” Fisher linear discriminant with applications to face, handwritten digit and terrain recognition. Pattern Recogn 45(1):54–65CrossRefMATH Ye QL, Zhao CX, Zhang HF, Chen XB (2012) Recursive “concave–convex” Fisher linear discriminant with applications to face, handwritten digit and terrain recognition. Pattern Recogn 45(1):54–65CrossRefMATH
Metadaten
Titel
Multiple recursive projection twin support vector machine for multi-class classification
verfasst von
Chun-Na Li
Yun-Feng Huang
He-Ji Wu
Yuan-Hai Shao
Zhi-Min Yang
Publikationsdatum
01.10.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 5/2016
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-014-0289-2

Weitere Artikel der Ausgabe 5/2016

International Journal of Machine Learning and Cybernetics 5/2016 Zur Ausgabe

Neuer Inhalt