Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 5/2016

01-10-2016 | Original Article

Multiple recursive projection twin support vector machine for multi-class classification

Authors: Chun-Na Li, Yun-Feng Huang, He-Ji Wu, Yuan-Hai Shao, Zhi-Min Yang

Published in: International Journal of Machine Learning and Cybernetics | Issue 5/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

For multi-class classification problem, a novel multiple projection twin support vector machine (Multi-PTSVM) is proposed. Our Multi-PTSVM solves \(K\) quadratic programming problems (QPPs) to obtain \(K\) projection axes, which is similar to binary PTSVM, but the regularization terms and recursive procedure are introduced for each class, which improve the generalization ability greatly. Comparisons against the Multi-SVM, Multi-TWSVM, Multi-GEPSVM, and our Multi-PTSVM on both synthetic and benchmark datasets indicate that our Multi-PTSVM has its advantages.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
2.
go back to reference Arun Kumar M, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef Arun Kumar M, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef
3.
go back to reference Bishop CM (2006) Pattern recognition and machine learning. Springer, New YorkMATH Bishop CM (2006) Pattern recognition and machine learning. Springer, New YorkMATH
5.
go back to reference Chang CC, Lin CJ (2011) A library for support vector machines. ACM Trans Intell Syst Technol 2:1–27 Chang CC, Lin CJ (2011) A library for support vector machines. ACM Trans Intell Syst Technol 2:1–27
6.
go back to reference Chen WJ, Shao YH, Hong N (2014) Laplacian smooth twin support vector machine for semi-supervised classification. Int J Mach Learn Cybern 5(3):459–468CrossRef Chen WJ, Shao YH, Hong N (2014) Laplacian smooth twin support vector machine for semi-supervised classification. Int J Mach Learn Cybern 5(3):459–468CrossRef
7.
go back to reference Chen X, Yang J, Ye Q, Liang J (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655CrossRefMATH Chen X, Yang J, Ye Q, Liang J (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655CrossRefMATH
8.
go back to reference Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297MATH
9.
go back to reference Deng NY, Tian YJ, Zhang CH (2012) Support vector machines: theory, algorithms, and extensions. CRC Press, Boca RatonMATH Deng NY, Tian YJ, Zhang CH (2012) Support vector machines: theory, algorithms, and extensions. CRC Press, Boca RatonMATH
10.
go back to reference Ding S, Hua X (2014) Recursive least squares projection twin support vector machines for nonlinear classification. Neurocomputing 130:3–9CrossRef Ding S, Hua X (2014) Recursive least squares projection twin support vector machines for nonlinear classification. Neurocomputing 130:3–9CrossRef
11.
go back to reference Ghorai S, Mukherjee A, Dutta PK (2009) Nonparallel plane proximal classifier. Signal Process 89(4):510–522CrossRefMATH Ghorai S, Mukherjee A, Dutta PK (2009) Nonparallel plane proximal classifier. Signal Process 89(4):510–522CrossRefMATH
12.
go back to reference Jayadeva R, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRefMATH Jayadeva R, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRefMATH
14.
go back to reference Lee Y, Lin Y, Wahba G (2004) Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data. J Am Stat Assoc 99(465):67–81MathSciNetCrossRefMATH Lee Y, Lin Y, Wahba G (2004) Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data. J Am Stat Assoc 99(465):67–81MathSciNetCrossRefMATH
15.
go back to reference Mangasarian OL, Wild EW (2006) Multisurface proximal support vector classification via generalize eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef Mangasarian OL, Wild EW (2006) Multisurface proximal support vector classification via generalize eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef
16.
go back to reference Nene SA, Nayar SK, Murase H (1996) Columbia object image library (coil-20). In: Technical Report CUCS-005-96, Columbia University, New York Nene SA, Nayar SK, Murase H (1996) Columbia object image library (coil-20). In: Technical Report CUCS-005-96, Columbia University, New York
17.
go back to reference Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRefMATH Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRefMATH
18.
go back to reference Qi Z, Tian YJ, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53CrossRefMATH Qi Z, Tian YJ, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53CrossRefMATH
19.
go back to reference Qi Z, Tian YJ, Shi Y (2012) Twin support vector machine with universum data. Neural Netw 36:112–119CrossRefMATH Qi Z, Tian YJ, Shi Y (2012) Twin support vector machine with universum data. Neural Netw 36:112–119CrossRefMATH
20.
go back to reference Scholkopf B, Smola A (2002) Learning with Kernels. MIT Press, MA CambridgeMATH Scholkopf B, Smola A (2002) Learning with Kernels. MIT Press, MA CambridgeMATH
21.
go back to reference Schwenker F (2000) Hierarchical support vector machines for multi-class pattern recognition. In: Knowledge-based intelligent engineering systems and allied technologies, pp 561–565 Schwenker F (2000) Hierarchical support vector machines for multi-class pattern recognition. In: Knowledge-based intelligent engineering systems and allied technologies, pp 561–565
22.
go back to reference Shao YH, Chen WJ, Deng NY (2014) Nonparallel hyperplane support vector machine for binary classification problems. Inf Sci 263(1):22–35MathSciNetCrossRefMATH Shao YH, Chen WJ, Deng NY (2014) Nonparallel hyperplane support vector machine for binary classification problems. Inf Sci 263(1):22–35MathSciNetCrossRefMATH
23.
go back to reference Shao YH, Chen WJ, Zhang JJ, Wang Z, Deng NY (2014) An efficient weighted lagrangian twin support vector machine for imbalanced data classification. Pattern Recogn 47(9):3158–3167CrossRefMATH Shao YH, Chen WJ, Zhang JJ, Wang Z, Deng NY (2014) An efficient weighted lagrangian twin support vector machine for imbalanced data classification. Pattern Recogn 47(9):3158–3167CrossRefMATH
24.
go back to reference Shao YH, Chen WJ, Zhang JJ, Wang Z, Deng NY (2014) An efficient weighted lagrangian twin support vector machine for imbalanced data classification. Pattern Recogn 47:3158–3167CrossRefMATH Shao YH, Chen WJ, Zhang JJ, Wang Z, Deng NY (2014) An efficient weighted lagrangian twin support vector machine for imbalanced data classification. Pattern Recogn 47:3158–3167CrossRefMATH
25.
go back to reference Shao YH, Deng NY (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121CrossRefMATH Shao YH, Deng NY (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121CrossRefMATH
26.
go back to reference Shao YH, Deng NY, Chen WJ (2013) A proximal classifier with consistency. Knowl Based Syst 49:171–178CrossRef Shao YH, Deng NY, Chen WJ (2013) A proximal classifier with consistency. Knowl Based Syst 49:171–178CrossRef
27.
go back to reference Shao YH, Deng NY, Chen WJ, Wang Z (2013) Improved generalized eigenvalue proximal support vector machine. IEEE Signal Process Lett 20(3):213–216CrossRef Shao YH, Deng NY, Chen WJ, Wang Z (2013) Improved generalized eigenvalue proximal support vector machine. IEEE Signal Process Lett 20(3):213–216CrossRef
28.
go back to reference Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307CrossRefMATH Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307CrossRefMATH
29.
go back to reference Shao YH, Wang Z, Chen WJ, Deng NY (2013) A regularization for the projection twin support vector machine. Knowl Based Syst 37:203–210CrossRef Shao YH, Wang Z, Chen WJ, Deng NY (2013) A regularization for the projection twin support vector machine. Knowl Based Syst 37:203–210CrossRef
30.
go back to reference Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef
31.
go back to reference Sun L, Mu WS, Qi B, Zhou ZJ (2014) A new privacy-preserving proximal support vector machine for classification of vertically partitioned data. Int J Mach Learn Cybern doi:10.1007/s13042-014-0245-1 Sun L, Mu WS, Qi B, Zhou ZJ (2014) A new privacy-preserving proximal support vector machine for classification of vertically partitioned data. Int J Mach Learn Cybern doi:10.​1007/​s13042-014-0245-1
32.
go back to reference Tao Q, Chu D, Wang J (2008) Recursive support vector machines for dimensionality reduction. IEEE Trans Neural Netw 19(1):189–193CrossRef Tao Q, Chu D, Wang J (2008) Recursive support vector machines for dimensionality reduction. IEEE Trans Neural Netw 19(1):189–193CrossRef
34.
go back to reference Tian YJ, Qi ZQ, Ju XC, Shi Y, Liu X (2013) Nonparallel support vector machines for pattern classification. IEEE Trans Cybern 44(7):1067–1079CrossRef Tian YJ, Qi ZQ, Ju XC, Shi Y, Liu X (2013) Nonparallel support vector machines for pattern classification. IEEE Trans Cybern 44(7):1067–1079CrossRef
35.
go back to reference Wang XZ, He Q, Chen DG, Yeung D (2005) A genetic algorithm for solving the inverse problem of support vector machines. Neurocomputing 68:225–238CrossRef Wang XZ, He Q, Chen DG, Yeung D (2005) A genetic algorithm for solving the inverse problem of support vector machines. Neurocomputing 68:225–238CrossRef
36.
go back to reference Wang XZ, Lu SX, Zhai JH (2008) Fast fuzzy multi-category svm based on support vector domain description. Int J Pattern Recogn Artif Intell 22(1):109–120CrossRef Wang XZ, Lu SX, Zhai JH (2008) Fast fuzzy multi-category svm based on support vector domain description. Int J Pattern Recogn Artif Intell 22(1):109–120CrossRef
37.
go back to reference Weston J, Watkins C (1998) Multi-class support vector machines. In: Technical Report CSD-TR-98-04, Department of Computer Science, Royal Holloway, University of London, Egham Weston J, Watkins C (1998) Multi-class support vector machines. In: Technical Report CSD-TR-98-04, Department of Computer Science, Royal Holloway, University of London, Egham
38.
go back to reference Xiang C, Fan XA, Lee TH (2006) Face recognition using recursive fisher linear discriminant. IEEE Trans Image Process 15(8):2097–2105CrossRef Xiang C, Fan XA, Lee TH (2006) Face recognition using recursive fisher linear discriminant. IEEE Trans Image Process 15(8):2097–2105CrossRef
39.
go back to reference Xue H, Chen S, Yang Q (2009) Discriminatively regularized least-squares classification. Pattern Recogn 42(1):93–104CrossRefMATH Xue H, Chen S, Yang Q (2009) Discriminatively regularized least-squares classification. Pattern Recogn 42(1):93–104CrossRefMATH
40.
go back to reference Yang ZX, Shao YH, Zhang XS (2012) Multiple birth support vector machine for multi-class classification. Neural Comput Appl 1–9 Yang ZX, Shao YH, Zhang XS (2012) Multiple birth support vector machine for multi-class classification. Neural Comput Appl 1–9
41.
go back to reference Ye Q, Zhao C, Ye N, Chen, Y (2010) Multi-weight vector projection support vector machines. Pattern Recogn Lett 31(13):2006–2011 Ye Q, Zhao C, Ye N, Chen, Y (2010) Multi-weight vector projection support vector machines. Pattern Recogn Lett 31(13):2006–2011
42.
go back to reference Ye QL, Zhao CX, Zhang HF, Chen XB (2012) Recursive “concave–convex” Fisher linear discriminant with applications to face, handwritten digit and terrain recognition. Pattern Recogn 45(1):54–65CrossRefMATH Ye QL, Zhao CX, Zhang HF, Chen XB (2012) Recursive “concave–convex” Fisher linear discriminant with applications to face, handwritten digit and terrain recognition. Pattern Recogn 45(1):54–65CrossRefMATH
Metadata
Title
Multiple recursive projection twin support vector machine for multi-class classification
Authors
Chun-Na Li
Yun-Feng Huang
He-Ji Wu
Yuan-Hai Shao
Zhi-Min Yang
Publication date
01-10-2016
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 5/2016
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-014-0289-2

Other articles of this Issue 5/2016

International Journal of Machine Learning and Cybernetics 5/2016 Go to the issue