Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 6/2017

10-06-2016 | Original Article

Multiple birth least squares support vector machine for multi-class classification

Authors: Su-Gen Chen, Xiao-Jun Wu

Published in: International Journal of Machine Learning and Cybernetics | Issue 6/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Least squares twin support vector machine (LSTSVM) was initially designed for binary classification. However, practical problems often require the discrimination more than two categories. To tackle multi-class classification problem, a novel algorithm, called multiple birth least squares support vector machine (MBLSSVM), is proposed. Our MBLSSVM solves K quadratic programming problems (QPPs) to obtain K hyperplanes, each problem is similar to binary LSTSVM. Comparison against the Multi-LSTSVM, Multi-TWSVM, MBSVM and our MBLSSVM on both UCI datasets and ORL, YALE face datasets illustrates the effectiveness of the proposed method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Cortes C, Vapnik VN (1995) Support vector machine. Mach Learn 20(3):273–297MATH Cortes C, Vapnik VN (1995) Support vector machine. Mach Learn 20(3):273–297MATH
2.
go back to reference Vapnik VN (2000) The nature of statistical learning theory. Springer, New York (Incorporated) CrossRefMATH Vapnik VN (2000) The nature of statistical learning theory. Springer, New York (Incorporated) CrossRefMATH
3.
go back to reference Osuna E, Freund R, Girosi F (1997) Training support vector machines: an application to face detection. In: Proceedings of computer vision and pattern recognition, pp 130–136 Osuna E, Freund R, Girosi F (1997) Training support vector machines: an application to face detection. In: Proceedings of computer vision and pattern recognition, pp 130–136
4.
go back to reference Isa D, Lee LH, Kallimani VP, Rajkumar R (2008) Text document preprocessing with the Bayes formula for classification using the support vector machine. IEEE Trans Knowl Data Eng 20(9):1264–1272CrossRef Isa D, Lee LH, Kallimani VP, Rajkumar R (2008) Text document preprocessing with the Bayes formula for classification using the support vector machine. IEEE Trans Knowl Data Eng 20(9):1264–1272CrossRef
5.
go back to reference Noble WS (2004) Kernel methods in computational biology. Support vector machine applications in computational biology. MIT Press, Cambridge, pp 71–92 Noble WS (2004) Kernel methods in computational biology. Support vector machine applications in computational biology. MIT Press, Cambridge, pp 71–92
6.
go back to reference Zafeiriou S, Tefas A, Pitas I (2007) Minimum class variance support vector machine. IEEE Trans Image Process 16(10):2551–2564CrossRefMathSciNet Zafeiriou S, Tefas A, Pitas I (2007) Minimum class variance support vector machine. IEEE Trans Image Process 16(10):2551–2564CrossRefMathSciNet
7.
go back to reference Mangasarian OL, Wild EW (2006) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef Mangasarian OL, Wild EW (2006) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef
8.
go back to reference Jayadeva R, Khemchandai S Chandra (2007) Twin support vector machine classification for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRef Jayadeva R, Khemchandai S Chandra (2007) Twin support vector machine classification for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRef
9.
go back to reference Arun Kumar M, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef Arun Kumar M, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef
10.
go back to reference Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef
11.
go back to reference Chen XB, Yang J, Ye QL, Liang J (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655CrossRefMATH Chen XB, Yang J, Ye QL, Liang J (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655CrossRefMATH
12.
go back to reference Shao YH, Chen WJ, Deng NY (2014) Nonparallel hyperplane support vector machine for binary classification problems. Inf Sci 263:22–35CrossRefMATHMathSciNet Shao YH, Chen WJ, Deng NY (2014) Nonparallel hyperplane support vector machine for binary classification problems. Inf Sci 263:22–35CrossRefMATHMathSciNet
13.
go back to reference Tian YJ, Qi ZQ, Ju XC, Shi Y, Liu XH (2014) Nonparallel support vector machines for pattern classification. IEEE Trans Cybern 44(7):1067–1079CrossRef Tian YJ, Qi ZQ, Ju XC, Shi Y, Liu XH (2014) Nonparallel support vector machines for pattern classification. IEEE Trans Cybern 44(7):1067–1079CrossRef
14.
go back to reference Peng XJ (2011) TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recogn 44(10):2678–2692CrossRefMATH Peng XJ (2011) TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recogn 44(10):2678–2692CrossRefMATH
15.
go back to reference Qi ZQ, Tian YJ, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRefMATH Qi ZQ, Tian YJ, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRefMATH
16.
go back to reference Shao YH, Wang Z, Chen WJ, Deng NY (2013) A regularization for the projection twin support vector machine. Knowl-Based Syst 37:203–210CrossRef Shao YH, Wang Z, Chen WJ, Deng NY (2013) A regularization for the projection twin support vector machine. Knowl-Based Syst 37:203–210CrossRef
17.
go back to reference Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307CrossRefMATH Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307CrossRefMATH
18.
go back to reference Ding SF, Hua XP (2014) Recursive least squares projection twin support vector machines for nonlinear classification. Neurocomputing 130:3–9CrossRef Ding SF, Hua XP (2014) Recursive least squares projection twin support vector machines for nonlinear classification. Neurocomputing 130:3–9CrossRef
19.
go back to reference Ding SF, Hua XP, Yu JZ (2014) An overview on nonparallel hyperplane support vector machine algorithms. Neural Comput Appl 25(5):975–982CrossRef Ding SF, Hua XP, Yu JZ (2014) An overview on nonparallel hyperplane support vector machine algorithms. Neural Comput Appl 25(5):975–982CrossRef
20.
go back to reference Ding SF, Yu JZ, Qi BJ, Huang HJ (2014) An overview on twin support vector machines. Artif Intell Rev 42(2):245–252CrossRef Ding SF, Yu JZ, Qi BJ, Huang HJ (2014) An overview on twin support vector machines. Artif Intell Rev 42(2):245–252CrossRef
21.
go back to reference Bottou L, Cortes C, Denker JS et al. (1994) Comparison of classifier methods: a case study in handwritten digit recognition. In: International conference on pattern recognition, IEEE Computer Society Press, pp 77–77 Bottou L, Cortes C, Denker JS et al. (1994) Comparison of classifier methods: a case study in handwritten digit recognition. In: International conference on pattern recognition, IEEE Computer Society Press, pp 77–77
22.
go back to reference Kreßel, Ulrich H-G (1999) Pairwise classification and support vector machines. In: Schölkopf B, Burges CJC, Smola AJ (eds) Advances in kernel methods. MIT Press, Cambridge, pp 255–268 Kreßel, Ulrich H-G (1999) Pairwise classification and support vector machines. In: Schölkopf B, Burges CJC, Smola AJ (eds) Advances in kernel methods. MIT Press, Cambridge, pp 255–268
23.
go back to reference Dietterich TG, Bakiri G (1995) Solving multiclass learning problems via error-correcting output codes. J Artif Intell Res 2:263–286MATH Dietterich TG, Bakiri G (1995) Solving multiclass learning problems via error-correcting output codes. J Artif Intell Res 2:263–286MATH
24.
go back to reference Platt JC, Cristianini N, Shawe-Taylor J (2000) Large margin dags for multiclass classification. In: Leen TK, Dietterich TG, Tresp V (eds) Advances in neural information processing systems, vol 12. MIT Press, Cambridge, pp 547–553 Platt JC, Cristianini N, Shawe-Taylor J (2000) Large margin dags for multiclass classification. In: Leen TK, Dietterich TG, Tresp V (eds) Advances in neural information processing systems, vol 12. MIT Press, Cambridge, pp 547–553
25.
go back to reference Weston J, Watkins C (1998) Multi-class support vector machines. Technical Report CSD-TR-98-04, Department of Computer Science, Royal Holloway, University of London, May Weston J, Watkins C (1998) Multi-class support vector machines. Technical Report CSD-TR-98-04, Department of Computer Science, Royal Holloway, University of London, May
26.
go back to reference Huang GB, Zhou HM, Ding XJ, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern B Cybern 42(2):513–529CrossRef Huang GB, Zhou HM, Ding XJ, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern B Cybern 42(2):513–529CrossRef
27.
go back to reference Weston J, Watkins C (1999) Support vector machines for multi-class pattern recognition. ESANN 99:219–224 Weston J, Watkins C (1999) Support vector machines for multi-class pattern recognition. ESANN 99:219–224
28.
go back to reference Crammer K, Singer Y (2002) On the learnability and design of output codes for multiclass problems. Mach Learn 47(2–3):201–233CrossRefMATH Crammer K, Singer Y (2002) On the learnability and design of output codes for multiclass problems. Mach Learn 47(2–3):201–233CrossRefMATH
29.
go back to reference Mayoraz E, Alpaydin E (1999) Support vector machines for multi-class classification. In: Cotta C, Troya JM (eds) Engineering applications of bio-inspired artificial neural networks. Springer, Berlin, pp 833–842CrossRef Mayoraz E, Alpaydin E (1999) Support vector machines for multi-class classification. In: Cotta C, Troya JM (eds) Engineering applications of bio-inspired artificial neural networks. Springer, Berlin, pp 833–842CrossRef
30.
go back to reference Angulo C, Parra X, Catala A (2003) K-SVCR: a support vector machine for multi-class classification. Neurocomputing 55(1):57–77CrossRef Angulo C, Parra X, Catala A (2003) K-SVCR: a support vector machine for multi-class classification. Neurocomputing 55(1):57–77CrossRef
31.
go back to reference Xu YT, Guo R, Wang LS (2013) A twin multi-class classification support vector machine. Cognit Comput 5(4):580–588CrossRef Xu YT, Guo R, Wang LS (2013) A twin multi-class classification support vector machine. Cognit Comput 5(4):580–588CrossRef
32.
go back to reference Nasiri JA, Charkari NM, Jalili S (2015) Least squares twin multi-class classification support vector machine. Pattern Recogn 48(3):984–992CrossRefMATH Nasiri JA, Charkari NM, Jalili S (2015) Least squares twin multi-class classification support vector machine. Pattern Recogn 48(3):984–992CrossRefMATH
33.
go back to reference Yang ZX, Shao YH, Zhang XS (2013) Multiple birth support vector machines for multi-class classification. Neural Comput Appl 22(1):153–161CrossRef Yang ZX, Shao YH, Zhang XS (2013) Multiple birth support vector machines for multi-class classification. Neural Comput Appl 22(1):153–161CrossRef
35.
go back to reference You ZH, Yu JZ, Zhu L, Li S, Wen ZK (2014) A Mapreduce based parallel SVM for large-scale predicting protein–protein interactions. Neurocomputing 145:37–43CrossRef You ZH, Yu JZ, Zhu L, Li S, Wen ZK (2014) A Mapreduce based parallel SVM for large-scale predicting protein–protein interactions. Neurocomputing 145:37–43CrossRef
36.
go back to reference Zhong HM, Miao CY, Shen ZQ, Feng YH (2014) Comparing the learning effectiveness of BP, ELM, I-ELM, and SVM for corporate credit ratings. Neurocomputing 128:285–295CrossRef Zhong HM, Miao CY, Shen ZQ, Feng YH (2014) Comparing the learning effectiveness of BP, ELM, I-ELM, and SVM for corporate credit ratings. Neurocomputing 128:285–295CrossRef
37.
go back to reference Wang XZ (2015) Uncertainty in learning from big data-Editorial. J Intell Fuzzy Syst 28(5):2329–2330CrossRef Wang XZ (2015) Uncertainty in learning from big data-Editorial. J Intell Fuzzy Syst 28(5):2329–2330CrossRef
38.
go back to reference Wang XZ, Ashfaq RAR, Fu AM (2015) Fuzziness based sample categorization for classifier performance improvement. J Intell Fuzzy Syst 29(3):1185–1196CrossRefMathSciNet Wang XZ, Ashfaq RAR, Fu AM (2015) Fuzziness based sample categorization for classifier performance improvement. J Intell Fuzzy Syst 29(3):1185–1196CrossRefMathSciNet
Metadata
Title
Multiple birth least squares support vector machine for multi-class classification
Authors
Su-Gen Chen
Xiao-Jun Wu
Publication date
10-06-2016
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 6/2017
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-016-0554-7

Other articles of this Issue 6/2017

International Journal of Machine Learning and Cybernetics 6/2017 Go to the issue