Skip to main content
Erschienen in: Soft Computing 2/2019

11.12.2017 | Methodologies and Application

A novel projection twin support vector machine for binary classification

verfasst von: Sugen Chen, Xiaojun Wu, Hefeng Yin

Erschienen in: Soft Computing | Ausgabe 2/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Based on the recently proposed projection twin support vector machine (PTSVM) and projection twin support vector machine with regularization term (RPTSVM), we propose a novel projection twin support vector machine (NPTSVM) for binary classification problems. Our proposed NPTSVM seeks two optimal projection directions simultaneously by solving a single quadratic programming problem, and the projected samples of one class are well separated from those of another class to some extent. Similar to RPTSVM, the singularity of matrix is avoided and the structural risk minimization principle is implemented in our NPTSVM. In addition, in our NPTSVM, we also discuss the nonlinear classification scenario which is not covered in PTSVM. The experimental results on several artificial and publicly available benchmark datasets show the feasibility and effectiveness of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Byun H, Lee SW (2002) Applications of support vector machines for pattern recognition: a survey. Pattern recognition with support vector machines. Springer, Berlin, pp 213–236MATHCrossRef Byun H, Lee SW (2002) Applications of support vector machines for pattern recognition: a survey. Pattern recognition with support vector machines. Springer, Berlin, pp 213–236MATHCrossRef
Zurück zum Zitat Chang C, Lin C (2001) LIBSVM: a library for support vector machine. Technical report, Department of Computer Science and Information Engineering, National Taiwan University Chang C, Lin C (2001) LIBSVM: a library for support vector machine. Technical report, Department of Computer Science and Information Engineering, National Taiwan University
Zurück zum Zitat Chen XB, Yang J, Ye QL, Liang J (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655MATHCrossRef Chen XB, Yang J, Ye QL, Liang J (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655MATHCrossRef
Zurück zum Zitat Chen SG, Wu XJ, Zhang RF (2016) A novel twin support vector machine for binary classification problems. Neural Process Lett 263:22–35 Chen SG, Wu XJ, Zhang RF (2016) A novel twin support vector machine for binary classification problems. Neural Process Lett 263:22–35
Zurück zum Zitat Cheng CT, Wang WC, Xu DM et al (2008) Optimizing hydropower reservoir operation using hybrid genetic algorithm and chaos. Water Resour Manag 22(7):895–909CrossRef Cheng CT, Wang WC, Xu DM et al (2008) Optimizing hydropower reservoir operation using hybrid genetic algorithm and chaos. Water Resour Manag 22(7):895–909CrossRef
Zurück zum Zitat Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20:273–297MATH Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20:273–297MATH
Zurück zum Zitat Ding SF, Hua XP (2014) Recursive least squares projection twin support vector machines for nonlinear classification. Neurocomputing 130:3–9CrossRef Ding SF, Hua XP (2014) Recursive least squares projection twin support vector machines for nonlinear classification. Neurocomputing 130:3–9CrossRef
Zurück zum Zitat Ding SF, Yu JZ, Qi BJ, Huang HJ (2014) An overview on twin support vector machines. Artif Intell Rev 42(2):245–252CrossRef Ding SF, Yu JZ, Qi BJ, Huang HJ (2014) An overview on twin support vector machines. Artif Intell Rev 42(2):245–252CrossRef
Zurück zum Zitat Duda GH, Van Loan CF (1996) Matrix computations, vol 3. Johns Hopkins University Press, Baltimore Duda GH, Van Loan CF (1996) Matrix computations, vol 3. Johns Hopkins University Press, Baltimore
Zurück zum Zitat Duda DO, Hart PE, Stork DG (2001) Pattern classification, Second edn. Wiley, New YorkMATH Duda DO, Hart PE, Stork DG (2001) Pattern classification, Second edn. Wiley, New YorkMATH
Zurück zum Zitat Fung G, Mangasarian OL (2005) Multicategory proximal support vector machine classifiers. Mach Learn 59:77–97MATHCrossRef Fung G, Mangasarian OL (2005) Multicategory proximal support vector machine classifiers. Mach Learn 59:77–97MATHCrossRef
Zurück zum Zitat Khemchandani JR, Chandra R (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910MATHCrossRef Khemchandani JR, Chandra R (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910MATHCrossRef
Zurück zum Zitat Lee YJ, Huang SY (2007) Reduced support vector machines: a statistical theory. IEEE Trans Neural Netw 13(1):1–13CrossRef Lee YJ, Huang SY (2007) Reduced support vector machines: a statistical theory. IEEE Trans Neural Netw 13(1):1–13CrossRef
Zurück zum Zitat Mangasarian OL, Musicant DR (1999) Successive overrelaxation for support vector machines. IEEE Trans Neural Netw 10(5):1032–1037CrossRef Mangasarian OL, Musicant DR (1999) Successive overrelaxation for support vector machines. IEEE Trans Neural Netw 10(5):1032–1037CrossRef
Zurück zum Zitat Mangasarian OL, Wild EW (2006) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef Mangasarian OL, Wild EW (2006) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef
Zurück zum Zitat Peng XJ (2011) TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recogn 44(10):2678–2692MATHCrossRef Peng XJ (2011) TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recogn 44(10):2678–2692MATHCrossRef
Zurück zum Zitat Peng XJ, Xu D (2013) Robust minimum class variance twin support vector machine classifier. Neural Comput Appl 22(5):999–1011CrossRef Peng XJ, Xu D (2013) Robust minimum class variance twin support vector machine classifier. Neural Comput Appl 22(5):999–1011CrossRef
Zurück zum Zitat Peng XJ, Xu D (2014) Twin support vector hypersphere (TSVH) classifier for pattern recognition. Neural Comput Appl 24:1207–1220CrossRef Peng XJ, Xu D (2014) Twin support vector hypersphere (TSVH) classifier for pattern recognition. Neural Comput Appl 24:1207–1220CrossRef
Zurück zum Zitat Platt J (1999) Fast training of support vector machines using sequential minimal optimization. In: Scholkopf B, Burges CJC, Smola AJ (eds) Advances in kernel methods-support vector learning. MIT Press, Cambridge, pp 185–208 Platt J (1999) Fast training of support vector machines using sequential minimal optimization. In: Scholkopf B, Burges CJC, Smola AJ (eds) Advances in kernel methods-support vector learning. MIT Press, Cambridge, pp 185–208
Zurück zum Zitat Qi ZQ, Tian YJ, Shi Y (2013a) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316MATHCrossRef Qi ZQ, Tian YJ, Shi Y (2013a) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316MATHCrossRef
Zurück zum Zitat Qi ZQ, Tian YJ, Shi Y (2013b) Structural twin support vector machine for classification. Knowl Based Syst 43:74–81CrossRef Qi ZQ, Tian YJ, Shi Y (2013b) Structural twin support vector machine for classification. Knowl Based Syst 43:74–81CrossRef
Zurück zum Zitat Ripley BD (2008) Pattern recognition and neural networks. Cambridge University Press, CambridgeMATH Ripley BD (2008) Pattern recognition and neural networks. Cambridge University Press, CambridgeMATH
Zurück zum Zitat Shao YH, Deng NY (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121MATHCrossRef Shao YH, Deng NY (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121MATHCrossRef
Zurück zum Zitat Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef
Zurück zum Zitat Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307MATHCrossRef Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307MATHCrossRef
Zurück zum Zitat Shao YH, Wang Z, Chen WJ, Deng NY (2013) A regularization for the projection twin support vector machine. Knowl Based Syst 37:203–210CrossRef Shao YH, Wang Z, Chen WJ, Deng NY (2013) A regularization for the projection twin support vector machine. Knowl Based Syst 37:203–210CrossRef
Zurück zum Zitat Shao YH, Chen WJ, Deng NY (2014) Nonparallel hyperplane support vector machine for binary classification problems. Inf Sci 263:22–35MathSciNetMATHCrossRef Shao YH, Chen WJ, Deng NY (2014) Nonparallel hyperplane support vector machine for binary classification problems. Inf Sci 263:22–35MathSciNetMATHCrossRef
Zurück zum Zitat Sun J, Fang W, Wu XJ, Palade P, Xu WB (2012) Quantum-behaved particle swarm optimization: analysis of individual particle behavior and parameter selection. Evol Comput 20(3):349–393CrossRef Sun J, Fang W, Wu XJ, Palade P, Xu WB (2012) Quantum-behaved particle swarm optimization: analysis of individual particle behavior and parameter selection. Evol Comput 20(3):349–393CrossRef
Zurück zum Zitat Suykens J, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9:293–300CrossRef Suykens J, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9:293–300CrossRef
Zurück zum Zitat Trafails TB, Ince H (2002) Support vector machine for regression and applications to financial forecasting. In: IEEE-INNS-ENNS international joint conference on neural networks, IEEE computer society, vol 6, pp 6348–6348 Trafails TB, Ince H (2002) Support vector machine for regression and applications to financial forecasting. In: IEEE-INNS-ENNS international joint conference on neural networks, IEEE computer society, vol 6, pp 6348–6348
Zurück zum Zitat Wang R, Kwong S, Chen DG, Cao JJ (2013) A vector-valued support vector machine model for multi-class problem. Inf Sci 235:174–194MATHCrossRef Wang R, Kwong S, Chen DG, Cao JJ (2013) A vector-valued support vector machine model for multi-class problem. Inf Sci 235:174–194MATHCrossRef
Zurück zum Zitat Ye QL, Zhao CX, Ye N, Chen YN (2010) Multi-weight vector projection support vector machines. Pattern Recogn Lett 31:2006–2011CrossRef Ye QL, Zhao CX, Ye N, Chen YN (2010) Multi-weight vector projection support vector machines. Pattern Recogn Lett 31:2006–2011CrossRef
Zurück zum Zitat Yen SJ, Wu YC, Yang JC, Lee YS, Liu LL (2013) A support vector machine-based context-ranking model for question answering. Inf Sci 224(1):77–87CrossRef Yen SJ, Wu YC, Yang JC, Lee YS, Liu LL (2013) A support vector machine-based context-ranking model for question answering. Inf Sci 224(1):77–87CrossRef
Zurück zum Zitat Zhang J, Chau KW (2009) Multilayer ensemble pruning via novel multi-sub-swarm particle swarm optimization. J Univ Comput Sci 15(4):840–858 Zhang J, Chau KW (2009) Multilayer ensemble pruning via novel multi-sub-swarm particle swarm optimization. J Univ Comput Sci 15(4):840–858
Metadaten
Titel
A novel projection twin support vector machine for binary classification
verfasst von
Sugen Chen
Xiaojun Wu
Hefeng Yin
Publikationsdatum
11.12.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 2/2019
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2974-z

Weitere Artikel der Ausgabe 2/2019

Soft Computing 2/2019 Zur Ausgabe