Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Neural Computing and Applications
Published in: Neural Computing and Applications 2/2018

20-10-2017 | Review

Improvement on projection twin support vector machine

Author: Xiaomin Xie

Published in: Neural Computing and Applications | Issue 2/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Traditional projection twin support vector machines (SVMs) ignore the differences between the categories when establishing the objective functions, which would lessen their generalization performance. To solve the issue, an improved projection twin SVM (abbreviated as IPTSVM) is proposed in this paper, which aims to find two projected directions via a single quadratic programming problem. In their respective subspace, the projected sample points belonging to each category are far from those of the other class. Meanwhile, to enhance the performance, the recursive arithmetic seeks for more than one projection directions for each class. Besides, an effective clipping dual coordinate descent model is adopted to solve the dual problem to accelerate the training process. The linear IPTSVM model could be changed into the nonlinear model by using the kernel metric. Furthermore, the multi-label version of IPTSVM model is developed to deal with the multi-label learning problems. Experiments on a set of public datasets show that the IPTSVM model has significant advantages over the other models in terms of generalization performance.
previous article Modified cuckoo search algorithm and the prediction of flashover voltage of insulators
next article Structural damage detection using finite element model updating with evolutionary algorithms: a survey

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now
Literature
1.
Vapnik V (1999) An overview of statistical learning theory. IEEE Trans Neural Netw 10(5):988–999CrossRef
2.
Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20:273–297MATH
3.
Liu YH, Chen YT (2007) Face recognition using total margin-based adaptive fuzzy support vector machines. IEEE Trans Neural Netw 18(1):178–192CrossRef
4.
Osuna E, Freund R, Girosi F (1997) Training support vector machines: an application to face detection. In: Proceedings of IEEE computer vision and pattern recognition, Puer to Rico, San Juan, pp 130–136
5.
Joachims T, Ndellec C, Rouveriol C (1998) Text categorization with support vector machines: learning with many relevant features. In: European conference on machine learning No. 10, Chemnitz, Germany, pp 137–142
6.
Trafalis TB, Ince H (2000) Support vector machine for regression and applications to financial forecasting. In: Proceedings of the IEEE-INNS-ENNS international joint conference on IEEE, 6th edn. pp 348–353
7.
Ding SF, Yu JZ, Qi BJ, Huang HJ (2014) An overview on twin support vector machines. Artif Intell Rev 42:245–252CrossRef
8.
Jayadeva Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classication. IEEE Trans Pattern Anal 29:905–910CrossRef
9.
Mangasarian OL, Wild EW (2006) Multisurface proximal support vector classification via generalized eigenvalues. IEEE Trans Pattern Anal 28(1):69–74CrossRef
10.
Ghorai S, Mukherjee A, Dutta PK (2009) Nonparallel plane proximal classifier. Signal Process 89:510–522CrossRefMATH
11.
Shao YH, Zhang CH, Wang XB, Deng N (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef
12.
13.
Xu YT, Guo R (2014) An improved ν-twin support vector machine. Appl Intell 41:42–54CrossRef
14.
15.
Qi ZQ, Tian YJ, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recognit 46:305–316CrossRefMATH
16.
Shao YH, Chen WJ, Deng NY (2014) Nonparallel hyperplane support vector machine for binary classification problems. Inf Sci 263:22–35MathSciNetCrossRefMATH
17.
Zhou XJ, Jiang T (2016) Enhancing least square support vector regression with gradient information. Neural Process Lett 43:65–83CrossRef
18.
Li JT, Cao YM, Wang YD, Xiao HM (2016) Online learning algorithms for double-weighted least squares twin bounded support vector machines. Neural Process Lett. doi:10.​1007/​s11063-016-9527-9
19.
Xi XM, Huang XL, Suykens JA, Wang SN (2016) Coordinate descent algorithm for ramp loss linear programming support vector machines. Neural Process Lett 43:887–903CrossRef
20.
21.
Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recognit 45(6):2299–2307CrossRefMATH
22.
Shao YH, Chen WJ, Liu LM, Deng NY (2015) Laplacian unit-hyperplane learning from positive and unlabeled examples. Inf Sci 314:152–168MathSciNetCrossRefMATH
23.
Wang Z, Shao YH, Bai L, Deng NY (2015) Twin support vector machine for clustering. IEEE Trans Neural Netw 26(10):2583–2588MathSciNetCrossRef
24.
Shao YH, Deng NY, Chen WJ (2013) A proximal classifier with consistency. Knowl Based Syst 49:171–178CrossRef
25.
Kumar M, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recognit Lett 29:1842–1848CrossRef
26.
Chen XB, Yang J, Ye QL, Liang J (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recognit 44:2643–2655CrossRefMATH
27.
Fung G, Mangasarian OL (2001) Proximal support vector machine classifiers. In: Proceedings of seventh international conference on knowledge and data discovery, San Francisco, pp 77–86
28.
Ye Q, Zhao C, Ye N, Chen Y (2010) Multi-weight vector projection support vector machines. Pattern Recognit Lett 31(13):2006–2011CrossRef
29.
Shao YH, Wang Z, Chen WJ, Deng NY (2013) A regularization for the projection twin support vector machine. Knowl Based Syst 37:203–210CrossRef
30.
Kudoh T, Matsumoto Y (2001) Chunking with support vector machines. In: Proceedings of the second meeting of the North American chapter of the association for computational linguistics on language technologies. MIT Press, Cambridge, pp 1–8
31.
Platt J (1999) Fast training of support vector machines using sequential minimal optimization. In: Schölkopf B, Burges CJC, Smola AJ (eds) Advances in Kernel methods-support vector machine. MIT Press, Cambridge, pp 185–208
32.
Joachims T (1999) Making large-scale SVM learning practical. In: Schölkopf B, Burges CJC, Smola AJ (eds) Advances in Kernel methods: support vector machine. MIT Press, Cambridge, pp 169–184
33.
34.
Mavroforakis M, Theodoridis S (2006) A geometric approach to support vector machine (SVM) classification. IEEE Trans on Neural Netw 17(3):671–682CrossRef
35.
Mangasarian OL, Musicant DR (1999) Successive overrelaxation for support vector machines. IEEE Trans Neural Netw 10(5):1032–1037CrossRef
36.
Hsieh CJ, Chang KW, Lin CJ (2008) A dual coordinate descent method for large-scale linear SVM. In: Proceedings of the 25th international conference on machine learning, Helsinki, Finland
37.
Peng XJ, Chen DJ, Kong LY (2014) A clipping dual coordinate descent algorithm for solving support vector machines. Knowl Based Syst 71:266–278CrossRef
38.
Chen WJ, Shao YH, Li CN, Deng NY (2016) MLTSVM: a novel twin support vector machine to multi-label learning. Pattern Recognit 52:61–74CrossRef
39.
Zhang M, Zhou Z (2014) A review on multi-label learning algorithms. IEEE Trans Knowl Data Eng 26(8):1819–1837CrossRef
40.
41.
42.
43.
Metadata
Title
Improvement on projection twin support vector machine
Author
Xiaomin Xie
Publication date
20-10-2017
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 2/2018
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-017-3237-8

Other articles of this Issue 2/2018

Neural Computing and Applications 2/2018 Go to the issue

Original Article

Design of passivity and passification for delayed neural networks with Markovian jump parameters via non-uniform sampled-data control

Original Article

Stagnation point flow of nanomaterial towards nonlinear stretching surface with melting heat

Original Article

Combination of particle swarm optimization algorithm and artificial neural network to propose an efficient controller for vehicle handling in uncertain road conditions

Original Article

An improved ranking method for comparing trapezoidal intuitionistic fuzzy numbers and its applications to multicriteria decision making

Review

Structural damage detection using finite element model updating with evolutionary algorithms: a survey

Review

Grey wolf optimizer: a review of recent variants and applications

Premium Partner

    Image Credits