Skip to main content
Top
Published in: Neural Computing and Applications 11/2017

02-03-2016 | Review

Twin support vector machine: theory, algorithm and applications

Authors: Shifei Ding, Nan Zhang, Xiekai Zhang, Fulin Wu

Published in: Neural Computing and Applications | Issue 11/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Twin support vector machine (TWSVM) has gained increasing interest from various research fields recently. In this paper, we aim to report the current state of the theoretical research and practical advances on TWSVM. We first give the basic thought and theory of TWSVM, including the theory of proximal support vector machine, generalized eigenvalue proximal support vector machine, and TWSVM. Then, we focus on the various improvements made to TWSVM, mainly including least squares twin support vector machine, smooth twin support vector machine, regularized twin support vector machine, projection twin support vector machine, and modified TWSVM on the model selection problem. These newly emerging algorithms greatly expand the applications of TWSVM. In recent years, there is a lot of research on application of TWSVM. Next, we list some research on application of TWSVM in detail. Finally, we try to provide a comprehensive view of these advances in TWSVM and discuss the direction of future research.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cristianini N, Taylor JS (2004) An introduction to support vector machines and other kernel-based learning methods (trans: Guozheng L, Meng W, Huajun Z). Electronic Industry Press, Beijing Cristianini N, Taylor JS (2004) An introduction to support vector machines and other kernel-based learning methods (trans: Guozheng L, Meng W, Huajun Z). Electronic Industry Press, Beijing
2.
go back to reference Ding S, Qi B, Tan H (2011) An overview on theory and algorithm of support vector machines. UESTC J Univ Electron Sci Technol China 40(1):2–10 Ding S, Qi B, Tan H (2011) An overview on theory and algorithm of support vector machines. UESTC J Univ Electron Sci Technol China 40(1):2–10
3.
go back to reference Cortes C, Vapnik V (1995) Support-vector networks. Spr Mach Learn 20(2):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Spr Mach Learn 20(2):273–297MATH
4.
go back to reference Vapnik VN (2000) The nature of statistical learning theory (trans: Zhang X). Tsinghua University Press, Beijing Vapnik VN (2000) The nature of statistical learning theory (trans: Zhang X). Tsinghua University Press, Beijing
5.
go back to reference Vapnik VN (2004) Statical learning theory (trans: Janhua X, Xuegong Z). Electronic Industry Press, Beijing Vapnik VN (2004) Statical learning theory (trans: Janhua X, Xuegong Z). Electronic Industry Press, Beijing
6.
go back to reference Nguyen TD, Lee HH (2014) A new SVM method for an indirect matrix converter with common-mode voltage reduction. IEEE Trans Industr Inf 10(1):61–72CrossRef Nguyen TD, Lee HH (2014) A new SVM method for an indirect matrix converter with common-mode voltage reduction. IEEE Trans Industr Inf 10(1):61–72CrossRef
7.
go back to reference Pasolli E, Melgani F, Tuia D et al (2014) SVM active learning approach for image classification using spatial information. IEEE Trans Geosci Remote Sens 52(4):2217–2233CrossRef Pasolli E, Melgani F, Tuia D et al (2014) SVM active learning approach for image classification using spatial information. IEEE Trans Geosci Remote Sens 52(4):2217–2233CrossRef
8.
go back to reference Weis C, Hess A, Budinsky L et al (2015) In-vivo imaging of cell migration using contrast enhanced MRI and SVM based post-processing. PLoS ONE 10(12):e0140548CrossRef Weis C, Hess A, Budinsky L et al (2015) In-vivo imaging of cell migration using contrast enhanced MRI and SVM based post-processing. PLoS ONE 10(12):e0140548CrossRef
9.
go back to reference Li P, Dong L, Xiao H et al (2015) A cloud image detection method based on SVM vector machine. Neurocomputing 169:34–42CrossRef Li P, Dong L, Xiao H et al (2015) A cloud image detection method based on SVM vector machine. Neurocomputing 169:34–42CrossRef
10.
go back to reference Dou Z, Mebarki A, Ni L et al (2016) SVM application in hazard assessment: self-heating for sulfurized rust. J Loss Prev Process Ind 39:112–120CrossRef Dou Z, Mebarki A, Ni L et al (2016) SVM application in hazard assessment: self-heating for sulfurized rust. J Loss Prev Process Ind 39:112–120CrossRef
11.
go back to reference Ding L, Yu F, Peng S et al (2013) A classification algorithm for network traffic based on improved support vector machine. J Comput 8(4):1090–1096 Ding L, Yu F, Peng S et al (2013) A classification algorithm for network traffic based on improved support vector machine. J Comput 8(4):1090–1096
12.
go back to reference Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300CrossRefMATH Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300CrossRefMATH
13.
go back to reference Fung G, Mangasarian OL (2001) Proximal support vector machine classifiers. In: Proceedings of 7th ACMSIFKDD, pp 77–86 Fung G, Mangasarian OL (2001) Proximal support vector machine classifiers. In: Proceedings of 7th ACMSIFKDD, pp 77–86
14.
go back to reference Li K, Lu XX (2013) Twin support vector machine algorithm with fuzzy weighting. Comput Eng Appl 49(4):162–165 Li K, Lu XX (2013) Twin support vector machine algorithm with fuzzy weighting. Comput Eng Appl 49(4):162–165
15.
go back to reference Mangasarian OL, Wild EW (2006) Multi-surface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef Mangasarian OL, Wild EW (2006) Multi-surface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef
16.
go back to reference Jayadeva, Reshma K, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRefMATH Jayadeva, Reshma K, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRefMATH
17.
go back to reference Ding S, Yu J, Qi B et al (2014) An overview on twin support vector machines. Artif Intell Rev 42(2):245–252CrossRef Ding S, Yu J, Qi B et al (2014) An overview on twin support vector machines. Artif Intell Rev 42(2):245–252CrossRef
18.
go back to reference Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29(13):1842–1848CrossRef Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29(13):1842–1848CrossRef
19.
go back to reference Peng X (2011) TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recogn 44(10):2678–2692CrossRefMATH Peng X (2011) TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recogn 44(10):2678–2692CrossRefMATH
20.
go back to reference Wang Z, Shao YH, Wu TR (2013) A GA-based model selection for smooth twin parametric-margin support vector machine. Pattern Recogn 46(8):2267–2277CrossRefMATH Wang Z, Shao YH, Wu TR (2013) A GA-based model selection for smooth twin parametric-margin support vector machine. Pattern Recogn 46(8):2267–2277CrossRefMATH
21.
go back to reference Qi Z, Tian Y, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53CrossRefMATH Qi Z, Tian Y, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53CrossRefMATH
22.
go back to reference Chen WJ, Shao YH, Hong N (2013) Laplacian smooth twin support vector machine for semi-supervised classification. Int J Mach Learn Cybernet 5(3):1–10 Chen WJ, Shao YH, Hong N (2013) Laplacian smooth twin support vector machine for semi-supervised classification. Int J Mach Learn Cybernet 5(3):1–10
24.
go back to reference Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef
25.
go back to reference Kumar MA, Khemchandani R, Gopal M et al (2010) Knowledge based least squares twin support vector machines. Inf Sci 180(23):4606–4618MathSciNetCrossRefMATH Kumar MA, Khemchandani R, Gopal M et al (2010) Knowledge based least squares twin support vector machines. Inf Sci 180(23):4606–4618MathSciNetCrossRefMATH
26.
go back to reference Chen J, Ji G (2010) Weighted least squares twin support vector machines for pattern classification. ICCAE 2:242–246 Chen J, Ji G (2010) Weighted least squares twin support vector machines for pattern classification. ICCAE 2:242–246
27.
go back to reference Chen J, Ji G (2010) Multi-class LSTSVM classifier based on optimal directed acyclic graph. In: ICCAE, IEEE, 2010, pp 100–104 Chen J, Ji G (2010) Multi-class LSTSVM classifier based on optimal directed acyclic graph. In: ICCAE, IEEE, 2010, pp 100–104
28.
go back to reference Gao S, Ye Q, Ye N (2011) 1-Norm least squares twin support vector machines. Neurocomputing 74(17):3590–3597CrossRef Gao S, Ye Q, Ye N (2011) 1-Norm least squares twin support vector machines. Neurocomputing 74(17):3590–3597CrossRef
29.
go back to reference Chen X, Yang J, Ye Q et al (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655CrossRefMATH Chen X, Yang J, Ye Q et al (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655CrossRefMATH
30.
go back to reference Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307CrossRefMATH Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307CrossRefMATH
31.
go back to reference Hua X, Ding S (2012) Matrix pattern based projection twin support vector machines. Int J Digit Content Technol Appl 6(20):172–181CrossRef Hua X, Ding S (2012) Matrix pattern based projection twin support vector machines. Int J Digit Content Technol Appl 6(20):172–181CrossRef
32.
go back to reference Shao Y, Wang Z, Chen WJ et al (2013) A regularization for the projection twin support vector machine. Knowl-Based Syst 37:203–210CrossRef Shao Y, Wang Z, Chen WJ et al (2013) A regularization for the projection twin support vector machine. Knowl-Based Syst 37:203–210CrossRef
33.
go back to reference Wang D, Ye Q, Ye N (2010) Localized multi-plane TWSVM classifier via manifold regularization. In: IHMSC, IEEE, 2010, pp 70–73 Wang D, Ye Q, Ye N (2010) Localized multi-plane TWSVM classifier via manifold regularization. In: IHMSC, IEEE, 2010, pp 70–73
34.
go back to reference Shao Y, Deng N (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121CrossRefMATH Shao Y, Deng N (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121CrossRefMATH
35.
go back to reference Gao B, Wang J, Huang H (2012) L2-loss twin support vector machine for classification. In: BMEI, 2012, pp 1265–1269 Gao B, Wang J, Huang H (2012) L2-loss twin support vector machine for classification. In: BMEI, 2012, pp 1265–1269
36.
go back to reference Wang Y, Zhao X, Tian Y (2013) Local and global regularized twin SVM. Proc Comput Sci 18:1710–1719CrossRef Wang Y, Zhao X, Tian Y (2013) Local and global regularized twin SVM. Proc Comput Sci 18:1710–1719CrossRef
38.
39.
go back to reference Su F, Shang H (2013) A wavelet kernel-based primal twin support vector machine for economic development prediction. Mathematical Problems in Engineering Su F, Shang H (2013) A wavelet kernel-based primal twin support vector machine for economic development prediction. Mathematical Problems in Engineering
40.
go back to reference Yu J, Ding S, Jin F et al (2012) Twin support vector machines based on rough sets. Int J Digit Content Technol Appl 6(20):493–500CrossRef Yu J, Ding S, Jin F et al (2012) Twin support vector machines based on rough sets. Int J Digit Content Technol Appl 6(20):493–500CrossRef
41.
go back to reference Ding S, Yu J, Huang H et al (2013) Twin support vector machines based on particle swarm optimization. J Comput 8(9):2296–2303CrossRef Ding S, Yu J, Huang H et al (2013) Twin support vector machines based on particle swarm optimization. J Comput 8(9):2296–2303CrossRef
42.
go back to reference Ding S, Wu F, Nie R et al (2013) Twin support vector machines based on particle swarm optimization. J Softw 8(7):1743–1750CrossRef Ding S, Wu F, Nie R et al (2013) Twin support vector machines based on particle swarm optimization. J Softw 8(7):1743–1750CrossRef
43.
go back to reference Huang H, Ding S, Wu F (2013) Invasive weed optimization algorithm for optimizating the parameters of mixed kernel twin support vector machines. J Comput 8(8):2077–2084CrossRef Huang H, Ding S, Wu F (2013) Invasive weed optimization algorithm for optimizating the parameters of mixed kernel twin support vector machines. J Comput 8(8):2077–2084CrossRef
44.
45.
go back to reference Peng X (2011) Building sparse twin support vector machine classifiers in primal space. Inf Sci 181(18):3967–3980CrossRef Peng X (2011) Building sparse twin support vector machine classifiers in primal space. Inf Sci 181(18):3967–3980CrossRef
46.
go back to reference Ye Q, Zhao C, Ye N et al (2011) Localized twin SVM via convex minimization. Neurocomputing 74(4):580–587CrossRef Ye Q, Zhao C, Ye N et al (2011) Localized twin SVM via convex minimization. Neurocomputing 74(4):580–587CrossRef
47.
go back to reference Qi Z, Tian Y, Shi Y (2012) Twin support vector machine with universum data. Neural Netw 36:112–119CrossRefMATH Qi Z, Tian Y, Shi Y (2012) Twin support vector machine with universum data. Neural Netw 36:112–119CrossRefMATH
48.
go back to reference Xu Y, Wang L, Zhong P (2012) A rough margin-based ν-twin support vector machine. Neural Comput Appl 21(6):1307–1317CrossRef Xu Y, Wang L, Zhong P (2012) A rough margin-based ν-twin support vector machine. Neural Comput Appl 21(6):1307–1317CrossRef
49.
go back to reference Ye Q, Zhao C, Gao S et al (2012) Weighted twin support vector machines with local information and its application. Neural Netw 35:31–39CrossRefMATH Ye Q, Zhao C, Gao S et al (2012) Weighted twin support vector machines with local information and its application. Neural Netw 35:31–39CrossRefMATH
50.
go back to reference Peng X, Xu D (2013) Bi-density twin support vector machines for pattern recognition. Neurocomputing 99:134–143CrossRef Peng X, Xu D (2013) Bi-density twin support vector machines for pattern recognition. Neurocomputing 99:134–143CrossRef
51.
go back to reference Peng X, Xu D (2013) Robust minimum class variance twin support vector machine classifier. Neural Comput Appl 22(5):999–1011CrossRef Peng X, Xu D (2013) Robust minimum class variance twin support vector machine classifier. Neural Comput Appl 22(5):999–1011CrossRef
52.
go back to reference Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRefMATH Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRefMATH
53.
go back to reference Qi Z, Tian Y, Shi Y (2013) Structural twin support vector machine for classification. Knowl-Based Syst 43:74–81CrossRef Qi Z, Tian Y, Shi Y (2013) Structural twin support vector machine for classification. Knowl-Based Syst 43:74–81CrossRef
54.
go back to reference Naik G, Kumar D (2010) Twin SVM for gesture classification using the surface electromyogram. IEEE Trans Inf Technol Biomed 14(2):301–308CrossRef Naik G, Kumar D (2010) Twin SVM for gesture classification using the surface electromyogram. IEEE Trans Inf Technol Biomed 14(2):301–308CrossRef
55.
go back to reference Tian Y, Qi Z, Ju X et al (2014) Nonparallel support vector machines for pattern classification. IEEE Trans Cybern 44(7):1067–1079CrossRef Tian Y, Qi Z, Ju X et al (2014) Nonparallel support vector machines for pattern classification. IEEE Trans Cybern 44(7):1067–1079CrossRef
56.
go back to reference Mozafari K, Nasiri JA, Charkari NM, et al. (2011) Hierarchical least square twin support vector machines based framework for human action recognition. In: Machine vision and image processing (MVIP), 2011 7th Iranian. IEEE, pp 1–5 Mozafari K, Nasiri JA, Charkari NM, et al. (2011) Hierarchical least square twin support vector machines based framework for human action recognition. In: Machine vision and image processing (MVIP), 2011 7th Iranian. IEEE, pp 1–5
57.
go back to reference Ding X, Zhang G, Ke Y, et al (2008) High efficient intrusion detection methodology with twin support vector machines. In: ISISE’08, 2008, pp 560–564 Ding X, Zhang G, Ke Y, et al (2008) High efficient intrusion detection methodology with twin support vector machines. In: ISISE’08, 2008, pp 560–564
58.
go back to reference Zhang X, Gao X, Wang Y (2008) Microcalcification clusters detection with tensor subspace learning and twin SVMs. In: WCICA 2008, IEEE, 2008, pp 1758–1763 Zhang X, Gao X, Wang Y (2008) Microcalcification clusters detection with tensor subspace learning and twin SVMs. In: WCICA 2008, IEEE, 2008, pp 1758–1763
59.
go back to reference Zhang X (2009) Boosting twin support vector machine approach for MCs detection. In: APCIP 2009, IEEE, 2009, vol 1, pp 149–152 Zhang X (2009) Boosting twin support vector machine approach for MCs detection. In: APCIP 2009, IEEE, 2009, vol 1, pp 149–152
60.
go back to reference Zhang X, Gao X, Wang M (2009) MCs detection approach using Bagging and Boosting based twin support vector machine. In SMC 2009. IEEE international conference on, IEEE, 2009, pp 5000–5505 Zhang X, Gao X, Wang M (2009) MCs detection approach using Bagging and Boosting based twin support vector machine. In SMC 2009. IEEE international conference on, IEEE, 2009, pp 5000–5505
61.
go back to reference Cong H, Yang C, Pu X (2008) Efficient speaker recognition based on multi-class twin support vector machines and GMMs. In: IEEE conference on robotics, automation and mechatronics, pp 348–352 Cong H, Yang C, Pu X (2008) Efficient speaker recognition based on multi-class twin support vector machines and GMMs. In: IEEE conference on robotics, automation and mechatronics, pp 348–352
62.
go back to reference Ding M, Yang D, Li X (2013) Fault diagnosis for wireless sensor by twin support vector machine. Mathematical Problems in Engineering Ding M, Yang D, Li X (2013) Fault diagnosis for wireless sensor by twin support vector machine. Mathematical Problems in Engineering
Metadata
Title
Twin support vector machine: theory, algorithm and applications
Authors
Shifei Ding
Nan Zhang
Xiekai Zhang
Fulin Wu
Publication date
02-03-2016
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 11/2017
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-016-2245-4

Other articles of this Issue 11/2017

Neural Computing and Applications 11/2017 Go to the issue

Premium Partner