Skip to main content
Erschienen in: Neural Computing and Applications 11/2017

02.03.2016 | Review

Twin support vector machine: theory, algorithm and applications

verfasst von: Shifei Ding, Nan Zhang, Xiekai Zhang, Fulin Wu

Erschienen in: Neural Computing and Applications | Ausgabe 11/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Twin support vector machine (TWSVM) has gained increasing interest from various research fields recently. In this paper, we aim to report the current state of the theoretical research and practical advances on TWSVM. We first give the basic thought and theory of TWSVM, including the theory of proximal support vector machine, generalized eigenvalue proximal support vector machine, and TWSVM. Then, we focus on the various improvements made to TWSVM, mainly including least squares twin support vector machine, smooth twin support vector machine, regularized twin support vector machine, projection twin support vector machine, and modified TWSVM on the model selection problem. These newly emerging algorithms greatly expand the applications of TWSVM. In recent years, there is a lot of research on application of TWSVM. Next, we list some research on application of TWSVM in detail. Finally, we try to provide a comprehensive view of these advances in TWSVM and discuss the direction of future research.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cristianini N, Taylor JS (2004) An introduction to support vector machines and other kernel-based learning methods (trans: Guozheng L, Meng W, Huajun Z). Electronic Industry Press, Beijing Cristianini N, Taylor JS (2004) An introduction to support vector machines and other kernel-based learning methods (trans: Guozheng L, Meng W, Huajun Z). Electronic Industry Press, Beijing
2.
Zurück zum Zitat Ding S, Qi B, Tan H (2011) An overview on theory and algorithm of support vector machines. UESTC J Univ Electron Sci Technol China 40(1):2–10 Ding S, Qi B, Tan H (2011) An overview on theory and algorithm of support vector machines. UESTC J Univ Electron Sci Technol China 40(1):2–10
3.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support-vector networks. Spr Mach Learn 20(2):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Spr Mach Learn 20(2):273–297MATH
4.
Zurück zum Zitat Vapnik VN (2000) The nature of statistical learning theory (trans: Zhang X). Tsinghua University Press, Beijing Vapnik VN (2000) The nature of statistical learning theory (trans: Zhang X). Tsinghua University Press, Beijing
5.
Zurück zum Zitat Vapnik VN (2004) Statical learning theory (trans: Janhua X, Xuegong Z). Electronic Industry Press, Beijing Vapnik VN (2004) Statical learning theory (trans: Janhua X, Xuegong Z). Electronic Industry Press, Beijing
6.
Zurück zum Zitat Nguyen TD, Lee HH (2014) A new SVM method for an indirect matrix converter with common-mode voltage reduction. IEEE Trans Industr Inf 10(1):61–72CrossRef Nguyen TD, Lee HH (2014) A new SVM method for an indirect matrix converter with common-mode voltage reduction. IEEE Trans Industr Inf 10(1):61–72CrossRef
7.
Zurück zum Zitat Pasolli E, Melgani F, Tuia D et al (2014) SVM active learning approach for image classification using spatial information. IEEE Trans Geosci Remote Sens 52(4):2217–2233CrossRef Pasolli E, Melgani F, Tuia D et al (2014) SVM active learning approach for image classification using spatial information. IEEE Trans Geosci Remote Sens 52(4):2217–2233CrossRef
8.
Zurück zum Zitat Weis C, Hess A, Budinsky L et al (2015) In-vivo imaging of cell migration using contrast enhanced MRI and SVM based post-processing. PLoS ONE 10(12):e0140548CrossRef Weis C, Hess A, Budinsky L et al (2015) In-vivo imaging of cell migration using contrast enhanced MRI and SVM based post-processing. PLoS ONE 10(12):e0140548CrossRef
9.
Zurück zum Zitat Li P, Dong L, Xiao H et al (2015) A cloud image detection method based on SVM vector machine. Neurocomputing 169:34–42CrossRef Li P, Dong L, Xiao H et al (2015) A cloud image detection method based on SVM vector machine. Neurocomputing 169:34–42CrossRef
10.
Zurück zum Zitat Dou Z, Mebarki A, Ni L et al (2016) SVM application in hazard assessment: self-heating for sulfurized rust. J Loss Prev Process Ind 39:112–120CrossRef Dou Z, Mebarki A, Ni L et al (2016) SVM application in hazard assessment: self-heating for sulfurized rust. J Loss Prev Process Ind 39:112–120CrossRef
11.
Zurück zum Zitat Ding L, Yu F, Peng S et al (2013) A classification algorithm for network traffic based on improved support vector machine. J Comput 8(4):1090–1096 Ding L, Yu F, Peng S et al (2013) A classification algorithm for network traffic based on improved support vector machine. J Comput 8(4):1090–1096
12.
Zurück zum Zitat Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300CrossRefMATH Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300CrossRefMATH
13.
Zurück zum Zitat Fung G, Mangasarian OL (2001) Proximal support vector machine classifiers. In: Proceedings of 7th ACMSIFKDD, pp 77–86 Fung G, Mangasarian OL (2001) Proximal support vector machine classifiers. In: Proceedings of 7th ACMSIFKDD, pp 77–86
14.
Zurück zum Zitat Li K, Lu XX (2013) Twin support vector machine algorithm with fuzzy weighting. Comput Eng Appl 49(4):162–165 Li K, Lu XX (2013) Twin support vector machine algorithm with fuzzy weighting. Comput Eng Appl 49(4):162–165
15.
Zurück zum Zitat Mangasarian OL, Wild EW (2006) Multi-surface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef Mangasarian OL, Wild EW (2006) Multi-surface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef
16.
Zurück zum Zitat Jayadeva, Reshma K, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRefMATH Jayadeva, Reshma K, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRefMATH
17.
Zurück zum Zitat Ding S, Yu J, Qi B et al (2014) An overview on twin support vector machines. Artif Intell Rev 42(2):245–252CrossRef Ding S, Yu J, Qi B et al (2014) An overview on twin support vector machines. Artif Intell Rev 42(2):245–252CrossRef
18.
Zurück zum Zitat Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29(13):1842–1848CrossRef Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29(13):1842–1848CrossRef
19.
Zurück zum Zitat Peng X (2011) TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recogn 44(10):2678–2692CrossRefMATH Peng X (2011) TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recogn 44(10):2678–2692CrossRefMATH
20.
Zurück zum Zitat Wang Z, Shao YH, Wu TR (2013) A GA-based model selection for smooth twin parametric-margin support vector machine. Pattern Recogn 46(8):2267–2277CrossRefMATH Wang Z, Shao YH, Wu TR (2013) A GA-based model selection for smooth twin parametric-margin support vector machine. Pattern Recogn 46(8):2267–2277CrossRefMATH
21.
Zurück zum Zitat Qi Z, Tian Y, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53CrossRefMATH Qi Z, Tian Y, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53CrossRefMATH
22.
Zurück zum Zitat Chen WJ, Shao YH, Hong N (2013) Laplacian smooth twin support vector machine for semi-supervised classification. Int J Mach Learn Cybernet 5(3):1–10 Chen WJ, Shao YH, Hong N (2013) Laplacian smooth twin support vector machine for semi-supervised classification. Int J Mach Learn Cybernet 5(3):1–10
23.
24.
Zurück zum Zitat Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef
25.
Zurück zum Zitat Kumar MA, Khemchandani R, Gopal M et al (2010) Knowledge based least squares twin support vector machines. Inf Sci 180(23):4606–4618MathSciNetCrossRefMATH Kumar MA, Khemchandani R, Gopal M et al (2010) Knowledge based least squares twin support vector machines. Inf Sci 180(23):4606–4618MathSciNetCrossRefMATH
26.
Zurück zum Zitat Chen J, Ji G (2010) Weighted least squares twin support vector machines for pattern classification. ICCAE 2:242–246 Chen J, Ji G (2010) Weighted least squares twin support vector machines for pattern classification. ICCAE 2:242–246
27.
Zurück zum Zitat Chen J, Ji G (2010) Multi-class LSTSVM classifier based on optimal directed acyclic graph. In: ICCAE, IEEE, 2010, pp 100–104 Chen J, Ji G (2010) Multi-class LSTSVM classifier based on optimal directed acyclic graph. In: ICCAE, IEEE, 2010, pp 100–104
28.
Zurück zum Zitat Gao S, Ye Q, Ye N (2011) 1-Norm least squares twin support vector machines. Neurocomputing 74(17):3590–3597CrossRef Gao S, Ye Q, Ye N (2011) 1-Norm least squares twin support vector machines. Neurocomputing 74(17):3590–3597CrossRef
29.
Zurück zum Zitat Chen X, Yang J, Ye Q et al (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655CrossRefMATH Chen X, Yang J, Ye Q et al (2011) Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn 44(10):2643–2655CrossRefMATH
30.
Zurück zum Zitat Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307CrossRefMATH Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recogn 45(6):2299–2307CrossRefMATH
31.
Zurück zum Zitat Hua X, Ding S (2012) Matrix pattern based projection twin support vector machines. Int J Digit Content Technol Appl 6(20):172–181CrossRef Hua X, Ding S (2012) Matrix pattern based projection twin support vector machines. Int J Digit Content Technol Appl 6(20):172–181CrossRef
32.
Zurück zum Zitat Shao Y, Wang Z, Chen WJ et al (2013) A regularization for the projection twin support vector machine. Knowl-Based Syst 37:203–210CrossRef Shao Y, Wang Z, Chen WJ et al (2013) A regularization for the projection twin support vector machine. Knowl-Based Syst 37:203–210CrossRef
33.
Zurück zum Zitat Wang D, Ye Q, Ye N (2010) Localized multi-plane TWSVM classifier via manifold regularization. In: IHMSC, IEEE, 2010, pp 70–73 Wang D, Ye Q, Ye N (2010) Localized multi-plane TWSVM classifier via manifold regularization. In: IHMSC, IEEE, 2010, pp 70–73
34.
Zurück zum Zitat Shao Y, Deng N (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121CrossRefMATH Shao Y, Deng N (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25:114–121CrossRefMATH
35.
Zurück zum Zitat Gao B, Wang J, Huang H (2012) L2-loss twin support vector machine for classification. In: BMEI, 2012, pp 1265–1269 Gao B, Wang J, Huang H (2012) L2-loss twin support vector machine for classification. In: BMEI, 2012, pp 1265–1269
36.
Zurück zum Zitat Wang Y, Zhao X, Tian Y (2013) Local and global regularized twin SVM. Proc Comput Sci 18:1710–1719CrossRef Wang Y, Zhao X, Tian Y (2013) Local and global regularized twin SVM. Proc Comput Sci 18:1710–1719CrossRef
37.
38.
39.
Zurück zum Zitat Su F, Shang H (2013) A wavelet kernel-based primal twin support vector machine for economic development prediction. Mathematical Problems in Engineering Su F, Shang H (2013) A wavelet kernel-based primal twin support vector machine for economic development prediction. Mathematical Problems in Engineering
40.
Zurück zum Zitat Yu J, Ding S, Jin F et al (2012) Twin support vector machines based on rough sets. Int J Digit Content Technol Appl 6(20):493–500CrossRef Yu J, Ding S, Jin F et al (2012) Twin support vector machines based on rough sets. Int J Digit Content Technol Appl 6(20):493–500CrossRef
41.
Zurück zum Zitat Ding S, Yu J, Huang H et al (2013) Twin support vector machines based on particle swarm optimization. J Comput 8(9):2296–2303CrossRef Ding S, Yu J, Huang H et al (2013) Twin support vector machines based on particle swarm optimization. J Comput 8(9):2296–2303CrossRef
42.
Zurück zum Zitat Ding S, Wu F, Nie R et al (2013) Twin support vector machines based on particle swarm optimization. J Softw 8(7):1743–1750CrossRef Ding S, Wu F, Nie R et al (2013) Twin support vector machines based on particle swarm optimization. J Softw 8(7):1743–1750CrossRef
43.
Zurück zum Zitat Huang H, Ding S, Wu F (2013) Invasive weed optimization algorithm for optimizating the parameters of mixed kernel twin support vector machines. J Comput 8(8):2077–2084CrossRef Huang H, Ding S, Wu F (2013) Invasive weed optimization algorithm for optimizating the parameters of mixed kernel twin support vector machines. J Comput 8(8):2077–2084CrossRef
44.
45.
Zurück zum Zitat Peng X (2011) Building sparse twin support vector machine classifiers in primal space. Inf Sci 181(18):3967–3980CrossRef Peng X (2011) Building sparse twin support vector machine classifiers in primal space. Inf Sci 181(18):3967–3980CrossRef
46.
Zurück zum Zitat Ye Q, Zhao C, Ye N et al (2011) Localized twin SVM via convex minimization. Neurocomputing 74(4):580–587CrossRef Ye Q, Zhao C, Ye N et al (2011) Localized twin SVM via convex minimization. Neurocomputing 74(4):580–587CrossRef
47.
Zurück zum Zitat Qi Z, Tian Y, Shi Y (2012) Twin support vector machine with universum data. Neural Netw 36:112–119CrossRefMATH Qi Z, Tian Y, Shi Y (2012) Twin support vector machine with universum data. Neural Netw 36:112–119CrossRefMATH
48.
Zurück zum Zitat Xu Y, Wang L, Zhong P (2012) A rough margin-based ν-twin support vector machine. Neural Comput Appl 21(6):1307–1317CrossRef Xu Y, Wang L, Zhong P (2012) A rough margin-based ν-twin support vector machine. Neural Comput Appl 21(6):1307–1317CrossRef
49.
Zurück zum Zitat Ye Q, Zhao C, Gao S et al (2012) Weighted twin support vector machines with local information and its application. Neural Netw 35:31–39CrossRefMATH Ye Q, Zhao C, Gao S et al (2012) Weighted twin support vector machines with local information and its application. Neural Netw 35:31–39CrossRefMATH
50.
Zurück zum Zitat Peng X, Xu D (2013) Bi-density twin support vector machines for pattern recognition. Neurocomputing 99:134–143CrossRef Peng X, Xu D (2013) Bi-density twin support vector machines for pattern recognition. Neurocomputing 99:134–143CrossRef
51.
Zurück zum Zitat Peng X, Xu D (2013) Robust minimum class variance twin support vector machine classifier. Neural Comput Appl 22(5):999–1011CrossRef Peng X, Xu D (2013) Robust minimum class variance twin support vector machine classifier. Neural Comput Appl 22(5):999–1011CrossRef
52.
Zurück zum Zitat Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRefMATH Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRefMATH
53.
Zurück zum Zitat Qi Z, Tian Y, Shi Y (2013) Structural twin support vector machine for classification. Knowl-Based Syst 43:74–81CrossRef Qi Z, Tian Y, Shi Y (2013) Structural twin support vector machine for classification. Knowl-Based Syst 43:74–81CrossRef
54.
Zurück zum Zitat Naik G, Kumar D (2010) Twin SVM for gesture classification using the surface electromyogram. IEEE Trans Inf Technol Biomed 14(2):301–308CrossRef Naik G, Kumar D (2010) Twin SVM for gesture classification using the surface electromyogram. IEEE Trans Inf Technol Biomed 14(2):301–308CrossRef
55.
Zurück zum Zitat Tian Y, Qi Z, Ju X et al (2014) Nonparallel support vector machines for pattern classification. IEEE Trans Cybern 44(7):1067–1079CrossRef Tian Y, Qi Z, Ju X et al (2014) Nonparallel support vector machines for pattern classification. IEEE Trans Cybern 44(7):1067–1079CrossRef
56.
Zurück zum Zitat Mozafari K, Nasiri JA, Charkari NM, et al. (2011) Hierarchical least square twin support vector machines based framework for human action recognition. In: Machine vision and image processing (MVIP), 2011 7th Iranian. IEEE, pp 1–5 Mozafari K, Nasiri JA, Charkari NM, et al. (2011) Hierarchical least square twin support vector machines based framework for human action recognition. In: Machine vision and image processing (MVIP), 2011 7th Iranian. IEEE, pp 1–5
57.
Zurück zum Zitat Ding X, Zhang G, Ke Y, et al (2008) High efficient intrusion detection methodology with twin support vector machines. In: ISISE’08, 2008, pp 560–564 Ding X, Zhang G, Ke Y, et al (2008) High efficient intrusion detection methodology with twin support vector machines. In: ISISE’08, 2008, pp 560–564
58.
Zurück zum Zitat Zhang X, Gao X, Wang Y (2008) Microcalcification clusters detection with tensor subspace learning and twin SVMs. In: WCICA 2008, IEEE, 2008, pp 1758–1763 Zhang X, Gao X, Wang Y (2008) Microcalcification clusters detection with tensor subspace learning and twin SVMs. In: WCICA 2008, IEEE, 2008, pp 1758–1763
59.
Zurück zum Zitat Zhang X (2009) Boosting twin support vector machine approach for MCs detection. In: APCIP 2009, IEEE, 2009, vol 1, pp 149–152 Zhang X (2009) Boosting twin support vector machine approach for MCs detection. In: APCIP 2009, IEEE, 2009, vol 1, pp 149–152
60.
Zurück zum Zitat Zhang X, Gao X, Wang M (2009) MCs detection approach using Bagging and Boosting based twin support vector machine. In SMC 2009. IEEE international conference on, IEEE, 2009, pp 5000–5505 Zhang X, Gao X, Wang M (2009) MCs detection approach using Bagging and Boosting based twin support vector machine. In SMC 2009. IEEE international conference on, IEEE, 2009, pp 5000–5505
61.
Zurück zum Zitat Cong H, Yang C, Pu X (2008) Efficient speaker recognition based on multi-class twin support vector machines and GMMs. In: IEEE conference on robotics, automation and mechatronics, pp 348–352 Cong H, Yang C, Pu X (2008) Efficient speaker recognition based on multi-class twin support vector machines and GMMs. In: IEEE conference on robotics, automation and mechatronics, pp 348–352
62.
Zurück zum Zitat Ding M, Yang D, Li X (2013) Fault diagnosis for wireless sensor by twin support vector machine. Mathematical Problems in Engineering Ding M, Yang D, Li X (2013) Fault diagnosis for wireless sensor by twin support vector machine. Mathematical Problems in Engineering
Metadaten
Titel
Twin support vector machine: theory, algorithm and applications
verfasst von
Shifei Ding
Nan Zhang
Xiekai Zhang
Fulin Wu
Publikationsdatum
02.03.2016
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 11/2017
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-016-2245-4

Weitere Artikel der Ausgabe 11/2017

Neural Computing and Applications 11/2017 Zur Ausgabe

Premium Partner