Skip to main content
Top

2017 | OriginalPaper | Chapter

5. Variants of Twin Support Vector Machines: Some More Formulations

Authors : Jayadeva, Reshma Khemchandani, Suresh Chandra

Published in: Twin Support Vector Machines

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Twin support vector machine formulation (TWSVM) is based on the idea of generalized eigenvalue proximal support vector machine formulation (GEPSVM), which determines two nonparallel planes by solving two related SVM-type problems, so that its computing cost in the training phase is much smaller than that of the standard SVM. In addition to keeping the superior characteristics of GEPSVM, the classification performance of TWSVM significantly outperforms that of GEPSVM. However, the stand-alone method requires the solution of two smaller quadratic programming problems. This chapter mainly reviews the research progress of TWSVM and presents some of its extensions including the learning model and specific applications in recent years.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Suykens, J. A., & Vandewalle, J. (1999). Least squares support vector machine classifiers. Neural processing letters, 9(3), 293–300.MathSciNetCrossRefMATH Suykens, J. A., & Vandewalle, J. (1999). Least squares support vector machine classifiers. Neural processing letters, 9(3), 293–300.MathSciNetCrossRefMATH
2.
go back to reference Kumar, M. A., & Gopal, M. (2009). Least squares twin support vector machines for pattern classification. Expert Systems and its Applications, 36(4), 7535–7543.CrossRef Kumar, M. A., & Gopal, M. (2009). Least squares twin support vector machines for pattern classification. Expert Systems and its Applications, 36(4), 7535–7543.CrossRef
3.
go back to reference Chandra, S., Jayadeva, & Mehra, A. (2009). Numerical Optimization with Applications. New Delhi: Narosa Publishing House. Chandra, S., Jayadeva, & Mehra, A. (2009). Numerical Optimization with Applications. New Delhi: Narosa Publishing House.
5.
go back to reference Nasiri, J. A., Charkari, N. M., & Mozafari, K. (2014). Energy-based model of least squares twin Support Vector Machines for human action recognition. Signal Processing, 104, 248–257.CrossRef Nasiri, J. A., Charkari, N. M., & Mozafari, K. (2014). Energy-based model of least squares twin Support Vector Machines for human action recognition. Signal Processing, 104, 248–257.CrossRef
6.
go back to reference Laptev I., Marszalek M., Schmid C., & Rozenfeld B. (2008). Learning realistic human actions from movies. IEEE Conference on Computer Vision and Pattern Recognition, CVPR, (p. 18). IEEE. Laptev I., Marszalek M., Schmid C., & Rozenfeld B. (2008). Learning realistic human actions from movies. IEEE Conference on Computer Vision and Pattern Recognition, CVPR, (p. 18). IEEE.
7.
go back to reference Jayadeva, Khemchandani. R., & Chandra, S. (2007). Twin support vector machines for pattern classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(5), 905–910. Jayadeva, Khemchandani. R., & Chandra, S. (2007). Twin support vector machines for pattern classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(5), 905–910.
8.
go back to reference Peng, X. J. (2010). A \(\nu \)-twin support vector machine (\(\nu \)-TWSVM) classifier and its geometric algorithms. Information Science, 180(20), 3863–3875.CrossRefMATH Peng, X. J. (2010). A \(\nu \)-twin support vector machine (\(\nu \)-TWSVM) classifier and its geometric algorithms. Information Science, 180(20), 3863–3875.CrossRefMATH
9.
go back to reference Schoolkopf, B., Smola, A., Williamson, R., & Bartlett, P. L. (2000). New support vector algorithms. Neural Computation, 12(5), 1207–1245. Schoolkopf, B., Smola, A., Williamson, R., & Bartlett, P. L. (2000). New support vector algorithms. Neural Computation, 12(5), 1207–1245.
10.
go back to reference Hao, Y. P. (2010). New support vector algorithms with parametric insensitive margin model. Neural Networks, 23(1), 60–73.CrossRef Hao, Y. P. (2010). New support vector algorithms with parametric insensitive margin model. Neural Networks, 23(1), 60–73.CrossRef
11.
go back to reference Peng, X. (2011). TPSVM: A novel twin parametric-margin support vector for pattern recognition. Pattern Recognition, 44(10–11), 2678–2692.CrossRefMATH Peng, X. (2011). TPSVM: A novel twin parametric-margin support vector for pattern recognition. Pattern Recognition, 44(10–11), 2678–2692.CrossRefMATH
12.
go back to reference Peng, X. J., Wang, Y. F., & Xu, D. (2013). Structural twin parametric margin support vector machine for binary classification. Knowledge-Based Systems, 49, 63–72.CrossRef Peng, X. J., Wang, Y. F., & Xu, D. (2013). Structural twin parametric margin support vector machine for binary classification. Knowledge-Based Systems, 49, 63–72.CrossRef
13.
go back to reference Khemchandani, R., & Sharma,S. (2016). Robust parametric twin support vector machines and its applications to human activity recognition. In Proceedings of International Conference on Image Processing, IIT Roorkee. Khemchandani, R., & Sharma,S. (2016). Robust parametric twin support vector machines and its applications to human activity recognition. In Proceedings of International Conference on Image Processing, IIT Roorkee.
14.
go back to reference Tian, Y. J., Qi, Z. Q., Ju, X. C., Shi, Y., & Liu, X. H. (2013). Nonparallel support vector machines for pattern classification. IEEE Transactions on cybernertics, 44(7), 1067–1079.CrossRef Tian, Y. J., Qi, Z. Q., Ju, X. C., Shi, Y., & Liu, X. H. (2013). Nonparallel support vector machines for pattern classification. IEEE Transactions on cybernertics, 44(7), 1067–1079.CrossRef
15.
go back to reference Hsu, C.-W., & Lin, C.-J. (2002). A comparison of methods for multiclass support vector machines. IEEE Transactions on Neural Networks, 13(2), 415–425.CrossRef Hsu, C.-W., & Lin, C.-J. (2002). A comparison of methods for multiclass support vector machines. IEEE Transactions on Neural Networks, 13(2), 415–425.CrossRef
16.
go back to reference Platt, J. C., Cristianini, N., & Shawe-Taylor, J. (2010). Large margin DAGs for multiclass classification. Advances in Neural Information Processing Systems, 12, 547–553. Platt, J. C., Cristianini, N., & Shawe-Taylor, J. (2010). Large margin DAGs for multiclass classification. Advances in Neural Information Processing Systems, 12, 547–553.
17.
go back to reference Kumar, M. A., & Gopal, M. (2010). Fast multiclass SVM classification using decision tree based one-against-all method. Neural Processing Letters, 32, 311–323.CrossRef Kumar, M. A., & Gopal, M. (2010). Fast multiclass SVM classification using decision tree based one-against-all method. Neural Processing Letters, 32, 311–323.CrossRef
18.
go back to reference Chen, P.-C., Lee, K.-Y., Lee, T.-J., Lee, Y.-J., & Huang, S.-Y. (2010). Multiclass support vector classification via coding and regression. Neurocomputing, 73, 1501–1512.CrossRef Chen, P.-C., Lee, K.-Y., Lee, T.-J., Lee, Y.-J., & Huang, S.-Y. (2010). Multiclass support vector classification via coding and regression. Neurocomputing, 73, 1501–1512.CrossRef
19.
go back to reference Jayadeva, Khemchandani. R., & Chandra, S. (2005). Fuzzy linear proximal support vector machines for multi-category data classification. Neurocomputing, 67, 426–435. Jayadeva, Khemchandani. R., & Chandra, S. (2005). Fuzzy linear proximal support vector machines for multi-category data classification. Neurocomputing, 67, 426–435.
20.
go back to reference Lei, H., & Govindaraju, V. (2005). Half-against-half multi-class support vector machines. MCS, LNCS, 3541, 156–164. Lei, H., & Govindaraju, V. (2005). Half-against-half multi-class support vector machines. MCS, LNCS, 3541, 156–164.
21.
go back to reference Shao, Y.-H., Chen, W.-J., Huang, W.-B., Yang, Z.-M., & Deng, N.-Y. (2013). The best separating decision tree twin support vector machine for multi-class classification. Procedia Computer Science, 17, 1032–1038.CrossRef Shao, Y.-H., Chen, W.-J., Huang, W.-B., Yang, Z.-M., & Deng, N.-Y. (2013). The best separating decision tree twin support vector machine for multi-class classification. Procedia Computer Science, 17, 1032–1038.CrossRef
22.
go back to reference Xie, J., Hone, K., Xie, W., Gao, X., Shi, Y., & Liu, X. (2013). Extending twin support vector machine classifier for multi-category classification problems. Intelligent Data Analysis, 17, 649–664. Xie, J., Hone, K., Xie, W., Gao, X., Shi, Y., & Liu, X. (2013). Extending twin support vector machine classifier for multi-category classification problems. Intelligent Data Analysis, 17, 649–664.
23.
go back to reference Xu, Y., Guo, R., & Wang, L. (2013). A Twin multi-class classification support vector machine. Cognate Computer, 5, 580–588.CrossRef Xu, Y., Guo, R., & Wang, L. (2013). A Twin multi-class classification support vector machine. Cognate Computer, 5, 580–588.CrossRef
24.
go back to reference Khemchandani, R., & Saigal, P. (2015). Color image classification and retrieval through ternary decision structure based multi-category TWSVM. Neurocomputing, 165, 444–455.CrossRef Khemchandani, R., & Saigal, P. (2015). Color image classification and retrieval through ternary decision structure based multi-category TWSVM. Neurocomputing, 165, 444–455.CrossRef
25.
go back to reference Queen, M. J. (1967). Some methods for classification and analysis of multivariate observations. In, Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Probability (pp. 281–297). University of California. Queen, M. J. (1967). Some methods for classification and analysis of multivariate observations. In, Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Probability (pp. 281–297). University of California.
26.
go back to reference Zhao, Y., Jia, W., Hu, R. X., & Min, H. (2013). Completed robust local binary pattern for texture classification. Neurocomputing, 106, 68–76.CrossRef Zhao, Y., Jia, W., Hu, R. X., & Min, H. (2013). Completed robust local binary pattern for texture classification. Neurocomputing, 106, 68–76.CrossRef
27.
go back to reference Ricard, Julien, Coeurjolly, David, & Baskurt, Atilla. (2005). Generalizations of angular radial transform for 2D and 3D shape retrieval. Pattern Recognition Letters, 26(14), 2174–2186.CrossRef Ricard, Julien, Coeurjolly, David, & Baskurt, Atilla. (2005). Generalizations of angular radial transform for 2D and 3D shape retrieval. Pattern Recognition Letters, 26(14), 2174–2186.CrossRef
28.
go back to reference Liu, G. H., Zhang, L., Hou, Y. K., Li, Z. Y., & Yang, J. Y. (2010). Image retrieval based on multi-texton histogram. Pattern Recognition, 43(7), 2380–2389.CrossRefMATH Liu, G. H., Zhang, L., Hou, Y. K., Li, Z. Y., & Yang, J. Y. (2010). Image retrieval based on multi-texton histogram. Pattern Recognition, 43(7), 2380–2389.CrossRefMATH
29.
go back to reference Khemchandani, R., Jayadeva, & Chandra, S. (2007). Fuzzy twin support vector machines for pattern classification. In ISPDM’ 07 International Symposium on Mathematical Programming for Decision Making: Theory and Applications. Singapore: World Scientific (Published in Mathematical Programming and Game Theory for Decision Making) Khemchandani, R., Jayadeva, & Chandra, S. (2007). Fuzzy twin support vector machines for pattern classification. In ISPDM’ 07 International Symposium on Mathematical Programming for Decision Making: Theory and Applications. Singapore: World Scientific (Published in Mathematical Programming and Game Theory for Decision Making)
30.
go back to reference Khemchandani, R., Jayadeva, & Chandra, S. (2008). Incremental twin support vector machines. In S.K. Neogy, A.K.das and R. B. Bapat (Eds.), ICMCO-08, International Conference on Modeling, Computation and Optimization. Published in Modeling, Computation and Optimization. Singapore:World Scientific. Khemchandani, R., Jayadeva, & Chandra, S. (2008). Incremental twin support vector machines. In S.K. Neogy, A.K.das and R. B. Bapat (Eds.), ICMCO-08, International Conference on Modeling, Computation and Optimization. Published in Modeling, Computation and Optimization. Singapore:World Scientific.
31.
go back to reference Shao, Y. H., Deng, N. Y., Yang, Z. M., Chen, W. J., & Wang, Z. (2012). Probabilistic outputs for twin support vector machines. Knowledge-Based Systems, 33, 145–151.CrossRef Shao, Y. H., Deng, N. Y., Yang, Z. M., Chen, W. J., & Wang, Z. (2012). Probabilistic outputs for twin support vector machines. Knowledge-Based Systems, 33, 145–151.CrossRef
32.
go back to reference Tian, Y. J., Zhang, Q., & Liu, D. L. (2014). \(\nu \)-Nonparallel support vector machine for pattern classification. Neural Computing and Applications,. doi:10.1007/s00521-014-1575-3. Tian, Y. J., Zhang, Q., & Liu, D. L. (2014). \(\nu \)-Nonparallel support vector machine for pattern classification. Neural Computing and Applications,. doi:10.​1007/​s00521-014-1575-3.
33.
go back to reference Tian, Y. J., Ju, X. C., & Qi, Z. Q. (2013). Efficient sparse nonparallel support vector machines for classification. Neural Computing and Applications, 24(5), 1089–1099.CrossRef Tian, Y. J., Ju, X. C., & Qi, Z. Q. (2013). Efficient sparse nonparallel support vector machines for classification. Neural Computing and Applications, 24(5), 1089–1099.CrossRef
34.
go back to reference Chen, X., Yang, J., Ye, Q., & Liang, J. (2011). Recursive projection twin support vector machine via within-class variance Minimization. Pattern Recognition, 44(10), 2643–2655.CrossRefMATH Chen, X., Yang, J., Ye, Q., & Liang, J. (2011). Recursive projection twin support vector machine via within-class variance Minimization. Pattern Recognition, 44(10), 2643–2655.CrossRefMATH
36.
go back to reference Ding, S., Yu, J., Qi, B., & Huang, H. (2014). An Overview of twin support vector machines. Artificial Intelligence Review., 42(2), 245–252. Ding, S., Yu, J., Qi, B., & Huang, H. (2014). An Overview of twin support vector machines. Artificial Intelligence Review., 42(2), 245–252.
37.
go back to reference Ding, S., Zhang, N., Zhang, X., & Wu. F. (2016). Twin support vector machine: theory, algorithm and applications. Neural Computing and Applications,. doi:10.1007/s00521-016-2245-4. Ding, S., Zhang, N., Zhang, X., & Wu. F. (2016). Twin support vector machine: theory, algorithm and applications. Neural Computing and Applications,. doi:10.​1007/​s00521-016-2245-4.
Metadata
Title
Variants of Twin Support Vector Machines: Some More Formulations
Authors
Jayadeva
Reshma Khemchandani
Suresh Chandra
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-46186-1_5

Premium Partner