Skip to main content
Top
Published in: International Journal of Data Science and Analytics 1/2024

23-08-2022 | Regular Paper

Improved robust nonparallel support vector machines

Authors: Ali Sahleh, Maziar Salahi

Published in: International Journal of Data Science and Analytics | Issue 1/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nonparallel Support Vector Machine (NPSVM) is a binary classification approach that combines the advantages of both support vector machine (SVM) and Twin SVM (TWSVM). It finds two nonparallel hyperplanes by solving two optimization problems such that each hyperplane is closer to one of the classes and as far as possible from the other class. To deal with data uncertainty, the chance-constrained Robust NPSVM (RNPSVM) is developed in López et al. (Neurocomputing 364:227–238, 2019) that improved model fit. In this paper, we propose an improved version of RNPSVM (IRNPSVM) by replacing the \(\epsilon -\)insensitive tube of each class by a chance constraint corresponding to its upper hyperplane while keeping its lower hyperplane. This results in reducing the number of missing data of the related class. It is reformulated as second-order cone programming problems. Experiments on both UCI and NDC datasets show that the improved model has better classification accuracy and its learning time is faster for the majority of the datasets compared to RNPSVM.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cortes, C., Vapnik, V.N.: Support vector networks. Mach. Learn. 20(3), 273–297 (1995)CrossRef Cortes, C., Vapnik, V.N.: Support vector networks. Mach. Learn. 20(3), 273–297 (1995)CrossRef
2.
go back to reference Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, NewYork (1996) Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, NewYork (1996)
3.
go back to reference Vapnik, V.N.: Statistical Learning Theory. John Wiley & Sons, NewYork (1998) Vapnik, V.N.: Statistical Learning Theory. John Wiley & Sons, NewYork (1998)
4.
go back to reference Rahman, M. A., Hasan, S. T., Kader, M. A.: Computer vision based industrial and forest fire detection using support vector machine (SVM). In: 2022 International Conference on Innovations in Science, Engineering and Technology (ICISET), pp. 233–238 (2022) Rahman, M. A., Hasan, S. T., Kader, M. A.: Computer vision based industrial and forest fire detection using support vector machine (SVM). In: 2022 International Conference on Innovations in Science, Engineering and Technology (ICISET), pp. 233–238 (2022)
5.
go back to reference Syriopoulos, T., Tsatsaronis, M., Karamanos, I.: Support vector machine algorithms: an application to ship price forecasting. Comput. Econ. 57(1), 55–87 (2021)CrossRef Syriopoulos, T., Tsatsaronis, M., Karamanos, I.: Support vector machine algorithms: an application to ship price forecasting. Comput. Econ. 57(1), 55–87 (2021)CrossRef
6.
go back to reference Sethy, P.K., Behera, S.K.: A data constrained approach for brain tumour detection using fused deep features and SVM. Multimedia Tools Appl. 80(19), 28745–28760 (2021)CrossRef Sethy, P.K., Behera, S.K.: A data constrained approach for brain tumour detection using fused deep features and SVM. Multimedia Tools Appl. 80(19), 28745–28760 (2021)CrossRef
7.
go back to reference Keerthi, S.S., Shevade, S.K., Bhattacharyya, C., Murthy, K.R.K.: Improvements to platt’s SMO algorithm for SVM classifier design. Neural Comput. 13(3), 637–649 (2001) Keerthi, S.S., Shevade, S.K., Bhattacharyya, C., Murthy, K.R.K.: Improvements to platt’s SMO algorithm for SVM classifier design. Neural Comput. 13(3), 637–649 (2001)
8.
go back to reference Platt, J.: Fast Training of Support Vector Machines using Sequential Minimal Optimization. MIT Press, Cambridge (1998)CrossRef Platt, J.: Fast Training of Support Vector Machines using Sequential Minimal Optimization. MIT Press, Cambridge (1998)CrossRef
9.
go back to reference Mangasarian, O.L., Wild, E.W.: Multisurface proximal support vector classification via generalized eigenvalues. IEEE Trans. Pattern Anal. Mach. Intell. 28, 69–74 (2006)CrossRef Mangasarian, O.L., Wild, E.W.: Multisurface proximal support vector classification via generalized eigenvalues. IEEE Trans. Pattern Anal. Mach. Intell. 28, 69–74 (2006)CrossRef
10.
go back to reference Khemchandani, R., Chandra, S.: Twin support vector machines for pattern classification. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 905–910 (2007)CrossRef Khemchandani, R., Chandra, S.: Twin support vector machines for pattern classification. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 905–910 (2007)CrossRef
11.
go back to reference Tian, Y., Qi, Z., Ju, X., Shi, Y., Liu, X.: Nonparallel support vector machines for pattern classification. IEEE Trans. Cybern. 44(7), 1067–1079 (2014)CrossRef Tian, Y., Qi, Z., Ju, X., Shi, Y., Liu, X.: Nonparallel support vector machines for pattern classification. IEEE Trans. Cybern. 44(7), 1067–1079 (2014)CrossRef
12.
go back to reference Hou, Q., Liu, L., Zhen, L., Jing, L.: A novel projection nonparallel support vector machine for pattern classification. Eng. Appl. Artif. Intell. 75, 64–75 (2018)CrossRef Hou, Q., Liu, L., Zhen, L., Jing, L.: A novel projection nonparallel support vector machine for pattern classification. Eng. Appl. Artif. Intell. 75, 64–75 (2018)CrossRef
13.
go back to reference Chen, D., Tian, Y., Liu, X.: Structural nonparallel support vector machine for pattern recognition. Pattern Recognit. 60, 296–305 (2016)CrossRef Chen, D., Tian, Y., Liu, X.: Structural nonparallel support vector machine for pattern recognition. Pattern Recognit. 60, 296–305 (2016)CrossRef
14.
go back to reference Liu, L., Chu, M., Gong, R., Zhang, L.: An improved nonparallel support vector machine. IEEE Trans. Neural Netw. Learn. Syst. 32(11), 5129–5143 (2020)MathSciNetCrossRef Liu, L., Chu, M., Gong, R., Zhang, L.: An improved nonparallel support vector machine. IEEE Trans. Neural Netw. Learn. Syst. 32(11), 5129–5143 (2020)MathSciNetCrossRef
15.
go back to reference Liu, L., Chu, M., Gong, R., Peng, Y.: Nonparallel support vector machine with large margin distribution for pattern classification. Pattern Recognit. 106, 107374 (2020)CrossRef Liu, L., Chu, M., Gong, R., Peng, Y.: Nonparallel support vector machine with large margin distribution for pattern classification. Pattern Recognit. 106, 107374 (2020)CrossRef
16.
go back to reference Wu, W., Xu, Y., Pang, X.: A hybrid acceleration strategy for nonparallel support vector machine. Inf. Sci. 546, 543–558 (2021)MathSciNetCrossRef Wu, W., Xu, Y., Pang, X.: A hybrid acceleration strategy for nonparallel support vector machine. Inf. Sci. 546, 543–558 (2021)MathSciNetCrossRef
17.
go back to reference Qi, K., Yang, H.: Joint rescaled asymmetric least squared nonparallel support vector machine with a stochastic quasi-Newton based algorithm. Appl. Intell., 1–19 (2022) Qi, K., Yang, H.: Joint rescaled asymmetric least squared nonparallel support vector machine with a stochastic quasi-Newton based algorithm. Appl. Intell., 1–19 (2022)
19.
go back to reference Goldfarb, D., Iyengar, G.: Robust convex quadratically constrained programs. Math. Program. 97(3), 495–515 (2003)MathSciNetCrossRef Goldfarb, D., Iyengar, G.: Robust convex quadratically constrained programs. Math. Program. 97(3), 495–515 (2003)MathSciNetCrossRef
20.
go back to reference Zhong, P., Fukushima, M.: Second order cone programming formulations for robust multi class classification. Neural Comput. 19(1), 258–282 (2007)MathSciNetCrossRef Zhong, P., Fukushima, M.: Second order cone programming formulations for robust multi class classification. Neural Comput. 19(1), 258–282 (2007)MathSciNetCrossRef
21.
go back to reference Shivaswamy, P.K., Bhattacharyya, C., Smola, A.J.: Second order cone programming approaches for handling missing and uncertain data. J. Mach. Learn. Res. 7, 1283–1314 (2006)MathSciNet Shivaswamy, P.K., Bhattacharyya, C., Smola, A.J.: Second order cone programming approaches for handling missing and uncertain data. J. Mach. Learn. Res. 7, 1283–1314 (2006)MathSciNet
22.
go back to reference Lanckriet, G., Ghaoui, L., Bhattacharyya, C., Jordan, M.: A robust minimax approach to classification. J. Mach. Learn. Res. 3, 555–582 (2003)MathSciNet Lanckriet, G., Ghaoui, L., Bhattacharyya, C., Jordan, M.: A robust minimax approach to classification. J. Mach. Learn. Res. 3, 555–582 (2003)MathSciNet
23.
go back to reference Saketha Nath, J., Bhattacharyya, C.: Maximum margin classifiers with specified false positive and false negative error rates. In: Proceedings of the SIAM International Conference on Data Mining (2007) Saketha Nath, J., Bhattacharyya, C.: Maximum margin classifiers with specified false positive and false negative error rates. In: Proceedings of the SIAM International Conference on Data Mining (2007)
24.
go back to reference Maldonado, S., López, J., Carrasco, M.: A second-order cone programming formulation for twin support vector machines. Appl. Intell. 45(2), 265–276 (2016)CrossRef Maldonado, S., López, J., Carrasco, M.: A second-order cone programming formulation for twin support vector machines. Appl. Intell. 45(2), 265–276 (2016)CrossRef
25.
go back to reference Sahleh, A., Salahi, M., Eskandari, S.: SOCP approach to robust twin parametric margin support vector machine. Appl. Intell., 1–19 (2022) Sahleh, A., Salahi, M., Eskandari, S.: SOCP approach to robust twin parametric margin support vector machine. Appl. Intell., 1–19 (2022)
26.
go back to reference Peng, X.: TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recognit. 44(10–11), 2678–2692 (2011)CrossRef Peng, X.: TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recognit. 44(10–11), 2678–2692 (2011)CrossRef
27.
go back to reference López, J., Maldonado, S., Carrasco, M.: Robust nonparallel support vector machines via second-order cone programming. Neurocomputing 364, 227–238 (2019)CrossRef López, J., Maldonado, S., Carrasco, M.: Robust nonparallel support vector machines via second-order cone programming. Neurocomputing 364, 227–238 (2019)CrossRef
28.
go back to reference Ju, H., Zhao, Y., Zhang, Y.: Directed acyclic graph fuzzy nonparallel support vector machine. J. Intell. Fuzzy Syst. 40(1), 1457–1470 (2021)CrossRef Ju, H., Zhao, Y., Zhang, Y.: Directed acyclic graph fuzzy nonparallel support vector machine. J. Intell. Fuzzy Syst. 40(1), 1457–1470 (2021)CrossRef
29.
go back to reference Mercer, J.: Functions of positive and negative type and the connection with the theory of integral equations. Philos. Trans. R. Soc. Lond. Ser. A 209(441–458), 415–446 (1909) Mercer, J.: Functions of positive and negative type and the connection with the theory of integral equations. Philos. Trans. R. Soc. Lond. Ser. A 209(441–458), 415–446 (1909)
30.
go back to reference Grant, M., Boyd, S.: CVX: Matlab software for disciplined convex programming, version 2.1 (2014) Grant, M., Boyd, S.: CVX: Matlab software for disciplined convex programming, version 2.1 (2014)
31.
go back to reference Lin, C.J., Hsu, C.W., Chang, C.C.: A practical guide to support vector classification, National Taiwan University (2003) Lin, C.J., Hsu, C.W., Chang, C.C.: A practical guide to support vector classification, National Taiwan University (2003)
32.
go back to reference Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. John Wiley & Sons, Hoboken (2012) Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. John Wiley & Sons, Hoboken (2012)
33.
go back to reference Friedman, M.: A comparison of alternative tests of significance for the problem of m rankings. Ann. Math. Stat. 11(1), 86–92 (1940)MathSciNetCrossRef Friedman, M.: A comparison of alternative tests of significance for the problem of m rankings. Ann. Math. Stat. 11(1), 86–92 (1940)MathSciNetCrossRef
34.
go back to reference Demsar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNet Demsar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNet
35.
36.
go back to reference An, Y., Ding, S., Shi, S., Li, J.: Discrete space reinforcement learning algorithm based on support vector machine classification. Pattern Recognit. Lett. 111, 30–35 (2018)CrossRef An, Y., Ding, S., Shi, S., Li, J.: Discrete space reinforcement learning algorithm based on support vector machine classification. Pattern Recognit. Lett. 111, 30–35 (2018)CrossRef
37.
go back to reference Shafiabady, N., Lee, L.H., Rajkumar, R., Kallimani, V.P., Akram, N.A., Isa, D.: Using unsupervised clustering approach to train the Support Vector Machine for text classification. Neurocomputing 211, 4–10 (2016) Shafiabady, N., Lee, L.H., Rajkumar, R., Kallimani, V.P., Akram, N.A., Isa, D.: Using unsupervised clustering approach to train the Support Vector Machine for text classification. Neurocomputing 211, 4–10 (2016)
Metadata
Title
Improved robust nonparallel support vector machines
Authors
Ali Sahleh
Maziar Salahi
Publication date
23-08-2022
Publisher
Springer International Publishing
Published in
International Journal of Data Science and Analytics / Issue 1/2024
Print ISSN: 2364-415X
Electronic ISSN: 2364-4168
DOI
https://doi.org/10.1007/s41060-022-00356-7

Other articles of this Issue 1/2024

International Journal of Data Science and Analytics 1/2024 Go to the issue

Premium Partner