Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Evolutionary Intelligence
Published in: Evolutionary Intelligence 1/2022

21-11-2020 | Research Paper

Stochastic nonparallel hyperplane support vector machine for binary classification problems and no-free-lunch theorems

Author: Ashish Sharma

Published in: Evolutionary Intelligence | Issue 1/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, the binary classification problem is considered and its solution is proposed as the formulated classification model, based on genetic algorithm (GA) and nonparallel hyperplane support vector machine (NHSVM), termed as stochastic nonparallel hyperplane support vector machine (SNHSVM). As GA provably violates the non-revisiting condition of the no-free-lunch theorems for optimization (NFLO), then SNHSVM have the natural property that NFLO do not apply to it. All the experiments are performed in a scenario in which no-free-lunch theorems for machine learning (NFLM) do not apply on all the compared machines. The hypothesis is that in such a scenario some classifier can perform better than others. The experiments are performed on the real world UCI datasets and the SNHSVM is compared with the state of art support vector based classifiers with performance measure as accuracy. SNHSVM achieves the highest accuracy in 100% of the cases and the Friedman test confirms the better performance of SNHSVM on all of the datasets used. These results validate the hypothesis empirically while apart from SNHSVM the NFLM floats up for the other compared classifiers.
previous article Two levels approach based on multifactorial optimization to solve the clustered shortest path tree problem
next article Analysis on intelligent machine learning enabled with meta-heuristic algorithms for solar irradiance prediction

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Appendix
Available only for authorised users
Literature
1.
Schölkopf B, Smola AJ (2002) Learning with kernels: support vector machines, regularization, optimization, and beyond. MIT Press, Cambridge
2.
Haykin SS (2009) Neural networks and learning machines. Pearson, Upper Saddle River
3.
Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
4.
Alzubi J, Nayyar A, Kumar A (2018) Machine learning from theory to algorithms: an overview. In: Journal of physics: conference series, vol. 1142, no. 1, p. 012012. IOP Publishing
5.
Zhang Y, Zhao Y (2014) Applications of support vector machines in astronomy. In: Astronomical data analysis software and systems XXIII, vol. 485, p. 239
6.
Díaz J, Acosta J, González R, Cota J, Sifuentes E, Nebot À (2018) Modeling the control of the central nervous system over the cardiovascular system using support vector machines. Comput Biol Med 1(93):75–83CrossRef
7.
Li H, Liang Y, Xu Q (2009) Support vector machines and its applications in chemistry. Chemom Intell Lab Syst 95(2):188–198CrossRef
8.
Azzam M, Awad M, Zeaiter J (2018) Application of evolutionary neural networks and support vector machines to model NOx emissions from gas turbines. J Environ Chem Eng 6:1044–1052CrossRef
9.
Yan J, Jin J, Chen F, Yu G, Yin H, Wang W (2018) Urban flash flood forecast using support vector machine and numerical simulation. J Hydroinform 20(1):221–231CrossRef
10.
Wang F, Liu S, Ni W, Xu Z, Qiu Z, Wan Z, Pan Z (2019) Imbalanced data classification algorithm with support vector machine kernel extensions. Evol Intell 12(3):341–347CrossRef
11.
Mangasarian OL, Wild EW (2006) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef
12.
Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRef
13.
Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef
14.
Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recognit 46(1):305–316CrossRef
15.
Qi Z, Tian Y, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53CrossRef
16.
Shao YH, Chen WJ, Deng NY (2014) Nonparallel hyperplane support vector machine for binary classification problems. Inf Sci 1(263):22–35MathSciNetCrossRef
17.
Ding S, Zhang X, Yu J (2016) Twin support vector machines based on fruit fly optimization algorithm. Int J Mach Learn Cybern 7(2):193–203CrossRef
18.
Wang Z, Shao YH, Wu TR (2013) A GA-based model selection for smooth twin parametric-margin support vector machine. Pattern Recognit 46(8):2267–2277CrossRef
19.
Zhang X, Qiu D, Chen F (2015) Support vector machine with parameter optimization by a novel hybrid method and its application to fault diagnosis. Neurocomputing. 3(149):641–651CrossRef
20.
Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82CrossRef
21.
Wolpert DH (2002) The supervised learning no-free-lunch theorems. In: Roy R, Köppen M, Ovaska S, Furuhashi T, Hoffmann F (eds) Soft computing and industry, pp. 25–42. Springer, London
22.
Wolpert DH (1996) The lack of a priori distinctions between learning algorithms. Neural Comput 8(7):1341–1390CrossRef
23.
Wolpert DH (1996) The existence of a priori distinctions between learning algorithms. Neural Comput 8(7):1391–1420CrossRef
24.
Liu F, Zhou Z (2015) A new data classification method based on chaotic particle swarm optimization and least square-support vector machine. Chemom Intell Lab Syst 15(147):147–156CrossRef
25.
Zhai S, Jiang T (2015) A new sense-through-foliage target recognition method based on hybrid differential evolution and self-adaptive particle swarm optimization-based support vector machine. Neurocomputing. 3(149):573–584CrossRef
26.
Zhai S, Jiang T (2014) A novel particle swarm optimization trained support vector machine for automatic sense-through-foliage target recognition system. Knowl Based Syst 1(65):50–59CrossRef
27.
Pai PF, Hong WC (2005) Support vector machines with simulated annealing algorithms in electricity load forecasting. Energy Convers Manag 46(17):2669–2688CrossRef
28.
Zhai S, Pan J, Luo H, Fu S, Chen H (2016) A new sense-through-foliage target recognition method based on hybrid particle swarm optimization-based wavelet twin support vector machine. Measurement 1(80):58–70CrossRef
29.
Sartakhti JS, Afrabandpey H, Saraee M (2017) Simulated annealing least squares twin support vector machine (SA-LSTSVM) for pattern classification. Soft Comput 21(15):4361–4373CrossRef
30.
Yang XS (2014) Nature-inspired optimization algorithms. Elsevier, AmsterdamMATH
31.
Nayyar A, Le DN, Nguyen NG (eds) (2018) Advances in swarm intelligence for optimizing problems in computer science. CRC Press, Boca Raton
32.
Xing B, Gao WJ (2016) Innovative computational intelligence: a rough guide to 134 clever algorithms. Springer, Berlin, p 105MATH
33.
Khemchandani R, Chandra S (2016) Twin support vector machines: models, extensions and applications. Springer, BerlinMATH
34.
Holland JH (1975) Adaption in natural and artificial systems. The University of Michigan Press, Ann ArborMATH
35.
De Jong KA (1975) Analysis of the behavior of a class of genetic adaptive systems. University of Michigan, Techniqual Report No 185
36.
Nayyar A, Nguyen NG (2018) Introduction to swarm intelligence. Adv Swarm Intell Optim Probl Comput Sci 3:53–78
37.
Nayyar A, Garg S, Gupta D, Khanna A (2018) Evolutionary computation: theory and algorithms. In: Nayyar A, Le D-N, Nguyen NG (eds) Advances in swarm intelligence for optimizing problems in computer science, pp 1–26. Chapman and Hall/CRC
38.
Wright AH, Zhao Y (1999) Markov chain models of genetic algorithms. In: Proceedings of the 1st annual conference on genetic and evolutionary computation, vol 1, pp 734–741. Morgan Kaufmann Publishers Inc
39.
Suzuki J (1995) A Markov chain analysis on simple genetic algorithms. IEEE Trans Systems Man Cybern 25(4):655–659CrossRef
40.
41.
Goldberg DE, Segrest P (1987) Finite Markov chain analysis of genetic algorithms. In: Proceedings of the second international conference on genetic algorithms, vol 1, p 1
42.
Sewell M, Shawe-Taylor J (2012) Forecasting foreign exchange rates using kernel methods. Expert Syst Appl 39(9):7652–7662CrossRef
43.
Aggarwal CC (2015) Data mining: the textbook. Springer, BerlinMATH
44.
Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):1–27CrossRef
45.
46.
Demšar J (2009) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(1):1–30MathSciNetMATH
47.
48.
Rudolph G (1994) Convergence analysis of canonical genetic algorithms. IEEE Trans Neural Netw 5(1):96–101CrossRef
Metadata
Title
Stochastic nonparallel hyperplane support vector machine for binary classification problems and no-free-lunch theorems
Author
Ashish Sharma
Publication date
21-11-2020
Publisher
Springer Berlin Heidelberg
Published in
Evolutionary Intelligence / Issue 1/2022
Print ISSN: 1864-5909
Electronic ISSN: 1864-5917
DOI
https://doi.org/10.1007/s12065-020-00503-8

Other articles of this Issue 1/2022

Evolutionary Intelligence 1/2022 Go to the issue

Research Paper

A multi-objective approach for solving transmission expansion planning problem considering wind power uncertainty

Research Paper

FAB classification of acute leukemia using an ensemble of neural networks

Research Paper

Towards robot vision using deep neural networks in evolutionary robotics

Research Paper

Analysis on intelligent machine learning enabled with meta-heuristic algorithms for solar irradiance prediction

Research Paper

Comparative analysis of machine learning algorithms for Lip print based person identification

Research Paper

An improved hybrid genetic algorithm to construct balanced Boolean function with optimal cryptographic properties

Premium Partner

    Image Credits