Top

Neural Computing and Applications

Published in:

01-04-2015 | Original Article

A chaos embedded GSA-SVM hybrid system for classification

Authors: Chaoshun Li, Xueli An, Ruhai Li

Published in: Neural Computing and Applications | Issue 3/2015

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Parameter optimization and feature selection influence the classification accuracy of support vector machine (SVM) significantly. In order to improve classification accuracy of SVM, this paper hybridizes chaotic search and gravitational search algorithm (GSA) with SVM and presents a new chaos embedded GSA-SVM (CGSA-SVM) hybrid system. In this system, input feature subsets and the SVM parameters are optimized simultaneously, while GSA is used to optimize the parameters of SVM and chaotic search is embedded in the searching iterations of GSA to optimize the feature subsets. Fourteen UCI datasets are employed to calculate the classification accuracy rate in order to evaluate the developed CGSA-SVM approach. The developed approach is compared with grid search and some other hybrid systems such as GA-SVM, PSO-SVM and GSA-SVM. The results show that the proposed approach achieves high classification accuracy and efficiency compared with well-known similar classifier systems.

previous article Soft variable structure controller design for constrained systems based on S-class functions

next article Black box modeling of PIDs implemented in PLCs without structural information: a support vector regression approach

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Vapnik VN (1995) The nature of statistical learning theory. Springer, New YorkCrossRefMATH

Guo XC, Yang JH, Wu CG, Wang CY, Liang YC (2008) A novel LS-SVMs hyper parameter selection based on particle swarm optimization. Neurocomputing 71:3211–3215CrossRef

Wu Q, Wu Sh, Liu J (2010) Hybrid model based on SVM with Gaussian loss function and adaptive Gaussian PSO. Eng Appl Artif Intell 23:487–494CrossRef

Shin K-S, Lee T-S, Kim H-J (2005) An application of support vector machines in bankruptcy prediction model. Expert Syst Appl 28:127–135CrossRef

Zhang X, Zhou J, Wang C et al (2012) Multi-class support vector machine optimized by inter-cluster distance and self-adaptive deferential evolution. Appl Math Comput 218:4973–4987CrossRefMATHMathSciNet

Yuan S-F, Chu F-L (2007) Fault diagnostics based on particle swarm optimization and support vector machines. Mech Syst Signal Process 21:1787–1798CrossRef

Huang C-L, Wang C-J (2006) A GA-based feature selection and parameters optimization for support vector machines. Expert Syst Appl 31:231–240CrossRef

Lin S-W, Ying K-C, Chen S-C et al (2008) Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Syst Appl 35:1817–1824CrossRef

Huang Ch-L, Dun J-F (2008) A distributed PSO–SVM hybrid system with features selection and parameter optimization. Appl Soft Comput 8:1381–1391CrossRef

10.

Friedrichs F, Igel Ch (2005) Evolutionary tuning of multiple SVM parameters. Neurocomputing 64:107–117CrossRef

11.

Boardman M, Trappenberg T (2006) A heuristic for free parameter optimization with support vector machines. In: International joining conference on neural networks. IEEE Computer Society Press, Silver Springer, MD, pp 1337–1344

12.

Gadat S, Younes L (2007) A stochastic algorithm for feature selection in pattern recognition. J Mach Learn Res 8:509–547MATH

13.

Zhang H, Sun G (2002) Feature selection using tabu search method. Pattern Recognit 35:701–711CrossRefMATH

14.

Unler A, Murat A (2010) A discrete particle swarm optimization method for feature selection in binary classification problems. Eur J Oper Res 206:528–539CrossRefMATH

15.

Das S, Abraham A, Konar A (2008) Automatic kernel clustering with a Multi-Elitist Particle Swarm Optimization Algorithm. Pattern Recognit Lett 29:688–699CrossRef

16.

Ranaee V, Ebrahimizadeh A, Ghaderi R (2010) Application of the PSO–SVM model for recognition of control chart patterns. ISA Trans 49(4):577–586CrossRef

17.

Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248CrossRefMATH

18.

Li C, Zhou J (2011) Parameters identification of hydraulic turbine governing system using improved gravitational search algorithm. Energy Convers Manag 52(1):374–381CrossRef

19.

Li C, Li H, Kou P (2014) Piecewise function based gravitational search algorithm and its application on parameter identification of AVR system. Neurocomputing 124:139–148CrossRef

20.

Li C, Zhou J, Fu B et al (2012) T-S fuzzy model identification with gravitational search based hyper-plane clustering algorithm. IEEE Trans Fuzzy Syst 20:305–317CrossRef

21.

Li C, Zhou J, Xiao J, Xiao H (2013) Hydraulic turbine governing system identification using T-S fuzzy model optimized by chaotic gravitational search algorithm. Eng Appl Artif Intell 26(9):2073–2082CrossRef

22.

Chatterjee A, et al (2014) A gravitational search algorithm (GSA) based photo-voltaic (PV) excitation control strategy for single phase operation of three phase wind-turbine coupled induction generator. Energy. doi:10.1016/j.energy.2014.07.037

23.

Shuaib YM, Kalavathi MS, Rajan CCA (2015) Optimal capacitor placement in radial distribution system using gravitational search algorithm. Int J Electr Power Energy Syst 64:384–397CrossRef

24.

Jiang S, Ji Z, Shen Y (2014) A novel hybrid particle swarm optimization and gravitational search algorithm for solving economic emission load dispatch problems with various practical constraints. Int J Electr Power Energy Syst 55:628–644CrossRef

25.

Ganesan T, Elamvazuthi I, Ku Shaari KZ, Vasant P (2013) Swarm intelligence and gravitational search algorithm for multi-objective optimization of synthesis gas production. Appl Energy 103(2013):368–374CrossRef

26.

Han X, Chang X, Quan L et al (2014) Feature subset selection by gravitational search algorithm optimization. Inf Sci 281:128–146CrossRefMathSciNet

27.

Zhang W, Niu P, Li G et al (2013) Forecasting of turbine heat rate with online least squares support vector machine based on gravitational search algorithm. Knowl Based Syst 39:34–44CrossRef

28.

Sarafrazi S, Nezamabadi-pour H (2013) Facing the classification of binary problems with a GSA-SVM hybrid system. Math Comput Model 57:270–278CrossRefMATHMathSciNet

29.

Li C, Zhou J, Kou P et al (2012) A novel chaotic particle swarm optimization based fuzzy clustering algorithm. Neurocomputing 83:98–109CrossRef

30.

Li C, Zhou J, Xiao J, Xiao H (2012) Parameters identification of chaotic system by chaotic gravitational search algorithm. Chaos, Solitons Fractals 45(4):539–547CrossRef

31.

Liu B, Wang L, Jin Y et al (2005) Improved particle swarm optimization combined with chaos. Chaos, Solitons Fractals 25:1261–1271CrossRefMATH

32.

Hu Y, Zhang H (2012) Chaos Optimization Method of SVM Parameters Selection for Chaotic Time Series Forecasting. Phys Procedia 25:588–594CrossRef

33.

Wu Q (2011) A self-adaptive embedded chaotic particle swarm optimization for parameters selection of Wv-SVM. Expert Syst Appl 38:184–192CrossRef

34.

Dos Santos GS, Luvizotto LGJ, Mariani VC, Coelho LDS (2012) Least squares support vector machines with tuning based on chaotic differential evolution approach applied to the identification of a thermal process. Expert Syst Appl 39:4805–4812CrossRef

35.

Chuang L, Yang C, Li J (2011) Chaotic maps based on binary particle swarm optimization for feature selection. Appl Soft Comput 11:239–248CrossRef

36.

May R (1976) Simple mathematical models with very complicated dynamics. Nature 261:459–467CrossRef

37.

Hettich S, Blake C, Merz C (1998) UCI repository of machine information and computer sciences. http://www.ics.uci.edu/~mlearn/MLRepository.html

38.

Salzberg SL (1997) On comparing classifiers: pitfalls to avoid and a recommended approach. Data Min Knowl Disc 1:317–327CrossRef

Title: A chaos embedded GSA-SVM hybrid system for classification
Authors: Chaoshun Li
Xueli An
Ruhai Li
Publication date: 01-04-2015
Publisher: Springer London
Published in: Neural Computing and Applications / Issue 3/2015
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI: https://doi.org/10.1007/s00521-014-1757-z

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Other articles of this Issue 3/2015

Spoken emotion recognition via locality-constrained kernel sparse representation

Solving time-varying quadratic programs based on finite-time Zhang neural networks and their application to robot tracking

Soft variable structure controller design for constrained systems based on S-class functions

Applying the ensemble artificial neural network-based hybrid data-driven model to daily total load forecasting

Stable fuzzy logic control of a general class of chaotic systems

Invasive weed classification

Premium Partner