Skip to main content
Erschienen in: Neural Computing and Applications 3/2015

01.04.2015 | Original Article

A chaos embedded GSA-SVM hybrid system for classification

verfasst von: Chaoshun Li, Xueli An, Ruhai Li

Erschienen in: Neural Computing and Applications | Ausgabe 3/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Parameter optimization and feature selection influence the classification accuracy of support vector machine (SVM) significantly. In order to improve classification accuracy of SVM, this paper hybridizes chaotic search and gravitational search algorithm (GSA) with SVM and presents a new chaos embedded GSA-SVM (CGSA-SVM) hybrid system. In this system, input feature subsets and the SVM parameters are optimized simultaneously, while GSA is used to optimize the parameters of SVM and chaotic search is embedded in the searching iterations of GSA to optimize the feature subsets. Fourteen UCI datasets are employed to calculate the classification accuracy rate in order to evaluate the developed CGSA-SVM approach. The developed approach is compared with grid search and some other hybrid systems such as GA-SVM, PSO-SVM and GSA-SVM. The results show that the proposed approach achieves high classification accuracy and efficiency compared with well-known similar classifier systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
2.
Zurück zum Zitat Guo XC, Yang JH, Wu CG, Wang CY, Liang YC (2008) A novel LS-SVMs hyper parameter selection based on particle swarm optimization. Neurocomputing 71:3211–3215CrossRef Guo XC, Yang JH, Wu CG, Wang CY, Liang YC (2008) A novel LS-SVMs hyper parameter selection based on particle swarm optimization. Neurocomputing 71:3211–3215CrossRef
3.
Zurück zum Zitat Wu Q, Wu Sh, Liu J (2010) Hybrid model based on SVM with Gaussian loss function and adaptive Gaussian PSO. Eng Appl Artif Intell 23:487–494CrossRef Wu Q, Wu Sh, Liu J (2010) Hybrid model based on SVM with Gaussian loss function and adaptive Gaussian PSO. Eng Appl Artif Intell 23:487–494CrossRef
4.
Zurück zum Zitat Shin K-S, Lee T-S, Kim H-J (2005) An application of support vector machines in bankruptcy prediction model. Expert Syst Appl 28:127–135CrossRef Shin K-S, Lee T-S, Kim H-J (2005) An application of support vector machines in bankruptcy prediction model. Expert Syst Appl 28:127–135CrossRef
5.
Zurück zum Zitat Zhang X, Zhou J, Wang C et al (2012) Multi-class support vector machine optimized by inter-cluster distance and self-adaptive deferential evolution. Appl Math Comput 218:4973–4987CrossRefMATHMathSciNet Zhang X, Zhou J, Wang C et al (2012) Multi-class support vector machine optimized by inter-cluster distance and self-adaptive deferential evolution. Appl Math Comput 218:4973–4987CrossRefMATHMathSciNet
6.
Zurück zum Zitat Yuan S-F, Chu F-L (2007) Fault diagnostics based on particle swarm optimization and support vector machines. Mech Syst Signal Process 21:1787–1798CrossRef Yuan S-F, Chu F-L (2007) Fault diagnostics based on particle swarm optimization and support vector machines. Mech Syst Signal Process 21:1787–1798CrossRef
7.
Zurück zum Zitat Huang C-L, Wang C-J (2006) A GA-based feature selection and parameters optimization for support vector machines. Expert Syst Appl 31:231–240CrossRef Huang C-L, Wang C-J (2006) A GA-based feature selection and parameters optimization for support vector machines. Expert Syst Appl 31:231–240CrossRef
8.
Zurück zum Zitat Lin S-W, Ying K-C, Chen S-C et al (2008) Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Syst Appl 35:1817–1824CrossRef Lin S-W, Ying K-C, Chen S-C et al (2008) Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Syst Appl 35:1817–1824CrossRef
9.
Zurück zum Zitat Huang Ch-L, Dun J-F (2008) A distributed PSO–SVM hybrid system with features selection and parameter optimization. Appl Soft Comput 8:1381–1391CrossRef Huang Ch-L, Dun J-F (2008) A distributed PSO–SVM hybrid system with features selection and parameter optimization. Appl Soft Comput 8:1381–1391CrossRef
10.
Zurück zum Zitat Friedrichs F, Igel Ch (2005) Evolutionary tuning of multiple SVM parameters. Neurocomputing 64:107–117CrossRef Friedrichs F, Igel Ch (2005) Evolutionary tuning of multiple SVM parameters. Neurocomputing 64:107–117CrossRef
11.
Zurück zum Zitat Boardman M, Trappenberg T (2006) A heuristic for free parameter optimization with support vector machines. In: International joining conference on neural networks. IEEE Computer Society Press, Silver Springer, MD, pp 1337–1344 Boardman M, Trappenberg T (2006) A heuristic for free parameter optimization with support vector machines. In: International joining conference on neural networks. IEEE Computer Society Press, Silver Springer, MD, pp 1337–1344
12.
Zurück zum Zitat Gadat S, Younes L (2007) A stochastic algorithm for feature selection in pattern recognition. J Mach Learn Res 8:509–547MATH Gadat S, Younes L (2007) A stochastic algorithm for feature selection in pattern recognition. J Mach Learn Res 8:509–547MATH
13.
Zurück zum Zitat Zhang H, Sun G (2002) Feature selection using tabu search method. Pattern Recognit 35:701–711CrossRefMATH Zhang H, Sun G (2002) Feature selection using tabu search method. Pattern Recognit 35:701–711CrossRefMATH
14.
Zurück zum Zitat Unler A, Murat A (2010) A discrete particle swarm optimization method for feature selection in binary classification problems. Eur J Oper Res 206:528–539CrossRefMATH Unler A, Murat A (2010) A discrete particle swarm optimization method for feature selection in binary classification problems. Eur J Oper Res 206:528–539CrossRefMATH
15.
Zurück zum Zitat Das S, Abraham A, Konar A (2008) Automatic kernel clustering with a Multi-Elitist Particle Swarm Optimization Algorithm. Pattern Recognit Lett 29:688–699CrossRef Das S, Abraham A, Konar A (2008) Automatic kernel clustering with a Multi-Elitist Particle Swarm Optimization Algorithm. Pattern Recognit Lett 29:688–699CrossRef
16.
Zurück zum Zitat Ranaee V, Ebrahimizadeh A, Ghaderi R (2010) Application of the PSO–SVM model for recognition of control chart patterns. ISA Trans 49(4):577–586CrossRef Ranaee V, Ebrahimizadeh A, Ghaderi R (2010) Application of the PSO–SVM model for recognition of control chart patterns. ISA Trans 49(4):577–586CrossRef
17.
Zurück zum Zitat Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248CrossRefMATH Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248CrossRefMATH
18.
Zurück zum Zitat Li C, Zhou J (2011) Parameters identification of hydraulic turbine governing system using improved gravitational search algorithm. Energy Convers Manag 52(1):374–381CrossRef Li C, Zhou J (2011) Parameters identification of hydraulic turbine governing system using improved gravitational search algorithm. Energy Convers Manag 52(1):374–381CrossRef
19.
Zurück zum Zitat Li C, Li H, Kou P (2014) Piecewise function based gravitational search algorithm and its application on parameter identification of AVR system. Neurocomputing 124:139–148CrossRef Li C, Li H, Kou P (2014) Piecewise function based gravitational search algorithm and its application on parameter identification of AVR system. Neurocomputing 124:139–148CrossRef
20.
Zurück zum Zitat Li C, Zhou J, Fu B et al (2012) T-S fuzzy model identification with gravitational search based hyper-plane clustering algorithm. IEEE Trans Fuzzy Syst 20:305–317CrossRef Li C, Zhou J, Fu B et al (2012) T-S fuzzy model identification with gravitational search based hyper-plane clustering algorithm. IEEE Trans Fuzzy Syst 20:305–317CrossRef
21.
Zurück zum Zitat Li C, Zhou J, Xiao J, Xiao H (2013) Hydraulic turbine governing system identification using T-S fuzzy model optimized by chaotic gravitational search algorithm. Eng Appl Artif Intell 26(9):2073–2082CrossRef Li C, Zhou J, Xiao J, Xiao H (2013) Hydraulic turbine governing system identification using T-S fuzzy model optimized by chaotic gravitational search algorithm. Eng Appl Artif Intell 26(9):2073–2082CrossRef
22.
Zurück zum Zitat Chatterjee A, et al (2014) A gravitational search algorithm (GSA) based photo-voltaic (PV) excitation control strategy for single phase operation of three phase wind-turbine coupled induction generator. Energy. doi:10.1016/j.energy.2014.07.037 Chatterjee A, et al (2014) A gravitational search algorithm (GSA) based photo-voltaic (PV) excitation control strategy for single phase operation of three phase wind-turbine coupled induction generator. Energy. doi:10.​1016/​j.​energy.​2014.​07.​037
23.
Zurück zum Zitat Shuaib YM, Kalavathi MS, Rajan CCA (2015) Optimal capacitor placement in radial distribution system using gravitational search algorithm. Int J Electr Power Energy Syst 64:384–397CrossRef Shuaib YM, Kalavathi MS, Rajan CCA (2015) Optimal capacitor placement in radial distribution system using gravitational search algorithm. Int J Electr Power Energy Syst 64:384–397CrossRef
24.
Zurück zum Zitat Jiang S, Ji Z, Shen Y (2014) A novel hybrid particle swarm optimization and gravitational search algorithm for solving economic emission load dispatch problems with various practical constraints. Int J Electr Power Energy Syst 55:628–644CrossRef Jiang S, Ji Z, Shen Y (2014) A novel hybrid particle swarm optimization and gravitational search algorithm for solving economic emission load dispatch problems with various practical constraints. Int J Electr Power Energy Syst 55:628–644CrossRef
25.
Zurück zum Zitat Ganesan T, Elamvazuthi I, Ku Shaari KZ, Vasant P (2013) Swarm intelligence and gravitational search algorithm for multi-objective optimization of synthesis gas production. Appl Energy 103(2013):368–374CrossRef Ganesan T, Elamvazuthi I, Ku Shaari KZ, Vasant P (2013) Swarm intelligence and gravitational search algorithm for multi-objective optimization of synthesis gas production. Appl Energy 103(2013):368–374CrossRef
26.
Zurück zum Zitat Han X, Chang X, Quan L et al (2014) Feature subset selection by gravitational search algorithm optimization. Inf Sci 281:128–146CrossRefMathSciNet Han X, Chang X, Quan L et al (2014) Feature subset selection by gravitational search algorithm optimization. Inf Sci 281:128–146CrossRefMathSciNet
27.
Zurück zum Zitat Zhang W, Niu P, Li G et al (2013) Forecasting of turbine heat rate with online least squares support vector machine based on gravitational search algorithm. Knowl Based Syst 39:34–44CrossRef Zhang W, Niu P, Li G et al (2013) Forecasting of turbine heat rate with online least squares support vector machine based on gravitational search algorithm. Knowl Based Syst 39:34–44CrossRef
28.
Zurück zum Zitat Sarafrazi S, Nezamabadi-pour H (2013) Facing the classification of binary problems with a GSA-SVM hybrid system. Math Comput Model 57:270–278CrossRefMATHMathSciNet Sarafrazi S, Nezamabadi-pour H (2013) Facing the classification of binary problems with a GSA-SVM hybrid system. Math Comput Model 57:270–278CrossRefMATHMathSciNet
29.
Zurück zum Zitat Li C, Zhou J, Kou P et al (2012) A novel chaotic particle swarm optimization based fuzzy clustering algorithm. Neurocomputing 83:98–109CrossRef Li C, Zhou J, Kou P et al (2012) A novel chaotic particle swarm optimization based fuzzy clustering algorithm. Neurocomputing 83:98–109CrossRef
30.
Zurück zum Zitat Li C, Zhou J, Xiao J, Xiao H (2012) Parameters identification of chaotic system by chaotic gravitational search algorithm. Chaos, Solitons Fractals 45(4):539–547CrossRef Li C, Zhou J, Xiao J, Xiao H (2012) Parameters identification of chaotic system by chaotic gravitational search algorithm. Chaos, Solitons Fractals 45(4):539–547CrossRef
31.
Zurück zum Zitat Liu B, Wang L, Jin Y et al (2005) Improved particle swarm optimization combined with chaos. Chaos, Solitons Fractals 25:1261–1271CrossRefMATH Liu B, Wang L, Jin Y et al (2005) Improved particle swarm optimization combined with chaos. Chaos, Solitons Fractals 25:1261–1271CrossRefMATH
32.
Zurück zum Zitat Hu Y, Zhang H (2012) Chaos Optimization Method of SVM Parameters Selection for Chaotic Time Series Forecasting. Phys Procedia 25:588–594CrossRef Hu Y, Zhang H (2012) Chaos Optimization Method of SVM Parameters Selection for Chaotic Time Series Forecasting. Phys Procedia 25:588–594CrossRef
33.
Zurück zum Zitat Wu Q (2011) A self-adaptive embedded chaotic particle swarm optimization for parameters selection of Wv-SVM. Expert Syst Appl 38:184–192CrossRef Wu Q (2011) A self-adaptive embedded chaotic particle swarm optimization for parameters selection of Wv-SVM. Expert Syst Appl 38:184–192CrossRef
34.
Zurück zum Zitat Dos Santos GS, Luvizotto LGJ, Mariani VC, Coelho LDS (2012) Least squares support vector machines with tuning based on chaotic differential evolution approach applied to the identification of a thermal process. Expert Syst Appl 39:4805–4812CrossRef Dos Santos GS, Luvizotto LGJ, Mariani VC, Coelho LDS (2012) Least squares support vector machines with tuning based on chaotic differential evolution approach applied to the identification of a thermal process. Expert Syst Appl 39:4805–4812CrossRef
35.
Zurück zum Zitat Chuang L, Yang C, Li J (2011) Chaotic maps based on binary particle swarm optimization for feature selection. Appl Soft Comput 11:239–248CrossRef Chuang L, Yang C, Li J (2011) Chaotic maps based on binary particle swarm optimization for feature selection. Appl Soft Comput 11:239–248CrossRef
36.
Zurück zum Zitat May R (1976) Simple mathematical models with very complicated dynamics. Nature 261:459–467CrossRef May R (1976) Simple mathematical models with very complicated dynamics. Nature 261:459–467CrossRef
38.
Zurück zum Zitat Salzberg SL (1997) On comparing classifiers: pitfalls to avoid and a recommended approach. Data Min Knowl Disc 1:317–327CrossRef Salzberg SL (1997) On comparing classifiers: pitfalls to avoid and a recommended approach. Data Min Knowl Disc 1:317–327CrossRef
Metadaten
Titel
A chaos embedded GSA-SVM hybrid system for classification
verfasst von
Chaoshun Li
Xueli An
Ruhai Li
Publikationsdatum
01.04.2015
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 3/2015
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-014-1757-z

Weitere Artikel der Ausgabe 3/2015

Neural Computing and Applications 3/2015 Zur Ausgabe

Advances in Intelligent Data Processing and Analysis

Hybrid evolutionary algorithms for classification data mining

Premium Partner