Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 2/2012

01-06-2012 | Original Article

Decision function estimation using intelligent gravitational search algorithm

Authors: Hossein Askari, Seyed-Hamid Zahiri

Published in: International Journal of Machine Learning and Cybernetics | Issue 2/2012

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

There are various kinds of supervised classification techniques such as Bayesian classifier, k nearest neighbor, neural network and rule based classifiers. A kind of supervised classifier, estimates the necessary decision hyperplanes for separating the feature space to distinct regions for recognizing unknown put patterns. In this paper a novel swarm intelligence based classifier is described for decision function estimation without requirement to priory knowledge. The utilized swarm intelligence technique is gravitational search algorithm (GSA) which has been recently reported. The proposed method is called intelligent GSA based classifier (IGSA-classifier). At first, a fuzzy system is designed for intelligently updating the effective parameters of GSA. Those are gravitational coefficient and the number of effective objects, two important parameters which play major roles on search process of GSA. Then the designed intelligent GSA is employed to construct a novel decision function estimation algorithm from feature space. Extensive experimental results on different benchmarks and a practical pattern recognition problem with nonlinear, overlapping class boundaries and different feature space dimensions are provided to show the capability of the proposed method. The comparative results show that the performance of the proposed classifier is comparable to or better than the performance of other swarm intelligence based and evolutionary classifiers.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Footnotes
1
This evolutionary classifier was inserted to comparative results based on one of the reviewers’ comments.
 
2
These data sets are available from the site: http://​archive.​ics.​uci.​edu/​ml/​datasets
 
Literature
1.
go back to reference Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inform Sci 179(13): 2232–2248 Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inform Sci 179(13): 2232–2248
2.
go back to reference Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11:341–359MathSciNetMATHCrossRef Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11:341–359MathSciNetMATHCrossRef
3.
go back to reference Wang X-Z, He Y-L, Dong L-C, Zhao H-Y (2011) Particle swarm optimization for determining fuzzy measures from data. Inform Sci 181(19): 4230–4252 Wang X-Z, He Y-L, Dong L-C, Zhao H-Y (2011) Particle swarm optimization for determining fuzzy measures from data. Inform Sci 181(19): 4230–4252
4.
go back to reference Wang X-Z, Dong C-R (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Trans Fuzzy Syst 17(3):556–567 Wang X-Z, Dong C-R (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Trans Fuzzy Syst 17(3):556–567
5.
go back to reference Lin C-M, Li M-C, Ting A-B, Lin M-H (2011) A robust self-learning PID control system design for nonlinear systems using a particle swarm optimization algorithm. Int J Mach Learn Cyber doi:10.1007/s13042-011-0021-4 Lin C-M, Li M-C, Ting A-B, Lin M-H (2011) A robust self-learning PID control system design for nonlinear systems using a particle swarm optimization algorithm. Int J Mach Learn Cyber doi:10.​1007/​s13042-011-0021-4
6.
go back to reference Mahapatra GS, Mandal TK, Samanta GP (2011) A production inventory model with fuzzy coefficients using parametric geometric programming approach. Int J Mach Learn Cyber 2(2):99–105 Mahapatra GS, Mandal TK, Samanta GP (2011) A production inventory model with fuzzy coefficients using parametric geometric programming approach. Int J Mach Learn Cyber 2(2):99–105
7.
go back to reference Zahiri SH (2010) Swarm intelligence and fuzzy systems, Nova publishers Zahiri SH (2010) Swarm intelligence and fuzzy systems, Nova publishers
8.
go back to reference Huang VL, Suganthan PN, Liang JJ (2006) Comprehensive learning particle Swarm optimizer for solving multiobjective optimization problems. Int J Int Syst 21(2):209–226MATHCrossRef Huang VL, Suganthan PN, Liang JJ (2006) Comprehensive learning particle Swarm optimizer for solving multiobjective optimization problems. Int J Int Syst 21(2):209–226MATHCrossRef
9.
go back to reference Zahiri SH, Seyedin SA (2007) Swarm intelligence based classifiers. Int J Franklin Inst 344(2):362–376CrossRef Zahiri SH, Seyedin SA (2007) Swarm intelligence based classifiers. Int J Franklin Inst 344(2):362–376CrossRef
10.
go back to reference Zahiri SH, Rajabi Mashhadi H, Seyedin SA (2005) Intelligent and robust genetic algorithm based classifier. Iran J Electr Electr Eng 1(3):1–9 Zahiri SH, Rajabi Mashhadi H, Seyedin SA (2005) Intelligent and robust genetic algorithm based classifier. Iran J Electr Electr Eng 1(3):1–9
11.
go back to reference Mary PM, Marimuthu S (2009) Minimum time swing up and stabilization of rotary inverted pendulum using pulse step control. Iran J Fuzzy Syst 6(3):1–15MATH Mary PM, Marimuthu S (2009) Minimum time swing up and stabilization of rotary inverted pendulum using pulse step control. Iran J Fuzzy Syst 6(3):1–15MATH
12.
go back to reference Mehdizadeh E, Sadi-nezhad S, Tavakkoli-moghaddam R (2008) Optimization of fuzzy clustering criteria by a hybrid PSO and fuzzy c-mean clustering algorithm. Iran J Fuzzy Syst 5(1):1–14MathSciNetMATH Mehdizadeh E, Sadi-nezhad S, Tavakkoli-moghaddam R (2008) Optimization of fuzzy clustering criteria by a hybrid PSO and fuzzy c-mean clustering algorithm. Iran J Fuzzy Syst 5(1):1–14MathSciNetMATH
13.
go back to reference Moayedi F, Boostani R, Kazemi AR, Katebi S, Dashti E (2010) Subclass fuzzy-svm classifier an efficient method to enhance the mass detection in mammograms. Iran J Fuzzy Syst 7(1):15–31 Moayedi F, Boostani R, Kazemi AR, Katebi S, Dashti E (2010) Subclass fuzzy-svm classifier an efficient method to enhance the mass detection in mammograms. Iran J Fuzzy Syst 7(1):15–31
14.
go back to reference Eiben AE, Hinterding R, Michalewicz Z (1999) Parameter control in evolutionary algorithms. IEEE Trans Evol Comput 3(2):124–141CrossRef Eiben AE, Hinterding R, Michalewicz Z (1999) Parameter control in evolutionary algorithms. IEEE Trans Evol Comput 3(2):124–141CrossRef
15.
go back to reference Shi Y, Eberhart R, Chen Y (1999) Implementation of evolutionary fuzzy systems. IEEE Trans Fuzzy Syst 7(2):109–119CrossRef Shi Y, Eberhart R, Chen Y (1999) Implementation of evolutionary fuzzy systems. IEEE Trans Fuzzy Syst 7(2):109–119CrossRef
16.
go back to reference Stenes M, Robous H (2000) GA-fuzzy modeling and classification: complexity and performance. IEEE Trans Fuzzy Syst 8(5):509–522CrossRef Stenes M, Robous H (2000) GA-fuzzy modeling and classification: complexity and performance. IEEE Trans Fuzzy Syst 8(5):509–522CrossRef
17.
go back to reference Zahiri SH, Zareie H, Agha-Ebrahimi MR (1996) Automatic target recognition using jet engine modulation on backscattered signals. In: Proceedings of 8th Iranian conference on electrical engineering, Isfahan, pp 296–303 Zahiri SH, Zareie H, Agha-Ebrahimi MR (1996) Automatic target recognition using jet engine modulation on backscattered signals. In: Proceedings of 8th Iranian conference on electrical engineering, Isfahan, pp 296–303
18.
go back to reference Zhao SZ, Liang JJ, Suganthan PN, Tasgetiren MF (2008) Dynamic multi-swarm particle swarm optimizer with local search for large scale global optimization. IEEE Congress on Evolutionary Computation, Hong Kong, pp 3845–3852 Zhao SZ, Liang JJ, Suganthan PN, Tasgetiren MF (2008) Dynamic multi-swarm particle swarm optimizer with local search for large scale global optimization. IEEE Congress on Evolutionary Computation, Hong Kong, pp 3845–3852
19.
go back to reference Huang VL, Suganthan PN, Baskar S (2005) Multiobjective differential evolution with external archive. Technical Report Nanyang Technological University, Singapore Huang VL, Suganthan PN, Baskar S (2005) Multiobjective differential evolution with external archive. Technical Report Nanyang Technological University, Singapore
20.
go back to reference Tou JT, Gonzalez RC (1992) Pattern recognition principles, Coden Apmcc Tou JT, Gonzalez RC (1992) Pattern recognition principles, Coden Apmcc
21.
go back to reference Qin AK, Suganthan PN (2005) Self-adaptive Differential Evolution Algorithm for Numerical Optimizatio. IEEE Congress on Evolutionary Computation, Scotland, pp 1785–1791 Qin AK, Suganthan PN (2005) Self-adaptive Differential Evolution Algorithm for Numerical Optimizatio. IEEE Congress on Evolutionary Computation, Scotland, pp 1785–1791
Metadata
Title
Decision function estimation using intelligent gravitational search algorithm
Authors
Hossein Askari
Seyed-Hamid Zahiri
Publication date
01-06-2012
Publisher
Springer-Verlag
Published in
International Journal of Machine Learning and Cybernetics / Issue 2/2012
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-011-0052-x

Other articles of this Issue 2/2012

International Journal of Machine Learning and Cybernetics 2/2012 Go to the issue