Skip to main content
Erschienen in: Memetic Computing 1/2015

01.03.2015 | Regular Research Paper

A memetic algorithm with support vector machine for feature selection and classification

verfasst von: Messaouda Nekkaa, Dalila Boughaci

Erschienen in: Memetic Computing | Ausgabe 1/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The memetic algorithm (MA) is an evolutionary metaheuristic that can be viewed as a hybrid genetic algorithm combined with some kinds of local search. In this paper, we propose a memetic algorithm combined with a support vector machine (SVM) for feature selection and classification in Data mining. The proposed approach tries to find a subset of features that maximizes the classification accuracy rate of SVM. In addition, another hybrid algorithm of MA and SVM with optimized parameters is also developed. The two versions of our proposed method are evaluated on some datasets and compared with some well-known classifiers for data classification. The computational experiments show that the hybrid method MA + SVM with optimized parameters provides competitive results and finds high quality solutions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bao Y, Hu Z, Xiong T (2013) A PSO and pattern search based memetic algorithm for SVMs parameters optimization. Neurocomputing 117:98–106CrossRef Bao Y, Hu Z, Xiong T (2013) A PSO and pattern search based memetic algorithm for SVMs parameters optimization. Neurocomputing 117:98–106CrossRef
2.
Zurück zum Zitat Bonilla Huerta EB, Duval B, Hao JK (2006) A hybrid GA/SVM approach for gene selection and classification of microarray data. In: Rothlanf et al (eds) EvoWorkshops 2006, LNCS 3907, pp 34–44 Bonilla Huerta EB, Duval B, Hao JK (2006) A hybrid GA/SVM approach for gene selection and classification of microarray data. In: Rothlanf et al (eds) EvoWorkshops 2006, LNCS 3907, pp 34–44
3.
Zurück zum Zitat Boughaci D, Benhamou B, Drias H (2004) Solving Max-SAT problems using a memetic evolutionary metaheuristic. In: Proceedings of 2004 IEEE CIS 2004, pp 480–484 Boughaci D, Benhamou B, Drias H (2004) Solving Max-SAT problems using a memetic evolutionary metaheuristic. In: Proceedings of 2004 IEEE CIS 2004, pp 480–484
4.
Zurück zum Zitat Boughaci D, Benhamou B, Drias H (2009) A memetic algorithm for the optimal winner determination problem. Soft Comput 13(8–9):905–917CrossRef Boughaci D, Benhamou B, Drias H (2009) A memetic algorithm for the optimal winner determination problem. Soft Comput 13(8–9):905–917CrossRef
5.
Zurück zum Zitat Boughaci D, Benhamou B, Drias H (2010) Local search methods for the optimal winner determination problem in combinatorial auctions. J Math Model Algorithms 9(2):165–180CrossRefMathSciNet Boughaci D, Benhamou B, Drias H (2010) Local search methods for the optimal winner determination problem in combinatorial auctions. J Math Model Algorithms 9(2):165–180CrossRefMathSciNet
6.
Zurück zum Zitat Breiman L, Friedman J, Olshen R, Stone C (1984) Classification and regression trees. Wadsworth, BelmontMATH Breiman L, Friedman J, Olshen R, Stone C (1984) Classification and regression trees. Wadsworth, BelmontMATH
7.
Zurück zum Zitat Campbell C, Ying Y (2011) Learning with support vector machines. In: Synthesis lectures on artificial intelligence and machine learning. Morgan and Claypool Publishers, CA Campbell C, Ying Y (2011) Learning with support vector machines. In: Synthesis lectures on artificial intelligence and machine learning. Morgan and Claypool Publishers, CA
10.
Zurück zum Zitat Caponio A, Cascella GL, Neri F, Salvatore N, Sumner M (2007) A fast adaptive memetic algorithm for online and offline control design of PMSM drives. IEEE Trans Syst Man Cybern Part B 37(1):28–41CrossRef Caponio A, Cascella GL, Neri F, Salvatore N, Sumner M (2007) A fast adaptive memetic algorithm for online and offline control design of PMSM drives. IEEE Trans Syst Man Cybern Part B 37(1):28–41CrossRef
11.
Zurück zum Zitat Caruana R, Freitag D (1994) Greedy attribute selection. In: Proceedings of the eleventh international conference on machine learning, ICML 1994. Morgan Kauffmann, New Brunswick, pp 28–36 Caruana R, Freitag D (1994) Greedy attribute selection. In: Proceedings of the eleventh international conference on machine learning, ICML 1994. Morgan Kauffmann, New Brunswick, pp 28–36
12.
Zurück zum Zitat Chen X, Ong Y, Lim M, Tan K (2011) A multi-facet survey on memetic computation. IEEE Trans Evol Comput 15(5):591–607CrossRef Chen X, Ong Y, Lim M, Tan K (2011) A multi-facet survey on memetic computation. IEEE Trans Evol Comput 15(5):591–607CrossRef
13.
Zurück zum Zitat Frank E, Witten IH (1998) Generating accurate rule sets without global optimization. In: Shavlik J (ed) Proceedings of the fifteenth international conference machine learning (ICML 98) Frank E, Witten IH (1998) Generating accurate rule sets without global optimization. In: Shavlik J (ed) Proceedings of the fifteenth international conference machine learning (ICML 98)
14.
Zurück zum Zitat Friedman N, Geiger D, Goldszmidt M (1997) Bayesian network classifiers. Mach Learn 29:131–163CrossRefMATH Friedman N, Geiger D, Goldszmidt M (1997) Bayesian network classifiers. Mach Learn 29:131–163CrossRefMATH
15.
Zurück zum Zitat Gao XZ, Wang X, Zenger K (2015) A memetic-inspired harmony search method in optimal wind generator design. Int J Mach Learn Cyber 6(1):43–58CrossRef Gao XZ, Wang X, Zenger K (2015) A memetic-inspired harmony search method in optimal wind generator design. Int J Mach Learn Cyber 6(1):43–58CrossRef
16.
Zurück zum Zitat Hamel L (2009) Knowledge discovery with support vector machines. John Wiley and Sons Inc, CanadaCrossRef Hamel L (2009) Knowledge discovery with support vector machines. John Wiley and Sons Inc, CanadaCrossRef
17.
Zurück zum Zitat Han J, Kamber M (2006) Data mining concepts and techniques, 2nd edn. Morgan Kaufmann, San FranciscoMATH Han J, Kamber M (2006) Data mining concepts and techniques, 2nd edn. Morgan Kaufmann, San FranciscoMATH
18.
Zurück zum Zitat Hertz JA, Krogh A, Palmer RG (1991) Introduction to the theory of neural computation. Addison-Wesley Publishing Company Inc, Redwood City Hertz JA, Krogh A, Palmer RG (1991) Introduction to the theory of neural computation. Addison-Wesley Publishing Company Inc, Redwood City
19.
Zurück zum Zitat John GH, Langley P (1995) Estimating continuous distributions in Bayesian classifiers. In: Proceedings of the eleventh conference on uncertainty in artificial intelligence. Morgan Kaufman, San Mateo, pp 338–345 John GH, Langley P (1995) Estimating continuous distributions in Bayesian classifiers. In: Proceedings of the eleventh conference on uncertainty in artificial intelligence. Morgan Kaufman, San Mateo, pp 338–345
20.
Zurück zum Zitat Kecman V (2001) Learning and soft computing: support vector machines. In: Neural networks, and fuzzy logic models. The MIT press, London Kecman V (2001) Learning and soft computing: support vector machines. In: Neural networks, and fuzzy logic models. The MIT press, London
21.
Zurück zum Zitat Kohavi R, John G (1997) Wrappers for feature subset selection. Artif Intell 97(1–2):273–324CrossRefMATH Kohavi R, John G (1997) Wrappers for feature subset selection. Artif Intell 97(1–2):273–324CrossRefMATH
22.
Zurück zum Zitat Lessmann S, Stahlbock R, Crone SF (2006) Genetic algorithms for support vector machine model selection. In: Proceedings of the international joint conference on neural networks, IJCNN 2006, part of the IEEE World Congress on Computational Intelligence, WCCI 2006. IEEE, Vancouver, pp 3063–3069 Lessmann S, Stahlbock R, Crone SF (2006) Genetic algorithms for support vector machine model selection. In: Proceedings of the international joint conference on neural networks, IJCNN 2006, part of the IEEE World Congress on Computational Intelligence, WCCI 2006. IEEE, Vancouver, pp 3063–3069
23.
Zurück zum Zitat Li Y, Tong Y, Bai B, Zhang Y (2007) An improved particle swarm optimization for SVM training. In: Third international conference on natural computation (ICNC 2007), pp 611–615 Li Y, Tong Y, Bai B, Zhang Y (2007) An improved particle swarm optimization for SVM training. In: Third international conference on natural computation (ICNC 2007), pp 611–615
24.
Zurück zum Zitat Morrison RW, De Jong KA (2002) Measurement of population diversity. In: Collet P, Fonlupt C, Hao JK, Lutton E, Schoenauer M (eds) Proceedings of AE 2001. Lecture Notes in Computer Science 2310 proceedings. Springer, pp 31–41 Morrison RW, De Jong KA (2002) Measurement of population diversity. In: Collet P, Fonlupt C, Hao JK, Lutton E, Schoenauer M (eds) Proceedings of AE 2001. Lecture Notes in Computer Science 2310 proceedings. Springer, pp 31–41
25.
Zurück zum Zitat Moscato P (1989) On evolution search optimization genetic algorithms and martial arts: towards memetic algorithms. Caltech Concurrent Computation Program, C3P Report, 826 Moscato P (1989) On evolution search optimization genetic algorithms and martial arts: towards memetic algorithms. Caltech Concurrent Computation Program, C3P Report, 826
26.
Zurück zum Zitat Moscato P, Norman MG (1992) A memetic approach for the traveling salesman problem implementation of a computational ecology for combinatorial optimization on message-passing systems. In: Valero et al (eds) Parallel computing and transputer applications, pp 177–186 Moscato P, Norman MG (1992) A memetic approach for the traveling salesman problem implementation of a computational ecology for combinatorial optimization on message-passing systems. In: Valero et al (eds) Parallel computing and transputer applications, pp 177–186
27.
Zurück zum Zitat Nekkaa M, Boughaci D (2014) Stochastic local search versus genetic algorithm for feature selection. In: Proceedings of APMOD conference 2014: international conference on applied mathematical optimization and modelling 2014 Nekkaa M, Boughaci D (2014) Stochastic local search versus genetic algorithm for feature selection. In: Proceedings of APMOD conference 2014: international conference on applied mathematical optimization and modelling 2014
28.
Zurück zum Zitat Nekkaa M, Boughaci D (2012) Improving support vector machine using a stochastic local search for classification in dataMining. In: Proceedings of ICONIP 2012, Part II, LNCS 7664 proceedings, pp 168–176 Nekkaa M, Boughaci D (2012) Improving support vector machine using a stochastic local search for classification in dataMining. In: Proceedings of ICONIP 2012, Part II, LNCS 7664 proceedings, pp 168–176
29.
Zurück zum Zitat Quinlan JR (1992) C4.5: programs for machine learning. Morgan Kaufmann, San Mateo Quinlan JR (1992) C4.5: programs for machine learning. Morgan Kaufmann, San Mateo
30.
Zurück zum Zitat Rao R, Savsani V, Vakharia D (2012) Teaching learning-based optimization: an optimization method for continuous non-linear large scale problems. Inf Sci 183:1–15CrossRefMathSciNet Rao R, Savsani V, Vakharia D (2012) Teaching learning-based optimization: an optimization method for continuous non-linear large scale problems. Inf Sci 183:1–15CrossRefMathSciNet
31.
Zurück zum Zitat Tan KC, Teoh EJ, Yua Q, Goh KC (2009) A hybrid evolutionary algorithm for attribute selection in data mining. Exp Syst Appl 36:8616–8630CrossRef Tan KC, Teoh EJ, Yua Q, Goh KC (2009) A hybrid evolutionary algorithm for attribute selection in data mining. Exp Syst Appl 36:8616–8630CrossRef
32.
Zurück zum Zitat Tang M, Yao X (2007) A memetic algorithm for VLSI floorplanning. IEEE Trans Syst Man Cybern Part B 37(1):62–69CrossRef Tang M, Yao X (2007) A memetic algorithm for VLSI floorplanning. IEEE Trans Syst Man Cybern Part B 37(1):62–69CrossRef
33.
Zurück zum Zitat Tang J, Lim MH, Ong YS (2007) Diversity-adaptive parallel memetic algorithm for solving large scale combinatorial optimization problems. Soft Comput 11(9):873–888CrossRef Tang J, Lim MH, Ong YS (2007) Diversity-adaptive parallel memetic algorithm for solving large scale combinatorial optimization problems. Soft Comput 11(9):873–888CrossRef
34.
Zurück zum Zitat Vapnik V (1998) Statistical learning theory. John Wiley and Sons, New YorkMATH Vapnik V (1998) Statistical learning theory. John Wiley and Sons, New YorkMATH
35.
Zurück zum Zitat Vapnik V (1995) The natural of statistical learning theory. Springer, New YorkCrossRef Vapnik V (1995) The natural of statistical learning theory. Springer, New YorkCrossRef
37.
Zurück zum Zitat Zhou Z, Ong YS, Lim MH, Lee BS (2007) Memetic algorithm using multi-surrogates for computationally expensive optimization problems. Soft Comput 11(10):957–971CrossRef Zhou Z, Ong YS, Lim MH, Lee BS (2007) Memetic algorithm using multi-surrogates for computationally expensive optimization problems. Soft Comput 11(10):957–971CrossRef
Metadaten
Titel
A memetic algorithm with support vector machine for feature selection and classification
verfasst von
Messaouda Nekkaa
Dalila Boughaci
Publikationsdatum
01.03.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Memetic Computing / Ausgabe 1/2015
Print ISSN: 1865-9284
Elektronische ISSN: 1865-9292
DOI
https://doi.org/10.1007/s12293-015-0153-2

Weitere Artikel der Ausgabe 1/2015

Memetic Computing 1/2015 Zur Ausgabe

Premium Partner