Skip to main content

2018 | OriginalPaper | Buchkapitel

26. Facing the Feature Selection Problem with a Binary PSO-GSA Approach

verfasst von : Malek Sarhani, Abdellatif El Afia, Rdouan Faizi

Erschienen in: Recent Developments in Metaheuristics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Feature selection has become the focus of much research in many areas where we can face the problem of big data or complex relationship among features. Metaheuristics have gained much attention in solving many practical problems, including feature selection. Our contribution in this paper is to propose a binary hybrid metaheuristic to minimize a fitness function representing a trade-off between the classification error of selecting the feature subset and the corresponding number of features. This algorithm combines particle swarm optimization (PSO) and gravitational search algorithm (GSA). Also, a mutation operator is integrated to enhance population diversity. Experimental results on ten benchmark dataset show that our proposed hybrid method for feature selection can achieve high performance when comparing with other metaheuristic algorithms and well-known feature selection approaches.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Z. Beheshti, S.M. Shamsuddin, S. Hasan, Memetic binary particle swarm optimization for discrete optimization problems. Inf. Sci. 299, 58–84 (2015)CrossRef Z. Beheshti, S.M. Shamsuddin, S. Hasan, Memetic binary particle swarm optimization for discrete optimization problems. Inf. Sci. 299, 58–84 (2015)CrossRef
2.
Zurück zum Zitat A.R. Behjat, A. Mustapha, H. Nezamabadi, M.N. Sulaiman, N. Mustapha, Feature subset selection using binary gravitational search algorithm for intrusion detection system, in Intelligent Information and Database Systems. Lecture Notes in Computer Science, vol. 7803 (Springer, Berlin/Heidelberg, 2013), pp. 377–386 A.R. Behjat, A. Mustapha, H. Nezamabadi, M.N. Sulaiman, N. Mustapha, Feature subset selection using binary gravitational search algorithm for intrusion detection system, in Intelligent Information and Database Systems. Lecture Notes in Computer Science, vol. 7803 (Springer, Berlin/Heidelberg, 2013), pp. 377–386
3.
Zurück zum Zitat G. Brown, A. Pocock, M.-J. Zhao, M. Lujan, Conditional likelihood maximisation: a unifying framework for information theoretic feature selection. J. Mach. Learn. Res. 13, 27–66 (2012) G. Brown, A. Pocock, M.-J. Zhao, M. Lujan, Conditional likelihood maximisation: a unifying framework for information theoretic feature selection. J. Mach. Learn. Res. 13, 27–66 (2012)
4.
Zurück zum Zitat T. Chakraborti, A. Chatterjee, A novel binary adaptive weight GSA based feature selection for face recognition using local gradient patterns, modified census transform and local binary patterns. Eng. Appl. Artif. Intel. 33, 80–90 (2014)CrossRef T. Chakraborti, A. Chatterjee, A novel binary adaptive weight GSA based feature selection for face recognition using local gradient patterns, modified census transform and local binary patterns. Eng. Appl. Artif. Intel. 33, 80–90 (2014)CrossRef
5.
Zurück zum Zitat R. Diao, Q. Shen, Nature inspired feature selection meta-heuristics. Eng. Appl. Artif. Intel. 44(3), 311–340 (2015) R. Diao, Q. Shen, Nature inspired feature selection meta-heuristics. Eng. Appl. Artif. Intel. 44(3), 311–340 (2015)
6.
Zurück zum Zitat T. Ganesan, I.M. Elamvazuthi, K.Z. Ku Shaari, P. Vasant, Swarm intelligence and gravitational search algorithm for multi-objective optimization of synthesis gas production. Appl. Energy 103, 368–374 (2013)CrossRef T. Ganesan, I.M. Elamvazuthi, K.Z. Ku Shaari, P. Vasant, Swarm intelligence and gravitational search algorithm for multi-objective optimization of synthesis gas production. Appl. Energy 103, 368–374 (2013)CrossRef
7.
Zurück zum Zitat J. Garca-Nieto, E. Alba, L. Jourdan, E. Talbi, Sensitivity and specificity based multiobjective approach for feature selection: application to cancer diagnosis. Inf. Process. Lett. 109, 887–896 (2009)CrossRef J. Garca-Nieto, E. Alba, L. Jourdan, E. Talbi, Sensitivity and specificity based multiobjective approach for feature selection: application to cancer diagnosis. Inf. Process. Lett. 109, 887–896 (2009)CrossRef
8.
Zurück zum Zitat I. Guyon, A. Elisseeff, An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003) I. Guyon, A. Elisseeff, An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)
9.
Zurück zum Zitat X.H. Han, X.M. Chang, L. Quan, X.Y. Xiong, J.X. Li, Z.X. Zhang, Y. Liu, Feature subset selection by gravitational search algorithm optimization. Inf. Sci. 281, 128–146 (2014)CrossRef X.H. Han, X.M. Chang, L. Quan, X.Y. Xiong, J.X. Li, Z.X. Zhang, Y. Liu, Feature subset selection by gravitational search algorithm optimization. Inf. Sci. 281, 128–146 (2014)CrossRef
10.
Zurück zum Zitat Z. Hu, Y. Bao, T. Xiong, Comprehensive learning particle swarm optimization based memetic algorithm for model selection in short-term load forecasting using support vector regression. Appl. Soft Comput. 25, 15–25 (2014)CrossRef Z. Hu, Y. Bao, T. Xiong, Comprehensive learning particle swarm optimization based memetic algorithm for model selection in short-term load forecasting using support vector regression. Appl. Soft Comput. 25, 15–25 (2014)CrossRef
11.
Zurück zum Zitat S. Jiang, A novel hybrid particle swarm optimization and gravitational search algorithm for solving economic emission load dispatch problems with various practical constraints. Electr. Power Energy Syst. 55, 628–644 (2014)CrossRef S. Jiang, A novel hybrid particle swarm optimization and gravitational search algorithm for solving economic emission load dispatch problems with various practical constraints. Electr. Power Energy Syst. 55, 628–644 (2014)CrossRef
12.
Zurück zum Zitat L. Jourdan, C. Dhaenens, E.-G. Talbi, Evolutionary feature selection for bioinformatics, in Computational Intelligence in Bioinformatics, Chap. 6 (IEEE Press, New York, 2007), pp. 117–139 L. Jourdan, C. Dhaenens, E.-G. Talbi, Evolutionary feature selection for bioinformatics, in Computational Intelligence in Bioinformatics, Chap. 6 (IEEE Press, New York, 2007), pp. 117–139
13.
Zurück zum Zitat J. Kennedy, R.C. Eberhart, A discrete binary version of the particle swarm optimization, in Proceedings on Conference on Systems, Man and Cybernetics, vol. 4 (1997), pp. 104–109 J. Kennedy, R.C. Eberhart, A discrete binary version of the particle swarm optimization, in Proceedings on Conference on Systems, Man and Cybernetics, vol. 4 (1997), pp. 104–109
14.
Zurück zum Zitat R. Kohavi, G.H. John, Wrappers for feature subset selection. Artif. Intell. 97(1–2), 273–324 (1997)CrossRef R. Kohavi, G.H. John, Wrappers for feature subset selection. Artif. Intell. 97(1–2), 273–324 (1997)CrossRef
15.
Zurück zum Zitat J. Krause, J. Cordeiro, R.S. Parpinelli, H.S. Lopes, A survey of swarm algorithms applied to discrete optimization problems, in Swarm Intelligence and Bio-Inspired Computation: Theory and Applications (Elsevier Science & Technology Books, London, 2013), pp. 169–191CrossRef J. Krause, J. Cordeiro, R.S. Parpinelli, H.S. Lopes, A survey of swarm algorithms applied to discrete optimization problems, in Swarm Intelligence and Bio-Inspired Computation: Theory and Applications (Elsevier Science & Technology Books, London, 2013), pp. 169–191CrossRef
16.
Zurück zum Zitat J. Lee, D.-W. Kim, Memetic feature selection algorithm for multi-label classification. Inf. Sci. 293, 80–96 (2015)CrossRef J. Lee, D.-W. Kim, Memetic feature selection algorithm for multi-label classification. Inf. Sci. 293, 80–96 (2015)CrossRef
17.
Zurück zum Zitat Y. Lu, I. Cohen, X.S. Zhou, Q. Tian, Feature selection using principal feature analysis, in Proceedings of the 15th International Conference on Multimedia, MULTIMEDIA ’07 (ACM, New York, 2007), pp. 301–304CrossRef Y. Lu, I. Cohen, X.S. Zhou, Q. Tian, Feature selection using principal feature analysis, in Proceedings of the 15th International Conference on Multimedia, MULTIMEDIA ’07 (ACM, New York, 2007), pp. 301–304CrossRef
18.
Zurück zum Zitat S. Mallick, S.P. Ghoshal, P. Acharjee, S.S. Thakur, Optimal static state estimation using improved particle swarm optimization and gravitational search algorithm. Electr. Power Energy Syst. 52, 254–265 (2013)CrossRef S. Mallick, S.P. Ghoshal, P. Acharjee, S.S. Thakur, Optimal static state estimation using improved particle swarm optimization and gravitational search algorithm. Electr. Power Energy Syst. 52, 254–265 (2013)CrossRef
19.
Zurück zum Zitat S. Mirjalili, G.-G. Wang, L.D. Coelho, Binary optimization using hybrid particle swarm optimization and gravitational search algorithm. Neural Comput. Appl. 25(6), 1423–1435 (2014)CrossRef S. Mirjalili, G.-G. Wang, L.D. Coelho, Binary optimization using hybrid particle swarm optimization and gravitational search algorithm. Neural Comput. Appl. 25(6), 1423–1435 (2014)CrossRef
20.
Zurück zum Zitat M. Nikravesh, L.A. Zadeh, I. Guyon, S. Gunn, Feature Extraction, Foundations and Applications (Springer, Berlin, 2006) M. Nikravesh, L.A. Zadeh, I. Guyon, S. Gunn, Feature Extraction, Foundations and Applications (Springer, Berlin, 2006)
21.
Zurück zum Zitat S. Piramuthu, Evaluating feature selection methods for learning in data mining applications. Eur. J. Oper. Res. 156, 483–494 (2004)CrossRef S. Piramuthu, Evaluating feature selection methods for learning in data mining applications. Eur. J. Oper. Res. 156, 483–494 (2004)CrossRef
22.
Zurück zum Zitat J. Pohjalainen, O. Rsnen, S. Kadioglu, Feature selection methods and their combinations in high-dimensional classification of speaker likability, intelligibility and personality traits. Comput. Speech Lang. 29, 145–171 (2015)CrossRef J. Pohjalainen, O. Rsnen, S. Kadioglu, Feature selection methods and their combinations in high-dimensional classification of speaker likability, intelligibility and personality traits. Comput. Speech Lang. 29, 145–171 (2015)CrossRef
23.
Zurück zum Zitat E. Rashedi, H. Nezamabadi-pour, S. Saryazdi, BGSA: binary gravitational search algorithm. Nat. Comput. 9(3), 727–745 (2010)CrossRef E. Rashedi, H. Nezamabadi-pour, S. Saryazdi, BGSA: binary gravitational search algorithm. Nat. Comput. 9(3), 727–745 (2010)CrossRef
24.
Zurück zum Zitat Y. Shi, R.C. Eberhart, A modified particle swarm optimizer, in Proceedings of the IEEE World Congress of Computational Intelligence (1997), pp. 69–73 Y. Shi, R.C. Eberhart, A modified particle swarm optimizer, in Proceedings of the IEEE World Congress of Computational Intelligence (1997), pp. 69–73
25.
Zurück zum Zitat E.-G. Talbi, L. Jourdan, J. Garcia-Nieto, E. Alba, Comparison of population based metaheuristics for feature selection: application to microarray data classification, in AICCSA’2008 IEEE/ACS International Conference on Computer Systems and Applications, Doha, Nov 2008, pp. 45–52 E.-G. Talbi, L. Jourdan, J. Garcia-Nieto, E. Alba, Comparison of population based metaheuristics for feature selection: application to microarray data classification, in AICCSA’2008 IEEE/ACS International Conference on Computer Systems and Applications, Doha, Nov 2008, pp. 45–52
26.
Zurück zum Zitat A. Unler, A. Murat, A discrete particle swarm optimization method for feature selection in binary classification problems. Eur. J. Oper. Res. 206, 528–539 (2010)CrossRef A. Unler, A. Murat, A discrete particle swarm optimization method for feature selection in binary classification problems. Eur. J. Oper. Res. 206, 528–539 (2010)CrossRef
27.
Zurück zum Zitat J.R. Vergara, P.A. Estvez, A review of feature selection methods based on mutual information. Neural Comput. Appl. 24(1), 175–186 (2014)CrossRef J.R. Vergara, P.A. Estvez, A review of feature selection methods based on mutual information. Neural Comput. Appl. 24(1), 175–186 (2014)CrossRef
28.
Zurück zum Zitat L. Vignolo, D. Milone, J. Scharcanski, Feature selection for face recognition based on multi-objective evolutionary wrapper. Expert Syst. Appl. 40, 5077–5084 (2013)CrossRef L. Vignolo, D. Milone, J. Scharcanski, Feature selection for face recognition based on multi-objective evolutionary wrapper. Expert Syst. Appl. 40, 5077–5084 (2013)CrossRef
29.
Zurück zum Zitat B. Xue, M. Zhang, W. Browne, Particle swarm optimisation for feature selection in classification: novel initialisation and updating mechanisms. Appl. Soft Comput. 18, 261–176 (2014)CrossRef B. Xue, M. Zhang, W. Browne, Particle swarm optimisation for feature selection in classification: novel initialisation and updating mechanisms. Appl. Soft Comput. 18, 261–176 (2014)CrossRef
30.
Zurück zum Zitat Y. Zhang, S. Wang, P. Phillips, G. Ji, Binary PSO with mutation operator for feature selection using decision tree applied to spam detection. Knowl.-Based Syst. 64, 22–31 (2014)CrossRef Y. Zhang, S. Wang, P. Phillips, G. Ji, Binary PSO with mutation operator for feature selection using decision tree applied to spam detection. Knowl.-Based Syst. 64, 22–31 (2014)CrossRef
Metadaten
Titel
Facing the Feature Selection Problem with a Binary PSO-GSA Approach
verfasst von
Malek Sarhani
Abdellatif El Afia
Rdouan Faizi
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-58253-5_26