Skip to main content

2017 | OriginalPaper | Buchkapitel

A Hybrid Method of Sine Cosine Algorithm and Differential Evolution for Feature Selection

verfasst von : Mohamed E. Abd Elaziz, Ahmed A. Ewees, Diego Oliva, Pengfei Duan, Shengwu Xiong

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The feature selection is an important step to improve the performance of classifier through reducing the dimension of the dataset, so the time complexity and space complexity are reduced. There are several feature selection methods are used the swarm techniques to determine the suitable subset of features. The sine cosine algorithm (SCA) is one of the recent swarm techniques that used as global optimization method to solve the feature selection, however, it can be getting stuck in local optima. In order to solve this problem, the differential evolution operators are used as local search method which helps the SCA to skip the local point. The proposed method is compared with other three algorithms to select the subset of features used eight UCI datasets. The experiments results showed that the proposed method provided better results than other methods in terms of performance measures and statistical test.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hancer, E., Xue, B., Karaboga, D., Zhang, M.: A binary ABC algorithm based on advanced similarity scheme for feature selection. Appl. Soft Comput. 36, 334–348 (2015)CrossRef Hancer, E., Xue, B., Karaboga, D., Zhang, M.: A binary ABC algorithm based on advanced similarity scheme for feature selection. Appl. Soft Comput. 36, 334–348 (2015)CrossRef
2.
Zurück zum Zitat Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Proceedings of 6th International Symposium on book Micro Machine and Human Science, MHS 1995, pp. 39–43 (1995) Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Proceedings of 6th International Symposium on book Micro Machine and Human Science, MHS 1995, pp. 39–43 (1995)
3.
Zurück zum Zitat Storn, R., Price, K.: Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim. 11(4), 341–359 (1997)MathSciNetCrossRefMATH Storn, R., Price, K.: Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim. 11(4), 341–359 (1997)MathSciNetCrossRefMATH
4.
Zurück zum Zitat Basturk, B., Karaboga, D.: An artificial bee colony (ABC) algorithm for numeric function optimization. In: IEEE Swarm Intelligence Symposium, vol. 8, no. 1, pp. 687–697 (2006) Basturk, B., Karaboga, D.: An artificial bee colony (ABC) algorithm for numeric function optimization. In: IEEE Swarm Intelligence Symposium, vol. 8, no. 1, pp. 687–697 (2006)
5.
Zurück zum Zitat Cuevas, E., Cienfuegos, M., Zaldivar, D., Perez-Cisneros, M.: A swarm optimization algorithm inspired in the behavior of the social-spider. Expert Syst. Appl. 40(16), 6374–6384 (2013)CrossRef Cuevas, E., Cienfuegos, M., Zaldivar, D., Perez-Cisneros, M.: A swarm optimization algorithm inspired in the behavior of the social-spider. Expert Syst. Appl. 40(16), 6374–6384 (2013)CrossRef
6.
Zurück zum Zitat Moradi, P., Rostami, M.: Integration of graph clustering with ant colony optimization for feature selection. Knowl.-Based Syst. 84, 144–161 (2015)CrossRef Moradi, P., Rostami, M.: Integration of graph clustering with ant colony optimization for feature selection. Knowl.-Based Syst. 84, 144–161 (2015)CrossRef
7.
Zurück zum Zitat Mirjalili, S., Mirjalili, S.M., Lewis, A.: Grey wolf optimizer. Adv. Eng. Softw. 69, 46–61 (2014)CrossRef Mirjalili, S., Mirjalili, S.M., Lewis, A.: Grey wolf optimizer. Adv. Eng. Softw. 69, 46–61 (2014)CrossRef
8.
Zurück zum Zitat Mirjalili, S.: SCA: a sine cosine algorithm for solving optimization problems. Knowl.-Based Syst. 96, 120–133 (2016)CrossRef Mirjalili, S.: SCA: a sine cosine algorithm for solving optimization problems. Knowl.-Based Syst. 96, 120–133 (2016)CrossRef
9.
Zurück zum Zitat Emary, E., Zawbaa, H.M., Hassanien, A.E.: Binary ant lion approaches for feature selection. Neurocomputing 213, 54–65 (2016)CrossRef Emary, E., Zawbaa, H.M., Hassanien, A.E.: Binary ant lion approaches for feature selection. Neurocomputing 213, 54–65 (2016)CrossRef
10.
Zurück zum Zitat Sindhu, R., Ngadiran, R., Yacob, Y.M., Zahri, N.A.H., Hariharan, M.: Sine-cosine algorithm for feature selection with elitism strategy and new updating mechanism. Neural Comput. Appl. 1–12 (2017) Sindhu, R., Ngadiran, R., Yacob, Y.M., Zahri, N.A.H., Hariharan, M.: Sine-cosine algorithm for feature selection with elitism strategy and new updating mechanism. Neural Comput. Appl. 1–12 (2017)
11.
Zurück zum Zitat Wang, J., Xue, B., Gao, X., Zhang, M.: A differential evolution approach to feature selection and instance selection. In: Pacific Rim International Conference on Artificial Intelligence, pp. 588–602 (2016) Wang, J., Xue, B., Gao, X., Zhang, M.: A differential evolution approach to feature selection and instance selection. In: Pacific Rim International Conference on Artificial Intelligence, pp. 588–602 (2016)
12.
Zurück zum Zitat Yang, W.-A., Zhou, Q., Tsui, K.-L.: Differential evolution-based feature selection and parameter optimisation for extreme learning machine in tool wear estimation. Int. J. Prod. Res. 54(15), 4703–4721 (2016)CrossRef Yang, W.-A., Zhou, Q., Tsui, K.-L.: Differential evolution-based feature selection and parameter optimisation for extreme learning machine in tool wear estimation. Int. J. Prod. Res. 54(15), 4703–4721 (2016)CrossRef
13.
Zurück zum Zitat Maheshwari, R., Kumar, M., Kumar, S.: Optimization of feature selection in face recognition system using differential evolution and genetic algorithm. In: Proceedings of 5th International Conference on Soft Computing for Problem Solving, pp. 363–374 (2016) Maheshwari, R., Kumar, M., Kumar, S.: Optimization of feature selection in face recognition system using differential evolution and genetic algorithm. In: Proceedings of 5th International Conference on Soft Computing for Problem Solving, pp. 363–374 (2016)
14.
Zurück zum Zitat Chattopadhyay, S., Mishra, S., Goswami, S.: Feature selection using differential evolution with binary mutation scheme. In: 2016 International Conference on Microelectronics, Computing and Communications (MicroCom), pp. 1–6 (2016) Chattopadhyay, S., Mishra, S., Goswami, S.: Feature selection using differential evolution with binary mutation scheme. In: 2016 International Conference on Microelectronics, Computing and Communications (MicroCom), pp. 1–6 (2016)
15.
Zurück zum Zitat Sikdar, U.K., Ekbal, A., Saha, S., Uryupina, O., Poesio, M.: Differential evolution-based feature selection technique for anaphora resolution. Soft. Comput. 19(8), 2149–2161 (2015)CrossRef Sikdar, U.K., Ekbal, A., Saha, S., Uryupina, O., Poesio, M.: Differential evolution-based feature selection technique for anaphora resolution. Soft. Comput. 19(8), 2149–2161 (2015)CrossRef
16.
Zurück zum Zitat Nakamura, R.Y.M., Pereira, L.A.M., Costa, K.A., Rodrigues, D., Papa, J.P., Yang, X.S.: BBA: a binary bat algorithm for feature selection. In: 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images, pp. 291–297 (2012) Nakamura, R.Y.M., Pereira, L.A.M., Costa, K.A., Rodrigues, D., Papa, J.P., Yang, X.S.: BBA: a binary bat algorithm for feature selection. In: 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images, pp. 291–297 (2012)
17.
Zurück zum Zitat Ewees, A.A., El Aziz, M.A., Hassanin, A.E.: Chaotic multi-verse optimizer-based feature selection. Neural Comput. Appl. 1–17 (2017) Ewees, A.A., El Aziz, M.A., Hassanin, A.E.: Chaotic multi-verse optimizer-based feature selection. Neural Comput. Appl. 1–17 (2017)
18.
Zurück zum Zitat El Aziz, M.A., Hassanien, A.E.: Modified cuckoo search algorithm with rough sets for feature selection. Neural Comput. Appl. 1–10 (2016) El Aziz, M.A., Hassanien, A.E.: Modified cuckoo search algorithm with rough sets for feature selection. Neural Comput. Appl. 1–10 (2016)
19.
Zurück zum Zitat Zorarpaci, E., Özel, S.A.: A hybrid approach of differential evolution and artificial bee colony for feature selection. Expert Syst. Appl. 62, 91–103 (2016)CrossRef Zorarpaci, E., Özel, S.A.: A hybrid approach of differential evolution and artificial bee colony for feature selection. Expert Syst. Appl. 62, 91–103 (2016)CrossRef
20.
Zurück zum Zitat Balakrishnan, U., Venkatachalapathy, K., Girirajkumar, M.S.: A hybrid PSO-DEFS based feature selection for the identification of diabetic retinopathy. Curr. Diabetes Rev. 11(3), 182–190 (2015)CrossRef Balakrishnan, U., Venkatachalapathy, K., Girirajkumar, M.S.: A hybrid PSO-DEFS based feature selection for the identification of diabetic retinopathy. Curr. Diabetes Rev. 11(3), 182–190 (2015)CrossRef
21.
Zurück zum Zitat Wang, X., Yang, J., Teng, X., Xia, W., Jensen, R.: Feature selection based on rough sets and particle swarm optimization. Pattern Recog. Lett. 28(4), 459–471 (2007)CrossRef Wang, X., Yang, J., Teng, X., Xia, W., Jensen, R.: Feature selection based on rough sets and particle swarm optimization. Pattern Recog. Lett. 28(4), 459–471 (2007)CrossRef
23.
Zurück zum Zitat El Aziz, M.A., Hassanien, A.E.: An improved social spider optimization algorithm based on rough sets for solving minimum number attribute reduction problem. Neural Comput. Appl. 1–12 (2017) El Aziz, M.A., Hassanien, A.E.: An improved social spider optimization algorithm based on rough sets for solving minimum number attribute reduction problem. Neural Comput. Appl. 1–12 (2017)
Metadaten
Titel
A Hybrid Method of Sine Cosine Algorithm and Differential Evolution for Feature Selection
verfasst von
Mohamed E. Abd Elaziz
Ahmed A. Ewees
Diego Oliva
Pengfei Duan
Shengwu Xiong
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-70139-4_15