Skip to main content
Erschienen in: Computing 6/2022

21.01.2022 | Regular Paper

Solving dimension reduction problems for classification using Promoted Crow Search Algorithm (PCSA)

verfasst von: Behrouz Samieiyan, Poorya MohammadiNasab, Mostafa Abbas Mollaei, Fahimeh Hajizadeh, Mohammadreza Kangavari

Erschienen in: Computing | Ausgabe 6/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In recent years, with the increasing volume of databases, the removal of redundant features has become an essential thing in classification. A smaller subset of features is selected using feature selection algorithm. One of the famous algorithms of feature selection methods is the crow search algorithm (CSA). This algorithm’s popularity can be mentioned in the algorithm’s implementation and process and the impressive results compared to the previous algorithms. Despite all these benefits, this algorithm suffers from problems such as unbalanced global and local search. It is also stuck in local optimization due to the search approach’s inadequacy. In this paper, a new algorithm based on CSA is introduced. In order to overcome the shortcoming, four fundamental changes have been made to CSA. (i) The algorithm uses the concept of dynamic awareness probability to solve the balance between exploitation and exploration. Then, a new approach is introduced for each part of the search that improves crows’ search performance both (ii) locally and (iii) globally. Also, as the last change, (iv) the concept of chaos is used to increase the algorithm’s convergence rate. The proposed method has been tested and compared with ten well-known algorithms in this field on the same datasets and has performed on average 20% better in the feature reduction index and 2.5% in the fitness index, while has a lower performance in accuracy by only 1.5%. Practical results show that the algorithm changes have provided attractive results compared to other algorithms in this field in the mentioned metrics.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abd Elaziz ME, Ewees AA, Oliva D, Duan P, Xiong S (2017) A hybrid method of sine cosine algorithm and differential evolution for feature selection. In: International conference on neural information processing, Springer, Berlin, pp 145–155 Abd Elaziz ME, Ewees AA, Oliva D, Duan P, Xiong S (2017) A hybrid method of sine cosine algorithm and differential evolution for feature selection. In: International conference on neural information processing, Springer, Berlin, pp 145–155
2.
Zurück zum Zitat Anter AM, Ali M (2020) Feature selection strategy based on hybrid crow search optimization algorithm integrated with chaos theory and fuzzy c-means algorithm for medical diagnosis problems. Soft Comput 24(3):1565–1584CrossRef Anter AM, Ali M (2020) Feature selection strategy based on hybrid crow search optimization algorithm integrated with chaos theory and fuzzy c-means algorithm for medical diagnosis problems. Soft Comput 24(3):1565–1584CrossRef
3.
Zurück zum Zitat Anter AM, Hassenian AE, Oliva D (2019) An improved fast fuzzy c-means using crow search optimization algorithm for crop identification in agricultural. Expert Syst Appl 118:340–354CrossRef Anter AM, Hassenian AE, Oliva D (2019) An improved fast fuzzy c-means using crow search optimization algorithm for crop identification in agricultural. Expert Syst Appl 118:340–354CrossRef
4.
Zurück zum Zitat Arora S, Anand P (2019) Binary butterfly optimization approaches for feature selection. Expert Syst Appl 116:147–160CrossRef Arora S, Anand P (2019) Binary butterfly optimization approaches for feature selection. Expert Syst Appl 116:147–160CrossRef
5.
Zurück zum Zitat Arora S, Singh H, Sharma M, Sharma S, Anand P (2019) A new hybrid algorithm based on grey wolf optimization and crow search algorithm for unconstrained function optimization and feature selection. IEEE Access 7:26343–26361CrossRef Arora S, Singh H, Sharma M, Sharma S, Anand P (2019) A new hybrid algorithm based on grey wolf optimization and crow search algorithm for unconstrained function optimization and feature selection. IEEE Access 7:26343–26361CrossRef
6.
Zurück zum Zitat Askarzadeh A (2016) A novel metaheuristic method for solving constrained engineering optimization problems: crow search algorithm. Comput Struct 169:1–12CrossRef Askarzadeh A (2016) A novel metaheuristic method for solving constrained engineering optimization problems: crow search algorithm. Comput Struct 169:1–12CrossRef
7.
Zurück zum Zitat Bhuvaneswari G, Manikandan G (2018) A novel machine learning framework for diagnosing the type 2 diabetics using temporal fuzzy ant miner decision tree classifier with temporal weighted genetic algorithm. Computing 100(8):759–772CrossRef Bhuvaneswari G, Manikandan G (2018) A novel machine learning framework for diagnosing the type 2 diabetics using temporal fuzzy ant miner decision tree classifier with temporal weighted genetic algorithm. Computing 100(8):759–772CrossRef
8.
Zurück zum Zitat Crone SF, Lessmann S, Stahlbock R (2006) The impact of preprocessing on data mining: an evaluation of classifier sensitivity in direct marketing. Eur J Oper Res 173(3):781–800MathSciNetCrossRef Crone SF, Lessmann S, Stahlbock R (2006) The impact of preprocessing on data mining: an evaluation of classifier sensitivity in direct marketing. Eur J Oper Res 173(3):781–800MathSciNetCrossRef
9.
Zurück zum Zitat De Souza RCT, dos Santos Coelho L, De Macedo CA, Pierezan J (2018) A v-shaped binary crow search algorithm for feature selection. In: 2018 IEEE congress on evolutionary computation (CEC), IEEE, pp 1–8 De Souza RCT, dos Santos Coelho L, De Macedo CA, Pierezan J (2018) A v-shaped binary crow search algorithm for feature selection. In: 2018 IEEE congress on evolutionary computation (CEC), IEEE, pp 1–8
10.
Zurück zum Zitat Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18CrossRef Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18CrossRef
11.
Zurück zum Zitat Díaz P, Pérez-Cisneros M, Cuevas E, Avalos O, Gálvez J, Hinojosa S, Zaldivar D (2018) An improved crow search algorithm applied to energy problems. Energies 11(3):571CrossRef Díaz P, Pérez-Cisneros M, Cuevas E, Avalos O, Gálvez J, Hinojosa S, Zaldivar D (2018) An improved crow search algorithm applied to energy problems. Energies 11(3):571CrossRef
12.
Zurück zum Zitat Gong W, Cai Z (2013) Differential evolution with ranking-based mutation operators. IEEE Trans Cybern 43(6):2066–2081CrossRef Gong W, Cai Z (2013) Differential evolution with ranking-based mutation operators. IEEE Trans Cybern 43(6):2066–2081CrossRef
13.
Zurück zum Zitat Gupta D, Rodrigues JJ, Sundaram S, Khanna A, Korotaev V, de Albuquerque VHC (2018) Usability feature extraction using modified crow search algorithm: a novel approach. Neural Comput Appl 32:10915–10925CrossRef Gupta D, Rodrigues JJ, Sundaram S, Khanna A, Korotaev V, de Albuquerque VHC (2018) Usability feature extraction using modified crow search algorithm: a novel approach. Neural Comput Appl 32:10915–10925CrossRef
14.
Zurück zum Zitat Gupta D, Sundaram S, Khanna A, Hassanien AE, De Albuquerque VHC (2018) Improved diagnosis of parkinsons disease using optimized crow search algorithm. Comput Electr Eng 68:412–424CrossRef Gupta D, Sundaram S, Khanna A, Hassanien AE, De Albuquerque VHC (2018) Improved diagnosis of parkinsons disease using optimized crow search algorithm. Comput Electr Eng 68:412–424CrossRef
16.
Zurück zum Zitat Jain M, Rani A, Singh V (2017) An improved crow search algorithm for high-dimensional problems. J Intell Fuzzy Syst 33(6):3597–3614CrossRef Jain M, Rani A, Singh V (2017) An improved crow search algorithm for high-dimensional problems. J Intell Fuzzy Syst 33(6):3597–3614CrossRef
17.
Zurück zum Zitat Jatana N, Suri B (2020) An improved crow search algorithm for test data generation using search-based mutation testing. Neural Process Lett 52(1):767–784CrossRef Jatana N, Suri B (2020) An improved crow search algorithm for test data generation using search-based mutation testing. Neural Process Lett 52(1):767–784CrossRef
18.
Zurück zum Zitat Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39(3):459–471MathSciNetCrossRef Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39(3):459–471MathSciNetCrossRef
19.
Zurück zum Zitat Kohavi R, John GH et al (1997) Wrappers for feature subset selection. Artif Intell 97(1–2):273–324CrossRef Kohavi R, John GH et al (1997) Wrappers for feature subset selection. Artif Intell 97(1–2):273–324CrossRef
20.
Zurück zum Zitat Liu H, Motoda H (1998) Feature extraction, construction and selection: a data mining perspective, vol 453. Springer, BerlinCrossRef Liu H, Motoda H (1998) Feature extraction, construction and selection: a data mining perspective, vol 453. Springer, BerlinCrossRef
22.
Zurück zum Zitat Mohammadi F, Abdi H (2018) A modified crow search algorithm (MCSA) for solving economic load dispatch problem. Appl Soft Comput 71:51–65CrossRef Mohammadi F, Abdi H (2018) A modified crow search algorithm (MCSA) for solving economic load dispatch problem. Appl Soft Comput 71:51–65CrossRef
23.
Zurück zum Zitat Ouadfel S, Abd Elaziz M (2020) Enhanced crow search algorithm for feature selection. Expert Syst Appl 159:113572CrossRef Ouadfel S, Abd Elaziz M (2020) Enhanced crow search algorithm for feature selection. Expert Syst Appl 159:113572CrossRef
24.
Zurück zum Zitat Rashedi E, Nezamabadi-Pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248CrossRef Rashedi E, Nezamabadi-Pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248CrossRef
25.
Zurück zum Zitat Sayed GI, Hassanien AE, Azar AT (2019) Feature selection via a novel chaotic crow search algorithm. Neural Comput Appl 31(1):171–188CrossRef Sayed GI, Hassanien AE, Azar AT (2019) Feature selection via a novel chaotic crow search algorithm. Neural Comput Appl 31(1):171–188CrossRef
26.
Zurück zum Zitat Shekhawat S, Saxena A (2020) Development and applications of an intelligent crow search algorithm based on opposition based learning. ISA Trans 99:210–230CrossRef Shekhawat S, Saxena A (2020) Development and applications of an intelligent crow search algorithm based on opposition based learning. ISA Trans 99:210–230CrossRef
27.
Zurück zum Zitat Shi Z, Li Q, Zhang S, Huang X (2017) Improved crow search algorithm with inertia weight factor and roulette wheel selection scheme. In: 2017 10th international symposium on computational intelligence and design (ISCID), IEEE, vol 1, pp 205–209 Shi Z, Li Q, Zhang S, Huang X (2017) Improved crow search algorithm with inertia weight factor and roulette wheel selection scheme. In: 2017 10th international symposium on computational intelligence and design (ISCID), IEEE, vol 1, pp 205–209
30.
Zurück zum Zitat Zamani H, Nadimi-Shahraki MH, Gandomi AH (2019) CCSA: Conscious neighborhood-based crow search algorithm for solving global optimization problems. Appl Soft Comput 85:105583CrossRef Zamani H, Nadimi-Shahraki MH, Gandomi AH (2019) CCSA: Conscious neighborhood-based crow search algorithm for solving global optimization problems. Appl Soft Comput 85:105583CrossRef
31.
Zurück zum Zitat Zames G, Ajlouni N, Ajlouni N, Ajlouni N, Holland J, Hills W, Goldberg D (1981) Genetic algorithms in search, optimization and machine learning. Inf Technol J 3(1):301–302 Zames G, Ajlouni N, Ajlouni N, Ajlouni N, Holland J, Hills W, Goldberg D (1981) Genetic algorithms in search, optimization and machine learning. Inf Technol J 3(1):301–302
32.
Zurück zum Zitat Zhang L, Mistry K, Lim CP, Neoh SC (2018) Feature selection using firefly optimization for classification and regression models. Decis Support Syst 106:64–85CrossRef Zhang L, Mistry K, Lim CP, Neoh SC (2018) Feature selection using firefly optimization for classification and regression models. Decis Support Syst 106:64–85CrossRef
Metadaten
Titel
Solving dimension reduction problems for classification using Promoted Crow Search Algorithm (PCSA)
verfasst von
Behrouz Samieiyan
Poorya MohammadiNasab
Mostafa Abbas Mollaei
Fahimeh Hajizadeh
Mohammadreza Kangavari
Publikationsdatum
21.01.2022
Verlag
Springer Vienna
Erschienen in
Computing / Ausgabe 6/2022
Print ISSN: 0010-485X
Elektronische ISSN: 1436-5057
DOI
https://doi.org/10.1007/s00607-021-01037-2

Weitere Artikel der Ausgabe 6/2022

Computing 6/2022 Zur Ausgabe