Skip to main content
Erschienen in: The Journal of Supercomputing 8/2021

03.02.2021

An efficient binary chaotic symbiotic organisms search algorithm approaches for feature selection problems

verfasst von: Hekmat Mohmmadzadeh, Farhad Soleimanian Gharehchopogh

Erschienen in: The Journal of Supercomputing | Ausgabe 8/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Feature selection is one of the main steps in preprocessing data in machine learning, and its goal is to reduce features by removing additional and noisy features. Feature selection methods and feature reduction in a dataset must consider the accuracy of the classifying algorithms. Meta-heuristic algorithms serve as the most successful and promising methods to solve this problem. Symbiotic Organisms Search (SOS) is one of the most successful meta-heuristic algorithms inspired by organisms' interaction in nature called mutualism, commensalism, and parasitism. In this paper, three SOS-based binary approaches are offered to solve the feature selection problem. In the first and second approaches, several S-shaped transfer functions and several Chaotic Tent Function-based V-shaped transfer functions called BSOSST and BSOSVT are used to make the binary SOS (BSOS). In the third approach, an advanced BSOS based on changing SOS and the chaotic Tent function operators called EBCSOS is provided. The EBCSOS algorithm uses the chaotic Tent function and the Gaussian mutation to increase usefulness and exploration. Moreover, two new operators, i.e., BMPT and BCPT, are suggested to make the commensalism and mutualism stage binary based on a chaotic function to solve the feature selection problem. Finally, the proposed BSOSST and BSOSVT methods and the advanced version of EBCSOS were implemented on 25 datasets than the basic algorithm's binary meta-heuristic algorithms. Various experiments demonstrated that the proposed EBCSOS algorithm outperformed other methods in terms of several features and accuracy. To further confirm the proposed EBCSOS algorithm, the problem of detecting spam E-mails was applied, with the results of this experiment indicating that the proposed EBCSOS algorithm significantly improved the accuracy and speed of all categories in detecting spam E-mails.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Mafarja M et al (2019) Binary grasshopper optimisation algorithm approaches for feature selection problems. Expert Syst Appl 117:267–286CrossRef Mafarja M et al (2019) Binary grasshopper optimisation algorithm approaches for feature selection problems. Expert Syst Appl 117:267–286CrossRef
2.
Zurück zum Zitat Li Y, Li T, Liu H (2017) Recent advances in feature selection and its applications. Knowl Inf Syst 53(3):551–577CrossRef Li Y, Li T, Liu H (2017) Recent advances in feature selection and its applications. Knowl Inf Syst 53(3):551–577CrossRef
3.
Zurück zum Zitat Liu H, Yu L (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17(4):491–502MathSciNetCrossRef Liu H, Yu L (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17(4):491–502MathSciNetCrossRef
4.
Zurück zum Zitat Arora S, Anand P (2019) Binary butterfly optimization approaches for feature selection. Expert Syst Appl 116:147–160CrossRef Arora S, Anand P (2019) Binary butterfly optimization approaches for feature selection. Expert Syst Appl 116:147–160CrossRef
6.
Zurück zum Zitat Kabir MM, Shahjahan M, Murase K (2012) A new hybrid ant colony optimization algorithm for feature selection. Expert Syst Appl 39(3):3747–3763CrossRef Kabir MM, Shahjahan M, Murase K (2012) A new hybrid ant colony optimization algorithm for feature selection. Expert Syst Appl 39(3):3747–3763CrossRef
7.
Zurück zum Zitat Faris H et al (2018) An efficient binary salp swarm algorithm with crossover scheme for feature selection problems. Knowl-Based Syst 154:43–67CrossRef Faris H et al (2018) An efficient binary salp swarm algorithm with crossover scheme for feature selection problems. Knowl-Based Syst 154:43–67CrossRef
8.
Zurück zum Zitat Emary E, Zawbaa HM, Hassanien AE (2016) Binary ant lion approaches for feature selection. Neurocomputing 213:54–65CrossRef Emary E, Zawbaa HM, Hassanien AE (2016) Binary ant lion approaches for feature selection. Neurocomputing 213:54–65CrossRef
9.
Zurück zum Zitat Emary E, Zawbaa HM, Hassanien AE (2016) Binary grey wolf optimization approaches for feature selection. Neurocomputing 172:371–381CrossRef Emary E, Zawbaa HM, Hassanien AE (2016) Binary grey wolf optimization approaches for feature selection. Neurocomputing 172:371–381CrossRef
10.
Zurück zum Zitat Mafarja MM, Mirjalili S (2017) Hybrid whale optimization algorithm with simulated annealing for feature selection. Neurocomputing 260:302–312CrossRef Mafarja MM, Mirjalili S (2017) Hybrid whale optimization algorithm with simulated annealing for feature selection. Neurocomputing 260:302–312CrossRef
11.
Zurück zum Zitat Mohammadzadeh H, Gharehchopogh FS (2020) A multi-agent system based for solving high-dimensional optimization problems: a case study on E-mail spam detection. Int J Commun Syst. 34(3):e4670 Mohammadzadeh H, Gharehchopogh FS (2020) A multi-agent system based for solving high-dimensional optimization problems: a case study on E-mail spam detection. Int J Commun Syst. 34(3):e4670
12.
Zurück zum Zitat Al-Madi N, Faris H, Mirjalili S (2019) Binary multi-verse optimization algorithm for global optimization and discrete problems. Int J Mach Learn Cyberne 10(12):3445–3465CrossRef Al-Madi N, Faris H, Mirjalili S (2019) Binary multi-verse optimization algorithm for global optimization and discrete problems. Int J Mach Learn Cyberne 10(12):3445–3465CrossRef
13.
Zurück zum Zitat Shayanfar H, Gharehchopogh FS (2018) Farmland fertility: A new metaheuristic algorithm for solving continuous optimization problems. Appl Soft Comput 71:728–746CrossRef Shayanfar H, Gharehchopogh FS (2018) Farmland fertility: A new metaheuristic algorithm for solving continuous optimization problems. Appl Soft Comput 71:728–746CrossRef
14.
Zurück zum Zitat Mirjalili S, Lewis A (2013) S-shaped versus V-shaped transfer functions for binary particle swarm optimization. Swarm Evolut Comput 9:1–14CrossRef Mirjalili S, Lewis A (2013) S-shaped versus V-shaped transfer functions for binary particle swarm optimization. Swarm Evolut Comput 9:1–14CrossRef
15.
Zurück zum Zitat Rodrigues D et al. (2013) BCS: A binary cuckoo search algorithm for feature selection. in 2013 IEEE International symposium on circuits and systems (ISCAS). 2013. IEEE Rodrigues D et al. (2013) BCS: A binary cuckoo search algorithm for feature selection. in 2013 IEEE International symposium on circuits and systems (ISCAS). 2013. IEEE
16.
Zurück zum Zitat Mirjalili S, Mirjalili SM, Yang X-S (2014) Binary bat algorithm. Neural Comput Appl 25(3–4):663–681CrossRef Mirjalili S, Mirjalili SM, Yang X-S (2014) Binary bat algorithm. Neural Comput Appl 25(3–4):663–681CrossRef
17.
Zurück zum Zitat Mafarja M, Mirjalili S (2018) Whale optimization approaches for wrapper feature selection. Appl Soft Comput 62:441–453CrossRef Mafarja M, Mirjalili S (2018) Whale optimization approaches for wrapper feature selection. Appl Soft Comput 62:441–453CrossRef
18.
Zurück zum Zitat Kaur G, Arora S (2018) Chaotic whale optimization algorithm. J Comput Design Eng 5(3):275–284CrossRef Kaur G, Arora S (2018) Chaotic whale optimization algorithm. J Comput Design Eng 5(3):275–284CrossRef
19.
Zurück zum Zitat Hussien AG et al (2019) S-shaped binary whale optimization algorithm for feature selection. Recent trends in signal and image processing. Springer, New york, pp 79–87CrossRef Hussien AG et al (2019) S-shaped binary whale optimization algorithm for feature selection. Recent trends in signal and image processing. Springer, New york, pp 79–87CrossRef
20.
Zurück zum Zitat De Souza RCT et al. (2018) A V-shaped binary crow search algorithm for feature selection. In 2018 IEEE congress on evolutionary computation (CEC). IEEE De Souza RCT et al. (2018) A V-shaped binary crow search algorithm for feature selection. In 2018 IEEE congress on evolutionary computation (CEC). IEEE
21.
Zurück zum Zitat Cheng M-Y, Prayogo D (2014) Symbiotic organisms search: a new metaheuristic optimization algorithm. Comput Struct 139:98–112CrossRef Cheng M-Y, Prayogo D (2014) Symbiotic organisms search: a new metaheuristic optimization algorithm. Comput Struct 139:98–112CrossRef
22.
Zurück zum Zitat Gharehchopogh FS, Shayanfar H, Gholizadeh H (2019) A comprehensive survey on symbiotic organisms search algorithms. Artif Intell Rev 53:2265–2312CrossRef Gharehchopogh FS, Shayanfar H, Gholizadeh H (2019) A comprehensive survey on symbiotic organisms search algorithms. Artif Intell Rev 53:2265–2312CrossRef
23.
Zurück zum Zitat Al-Betar MA et al. (2020). Binary β-hill climbing optimizer with S-shape transfer function for feature selection. J Ambient Intell Humaniz Comput. pp 1–29 Al-Betar MA et al. (2020). Binary β-hill climbing optimizer with S-shape transfer function for feature selection. J Ambient Intell Humaniz Comput. pp 1–29
24.
Zurück zum Zitat Hegazy AE, Makhlouf M, El-Tawel GS (2019) Feature selection using chaotic salp swarm algorithm for data classification. Arab J Sci Eng 44(4):3801–3816CrossRef Hegazy AE, Makhlouf M, El-Tawel GS (2019) Feature selection using chaotic salp swarm algorithm for data classification. Arab J Sci Eng 44(4):3801–3816CrossRef
25.
Zurück zum Zitat He Y et al. (2008) A Precise Chaotic Particle Swarm Optimization Algorithm Based On Improved Tent Map. in 2008 Fourth International Conference on Natural Computation. IEEE. He Y et al. (2008) A Precise Chaotic Particle Swarm Optimization Algorithm Based On Improved Tent Map. in 2008 Fourth International Conference on Natural Computation. IEEE.
26.
Zurück zum Zitat Anand P, Arora S (2020) A novel chaotic selfish herd optimizer for global optimization and feature selection. Artif Intell Rev 53(2):1441–1486CrossRef Anand P, Arora S (2020) A novel chaotic selfish herd optimizer for global optimization and feature selection. Artif Intell Rev 53(2):1441–1486CrossRef
27.
Zurück zum Zitat Liao TW, Kuo R (2018) Five discrete symbiotic organisms search algorithms for simultaneous optimization of feature subset and neighborhood size of knn classification models. Appl Soft Comput 64:581–595CrossRef Liao TW, Kuo R (2018) Five discrete symbiotic organisms search algorithms for simultaneous optimization of feature subset and neighborhood size of knn classification models. Appl Soft Comput 64:581–595CrossRef
28.
Zurück zum Zitat Mafarja M et al (2018) Evolutionary population dynamics and grasshopper optimization approaches for feature selection problems. Knowl-Based Syst 145:25–45CrossRef Mafarja M et al (2018) Evolutionary population dynamics and grasshopper optimization approaches for feature selection problems. Knowl-Based Syst 145:25–45CrossRef
29.
Zurück zum Zitat Rajamohana S, Umamaheswari K (2018) Hybrid approach of improved binary particle swarm optimization and shuffled frog leaping for feature selection. Comput Electr Eng 67:497–508CrossRef Rajamohana S, Umamaheswari K (2018) Hybrid approach of improved binary particle swarm optimization and shuffled frog leaping for feature selection. Comput Electr Eng 67:497–508CrossRef
30.
Zurück zum Zitat Altman NS (1992) An introduction to kernel and nearest-neighbor nonparametric regression. Am Statistician 46(3):175–185MathSciNet Altman NS (1992) An introduction to kernel and nearest-neighbor nonparametric regression. Am Statistician 46(3):175–185MathSciNet
32.
Zurück zum Zitat Zeugmann T et al. (2011) Particle swarm optimization. Encyclopedia of machine learning. pp 760–766 Zeugmann T et al. (2011) Particle swarm optimization. Encyclopedia of machine learning. pp 760–766
33.
Zurück zum Zitat Yang X-S (2012) Flower Pollination Algorithm For Global Optimization. In: International conference on unconventional computing and natural computation. Springer Yang X-S (2012) Flower Pollination Algorithm For Global Optimization. In: International conference on unconventional computing and natural computation. Springer
34.
Zurück zum Zitat Sakkis G et al. (2001) Stacking classifiers for anti-spam filtering of E-mail. arXiv preprint cs/0106040 Sakkis G et al. (2001) Stacking classifiers for anti-spam filtering of E-mail. arXiv preprint cs/0106040
Metadaten
Titel
An efficient binary chaotic symbiotic organisms search algorithm approaches for feature selection problems
verfasst von
Hekmat Mohmmadzadeh
Farhad Soleimanian Gharehchopogh
Publikationsdatum
03.02.2021
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 8/2021
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-021-03626-6

Weitere Artikel der Ausgabe 8/2021

The Journal of Supercomputing 8/2021 Zur Ausgabe