nach oben

Journal of Classification

04.03.2024

Binary Peacock Algorithm: A Novel Metaheuristic Approach for Feature Selection

verfasst von: Hema Banati, Richa Sharma, Asha Yadav

Erschienen in: Journal of Classification

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Binary metaheuristic algorithms prove to be invaluable for solving binary optimization problems. This paper proposes a binary variant of the peacock algorithm (PA) for feature selection. PA, a recent metaheuristic algorithm, is built upon lekking and mating behaviors of peacocks and peahens. While designing the binary variant, two major shortcomings of PA (lek formation and offspring generation) were identified and addressed. Eight binary variants of PA are also proposed and compared over mean fitness to identify the best variant, called binary peacock algorithm (bPA). To validate bPA’s performance experiments are conducted using 34 benchmark datasets and results are compared with eight well-known binary metaheuristic algorithms. The results show that bPA classifies 30 datasets with highest accuracy and extracts minimum features in 32 datasets, achieving up to 99.80% reduction in the feature subset size in the dataset with maximum features. bPA attained rank 1 in Friedman rank test over all parameters.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Agrawal, P., Abutarboush, H. F., Ganesh, T., et al. (2021). Metaheuristic algorithms on feature selection: A survey of one decade of research (2009–2019). IEEE Access, 9, 26766–26791. https://doi.org/10.1109/ACCESS.2021.3056407CrossRef

Agrawal, R., Kaur, B., & Sharma, S. (2020). Quantum based whale optimization algorithm for wrapper feature selection. Applied Soft Computing, 89, 106092. https://doi.org/10.1016/j.asoc.2020.106092CrossRef

Al-Tashi, Q., Rais, H., & Jadid, S. (2018). Feature selection method based on grey wolf optimization for coronary artery disease classification. In International conference of reliable information and communication technology (pp. 257–266). Springer. https://doi.org/10.1007/978-3-319-99007-1_25

Al-Tashi, Q., Abdulkadir, S. J., Rais, H. M., et al. (2020). Binary multi-objective grey wolf optimizer for feature selection in classification. IEEE Access, 8, 106247–106263. https://doi.org/10.1109/ACCESS.2020.3000040CrossRef

Allam, M., & Nandhini, M. (2022). Optimal feature selection using binary teaching learning based optimization algorithm. Journal of King Saud University - Computer and Information Sciences, 34(2), 329–341. https://doi.org/10.1016/j.jksuci.2018.12.001CrossRef

Banati, H., & Bajaj, M. (2012). Promoting products online using firefly algorithm. In A. Abraham, A. Y. Zomaya, & S. Ventura, et al. (Eds.) 12th International Conference on Intelligent Systems Design and Applications, ISDA 2012, Kochi, India, November 27-29, 2012. IEEE, pp 580–585. https://doi.org/10.1109/ISDA.2012.6416602

Chandrashekar, G., & Sahin, F. (2014). A survey on feature selection methods. Computers & Electrical Engineering, 40(1), 16–28. https://doi.org/10.1016/j.compeleceng.2013.11.024, 40th-year commemorative issue

Chaudhary, R., & Banati, H. (2019). Peacock algorithm. 2019 IEEE Congress on Evolutionary Computation (CEC) (pp. 2331–2338). Wellington, New Zealand: IEEE.CrossRef

Cherrington, M., Thabtah, F., Lu, J., et al. (2019). Feature selection: Filter methods performance challenges. In 2019 International Conference on Computer and Information Sciences (ICCIS) (pp. 1–4). IEEE

Crawford, B., Soto, R., Astorga, G., et al. (2017). Putting continuous metaheuristics to work in binary search spaces. Complexity, 2017,. https://doi.org/10.1155/2017/8404231

Deniz, A., Kiziloz, H. E., Dokeroglu, T., et al. (2017). Robust multiobjective evolutionary feature subset selection algorithm for binary classification using machine learning techniques. Neurocomputing, 241, 128–146. https://doi.org/10.1016/j.neucom.2017.02.033CrossRef

Dokeroglu, T., Sevinc, E., Kucukyilmaz, T., et al. (2019). A survey on new generation metaheuristic algorithms. Computers & Industrial Engineering, 137, 106040. https://doi.org/10.1016/j.cie.2019.106040CrossRef

Dua, D., & Graff, C. (2017). UCI machine learning repository. http://archive.ics.uci.edu/ml

Eberhart, R., & Kennedy, J. (1995). Particle swarm optimization. In Proceedings of the IEEE international conference on neural networks (pp. 1942–1948). Citeseer

El Aboudi, N., & Benhlima, L. (2016). Review on wrapper feature selection approaches. In 2016 International Conference on Engineering & MIS (ICEMIS) (pp. 1–5). IEEE

Emary, E., Zawbaa, H. M., & Hassanien, A. E. (2016). Binary grey wolf optimization approaches for feature selection. Neurocomputing, 172, 371–381. https://doi.org/10.1016/j.neucom.2015.06.083CrossRef

Faris, H., Aljarah, I., Mirjalili, S., et al. (2016). Evolopy: An open-source nature-inspired optimization framework in python. In Evolutionary machine learning techniques (pp. 131–173). Springer. https://doi.org/10.5220/0006048201710177

García, S., Molina, D., Lozano, M., et al. (2009). A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: A case study on the CEC’2005 special session on real parameter optimization. Journal of Heuristics, 15, 617–644.CrossRef

Gharehchopogh, F. S. (2023). Quantum-inspired metaheuristic algorithms: Comprehensive survey and classification. Artificial Intelligence Review, 56(6), 5479–5543.CrossRef

Gharehchopogh, F. S., Maleki, I., & Dizaji, Z. A. (2022). Chaotic vortex search algorithm: Metaheuristic algorithm for feature selection. Evolutionary Intelligence, 15(3), 1777–1808.CrossRef

Gharehchopogh, F. S., Namazi, M., Ebrahimi, L., et al. (2023). Advances in sparrow search algorithm: A comprehensive survey. Archives of Computational Methods in Engineering, 30(1), 427–455.CrossRefPubMed

Hameed, S. S., Hassan, R., Hassan, W. H., et al. (2021). The microarray dataset of prostate cancer in csv format.https://doi.org/10.1371/journal.pone.0246039.s003. https://plos.figshare.com/articles/dataset/The microarray_dataset_of_prostate_cancer_in_csv_format_/13658793

Han, S., Hong, G., Kim, J., et al. (2024). Optimal feature selection for firewall log analysis using machine learning and hybrid metaheuristic algorithms. https://doi.org/10.31224/osf.io/pm3hy

Hu, P., Pan, J. S., & Chu, S. C. (2020). Improved binary grey wolf optimizer and its application for feature selection. Knowledge-Based Systems, 195, 105746. https://doi.org/10.1016/j.knosys.2020.105746CrossRef

Hussien, A. G., Hassanien, A. E., Houssein, E. H., Bhattacharyya, S., et al. (2019). S-shaped binary whale optimization algorithm for feature selection. In S. Bhattacharyya, A. Mukherjee, H. Bhaumik, et al. (Eds.), Recent Trends in Signal and Image Processing (pp. 79–87). Singapore: Springer Singapore.

Jović, A., Brkić, K., Bogunović, N. (2015). A review of feature selection methods with applications. 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) (pp. 1200–1205). Opatija: IEEE.

Kaur, T., Saini, B. S., & Gupta, S. (2018). A novel feature selection method for brain tumor MR image classification based on the fisher criterion and parameter-free bat optimization. Neural Computing and Applications, 29(8), 193–206. https://doi.org/10.1007/s00521-017-2869-zCrossRef

Kigsirisin, S., & Miyauchi, H. (2021). Short-term operational scheduling of unit commitment using binary alternative moth-flame optimization. IEEE Access, 9, 12267–12281. https://doi.org/10.1109/ACCESS.2021.3051175CrossRef

Kohavi, R., & John, G. H. (1997). Wrappers for feature subset selection. Artificial Intelligence, 97(1), 273–324. https://doi.org/10.1016/S0004-3702(97)00043-XCrossRef

Laamari, M. A., & Kamel, N. (2014). A hybrid bat based feature selection approach for intrusion detection. In International Conference on Bio-Inspired Computing: Theories and Applications. China, Springer

Luo, J., Li, X., Yu, C., et al. (2023). Multiclass sparse discriminant analysis incorporating graphical structure among predictors. Journal of Classification, 40(3), 614–637.MathSciNetCrossRef

Mafarja, M., & Mirjalili, S. (2018). Whale optimization approaches for wrapper feature selection. Applied Soft Computing, 62, 441–453. https://doi.org/10.1016/j.asoc.2017.11.006CrossRef

Marie-Sainte, S. L., & Alalyani, N. (2020). Firefly algorithm based feature selection for Arabic text classification. Journal of King Saud University-Computer and Information Sciences, 32(3), 320–328. https://doi.org/10.1016/j.jksuci.2018.06.004CrossRef

Mirjalili, S. (2015). Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm. Knowledge-Based Systems, 89, 228–249. https://doi.org/10.1016/j.knosys.2015.07.006. https://www.sciencedirect.com/science/article/pii/S0950705115002580

Mirjalili, S., & Lewis, A. (2013). S-shaped versus v-shaped transfer functions for binary particle swarm optimization. Swarm and Evolutionary Computation, 9, 1–14. https://doi.org/10.1016/j.swevo.2012.09.002CrossRef

Mirjalili, S., & Lewis, A. (2016a). The whale optimization algorithm. Advances in Engineering Software, 95, 51–67.CrossRef

Mirjalili, S., & Lewis, A. (2016b). The whale optimization algorithm. Advances in Engineering Software, 95, 51–67.CrossRef

Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014a). Grey wolf optimizer. Advances in Engineering Software, 69, 46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007CrossRef

Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Grey wolf optimizer. Advances in Engineering Software, 69, 46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007. https://www.sciencedirect.com/science/article/pii/S0965997813001853

Mohammadzadeh, H., & Gharehchopogh, F. S. (2021a). Feature selection with binary symbiotic organisms search algorithm for email spam detection. International Journal of Information Technology & Decision Making, 20(01), 469–515.CrossRef

Mohammadzadeh, H., & Gharehchopogh, F. S. (2021b). A multi-agent system based for solving high-dimensional optimization problems: A case study on email spam detection. International Journal of Communication Systems, 34(3), e4670.CrossRef

Nadimi-Shahraki, M. H., Taghian, S., Mirjalili, S., et al. (2020). MTDE: An effective multi-trial vector-based differential evolution algorithm and its applications for engineering design problems. Applied Soft Computing, 97,

Nadimi-Shahraki, M. H., Banaie-Dezfouli, M., Zamani, H., et al. (2021a). B-MFO: A binary moth-flame optimization for feature selection from medical datasets. Computers, 10(11), 136.CrossRef

Nadimi-Shahraki, M. H., Moeini, E., Taghian, S., et al. (2021b). DMFO-CD: A discrete moth-flame optimization algorithm for community detection. Algorithms, 14(11), 314.CrossRef

Nadimi-Shahraki, M. H., Taghian, S., & Mirjalili, S. (2021c). An improved grey wolf optimizer for solving engineering problems. Expert Systems with Applications, 166, 113917.CrossRef

Nadimi-Shahraki, M. H., Fatahi, A., Zamani, H., et al. (2022a). Binary approaches of quantum-based avian navigation optimizer to select effective features from high-dimensional medical data. Mathematics, 10(15), 2770.CrossRef

Nadimi-Shahraki, M. H., Taghian, S., Mirjalili, S., et al. (2022b). Binary aquila optimizer for selecting effective features from medical data: A COVID-19 case study. Mathematics, 10(11), 1929.CrossRef

Nadimi-Shahraki, M. H., Taghian, S., Mirjalili, S., et al. (2022). GGWO: Gaze cues learning-based grey wolf optimizer and its applications for solving engineering problems. Journal of Computational Science, 61, 101636.CrossRef

Nadimi-Shahraki, M. H., Taghian, S., Zamani, H., et al. (2023). MMKE: Multi-trial vector-based monkey king evolution algorithm and its applications for engineering optimization problems. PloS One, 18(1), e0280006.CrossRefPubMedPubMedCentral

Nakamura, R. Y. M., Pereira, L. A. M., Costa, K. A., et al. (2012). BBA: A binary bat algorithm for feature selection. In 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images (pp. 291–297). IEEE. https://doi.org/10.1109/SIBGRAPI.2012.47

Naseri, T. S., & Gharehchopogh, F. S. (2022). A feature selection based on the farmland fertility algorithm for improved intrusion detection systems. Journal of Network and Systems Management, 30(3), 40.CrossRef

Pandey, A. C., Rajpoot, D. S., & Saraswat, M. (2020). Feature selection method based on hybrid data transformation and binary binomial cuckoo search. Journal of Ambient Intelligence and Humanized Computing, 11(2), 719–738. https://doi.org/10.1007/s12652-019-01330-1CrossRef

Pashaei, E., Pashaei, E., & Aydin, N. (2019). Gene selection using hybrid binary black hole algorithm and modified binary particle swarm optimization. Genomics, 111(4), 669–686. https://doi.org/10.1016/j.ygeno.2018.04.004CrossRefPubMed

Qasim, O. S., & Algamal, Z. Y. (2018). Feature selection using particle swarm optimization-based logistic regression model. Chemometrics and Intelligent Laboratory Systems, 182, 41–46. https://doi.org/10.1016/j.chemolab.2018.08.016CrossRef

Qiu, J., Wu, Q., Ding, G., et al. (2016). 2016 A survey of machine learning for big data processing. EURASIP Journal on Advances in Signal Processing, 1, 1–16. https://doi.org/10.1186/s13634-016-0355-xCrossRef

Reddy, S., Panwar, L. K., Panigrahi, B. K., et al. (2018). Solution to unit commitment in power system operation planning using binary coded modified moth flame optimization algorithm (BMMFOA): A flame selection based computational technique. Journal of Computational Science, 25, 298–317. https://doi.org/10.1016/j.jocs.2017.04.011MathSciNetCrossRef

Rodrigues, D., Pereira, L. A. M., Almeida, T. N. S., et al. (2013). BCS: A binary cuckoo search algorithm for feature selection. In 2013 IEEE International Symposium on Circuits and Systems (ISCAS) (pp. 465–468). IEEE. https://doi.org/10.1109/ISCAS.2013.6571881

Rodrigues, D., Pereira, L. A., Nakamura, R. Y., et al. (2014). A wrapper approach for feature selection based on bat algorithm and optimum-path forest. Expert Systems with Applications, 41(5), 2250–2258. https://doi.org/10.1016/j.eswa.2013.09.023CrossRef

Salesi, S., Cosma, G. (2017). A novel extended binary cuckoo search algorithm for feature selection. In 2017 2nd International Conference on Knowledge Engineering and Applications (ICKEA) (pp. 6–12). IEEE. https://doi.org/10.1109/ICKEA.2017.8169893

Selvakumar, B., & Muneeswaran, K. (2019). Firefly algorithm based feature selection for network intrusion detection. Computers & Security, 81, 148–155. https://doi.org/10.1016/j.cose.2018.11.005CrossRef

Sudha, M., & Selvarajan S,. (2016). Feature selection based on enhanced cuckoo search for breast cancer classification in mammogram image. Circuits and Systems, 7, 327. https://doi.org/10.4236/cs.2016.74028

Tiwari, V. (2012). Face recognition based on cuckoo search algorithm. Indian Journal of Computer Science and Engineering, 3, 401–405.

Tubishat, M., Abushariah, M. A., Idris, N., et al. (2019). Improved whale optimization algorithm for feature selection in Arabic sentiment analysis. Applied Intelligence, 49(5), 1688–1707. https://doi.org/10.1007/s10489-018-1334-8CrossRef

Tumar, I., Hassouneh, Y., Turabieh, H., et al. (2020). Enhanced binary moth flame optimization as a feature selection algorithm to predict software fault prediction. IEEE Access, 8, 8041–8055. https://doi.org/10.1109/ACCESS.2020.2964321CrossRef

Vahidi, M., Aghakhani, S., Martín, D., et al. (2023). Optimal band selection using evolutionary machine learning to improve the accuracy of hyper-spectral images classification: A novel migration-based particle swarm optimization. Journal of Classification, 1–36.

Wong, W., & Ming, C. I. (2019). A review on metaheuristic algorithms: Recent trends, benchmarking and applications. In 2019 7th International Conference on Smart Computing & Communications (ICSCC) (pp. 1–5). IEEE. https://doi.org/10.1109/ICSCC.2019.8843624

Xin-She, Y., & Slowik, A. (2008). Firefly algorithm. Nature-inspired Metaheuristic Algorithms, 20, 79–90.

Xue, Y., Tang, T., Pang, W., et al. (2020). Self-adaptive parameter and strategy based particle swarm optimization for large-scale feature selection problems with multiple classifiers. Applied Soft Computing, 88, 106031. https://doi.org/10.1016/j.asoc.2019.106031CrossRef

Yang, X. S. (2010a). A new metaheuristic bat-inspired algorithm. In Nature inspired cooperative strategies for optimization (NICSO 2010) (pp. 65–74). Springer

Yang, X. S. (2010b). A new metaheuristic bat-inspired algorithm. In Nature inspired cooperative strategies for optimization (NICSO 2010) (pp. 65–74). Springer

Yang, X. S., & Deb, S. (2009a). Cuckoo search via lévy flights. In 2009 World congress on nature & biologically inspired computing (NaBIC) (pp. 210–214). IEEE

Yang, X. S., & Deb, S. (2009b). Cuckoo search via lévy flights. In 2009 World congress on nature & biologically inspired computing (NaBIC) (pp. 210–214). IEEE

Zhang, L., Mistry, K., Lim, C. P., et al. (2018). Feature selection using firefly optimization for classification and regression models. Decision Support Systems, 106, 64–85. https://doi.org/10.1016/j.dss.2017.12.001CrossRef

Zhang, Y., Xf, Song, & Dw, Gong. (2017). A return-cost-based binary firefly algorithm for feature selection. Information Sciences, 418, 561–574. https://doi.org/10.1016/j.ins.2017.08.047CrossRef

Titel: Binary Peacock Algorithm: A Novel Metaheuristic Approach for Feature Selection
verfasst von: Hema Banati
Richa Sharma
Asha Yadav
Publikationsdatum: 04.03.2024
Verlag: Springer US
Erschienen in: Journal of Classification
Print ISSN: 0176-4268
Elektronische ISSN: 1432-1343
DOI: https://doi.org/10.1007/s00357-024-09468-0

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner