Skip to main content
Top

2018 | OriginalPaper | Chapter

Hybrid Artificial Bees Colony and Particle Swarm on Feature Selection

Authors : Hayet Djellali, Akila Djebbar, Nacira Ghoualmi Zine, Nabiha Azizi

Published in: Computational Intelligence and Its Applications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper investigates feature selection method using two hybrid approaches based on artificial Bee colony ABC with Particle Swarm PSO algorithm (ABC-PSO) and ABC with genetic algorithm (ABC-GA). To achieve balance between exploration and exploitation a novel improvement is integrated in ABC algorithm. In this work, particle swarm PSO contribute in ABC during employed bees, and GA mutation operators are applied in Onlooker phase and Scout phase. It has been found that the proposed method hybrid ABC-GA method is competitive than exiting methods (GA, PSO, ABC) for finding minimal number of features and classifying WDBC, colon, hepatitis, DLBCL, lung cancer dataset. Experimental results are carried out on UCI data repository and show the effectiveness of mutation operators in term of accuracy and particle swarm for less size of features.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Yu, L., Liu, H.: Feature selection for high-dimensional data: a fast correlation based filter solution. In: Proceedings of International Conference on Machine Learning, pp. 856–863 (2003) Yu, L., Liu, H.: Feature selection for high-dimensional data: a fast correlation based filter solution. In: Proceedings of International Conference on Machine Learning, pp. 856–863 (2003)
2.
go back to reference Djellali, H., Zine, N.G., Azizi, N.: Two stages feature selection based on filter ranking methods and SVMRFE on medical applications. In: Chikhi, S., Amine, A., Chaoui, A., Kholladi, M.K., Saidouni, D.E. (eds.) Modelling and Implementation of Complex Systems. LNNS, vol. 1, pp. 281–293. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-33410-3_20CrossRef Djellali, H., Zine, N.G., Azizi, N.: Two stages feature selection based on filter ranking methods and SVMRFE on medical applications. In: Chikhi, S., Amine, A., Chaoui, A., Kholladi, M.K., Saidouni, D.E. (eds.) Modelling and Implementation of Complex Systems. LNNS, vol. 1, pp. 281–293. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-33410-3_​20CrossRef
3.
go back to reference Hancer, E., Xue, B., Karaboga, D., Zhang, M.: A binary ABC algorithm based on advanced similarity scheme for feature selection. J. Appl. Soft. Comput. 36, 334–348 (2015)CrossRef Hancer, E., Xue, B., Karaboga, D., Zhang, M.: A binary ABC algorithm based on advanced similarity scheme for feature selection. J. Appl. Soft. Comput. 36, 334–348 (2015)CrossRef
4.
go back to reference Dorigo, M., Maniezzo, V., Colorni, A.: Ant System: optimization by a colony of cooperating agents. IEEE Trans. Syst. Man Cybern. 26(1), 29–41 (1996)CrossRef Dorigo, M., Maniezzo, V., Colorni, A.: Ant System: optimization by a colony of cooperating agents. IEEE Trans. Syst. Man Cybern. 26(1), 29–41 (1996)CrossRef
5.
go back to reference Karaboga, D.: An idea based on honey bee swarm for numerical optimization, Technical report TR06, Erciyes University Engineering Faculty (2005) Karaboga, D.: An idea based on honey bee swarm for numerical optimization, Technical report TR06, Erciyes University Engineering Faculty (2005)
6.
go back to reference Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995) Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995)
7.
go back to reference Zhu, G., Kwong, S.: Gbest-guided artificial bee colony algorithm for numerical function optimization. J. Appl. Math. Comput. 217(7), 3166–3173 (2010)MathSciNetCrossRef Zhu, G., Kwong, S.: Gbest-guided artificial bee colony algorithm for numerical function optimization. J. Appl. Math. Comput. 217(7), 3166–3173 (2010)MathSciNetCrossRef
8.
go back to reference Li, G., Niu, P., Xiao, X.: Development and investigation of efficient artificial bee colony algorithm for numerical function optimization. J. Appl. Soft Comput. 12(1), 320–332 (2012)CrossRef Li, G., Niu, P., Xiao, X.: Development and investigation of efficient artificial bee colony algorithm for numerical function optimization. J. Appl. Soft Comput. 12(1), 320–332 (2012)CrossRef
9.
go back to reference Karaboga, D., Basturk, B.: A Powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J. Glob. Optim. 39(3), 459–471 (2007)MathSciNetCrossRef Karaboga, D., Basturk, B.: A Powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J. Glob. Optim. 39(3), 459–471 (2007)MathSciNetCrossRef
10.
go back to reference Schiezaro, M., Pedrini, H.: Data feature selection based on artificial bee colony algorithm. J. Image Video Process. 47, 1–8 (2013) Schiezaro, M., Pedrini, H.: Data feature selection based on artificial bee colony algorithm. J. Image Video Process. 47, 1–8 (2013)
11.
go back to reference Ma, L., Zhu, Y., Zhang, D., Niu, B.: A hybrid approach to artificial bee colony algorithm. J. Neural Comput. Appl. 27, 387–409 (2016)CrossRef Ma, L., Zhu, Y., Zhang, D., Niu, B.: A hybrid approach to artificial bee colony algorithm. J. Neural Comput. Appl. 27, 387–409 (2016)CrossRef
12.
go back to reference Murugan, R., Mohan, M.: Artificial bee colony optimization for the combined heat and power economic dispatch problem. ARPN J. Eng. Appl. Sci. 7(5), 597–604 (2012) Murugan, R., Mohan, M.: Artificial bee colony optimization for the combined heat and power economic dispatch problem. ARPN J. Eng. Appl. Sci. 7(5), 597–604 (2012)
13.
go back to reference Wu, B., Qian, C., Ni, W., Fan, S.: The improvement of glowworm swarm optimization for the combined heat and power economic dispatch problem. ARPN J. Eng. Appl. Sci. 7(5), 597–604 (2012) Wu, B., Qian, C., Ni, W., Fan, S.: The improvement of glowworm swarm optimization for the combined heat and power economic dispatch problem. ARPN J. Eng. Appl. Sci. 7(5), 597–604 (2012)
14.
go back to reference Yan, X., Zhu, Y., Zou, W., Wang, L.: A new approach for data clustering using hybrid artificial bee colony algorithm. J. Neurocomputing 97(15), 241–250 (2012)CrossRef Yan, X., Zhu, Y., Zou, W., Wang, L.: A new approach for data clustering using hybrid artificial bee colony algorithm. J. Neurocomputing 97(15), 241–250 (2012)CrossRef
15.
go back to reference Gao, W., Liu, S., Jiang, F., Zhang, J.: Hybrid artificial bee colony algorithm. J. Syst. Eng. Electron. 33(5), 1167–1170 (2011)MATH Gao, W., Liu, S., Jiang, F., Zhang, J.: Hybrid artificial bee colony algorithm. J. Syst. Eng. Electron. 33(5), 1167–1170 (2011)MATH
16.
go back to reference Das, S., Biswas, S., Kundu, S.: Synergizing fitness learning with proximity-based food source selection in artificial bee colony algorithm for numerical optimization. J. Appl. Soft Comput. 13(12), 4676–4694 (2013)CrossRef Das, S., Biswas, S., Kundu, S.: Synergizing fitness learning with proximity-based food source selection in artificial bee colony algorithm for numerical optimization. J. Appl. Soft Comput. 13(12), 4676–4694 (2013)CrossRef
17.
go back to reference Li, Z., Wang, W., Yan, Y., Li, Z.: PS–ABC: a hybrid algorithm based on particle swarm and artificial bee colony for high-dimensional optimization problems. J. Expert. Syst. Appl. 42(22), 8881–8895 (2015)CrossRef Li, Z., Wang, W., Yan, Y., Li, Z.: PS–ABC: a hybrid algorithm based on particle swarm and artificial bee colony for high-dimensional optimization problems. J. Expert. Syst. Appl. 42(22), 8881–8895 (2015)CrossRef
18.
go back to reference Vazquez, R.A., Garro, B.A: Crop classification using artificial bee colony (ABC) algorithm, advances in swarm intelligence (2016) Vazquez, R.A., Garro, B.A: Crop classification using artificial bee colony (ABC) algorithm, advances in swarm intelligence (2016)
19.
go back to reference Kennedy, J., Eberhart, R.: A discrete binary version of the particle swarm algorithm. In: Proceedings of IEEE International Conference on Systems and Man, Cybernetics, Computational Cybernetics and Simulation, vol. 5, pp. 4104–4108 (1997) Kennedy, J., Eberhart, R.: A discrete binary version of the particle swarm algorithm. In: Proceedings of IEEE International Conference on Systems and Man, Cybernetics, Computational Cybernetics and Simulation, vol. 5, pp. 4104–4108 (1997)
20.
go back to reference Moradi, P., Gholampour, M.: A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy. J. Appl. Soft Comput. 43, 1–14 (2016)CrossRef Moradi, P., Gholampour, M.: A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy. J. Appl. Soft Comput. 43, 1–14 (2016)CrossRef
21.
go back to reference Holland, J.H.: Adaptation in Natural and Artificial Systems. University of Michigan Press, Ann Arbor (1975) Holland, J.H.: Adaptation in Natural and Artificial Systems. University of Michigan Press, Ann Arbor (1975)
22.
go back to reference Djellali, H., Guessoum, S., Ghoualmi-Zine, N., Layachi, S.: Fast correlation based filter combined with genetic algorithm and particle swarm on feature selection. In: 5th International Conference on Electrical Engineering - Boumerdes (ICEE-B), pp. 1–6 (2017). https://doi.org/10.1109/icee-b.2017.8192090 Djellali, H., Guessoum, S., Ghoualmi-Zine, N., Layachi, S.: Fast correlation based filter combined with genetic algorithm and particle swarm on feature selection. In: 5th International Conference on Electrical Engineering - Boumerdes (ICEE-B), pp. 1–6 (2017). https://​doi.​org/​10.​1109/​icee-b.​2017.​8192090
23.
go back to reference Vapnick, V.: Statistical Learning Theory. Wiley, Hoboken (1998) Vapnick, V.: Statistical Learning Theory. Wiley, Hoboken (1998)
25.
go back to reference Kohavi, R., John, J.H.: wrappers for feature selection. J. Artif. Intell. 97(1/2), 273–324 (1997)CrossRef Kohavi, R., John, J.H.: wrappers for feature selection. J. Artif. Intell. 97(1/2), 273–324 (1997)CrossRef
Metadata
Title
Hybrid Artificial Bees Colony and Particle Swarm on Feature Selection
Authors
Hayet Djellali
Akila Djebbar
Nacira Ghoualmi Zine
Nabiha Azizi
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-89743-1_9

Premium Partner