Skip to main content
Top
Published in: Neural Computing and Applications 10/2019

10-03-2018 | Original Article

A grasshopper optimizer approach for feature selection and optimizing SVM parameters utilizing real biomedical data sets

Authors: Hadeel Tariq Ibrahim, Wamidh Jalil Mazher, Osman N. Ucan, Oguz Bayat

Published in: Neural Computing and Applications | Issue 10/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Support vector machines (SVM) are one of the important techniques used to solve classifications problems efficiently. Setting support vector machine kernel factors affects the classification performance. Feature selection is a powerful technique to solve dimensionality problems. In this paper, we optimized SVM factors and chose features using a Grasshopper Optimization Algorithm (GOA). GOA is a new heuristic optimization algorithm inspired by grasshoppers searching for food. It approved its ability to solve real-world problems with anonymous search space. We applied the proposed GOA + SVM approach on biomedical data sets for Iraqi cancer patients in 2010–2012 and for University of California Irvine data sets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Staelin C (2003) Parameter selection for support vector machines. Hewlett-Packard Company, HPL-2002-354 (R.1), vol 354, pp 1–4 Staelin C (2003) Parameter selection for support vector machines. Hewlett-Packard Company, HPL-2002-354 (R.1), vol 354, pp 1–4
2.
go back to reference Vapnik V (1999) The nature of statistical learning theory. Springer, New York. ISBN:0-387-98780-0; SPIN 10713304 Vapnik V (1999) The nature of statistical learning theory. Springer, New York. ISBN:0-387-98780-0; SPIN 10713304
3.
go back to reference Sweilam NH, Tharwat AA, Moniem NA (2010) Support vector machine for diagnosis cancer disease: a comparative study. Egyp Inform J 11(2):81–92CrossRef Sweilam NH, Tharwat AA, Moniem NA (2010) Support vector machine for diagnosis cancer disease: a comparative study. Egyp Inform J 11(2):81–92CrossRef
4.
go back to reference Salcedo-Sanz S, Rojo-Álvarez JL, Martínez-Ramón M, Camps-Valls G (2014) Support vector machines in engineering: an overview. Wiley Interdiscip Rev Data Min Knowl Discov 4(3):234–267CrossRef Salcedo-Sanz S, Rojo-Álvarez JL, Martínez-Ramón M, Camps-Valls G (2014) Support vector machines in engineering: an overview. Wiley Interdiscip Rev Data Min Knowl Discov 4(3):234–267CrossRef
5.
go back to reference Zhang L, Lin F, Zhang B (2001) Support vector machine learning for image retrieval. In: Proceedings of 2001 international conference on image processing, vol 2, no. x, pp 721–724 Zhang L, Lin F, Zhang B (2001) Support vector machine learning for image retrieval. In: Proceedings of 2001 international conference on image processing, vol 2, no. x, pp 721–724
6.
go back to reference Lehtokangas M (2000) Pattern recognition with novel support vector machine learning method. In: 2000 10th European signal processing conference Lehtokangas M (2000) Pattern recognition with novel support vector machine learning method. In: 2000 10th European signal processing conference
7.
go back to reference Tobergte DR, Curtis S (2013) Review on support vector machine (SVM) classifier for human emotion pattern recognition from EEG signals. J Chem Inf Model 53(9):1689–1699 Tobergte DR, Curtis S (2013) Review on support vector machine (SVM) classifier for human emotion pattern recognition from EEG signals. J Chem Inf Model 53(9):1689–1699
8.
go back to reference Drucker H, Wu D, Vapnik VN (1999) Support vector machines for spam categorization. IEEE Trans Neural Netw 10(5):1048–1054CrossRef Drucker H, Wu D, Vapnik VN (1999) Support vector machines for spam categorization. IEEE Trans Neural Netw 10(5):1048–1054CrossRef
9.
go back to reference Moghaddam B (2000) Gender classification using support vector machines. In: Proceedings of 2000 international conference on image processing (Cat. No. 00CH37101), vol 2, pp 471–474 Moghaddam B (2000) Gender classification using support vector machines. In: Proceedings of 2000 international conference on image processing (Cat. No. 00CH37101), vol 2, pp 471–474
10.
go back to reference Hermes L, Buhmann JM (2000) Feature selection for support vector machines. Proc IEEE Int Conf Pattern Recognit 2:716–719CrossRef Hermes L, Buhmann JM (2000) Feature selection for support vector machines. Proc IEEE Int Conf Pattern Recognit 2:716–719CrossRef
11.
go back to reference Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3(3):1157–1182MATH Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3(3):1157–1182MATH
12.
go back to reference Leardi R, Gonzalez AL (1998) Genetic algorithms applied to feature selection in PLS regression: how and when to use them. Chemom Intell Lab Syst 41(2):195–207CrossRef Leardi R, Gonzalez AL (1998) Genetic algorithms applied to feature selection in PLS regression: how and when to use them. Chemom Intell Lab Syst 41(2):195–207CrossRef
13.
go back to reference Khushaba RN, Al-ani A, Al-jumaily A, Box PO (2008) Differential evolution based feature subset selection. Evolution (N. Y) Khushaba RN, Al-ani A, Al-jumaily A, Box PO (2008) Differential evolution based feature subset selection. Evolution (N. Y)
14.
go back to reference Khushaba RN, Al-Ani A, Al-Jumaily A (2011) Feature subset selection using differential evolution and a statistical repair mechanism. Expert Syst Appl 38(9):11515–11526CrossRef Khushaba RN, Al-Ani A, Al-Jumaily A (2011) Feature subset selection using differential evolution and a statistical repair mechanism. Expert Syst Appl 38(9):11515–11526CrossRef
15.
go back to reference Al-Ani A, Alsukker A, Khushaba RN (2013) Feature subset selection using differential evolution and a wheel based search strategy. Swarm Evol Comput 9:15–26CrossRef Al-Ani A, Alsukker A, Khushaba RN (2013) Feature subset selection using differential evolution and a wheel based search strategy. Swarm Evol Comput 9:15–26CrossRef
16.
go back to reference Ceylan O, Gulsen T (2016) A comparison of differential evolution and harmony search methods for svm model selection in hyperspectral image classification Classification. In: Ceylan O (ed) Igarss. emerburgaz University Department of Electrical and Electronics Engineering Istanbul, Turkey, pp 485–488 Ceylan O, Gulsen T (2016) A comparison of differential evolution and harmony search methods for svm model selection in hyperspectral image classification Classification. In: Ceylan O (ed) Igarss. emerburgaz University Department of Electrical and Electronics Engineering Istanbul, Turkey, pp 485–488
17.
go back to reference Yang CS, Chuang LY, Li JC, Yang CH (2008) Chaotic maps in binary particle swarm optimization for feature selection, pp. 107–112 Yang CS, Chuang LY, Li JC, Yang CH (2008) Chaotic maps in binary particle swarm optimization for feature selection, pp. 107–112
18.
go back to reference Kanan HR, Faez K, Taheri SM (2007) Feature selection using ant colony optimization (ACO): A New Method and Comparative Study in the application of face recognition system, pp 63–64 Kanan HR, Faez K, Taheri SM (2007) Feature selection using ant colony optimization (ACO): A New Method and Comparative Study in the application of face recognition system, pp 63–64
19.
go back to reference Emary E, Zawbaa HM, Grosan C, Hassenian AE (2015) Feature subset selection approach by gray-wolf optimization, vol 334 Emary E, Zawbaa HM, Grosan C, Hassenian AE (2015) Feature subset selection approach by gray-wolf optimization, vol 334
20.
go back to reference Zawbaa HM, Emary E, Parv B, Sharawi M (2016) Proceedings of IEEE congress evolution on computation, pp 4612–4617 Zawbaa HM, Emary E, Parv B, Sharawi M (2016) Proceedings of IEEE congress evolution on computation, pp 4612–4617
22.
go back to reference Saremi S, Mirjalili S, Lewis A (2017) Grasshopper optimisation algorithm: theory and application. Adv Eng Softw 105:30–47CrossRef Saremi S, Mirjalili S, Lewis A (2017) Grasshopper optimisation algorithm: theory and application. Adv Eng Softw 105:30–47CrossRef
24.
go back to reference Braga PL, Oliveira ALI, Meira SRL (2008) A GA-based feature selection and parameters optimization for support vector regression applied to software effort estimation. In: Proceedings of 2008 ACM symposium on applied computing—SAC’08, no. January, pp 1788 Braga PL, Oliveira ALI, Meira SRL (2008) A GA-based feature selection and parameters optimization for support vector regression applied to software effort estimation. In: Proceedings of 2008 ACM symposium on applied computing—SAC’08, no. January, pp 1788
25.
go back to reference Ministry of Health-Iraq-Iraqi Cancer Board (2017) Acceptance of Official Cancer datasets from Iraq Ministry of Health-Iraq-Iraqi Cancer Board (2017) Acceptance of Official Cancer datasets from Iraq
27.
go back to reference Izmailov AF (2010) Solution sensitivity for Karush–Kuhn–Tucker systems with non-unique Lagrange multipliers. Optimization 59(5):747–775MathSciNetCrossRef Izmailov AF (2010) Solution sensitivity for Karush–Kuhn–Tucker systems with non-unique Lagrange multipliers. Optimization 59(5):747–775MathSciNetCrossRef
28.
go back to reference Rogers SM, Matheson T, Despland E, Dodgson T, Burrows M, Simpson SJ (2003) Mechanosensory-induced behavioural gregarization in the desert locust Schistocerca gregaria. J Exp Biol 206(Pt 22):3991–4002CrossRef Rogers SM, Matheson T, Despland E, Dodgson T, Burrows M, Simpson SJ (2003) Mechanosensory-induced behavioural gregarization in the desert locust Schistocerca gregaria. J Exp Biol 206(Pt 22):3991–4002CrossRef
29.
go back to reference Huang CL, Wang CJ (2006) A GA-based feature selection and parameters optimizationfor support vector machines. Expert Syst Appl 31(2):231–240CrossRef Huang CL, Wang CJ (2006) A GA-based feature selection and parameters optimizationfor support vector machines. Expert Syst Appl 31(2):231–240CrossRef
30.
go back to reference Roffo G (2016) Feature selection library (MATLAB toolbox) feature selection library (MATLAB toolbox), no. April, pp 3–7 Roffo G (2016) Feature selection library (MATLAB toolbox) feature selection library (MATLAB toolbox), no. April, pp 3–7
31.
go back to reference Mathew TV (2014) Genetic algorithm, pp 1–18 Mathew TV (2014) Genetic algorithm, pp 1–18
32.
go back to reference Li M, Du W, Nian F (2014) An adaptive particle swarm optimization algorithm based on directed weighted complex network. Mathematical problems in engineering, vol 2014 Li M, Du W, Nian F (2014) An adaptive particle swarm optimization algorithm based on directed weighted complex network. Mathematical problems in engineering, vol 2014
33.
go back to reference Zhang L, Liu L, Yang X-S, Dai Y (2016) A novel hybrid firefly algorithm for global optimization. PLoS ONE 11(9):e0163230CrossRef Zhang L, Liu L, Yang X-S, Dai Y (2016) A novel hybrid firefly algorithm for global optimization. PLoS ONE 11(9):e0163230CrossRef
34.
go back to reference Mirjalili S, Mirjalili SM, Hatamlou A (2016) Multi-verse optimizer: a nature-inspired algorithm for global optimization. Neural Comput Appl 27(2):495–513CrossRef Mirjalili S, Mirjalili SM, Hatamlou A (2016) Multi-verse optimizer: a nature-inspired algorithm for global optimization. Neural Comput Appl 27(2):495–513CrossRef
35.
go back to reference Emary E, Yamany W, Hassanien AE (2014) New approach for feature selection based on rough set and bat algorithm. In: 2014 9th International Conference on Computer Engineering & Systems (ICCES), pp 346–353 Emary E, Yamany W, Hassanien AE (2014) New approach for feature selection based on rough set and bat algorithm. In: 2014 9th International Conference on Computer Engineering & Systems (ICCES), pp 346–353
36.
go back to reference Mirjalili SZ, Mirjalili S, Saremi S, Faris H, Aljarah I (2017) Grasshopper optimization algorithm for multi-objective optimization problems. Appl Intell 48(4):805–850CrossRef Mirjalili SZ, Mirjalili S, Saremi S, Faris H, Aljarah I (2017) Grasshopper optimization algorithm for multi-objective optimization problems. Appl Intell 48(4):805–850CrossRef
37.
go back to reference Emary E, Zawbaa HM, Ghany KKA, Hassanien AE, Parv B (2015) Firefly optimization algorithm for feature selection. In: Proceedings of the 7th Balkan conference on informatics conference—BCI’15, pp1–7 Emary E, Zawbaa HM, Ghany KKA, Hassanien AE, Parv B (2015) Firefly optimization algorithm for feature selection. In: Proceedings of the 7th Balkan conference on informatics conference—BCI’15, pp1–7
Metadata
Title
A grasshopper optimizer approach for feature selection and optimizing SVM parameters utilizing real biomedical data sets
Authors
Hadeel Tariq Ibrahim
Wamidh Jalil Mazher
Osman N. Ucan
Oguz Bayat
Publication date
10-03-2018
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 10/2019
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-018-3414-4

Other articles of this Issue 10/2019

Neural Computing and Applications 10/2019 Go to the issue

Premium Partner