Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 3/2014

01.06.2014 | Original Article

A filter-dominating hybrid sequential forward floating search method for feature subset selection in high-dimensional space

verfasst von: John Q. Gan, Bashar Awwad Shiekh Hasan, Chun Sing Louis Tsui

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 3/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Sequential forward floating search (SFFS) has been well recognized as one of the best feature selection methods. This paper proposes a filter-dominating hybrid SFFS method, aiming at high efficiency and insignificant accuracy sacrifice for high-dimensional feature subset selection. Experiments with this new hybrid approach have been conducted on five feature data sets, with different combinations of classifier and separability index as alternative criteria for evaluating the performance of potential feature subsets. The classifiers under consideration include linear discriminate analysis classifier, support vector machine, and K-nearest neighbors classifier, and the separability indexes include the Davies-Bouldin index and a mutual information based index. Experimental results have demonstrated the advantages and usefulness of the proposed method in high-dimensional feature subset selection.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Fußnoten
1
The challenge itself contains EEG signals from 7 subjects, recorded during synchronous BCI experiments. Three subjects are synthesized, thus we used only the data recorded from 4 human subjects.
 
Literatur
1.
Zurück zum Zitat Liu H, Yu L (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17(4):491–502CrossRef Liu H, Yu L (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17(4):491–502CrossRef
2.
Zurück zum Zitat Gan JQ (2006) Feature dimensionality reduction by manifold learning in brain-computer interface design. In: 3rd international workshop on brain-computer interfaces. Graz, Austria, pp 28–29 Gan JQ (2006) Feature dimensionality reduction by manifold learning in brain-computer interface design. In: 3rd international workshop on brain-computer interfaces. Graz, Austria, pp 28–29
3.
Zurück zum Zitat Gheyas IA, Smith LS (2010) Feature subset selection in large dimensionality domains. Pattern Recogn 43(1):5–13CrossRefMATH Gheyas IA, Smith LS (2010) Feature subset selection in large dimensionality domains. Pattern Recogn 43(1):5–13CrossRefMATH
4.
Zurück zum Zitat Awwad Shiekh Hasan B, Gan JQ, Zhang Q (2010) Multi-objective evolutionary methods for channel selection in brain-computer interfaces: some preliminary experimental results. In: IEEE congress on evolutionary computation. Barcelona, Spain, pp 3339–3344 Awwad Shiekh Hasan B, Gan JQ, Zhang Q (2010) Multi-objective evolutionary methods for channel selection in brain-computer interfaces: some preliminary experimental results. In: IEEE congress on evolutionary computation. Barcelona, Spain, pp 3339–3344
5.
Zurück zum Zitat Tong DL, Mintram R (2010) Genetic algorithm-neural network (GANN): a study of neural network activation functions and depth of genetic algorithm search applied to feature selection. Int J Mach Learn Cybern 1(1–4):75–87CrossRef Tong DL, Mintram R (2010) Genetic algorithm-neural network (GANN): a study of neural network activation functions and depth of genetic algorithm search applied to feature selection. Int J Mach Learn Cybern 1(1–4):75–87CrossRef
6.
Zurück zum Zitat Boehm O, Hardoon DR, Manevitz LM (2011) Classifying cognitive states of brain activity via one-class neural networks with feature selection by genetic algorithms. Int J Mach Learn Cybern 2(3):125–134CrossRef Boehm O, Hardoon DR, Manevitz LM (2011) Classifying cognitive states of brain activity via one-class neural networks with feature selection by genetic algorithms. Int J Mach Learn Cybern 2(3):125–134CrossRef
7.
Zurück zum Zitat Davies JL, Bouldin DW (1979) A cluster separation measure. IEEE Trans Pattern Anal Mach Intell 1:224–227CrossRef Davies JL, Bouldin DW (1979) A cluster separation measure. IEEE Trans Pattern Anal Mach Intell 1:224–227CrossRef
8.
Zurück zum Zitat Bezdek JC, Pal NR (1998) Some new indexes of cluster validity. IEEE Trans SMC-Part B 28(3):301–315 Bezdek JC, Pal NR (1998) Some new indexes of cluster validity. IEEE Trans SMC-Part B 28(3):301–315
9.
Zurück zum Zitat Peng H, Long F, Ding C (2005) Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans Pattern Anal Mach Intell 27(8):1226–1238CrossRef Peng H, Long F, Ding C (2005) Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans Pattern Anal Mach Intell 27(8):1226–1238CrossRef
10.
Zurück zum Zitat Handl J, Knowles J (2006) Feature subset selection in unsupervised learning via multiobjective optimization. Int J Comput Intell Res 2(3):217–238MathSciNet Handl J, Knowles J (2006) Feature subset selection in unsupervised learning via multiobjective optimization. Int J Comput Intell Res 2(3):217–238MathSciNet
11.
Zurück zum Zitat Das S (2001) Filters, wrappers and a boosting-based hybrid for feature selection. In: Proceedings 18th international conference on machine learning, pp 74–81 Das S (2001) Filters, wrappers and a boosting-based hybrid for feature selection. In: Proceedings 18th international conference on machine learning, pp 74–81
12.
Zurück zum Zitat Sebban M, Nock R (2002) A hybrid filter/wrapper approach of feature selection using information theory. Pattern Recogn 35:835–846CrossRefMATH Sebban M, Nock R (2002) A hybrid filter/wrapper approach of feature selection using information theory. Pattern Recogn 35:835–846CrossRefMATH
13.
Zurück zum Zitat Somol P, Novovocova J, Pudil P (2006) Flexible-hybrid sequential floating search in statistical feature selection. In: Lecture notes in computer science, vol 4109. Springer, Berlin, pp 632–639 Somol P, Novovocova J, Pudil P (2006) Flexible-hybrid sequential floating search in statistical feature selection. In: Lecture notes in computer science, vol 4109. Springer, Berlin, pp 632–639
14.
Zurück zum Zitat Huang J, Cai Y, Xu X (2007) A hybrid genetic algorithm for feature selection wrapper based on mutual information. Pattern Recogn Lett 28(13):1825–1844CrossRef Huang J, Cai Y, Xu X (2007) A hybrid genetic algorithm for feature selection wrapper based on mutual information. Pattern Recogn Lett 28(13):1825–1844CrossRef
15.
16.
Zurück zum Zitat Bermejo P, Gamez JA, Puerta JM (2011) A GRASP algorithm for fast hybrid (filter-wrapper) feature subset selection in high-dimensional datasets. Pattern Recogn Lett 32(5):701–711CrossRefMathSciNet Bermejo P, Gamez JA, Puerta JM (2011) A GRASP algorithm for fast hybrid (filter-wrapper) feature subset selection in high-dimensional datasets. Pattern Recogn Lett 32(5):701–711CrossRefMathSciNet
17.
Zurück zum Zitat Pudil P, Novovicova J, Kittler J (1994) Floating search methods in feature selection. Pattern Recogn Lett 15:1119–1125CrossRef Pudil P, Novovicova J, Kittler J (1994) Floating search methods in feature selection. Pattern Recogn Lett 15:1119–1125CrossRef
18.
Zurück zum Zitat Jain A, Zongker D (1997) Feature selection: evaluation, application, and small sample performance. IEEE Trans Pattern Anal Mach Intell 19(2):153–158CrossRef Jain A, Zongker D (1997) Feature selection: evaluation, application, and small sample performance. IEEE Trans Pattern Anal Mach Intell 19(2):153–158CrossRef
19.
Zurück zum Zitat Dyson M, Balli T, Gan JQ, Sepulveda F, Palaniappan R (2008) Approximate entropy for EEG-based movement detection. In: 4th international workshop on brain-computer interfaces, Graz, Austria, pp 110–115 Dyson M, Balli T, Gan JQ, Sepulveda F, Palaniappan R (2008) Approximate entropy for EEG-based movement detection. In: 4th international workshop on brain-computer interfaces, Graz, Austria, pp 110–115
20.
Zurück zum Zitat Blankertz B, Dornhege G, Krauledat M, Mller K, Curio G (2007) The non-invasive berlin brain-computer interface: fast acquisition of effective performance in untrained subjects. NeuroImage 37:539–550 Blankertz B, Dornhege G, Krauledat M, Mller K, Curio G (2007) The non-invasive berlin brain-computer interface: fast acquisition of effective performance in untrained subjects. NeuroImage 37:539–550
21.
Zurück zum Zitat Desmar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNet Desmar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNet
Metadaten
Titel
A filter-dominating hybrid sequential forward floating search method for feature subset selection in high-dimensional space
verfasst von
John Q. Gan
Bashar Awwad Shiekh Hasan
Chun Sing Louis Tsui
Publikationsdatum
01.06.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 3/2014
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-012-0139-z

Weitere Artikel der Ausgabe 3/2014

International Journal of Machine Learning and Cybernetics 3/2014 Zur Ausgabe

Neuer Inhalt