Skip to main content

2016 | OriginalPaper | Buchkapitel

Two Stages Feature Selection Based on Filter Ranking Methods and SVMRFE on Medical Applications

verfasst von : Hayet Djellali, Nacira Ghoualmi Zine, Nabiha Azizi

Erschienen in: Modelling and Implementation of Complex Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper investigates feature selection stage applied to medical classification of disease on datasets from UCI repository. Feature selection methods based on minimum Redundancy Maximum Relevance (mRMR) filter and Ficher score were applied, each of them select a subset of features then the selection criteria is used to get the initial features subset. The second stage Support vector machine recursive feature elimination is performed to have the final subset. Experiments show that the proposed method provide an accuracy of 99.89 % on hepatitis dataset and 97.81 % on Wisconcin Breast cancer dataset and outperforms MRMR and Support vector machine recursive feature elimination SVM-RFE methods, as well as other popular methods on UCI database, and select features that are relevant in discriminating cancer class (malign/benign).

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Saeys, Y., Inza, I., Larranaga, P.: A review of feature selection technique in bioinformatics. J. Bioinform. Oxford university press, 1–10 (2005) Saeys, Y., Inza, I., Larranaga, P.: A review of feature selection technique in bioinformatics. J. Bioinform. Oxford university press, 1–10 (2005)
2.
Zurück zum Zitat Ding, C., Peng, H., Long, F., Ding, C.: Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27(8) (2005) Ding, C., Peng, H., Long, F., Ding, C.: Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27(8) (2005)
3.
Zurück zum Zitat Yoon, S., Kim, S.: Mutual information-based SVM-RFE for diagnostic classification of digitized mammograms. J. Pattern Recognit. Lett. 30, 1489–1495 (2009)CrossRef Yoon, S., Kim, S.: Mutual information-based SVM-RFE for diagnostic classification of digitized mammograms. J. Pattern Recognit. Lett. 30, 1489–1495 (2009)CrossRef
4.
Zurück zum Zitat Mitra, S., Shankar, B.U.: Medical image analysis for cancer management in natural computing framework. Inf. Sci. 306, 111–131 (2015)CrossRef Mitra, S., Shankar, B.U.: Medical image analysis for cancer management in natural computing framework. Inf. Sci. 306, 111–131 (2015)CrossRef
5.
Zurück zum Zitat Yang, F., Mao, K.Z.: Robust feature for microaccray data based on multicriterion fusion. IEEE/ACM trans. Comput. Biol. Bioinform. 8(4), 1080–1092 (2011). Yang, F., Mao, K.Z.: Robust feature for microaccray data based on multicriterion fusion. IEEE/ACM trans. Comput. Biol. Bioinform. 8(4), 1080–1092 (2011).
6.
Zurück zum Zitat Akay, M.F.: Support vector machines combined with feature selection for breast cancer diagnosis. J. Expert Syst. Appl. 36, 3240–3247 (2009)CrossRef Akay, M.F.: Support vector machines combined with feature selection for breast cancer diagnosis. J. Expert Syst. Appl. 36, 3240–3247 (2009)CrossRef
7.
Zurück zum Zitat Yang, P., Bing B., Zhou, J.Y., Yang, A., Zomaya. Y.: Stability of feature selection algorithms and ensemble feature selection methods in bioinformatics, pp. 1–23 (2006). Yang, P., Bing B., Zhou, J.Y., Yang, A., Zomaya. Y.: Stability of feature selection algorithms and ensemble feature selection methods in bioinformatics, pp. 1–23 (2006).
8.
Zurück zum Zitat Zhang, J., Hu, X., Li, P., He, W., Zhang H.Y.: A hybrid feature selection approach by correlation based filters and svm-rfe. In: International Conference on Pattern Recognition, 3684–3689 (2014). Zhang, J., Hu, X., Li, P., He, W., Zhang H.Y.: A hybrid feature selection approach by correlation based filters and svm-rfe. In: International Conference on Pattern Recognition, 3684–3689 (2014).
9.
Zurück zum Zitat Guyon, J., Weston, S., Barnhill, S., Vapnik, V.: Gene selection for cancer classification using support vector machines. Mach. Learn. 46(1–3), 389–422 (2002)CrossRefMATH Guyon, J., Weston, S., Barnhill, S., Vapnik, V.: Gene selection for cancer classification using support vector machines. Mach. Learn. 46(1–3), 389–422 (2002)CrossRefMATH
10.
Zurück zum Zitat Bolon Canedo, V., Sanchez Maono, N., Betanzos, A.: A review of feature selection methods on synthetic data. J. knowl. Inform. Syst. 34, 483–519 (2013). Bolon Canedo, V., Sanchez Maono, N., Betanzos, A.: A review of feature selection methods on synthetic data. J. knowl. Inform. Syst. 34, 483–519 (2013).
11.
Zurück zum Zitat Jirapech Umpai T., Aitken. S.: Feature selection and classification for microarray data analysis: Evolutionary methods for identifying predictive genes. BMC Bioinform. 6(1), 148 (2005) Jirapech Umpai T., Aitken. S.: Feature selection and classification for microarray data analysis: Evolutionary methods for identifying predictive genes. BMC Bioinform. 6(1), 148 (2005)
12.
Zurück zum Zitat Li, L., Weinberg, C.R., Darden, T.A., Pedersen, L.G.: Gene selection for sample classification based on gene expression data: study of sensitivity to choice of parameters of the ga/knn method. Bioinform. 17(12), 1131–1142 (2001)CrossRef Li, L., Weinberg, C.R., Darden, T.A., Pedersen, L.G.: Gene selection for sample classification based on gene expression data: study of sensitivity to choice of parameters of the ga/knn method. Bioinform. 17(12), 1131–1142 (2001)CrossRef
13.
Zurück zum Zitat Umbach, D.M., Li L., Terry, P., Taylor. J. A.: Application of the ga/knn method to seldi proteomics data. Bioinform. 20(10) (2004) Umbach, D.M., Li L., Terry, P., Taylor. J. A.: Application of the ga/knn method to seldi proteomics data. Bioinform. 20(10) (2004)
14.
Zurück zum Zitat Yan, K., Zhang, D.: Feature selection and analysis on correlated gas sensor data with recursive feature elimination. J. Sens. actuators B chem. 353–363 (2015). Yan, K., Zhang, D.: Feature selection and analysis on correlated gas sensor data with recursive feature elimination. J. Sens. actuators B chem. 353–363 (2015).
15.
Zurück zum Zitat Piyushkumar A.M., Rajapakse, J.C.: SVM-RFE with mrmr filter for gene selection, IEEE Trans. Nanobioscience 9(1) (2010) Piyushkumar A.M., Rajapakse, J.C.: SVM-RFE with mrmr filter for gene selection, IEEE Trans. Nanobioscience 9(1) (2010)
16.
Zurück zum Zitat Heath, M., Bowyer, K., Kopans, D., Moore, R., Kegelmeyer, W.: The digital database for screening mammography. In: Yaffe, M. (ed.), Proceeding 5th IWDM. Medical Physics Publishing, pp. 212–218 (2001). Heath, M., Bowyer, K., Kopans, D., Moore, R., Kegelmeyer, W.: The digital database for screening mammography. In: Yaffe, M. (ed.), Proceeding 5th IWDM. Medical Physics Publishing, pp. 212–218 (2001).
17.
Zurück zum Zitat Maka, M.W., Kung, S.Y.: Fusion of feature selection methods for pairwise scoring SVM. Neurocomputing 71, 3104–3113 (2008)CrossRef Maka, M.W., Kung, S.Y.: Fusion of feature selection methods for pairwise scoring SVM. Neurocomputing 71, 3104–3113 (2008)CrossRef
18.
Zurück zum Zitat Kai-Bo D., Rajapakse, H., Wang H., Azuaje F.: Multiple SVM-RFE for gene selection in cancer classification with expression data. IEEE Trans. Nanobioscience 4(3), 228–234 (2005). Kai-Bo D., Rajapakse, H., Wang H., Azuaje F.: Multiple SVM-RFE for gene selection in cancer classification with expression data. IEEE Trans. Nanobioscience 4(3), 228–234 (2005).
19.
Zurück zum Zitat Tang, Y.C., Zhang Y.Q., Huang, Z.: Development of two stage SVMRFE Gene selection strategy for microarray expression data analysis. IEEE ACM. Trans. Comput. Biol. Bioinform. 4(3), 365–381 (2007). Tang, Y.C., Zhang Y.Q., Huang, Z.: Development of two stage SVMRFE Gene selection strategy for microarray expression data analysis. IEEE ACM. Trans. Comput. Biol. Bioinform. 4(3), 365–381 (2007).
20.
Zurück zum Zitat Zhang, Y., Ding, C., Li, T.: Gene selection algorithm by combining relief and mRMR. BMC Genom. 9(2), S27 (2008)CrossRef Zhang, Y., Ding, C., Li, T.: Gene selection algorithm by combining relief and mRMR. BMC Genom. 9(2), S27 (2008)CrossRef
21.
Zurück zum Zitat Peng, Y., Wu, Z., Jiang, J.: A novel feature selection approach for biomedical data classification. J. Biomed. Inform. 43, 15–23 (2010)CrossRef Peng, Y., Wu, Z., Jiang, J.: A novel feature selection approach for biomedical data classification. J. Biomed. Inform. 43, 15–23 (2010)CrossRef
22.
Zurück zum Zitat Vapnick, V.: Statistical learning theory, Wiley (1998) Vapnick, V.: Statistical learning theory, Wiley (1998)
Metadaten
Titel
Two Stages Feature Selection Based on Filter Ranking Methods and SVMRFE on Medical Applications
verfasst von
Hayet Djellali
Nacira Ghoualmi Zine
Nabiha Azizi
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-33410-3_20

Premium Partner