Skip to main content
Top
Published in: The Journal of Supercomputing 8/2016

01-08-2016

Fast kernel feature ranking using class separability for big data mining

Author: Zhiliang Liu

Published in: The Journal of Supercomputing | Issue 8/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Kernel feature ranking often delivers many benefits for big data mining, e.g., improving generalization performance. However, its efficiency is quite challenging due to a need of tuning kernel parameters in the ranking process. In present work, we propose a computational-light metric based on kernel class separability for kernel feature ranking. In the proposed metric, the kernel parameter is optimized by a proposed analytical algorithm rather than an optimization search algorithm. Experimental results demonstrate that (1) the proposed metric can lead to a fast and robust kernel feature ranking; and (2) the proposed analytical algorithm can select a right kernel parameter with much less computation time for two state-of-the-arts kernel metrics.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Liu Z, Qu J, Zuo MJ, Xu H (2013) Fault level diagnosis for planetary gearboxes using hybrid kernel feature selection and kernel Fisher discriminant analysis. Int J Adv Manuf Technol 67(5–8):1217–1230CrossRef Liu Z, Qu J, Zuo MJ, Xu H (2013) Fault level diagnosis for planetary gearboxes using hybrid kernel feature selection and kernel Fisher discriminant analysis. Int J Adv Manuf Technol 67(5–8):1217–1230CrossRef
2.
go back to reference Wang L (2008) Feature selection with kernel class separability. IEEE Trans Pattern Anal Mach Intell 30(9):1534–1546CrossRef Wang L (2008) Feature selection with kernel class separability. IEEE Trans Pattern Anal Mach Intell 30(9):1534–1546CrossRef
3.
go back to reference Liu Z, Zuo MJ, Xu H (2013) Fault diagnosis for planetary gearboxes using multi-criterion fusion feature selection framework. Proc Inst Mech Eng Part C J Mech Eng Sci 227(9):2064–2076CrossRef Liu Z, Zuo MJ, Xu H (2013) Fault diagnosis for planetary gearboxes using multi-criterion fusion feature selection framework. Proc Inst Mech Eng Part C J Mech Eng Sci 227(9):2064–2076CrossRef
4.
go back to reference Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182MATH Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182MATH
5.
go back to reference Guyon I, Weston J, Barnhill S, Vapnik V (2002) Gene selection for cancer classification using support vector machines. Mach Learn 46(1–3):389–422CrossRefMATH Guyon I, Weston J, Barnhill S, Vapnik V (2002) Gene selection for cancer classification using support vector machines. Mach Learn 46(1–3):389–422CrossRefMATH
6.
go back to reference Gualdrón O, Brezmes J, Llobet E, Amari A, Vilanova X, Bouchikhi B, Correig X (2007) Variable selection for support vector machine based multisensor systems. Sens Actuators B Chem 122(1):259–268CrossRef Gualdrón O, Brezmes J, Llobet E, Amari A, Vilanova X, Bouchikhi B, Correig X (2007) Variable selection for support vector machine based multisensor systems. Sens Actuators B Chem 122(1):259–268CrossRef
7.
go back to reference Chen X, Zeng X, Alphen DV (2006) Multi-class feature selection for texture classification. Pattern Recognit Lett 27(14):1685–1691CrossRef Chen X, Zeng X, Alphen DV (2006) Multi-class feature selection for texture classification. Pattern Recognit Lett 27(14):1685–1691CrossRef
8.
go back to reference Qu J, Liu Z, Zuo MJ, Huang H (2011) Feature selection for damage degree classification of planetary gearboxes using support vector machine. Proc Inst Mech Eng Part C J Mech Eng Sci 225(9):2250–2264CrossRef Qu J, Liu Z, Zuo MJ, Huang H (2011) Feature selection for damage degree classification of planetary gearboxes using support vector machine. Proc Inst Mech Eng Part C J Mech Eng Sci 225(9):2250–2264CrossRef
9.
go back to reference Tan M, Tsang IW, Wang L (2014) Towards ultrahigh dimensional feature selection for big data. J Mach Learn Res 15:1371–1429MathSciNetMATH Tan M, Tsang IW, Wang L (2014) Towards ultrahigh dimensional feature selection for big data. J Mach Learn Res 15:1371–1429MathSciNetMATH
10.
go back to reference Yeung DY, Dai G (2007) Learning the kernel matrix by maximizing a KFD-based class separability criterion. Pattern Recognit 40(7):2021–2028CrossRefMATH Yeung DY, Dai G (2007) Learning the kernel matrix by maximizing a KFD-based class separability criterion. Pattern Recognit 40(7):2021–2028CrossRefMATH
11.
go back to reference Liu J, Zhao F, Liu Y (2013) Learning kernel parameters for kernel Fisher discriminant analysis. Pattern Recognit Lett 34(9):1026–1031CrossRef Liu J, Zhao F, Liu Y (2013) Learning kernel parameters for kernel Fisher discriminant analysis. Pattern Recognit Lett 34(9):1026–1031CrossRef
12.
go back to reference Li CH, Ho HH, Liu YL, Lin CT, Kuo BC, Taur JS (2012) An automatic method for selecting the parameter of the normalized kernel function to support vector machines. J Inf Sci Eng 28(SI):1–15MathSciNet Li CH, Ho HH, Liu YL, Lin CT, Kuo BC, Taur JS (2012) An automatic method for selecting the parameter of the normalized kernel function to support vector machines. J Inf Sci Eng 28(SI):1–15MathSciNet
13.
go back to reference Liu Z, Zuo MJ, Xu H (2011) A Gaussian radial basis function based feature selection algorithm. In: 2011 IEEE international conference on computational intelligence for measurement systems and applications (CIMSA), Ottawa, ON, Canada, pp 1-4 Liu Z, Zuo MJ, Xu H (2011) A Gaussian radial basis function based feature selection algorithm. In: 2011 IEEE international conference on computational intelligence for measurement systems and applications (CIMSA), Ottawa, ON, Canada, pp 1-4
14.
go back to reference Liu Z, Zuo MJ, Xu H (2013) Feature ranking for support vector machine classification and its application to machinery fault diagnosis. Proc Inst Mech Eng Part C J Mech Eng Sci 227(9):2077–2089CrossRef Liu Z, Zuo MJ, Xu H (2013) Feature ranking for support vector machine classification and its application to machinery fault diagnosis. Proc Inst Mech Eng Part C J Mech Eng Sci 227(9):2077–2089CrossRef
15.
go back to reference Fukunaga K (1990) Introduction to statistical pattern recognition. Academic Press Inc., LondonMATH Fukunaga K (1990) Introduction to statistical pattern recognition. Academic Press Inc., LondonMATH
18.
go back to reference Eichelberger RK, Sheng VS (2013) Does one-against-all or one-against-one improve the performance of multiclass classifications. In: The 27th national conference on artificial intelligence (AAAI), Bellevue, Washington, pp 1609–1610 Eichelberger RK, Sheng VS (2013) Does one-against-all or one-against-one improve the performance of multiclass classifications. In: The 27th national conference on artificial intelligence (AAAI), Bellevue, Washington, pp 1609–1610
20.
go back to reference Liu Z, Zhao X, Zuo MJ, Xu H (2015) An analytical approach to fast parameter selection of Gaussian RBF kernel for support vector machine. J Inf Sci Eng 31(2):691–710MathSciNet Liu Z, Zhao X, Zuo MJ, Xu H (2015) An analytical approach to fast parameter selection of Gaussian RBF kernel for support vector machine. J Inf Sci Eng 31(2):691–710MathSciNet
21.
go back to reference Chang C, Lin C (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:21–27CrossRef Chang C, Lin C (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:21–27CrossRef
22.
go back to reference Liu Z, Zhao X, Zou J, Xu H (2013) A semi-supervised approach based on k-nearest neighbor. J Softw 8(4):768–775 Liu Z, Zhao X, Zou J, Xu H (2013) A semi-supervised approach based on k-nearest neighbor. J Softw 8(4):768–775
23.
go back to reference Liu Z, Zhao X, Zuo MJ, Xu H (2014) Feature selection for fault level diagnosis of planetary gearboxes. Adv Data Anal Classif 8(4):377–401MathSciNetCrossRef Liu Z, Zhao X, Zuo MJ, Xu H (2014) Feature selection for fault level diagnosis of planetary gearboxes. Adv Data Anal Classif 8(4):377–401MathSciNetCrossRef
Metadata
Title
Fast kernel feature ranking using class separability for big data mining
Author
Zhiliang Liu
Publication date
01-08-2016
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 8/2016
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-015-1481-1

Other articles of this Issue 8/2016

The Journal of Supercomputing 8/2016 Go to the issue

Premium Partner