Skip to main content
Erschienen in: Neural Computing and Applications 1/2011

01.02.2011 | Original Article

Adaptive huberized support vector machine and its application to microarray classification

verfasst von: Juntao Li, Yingmin Jia, Wenlin Li

Erschienen in: Neural Computing and Applications | Ausgabe 1/2011

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes an adaptive huberized support vector machine for simultaneous classification and gene selection. By introducing the data-driven weights, the proposed support vector machine can adaptively identify the important genes in groups, thus encouraging an adaptive grouping effect. Furthermore, the shrinkage biases for the coefficients of important genes are largely reduced. A reasonable correlation between the two regularization parameters is also given, based on which the solution paths are shown to be piecewise linear with respect to the single regularization parameter. Experiment results on leukaemia data set are provided to illustrate the effectiveness of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cawley GC, Talbot NLC (2006) Gene selection in cancer classification using sparse logistic regression with Bayesian regularization. Bioinformatics 22(19):2438-–2355CrossRef Cawley GC, Talbot NLC (2006) Gene selection in cancer classification using sparse logistic regression with Bayesian regularization. Bioinformatics 22(19):2438-–2355CrossRef
2.
Zurück zum Zitat Golub T, Slonim D, Tamayo P, Huard C, Gaasenbeek M, Mesirov J, Coller H, Loh M, Downing J, Caligiuri M (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286:531–536CrossRef Golub T, Slonim D, Tamayo P, Huard C, Gaasenbeek M, Mesirov J, Coller H, Loh M, Downing J, Caligiuri M (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286:531–536CrossRef
3.
Zurück zum Zitat Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182MATHCrossRef Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182MATHCrossRef
4.
Zurück zum Zitat Guyon I, Weston J, Barnhill S, Vapnik V (2002) Gene selection for cancer classification using support vector machines. Mach Learn 46:389–422MATHCrossRef Guyon I, Weston J, Barnhill S, Vapnik V (2002) Gene selection for cancer classification using support vector machines. Mach Learn 46:389–422MATHCrossRef
5.
Zurück zum Zitat Li GZ, Meng HH, Yang MQ, Yang JY (2009) Combining support vector regression with feature selection for multivariate calibration. Neural Comput Appl 18:813–820CrossRef Li GZ, Meng HH, Yang MQ, Yang JY (2009) Combining support vector regression with feature selection for multivariate calibration. Neural Comput Appl 18:813–820CrossRef
6.
Zurück zum Zitat Li GZ, Yang J, Ye CZ, Geng D (2006) Degree prediction of malignancy in brain glioma using support vector machines. Comput Biol Med 36:315–325 Li GZ, Yang J, Ye CZ, Geng D (2006) Degree prediction of malignancy in brain glioma using support vector machines. Comput Biol Med 36:315–325
7.
Zurück zum Zitat Li GZ, Yang J, Liu GP, Xue L (2004) Feature selection for multi-class problems using support vector machines, In: Proceedings of 8th pacific rim international conference on artificial intelligence (PRICAI-04), Sheraton, Auckland, August 9 to August 13, pp 292–300 Li GZ, Yang J, Liu GP, Xue L (2004) Feature selection for multi-class problems using support vector machines, In: Proceedings of 8th pacific rim international conference on artificial intelligence (PRICAI-04), Sheraton, Auckland, August 9 to August 13, pp 292–300
8.
Zurück zum Zitat Li J, Jia Y, Du J, Yu F (2009) A new support vector machine for microarray classification and adaptive gene selection. 2009 American control conference. Hyatt Regency Riverfront, St. Louis, MO, USA, pp 5410–5415 Li J, Jia Y, Du J, Yu F (2009) A new support vector machine for microarray classification and adaptive gene selection. 2009 American control conference. Hyatt Regency Riverfront, St. Louis, MO, USA, pp 5410–5415
9.
Zurück zum Zitat Mao Y, Zhou X, Yin Z, Pi D, Sun Y, Wong STC (2006) Gene selection using gaussian kernel support vector machine based recursive feature elimination with adaptive kernel width strategy. Lect Notes Comput Sci Rough Sets Knowl Technol 4062:799–806CrossRef Mao Y, Zhou X, Yin Z, Pi D, Sun Y, Wong STC (2006) Gene selection using gaussian kernel support vector machine based recursive feature elimination with adaptive kernel width strategy. Lect Notes Comput Sci Rough Sets Knowl Technol 4062:799–806CrossRef
10.
Zurück zum Zitat Mukherjee S, Tamayo R, Slonim D, Verri A, Golub T, Mesirov J, Poggio T (1999) Support vector machine classification of microarray data (Technical Report). Artificial Intelligence Laboratory, Massachusetts Institute of Technology Mukherjee S, Tamayo R, Slonim D, Verri A, Golub T, Mesirov J, Poggio T (1999) Support vector machine classification of microarray data (Technical Report). Artificial Intelligence Laboratory, Massachusetts Institute of Technology
11.
Zurück zum Zitat Park M, Hastie T (2008) Penalized logistic regression for detecting gene interactions. Biostatistics 9:30–50MATHCrossRef Park M, Hastie T (2008) Penalized logistic regression for detecting gene interactions. Biostatistics 9:30–50MATHCrossRef
13.
Zurück zum Zitat Wang L, Zhu J, Zou H (2008) Hybrid huberized support vector machines for microarray classification and gene selection. Bioinformatics 24:412–419CrossRef Wang L, Zhu J, Zou H (2008) Hybrid huberized support vector machines for microarray classification and gene selection. Bioinformatics 24:412–419CrossRef
14.
Zurück zum Zitat Wang L, Zhu J, Zou H (2006) The doubly regularized support vector machine. Stat Sinic 16:589–615MATHMathSciNet Wang L, Zhu J, Zou H (2006) The doubly regularized support vector machine. Stat Sinic 16:589–615MATHMathSciNet
15.
16.
Zurück zum Zitat Zhu J, Rosset S, Hastie T, Tibshirani R (2004) 1-norm support vector machines. Adv Neural Infor Process Syst 16:49–56 Zhu J, Rosset S, Hastie T, Tibshirani R (2004) 1-norm support vector machines. Adv Neural Infor Process Syst 16:49–56
17.
Zurück zum Zitat Zhu J, Hastie T (2004) Classification of gene microarrays by penalized logistic regression. Biostatistics 46:505–510MATH Zhu J, Hastie T (2004) Classification of gene microarrays by penalized logistic regression. Biostatistics 46:505–510MATH
19.
Zurück zum Zitat Tibshirani R (1996) Regression shrinkage and selection via the lasso. J Roy Stat Soc Ser B 58:267–288MATHMathSciNet Tibshirani R (1996) Regression shrinkage and selection via the lasso. J Roy Stat Soc Ser B 58:267–288MATHMathSciNet
20.
Zurück zum Zitat Zou H (2007) An improved 1-norm support vector machine for simultaneous classification and variable selection. Eleventh international conference on artificial intelligence and statistics Zou H (2007) An improved 1-norm support vector machine for simultaneous classification and variable selection. Eleventh international conference on artificial intelligence and statistics
21.
Zurück zum Zitat Zhou X, Wang X, Dougherty E (2005) Gene selection using logistic regressions based on AIC, BIC and MDL criteria. New Math Nat Comput 1:129–145MATHCrossRefMathSciNet Zhou X, Wang X, Dougherty E (2005) Gene selection using logistic regressions based on AIC, BIC and MDL criteria. New Math Nat Comput 1:129–145MATHCrossRefMathSciNet
22.
24.
Zurück zum Zitat Schokpof B, Smola A, Williamson RC, Bartlett PL (2000) New support vector algorithms. Neural Comput 12:1207–1245CrossRef Schokpof B, Smola A, Williamson RC, Bartlett PL (2000) New support vector algorithms. Neural Comput 12:1207–1245CrossRef
25.
Zurück zum Zitat Shevade SK, Keerthi SS, Bhattacharyya C, Murthy KRK (2000) Improvements to the SMO algorithm for SVM regression. IEEE Trans Neural Netw 11:1188–1194CrossRef Shevade SK, Keerthi SS, Bhattacharyya C, Murthy KRK (2000) Improvements to the SMO algorithm for SVM regression. IEEE Trans Neural Netw 11:1188–1194CrossRef
26.
Zurück zum Zitat Vapnik V (1995) The nature of statistical learning theory. Springer, New YorkMATH Vapnik V (1995) The nature of statistical learning theory. Springer, New YorkMATH
27.
Zurück zum Zitat Dong JX, Krzyzak A, Suen CY (2005) Fast SVM training algorithm with decomposition on very large data sets. IEEE Trans Pattern Anal Mach Intell 27:603–618CrossRef Dong JX, Krzyzak A, Suen CY (2005) Fast SVM training algorithm with decomposition on very large data sets. IEEE Trans Pattern Anal Mach Intell 27:603–618CrossRef
28.
Zurück zum Zitat Jiao L, Bo L, Wang L (2007) Fast sparse approximation for least square support vector machines. IEEE Trans Neural Netw 18:685–697CrossRef Jiao L, Bo L, Wang L (2007) Fast sparse approximation for least square support vector machines. IEEE Trans Neural Netw 18:685–697CrossRef
29.
Zurück zum Zitat Wu Q, Zhou DX (2005) SVM soft margin classifiers: linear programming versus quadratic programming. Neural Comput 17:1160–1187MATHCrossRefMathSciNet Wu Q, Zhou DX (2005) SVM soft margin classifiers: linear programming versus quadratic programming. Neural Comput 17:1160–1187MATHCrossRefMathSciNet
30.
Zurück zum Zitat Hastie T, Rosset S, Tibshirani R, Zhu J (2004) The entire regularization path for the support vector machine. J Mach Learn Res 5:1391–1415MathSciNet Hastie T, Rosset S, Tibshirani R, Zhu J (2004) The entire regularization path for the support vector machine. J Mach Learn Res 5:1391–1415MathSciNet
Metadaten
Titel
Adaptive huberized support vector machine and its application to microarray classification
verfasst von
Juntao Li
Yingmin Jia
Wenlin Li
Publikationsdatum
01.02.2011
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 1/2011
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-010-0371-y

Weitere Artikel der Ausgabe 1/2011

Neural Computing and Applications 1/2011 Zur Ausgabe