Skip to main content
Erschienen in: Neural Computing and Applications 8/2012

01.11.2012 | Original Article

Sparse data-dependent kernel principal component analysis based on least squares support vector machine for feature extraction and recognition

verfasst von: Jun-Bao Li, Huijun Gao

Erschienen in: Neural Computing and Applications | Ausgabe 8/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Kernel learning is widely used in many areas, and many methods are developed. As a famous kernel learning method, kernel principal component analysis (KPCA) endures two problems in the practical applications. One is that all training samples need to be stored for the computing the kernel matrix during kernel learning. Second is that the kernel and its parameter have the heavy influence on the performance of kernel learning. In order to solve the above problem, we present a novel kernel learning namely sparse data-dependent kernel principal component analysis through reducing the training samples with sparse learning-based least squares support vector machine and adaptive self-optimizing kernel structure according to the input training samples. Experimental results on UCI datasets, ORL and YALE face databases, and Wisconsin Breast Cancer database show that it is feasible to improve KPCA on saving consuming space and optimizing kernel structure.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lee J-S, Lin S-F (2010) A hierarchical face recognition scheme. Int J Innov Comput Inf Control 6(12):5439–5450 Lee J-S, Lin S-F (2010) A hierarchical face recognition scheme. Int J Innov Comput Inf Control 6(12):5439–5450
2.
Zurück zum Zitat Wei X, Zhou C, Zhang Q (2010) ICA-based features fusion for face recognition. Int J Innov Comput Inf Control 6(10):4651–4661 Wei X, Zhou C, Zhang Q (2010) ICA-based features fusion for face recognition. Int J Innov Comput Inf Control 6(10):4651–4661
3.
Zurück zum Zitat Arora S, Bhattacharjee D, Nasipuri M, Basu DK, Kundu M (2011) Complementary features combined in a MLP-based system to recognize handwritten devnagari character. J Inf Hiding Multimed Signal Process 2(1):71–77 Arora S, Bhattacharjee D, Nasipuri M, Basu DK, Kundu M (2011) Complementary features combined in a MLP-based system to recognize handwritten devnagari character. J Inf Hiding Multimed Signal Process 2(1):71–77
4.
Zurück zum Zitat Krinidis S, Pitas I (2010) Statistical analysis of human facial expressions. J Inf Hiding Multimed Signal Process 1(3):241–260 Krinidis S, Pitas I (2010) Statistical analysis of human facial expressions. J Inf Hiding Multimed Signal Process 1(3):241–260
5.
Zurück zum Zitat Sayoud H, Ouamour S (2010) Speaker clustering of stereo audio documents based on sequential gathering process. J Inf Hiding Multimed Signal Process 1(4):344–360 Sayoud H, Ouamour S (2010) Speaker clustering of stereo audio documents based on sequential gathering process. J Inf Hiding Multimed Signal Process 1(4):344–360
6.
Zurück zum Zitat Lin H-D, Peter Chiu Y-S (2010) RBF network and EPC method applied to automated process regulations for passive components dicing. Int J Innov Comput Inf Control 6(12):5077–5091 Lin H-D, Peter Chiu Y-S (2010) RBF network and EPC method applied to automated process regulations for passive components dicing. Int J Innov Comput Inf Control 6(12):5077–5091
7.
Zurück zum Zitat Tang H, Wu J, Lin Z, Lu M (2010) An enhanced AdaBoost algorithm with naive Bayesian text categorization based on a novel re-weighting strategy. Int J Innov Comput Inf Control 6(11):5299–5310 Tang H, Wu J, Lin Z, Lu M (2010) An enhanced AdaBoost algorithm with naive Bayesian text categorization based on a novel re-weighting strategy. Int J Innov Comput Inf Control 6(11):5299–5310
8.
Zurück zum Zitat Yang J, Frangi AF, Yang J-Y, Zhang D, Jin Z (2005) KPCA plus LDA: a complete kernel fisher Discriminant framework for feature extraction and recognition. IEEE Trans Pattern Anal Mach Intell 27(2):230–244CrossRef Yang J, Frangi AF, Yang J-Y, Zhang D, Jin Z (2005) KPCA plus LDA: a complete kernel fisher Discriminant framework for feature extraction and recognition. IEEE Trans Pattern Anal Mach Intell 27(2):230–244CrossRef
9.
Zurück zum Zitat Vapnik V (1995) The nature of statistical learning theory. Springer, New YorkMATH Vapnik V (1995) The nature of statistical learning theory. Springer, New YorkMATH
10.
Zurück zum Zitat Lu J, Plataniotis KN, Venetsanopoulos AN (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans Neural Netw 14(1):117–226CrossRef Lu J, Plataniotis KN, Venetsanopoulos AN (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans Neural Netw 14(1):117–226CrossRef
11.
Zurück zum Zitat Baudat G, Anouar F (2000) Generalized discriminant analysis using a kernel approach. Neural Comput 12(10):2385–2404CrossRef Baudat G, Anouar F (2000) Generalized discriminant analysis using a kernel approach. Neural Comput 12(10):2385–2404CrossRef
12.
Zurück zum Zitat Liang Z, Shi P (2005) Uncorrelated discriminant vectors using a kernel method. Pattern Recognit 38:307–310MATHCrossRef Liang Z, Shi P (2005) Uncorrelated discriminant vectors using a kernel method. Pattern Recognit 38:307–310MATHCrossRef
13.
Zurück zum Zitat MH Yang (2002) Kernel Eigenfaces vs. Kernel Fisherfaces: face recognition using kernel methods. In: Proceedings of the fifth IEEE international conference automatic face and gesture recognition, pp 215–220 MH Yang (2002) Kernel Eigenfaces vs. Kernel Fisherfaces: face recognition using kernel methods. In: Proceedings of the fifth IEEE international conference automatic face and gesture recognition, pp 215–220
14.
Zurück zum Zitat Wang L, Chan KL, Xue P (2005) A criterion for optimizing kernel parameters in KBDA for image retrieval. IEEE Trans Syst Man Cybern B Cybern 35(3):556–562CrossRef Wang L, Chan KL, Xue P (2005) A criterion for optimizing kernel parameters in KBDA for image retrieval. IEEE Trans Syst Man Cybern B Cybern 35(3):556–562CrossRef
15.
Zurück zum Zitat Chen W-S, Yuen PC, Huang J, Dai D-Q (2005) Kernel machine-based one-parameter regularized fisher discriminant method for face recognition. IEEE Trans Syst Man Cybern B Cybern 35(4):658–669 Chen W-S, Yuen PC, Huang J, Dai D-Q (2005) Kernel machine-based one-parameter regularized fisher discriminant method for face recognition. IEEE Trans Syst Man Cybern B Cybern 35(4):658–669
16.
Zurück zum Zitat Amari S, Wu S (1999) Improving support vector machine classifiers by modifying kernel functions. Neural Network 12(6):783–789CrossRef Amari S, Wu S (1999) Improving support vector machine classifiers by modifying kernel functions. Neural Network 12(6):783–789CrossRef
17.
Zurück zum Zitat J-B Li, Pan J-S, Lu Z-M (2009) Kernel optimization-based discriminant analysis for face recognition. Neural Comput Appl 18(6):603–612CrossRef J-B Li, Pan J-S, Lu Z-M (2009) Kernel optimization-based discriminant analysis for face recognition. Neural Comput Appl 18(6):603–612CrossRef
18.
Zurück zum Zitat Samaria F, Harter A (1994) Parameterisation of a stochastic model for human face identification. In: Proceedings of 2nd IEEE workshop on applications of computer vision, Sarasota, FL Samaria F, Harter A (1994) Parameterisation of a stochastic model for human face identification. In: Proceedings of 2nd IEEE workshop on applications of computer vision, Sarasota, FL
19.
Zurück zum Zitat Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef
20.
Zurück zum Zitat Wolberg WH, Street WN, Heisey DM, Mangasarian OL (1995) Computer-derived nuclear features distinguish malignant from benign breast cytology. Human Pathol 26:792–796CrossRef Wolberg WH, Street WN, Heisey DM, Mangasarian OL (1995) Computer-derived nuclear features distinguish malignant from benign breast cytology. Human Pathol 26:792–796CrossRef
Metadaten
Titel
Sparse data-dependent kernel principal component analysis based on least squares support vector machine for feature extraction and recognition
verfasst von
Jun-Bao Li
Huijun Gao
Publikationsdatum
01.11.2012
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 8/2012
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-011-0600-z

Weitere Artikel der Ausgabe 8/2012

Neural Computing and Applications 8/2012 Zur Ausgabe