Skip to main content
Top
Published in: Neural Computing and Applications 6/2009

01-09-2009 | Original Article

Kernel optimization-based discriminant analysis for face recognition

Authors: Jun-Bao Li, Jeng-Shyang Pan, Zhe-Ming Lu

Published in: Neural Computing and Applications | Issue 6/2009

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The selection of kernel function and its parameter influences the performance of kernel learning machine. The difference geometry structure of the empirical feature space is achieved under the different kernel and its parameters. The traditional changing only the kernel parameters method will not change the data distribution in the empirical feature space, which is not feasible to improve the performance of kernel learning. This paper applies kernel optimization to enhance the performance of kernel discriminant analysis and proposes a so-called Kernel Optimization-based Discriminant Analysis (KODA) for face recognition. The procedure of KODA consisted of two steps: optimizing kernel and projecting. KODA automatically adjusts the parameters of kernel according to the input samples and performance on feature extraction is improved for face recognition. Simulations on Yale and ORL face databases are demonstrated the feasibility of enhancing KDA with kernel optimization.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Li J-B, Pan J-S, Chu S-C (2008) Kernel class-wise locality preserving projection. Inf Sci 178(7):1825–1835MATHCrossRef Li J-B, Pan J-S, Chu S-C (2008) Kernel class-wise locality preserving projection. Inf Sci 178(7):1825–1835MATHCrossRef
2.
go back to reference Ma B, Qu H-y, Wong H-s (2007) Kernel clustering-based discriminant analysis. Pattern Recognit 40(1):324–327MATHCrossRef Ma B, Qu H-y, Wong H-s (2007) Kernel clustering-based discriminant analysis. Pattern Recognit 40(1):324–327MATHCrossRef
3.
4.
go back to reference Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef
5.
go back to reference Chawla MPS (2008) Segment classification of ECG data and construction of scatter plots using principal component analysis. Int J Mech Med Biol (JMMB), WSPC 8(3):421–458CrossRef Chawla MPS (2008) Segment classification of ECG data and construction of scatter plots using principal component analysis. Int J Mech Med Biol (JMMB), WSPC 8(3):421–458CrossRef
6.
go back to reference Chawla MPS (2007) Parameterization and correction of electrocardiogram signals using independent component analysis. Int J Mech Med Biol (JMMB), WSPC 7(4):355–379CrossRefMathSciNet Chawla MPS (2007) Parameterization and correction of electrocardiogram signals using independent component analysis. Int J Mech Med Biol (JMMB), WSPC 7(4):355–379CrossRefMathSciNet
7.
go back to reference Chawla MPS, Verma HK, Kumar V (2008) Artifacts and noise removal in electrocardiograms using independent component analysis. Int J Cardiol 129(2):278–281CrossRef Chawla MPS, Verma HK, Kumar V (2008) Artifacts and noise removal in electrocardiograms using independent component analysis. Int J Cardiol 129(2):278–281CrossRef
8.
go back to reference Chawla MPS (2008) A comparative analysis of principal component and independent component techniques for electrocardiograms. Int J Neural Comput Appl (NCA), Springer (available online 23-7-2008) Chawla MPS (2008) A comparative analysis of principal component and independent component techniques for electrocardiograms. Int J Neural Comput Appl (NCA), Springer (available online 23-7-2008)
9.
go back to reference Chawla MPS, Verma HK, Kumar V (2008) A new statistical PCA–ICA algorithm for location of R-peaks in ECG. Int J Cardiol 129(1):146–148CrossRef Chawla MPS, Verma HK, Kumar V (2008) A new statistical PCA–ICA algorithm for location of R-peaks in ECG. Int J Cardiol 129(1):146–148CrossRef
10.
go back to reference Lu J, Plataniotis KN, Venetsanopoulos AN (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans Neural Netw 14(1):117–226CrossRef Lu J, Plataniotis KN, Venetsanopoulos AN (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans Neural Netw 14(1):117–226CrossRef
11.
go back to reference Müller KR, Mika S, Rätsch G, Tsuda K, Schölkopf B (2001) An introduction to kernel-based learning algorithms. IEEE Trans Neural Netw 12:181–201CrossRef Müller KR, Mika S, Rätsch G, Tsuda K, Schölkopf B (2001) An introduction to kernel-based learning algorithms. IEEE Trans Neural Netw 12:181–201CrossRef
12.
go back to reference Liu Q, Lu H, Ma S (2004) Improving kernel fisher discriminant analysis for face recognition. IEEE Trans Pattern Anal Mach Intell 14(1):42–49 Liu Q, Lu H, Ma S (2004) Improving kernel fisher discriminant analysis for face recognition. IEEE Trans Pattern Anal Mach Intell 14(1):42–49
13.
go back to reference Baudat G, Anouar F (2000) Generalized discriminant analysis using a kernel approach. Neural Comput 12:2385–2404CrossRef Baudat G, Anouar F (2000) Generalized discriminant analysis using a kernel approach. Neural Comput 12:2385–2404CrossRef
14.
go back to reference Ruiz A, López de Teruel PE (2001) Nonlinear kernel-based statistical pattern analysis. IEEE Trans Neural Netw 12:16–32CrossRef Ruiz A, López de Teruel PE (2001) Nonlinear kernel-based statistical pattern analysis. IEEE Trans Neural Netw 12:16–32CrossRef
15.
go back to reference Lu JW, Plataniotis K, Venetsanopoulos AN (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans Neural Netw 14(1):117–126CrossRef Lu JW, Plataniotis K, Venetsanopoulos AN (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans Neural Netw 14(1):117–126CrossRef
16.
go back to reference Liang ZZ, Shi PF (2005) Uncorrelated discriminant analysis using a kernel method. Pattern Recognit 38(2):307–310MATHCrossRef Liang ZZ, Shi PF (2005) Uncorrelated discriminant analysis using a kernel method. Pattern Recognit 38(2):307–310MATHCrossRef
17.
go back to reference Liang Z, Shi P (2004) Efficient algorithm for kernel discriminant anlaysis. Pattern Recognit 37(2):381–384CrossRef Liang Z, Shi P (2004) Efficient algorithm for kernel discriminant anlaysis. Pattern Recognit 37(2):381–384CrossRef
18.
go back to reference Huang J, Yuen PC, Chen W-S, Lai JH (2004) Kernel Subspace LDA with optimized kernel parameters on face recognition. In: Proceedings of the sixth IEEE international conference on automatic face and gesture recognition Huang J, Yuen PC, Chen W-S, Lai JH (2004) Kernel Subspace LDA with optimized kernel parameters on face recognition. In: Proceedings of the sixth IEEE international conference on automatic face and gesture recognition
19.
go back to reference Wang L, Chan KL, Xue P (2005) A criterion for optimizing kernel parameters in KBDA for image retrieval. IEEE Trans Syst Man Cybern B Cybern 35(3):556–562CrossRef Wang L, Chan KL, Xue P (2005) A criterion for optimizing kernel parameters in KBDA for image retrieval. IEEE Trans Syst Man Cybern B Cybern 35(3):556–562CrossRef
20.
go back to reference Chen W-S, Yuen PC, Huang J, Dai D-Q (2005) Kernel machine-based one-parameter regularized fisher discriminant method for face recognition. IEEE Trans Syst Man Cybern B Cybern 35(4):658–669 Chen W-S, Yuen PC, Huang J, Dai D-Q (2005) Kernel machine-based one-parameter regularized fisher discriminant method for face recognition. IEEE Trans Syst Man Cybern B Cybern 35(4):658–669
21.
go back to reference Micchelli CA, Pontil M (2005) Learning the kernel function via regularization. J Mach Learn Res 6:1099–1125MathSciNet Micchelli CA, Pontil M (2005) Learning the kernel function via regularization. J Mach Learn Res 6:1099–1125MathSciNet
22.
go back to reference Lanckriet G, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2004) Learning the kernel matrix with semidefinte programming. J Mach Learn Res 5:27–72 Lanckriet G, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2004) Learning the kernel matrix with semidefinte programming. J Mach Learn Res 5:27–72
23.
go back to reference Dai G, Yeung D-Y (2007) Kernel selection for semi-supervised kernel machines. In: Proceedings of the 24th international conference on machine learning, pp 1457–1465 Dai G, Yeung D-Y (2007) Kernel selection for semi-supervised kernel machines. In: Proceedings of the 24th international conference on machine learning, pp 1457–1465
24.
go back to reference Xiong H, Swamy MNS, Ahmad MO (2005) Optimizing the kernel in the empirical feature space. IEEE Trans Neural Netw 16(2):460–474CrossRef Xiong H, Swamy MNS, Ahmad MO (2005) Optimizing the kernel in the empirical feature space. IEEE Trans Neural Netw 16(2):460–474CrossRef
25.
go back to reference Amari S, Wu S (1999) Improving support vector machine classifiers by modifying kernel functions. Neural Netw 12(6):783–789CrossRef Amari S, Wu S (1999) Improving support vector machine classifiers by modifying kernel functions. Neural Netw 12(6):783–789CrossRef
26.
go back to reference Li H, Jiang T, Zhang K (2006) Efficient and robust feature extraction by maximum margin criterion. IEEE Trans Neural Netw 17(1):157–164CrossRef Li H, Jiang T, Zhang K (2006) Efficient and robust feature extraction by maximum margin criterion. IEEE Trans Neural Netw 17(1):157–164CrossRef
27.
go back to reference Samaria F, Harter A (1994) Parameterisation of a stochastic model for human face identification. In: Proceedings of 2nd IEEE workshop on applications of computer vision Samaria F, Harter A (1994) Parameterisation of a stochastic model for human face identification. In: Proceedings of 2nd IEEE workshop on applications of computer vision
28.
go back to reference Graham DB, Allinson NM (1998) Face recognition: from theory to applications. Comput Syst Sci 163:446–456 Graham DB, Allinson NM (1998) Face recognition: from theory to applications. Comput Syst Sci 163:446–456
Metadata
Title
Kernel optimization-based discriminant analysis for face recognition
Authors
Jun-Bao Li
Jeng-Shyang Pan
Zhe-Ming Lu
Publication date
01-09-2009
Publisher
Springer-Verlag
Published in
Neural Computing and Applications / Issue 6/2009
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-009-0282-y

Other articles of this Issue 6/2009

Neural Computing and Applications 6/2009 Go to the issue

Premium Partner