Skip to main content
Erschienen in: Neural Processing Letters 1/2014

01.02.2014

Face Recognition and Micro-expression Recognition Based on Discriminant Tensor Subspace Analysis Plus Extreme Learning Machine

verfasst von: Su-Jing Wang, Hui-Ling Chen, Wen-Jing Yan, Yu-Hsin Chen, Xiaolan Fu

Erschienen in: Neural Processing Letters | Ausgabe 1/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, a novel recognition algorithm based on discriminant tensor subspace analysis (DTSA) and extreme learning machine (ELM) is introduced. DTSA treats a gray facial image as a second order tensor and adopts two-sided transformations to reduce dimensionality. One of the many advantages of DTSA is its ability to preserve the spatial structure information of the images. In order to deal with micro-expression video clips, we extend DTSA to a high-order tensor. Discriminative features are generated using DTSA to further enhance the classification performance of ELM classifier. Another notable contribution of the proposed method includes significant improvements in face and micro-expression recognition accuracy. The experimental results on the ORL, Yale, YaleB facial databases and CASME micro-expression database show the effectiveness of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The matlab code can be downloaded from http://​www3.​ntu.​edu.​sg/​home/​egbhuang/​.
 
6
The onset is the first frame which changes from the baseline (usually neutral facial expressions). The apex is the one that reaches highest intensity of the facial expression. The offset is the last frame of the expression (before turning back to a neutral facial expression). Sometimes the facial expressions faded very slowly, and the changes between frames were very difficult to detect by eyes. For such offset frames, the coders only coded the last obvious frame as the offset frame while ignore the nearly imperceptible changing frames.
 
Literatur
1.
Zurück zum Zitat Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Machine Intell 19(7):711–720CrossRef Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Machine Intell 19(7):711–720CrossRef
2.
Zurück zum Zitat Bian W, Tao D (2011) Max–min distance analysis by using sequential sdp relaxation for dimension reduction. IEEE Trans Pattern Anal Machine Intell 33(5):1037–1050CrossRef Bian W, Tao D (2011) Max–min distance analysis by using sequential sdp relaxation for dimension reduction. IEEE Trans Pattern Anal Machine Intell 33(5):1037–1050CrossRef
3.
Zurück zum Zitat Chen H, Yang B, Liu J, Liu D (2011) A support vector machine classifier with rough set based feature selection for breast cancer diagnosis. Expert Syst Appl 38:9014–9022 Chen H, Yang B, Liu J, Liu D (2011) A support vector machine classifier with rough set based feature selection for breast cancer diagnosis. Expert Syst Appl 38:9014–9022
4.
Zurück zum Zitat Chen SB, Zhao HF, Kong M, Luo B (2007) 2D-LPP: a two-dimensional extension of locality preserving projections. Neurocomputing 70(4–6):912–921CrossRef Chen SB, Zhao HF, Kong M, Luo B (2007) 2D-LPP: a two-dimensional extension of locality preserving projections. Neurocomputing 70(4–6):912–921CrossRef
5.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support-vector networks. Machine Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Machine Learn 20(3):273–297MATH
6.
Zurück zum Zitat Ekman P (1992) An argument for basic emotions. Cogn Emotion 6(3–4):169–200CrossRef Ekman P (1992) An argument for basic emotions. Cogn Emotion 6(3–4):169–200CrossRef
7.
Zurück zum Zitat Ekman P, Friesen W (1969) Nonverbal leakage and clues to deception. Technical report, DTIC document Ekman P, Friesen W (1969) Nonverbal leakage and clues to deception. Technical report, DTIC document
8.
Zurück zum Zitat Ekman P, Friesen W, Hager J (2002) FACS: investigators guide. In: A Human Face. Research Nexus eBook, Salt Lake City Ekman P, Friesen W, Hager J (2002) FACS: investigators guide. In: A Human Face. Research Nexus eBook, Salt Lake City
9.
Zurück zum Zitat Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Machine Intell 23(6):643–660CrossRef Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Machine Intell 23(6):643–660CrossRef
10.
Zurück zum Zitat Guan N, Tao D, Luo Z, Shawe-Taylor J (2012) Mahnmf: Manhattan non-negative matrix factorization. arXiv, preprint arXiv:1207.3438. Accessed 12 Sept 2012 Guan N, Tao D, Luo Z, Shawe-Taylor J (2012) Mahnmf: Manhattan non-negative matrix factorization. arXiv, preprint arXiv:1207.3438. Accessed 12 Sept 2012
11.
Zurück zum Zitat Guan N, Tao D, Luo Z, Yuan B (2011) Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent. IEEE Trans Image Process 20(7):2030–2048CrossRefMathSciNet Guan N, Tao D, Luo Z, Yuan B (2011) Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent. IEEE Trans Image Process 20(7):2030–2048CrossRefMathSciNet
12.
Zurück zum Zitat Guan N, Tao D, Luo Z, Yuan B (2011) Non-negative patch alignment framework. IEEE Trans Neural Netw 22(8):1218–1230CrossRef Guan N, Tao D, Luo Z, Yuan B (2011) Non-negative patch alignment framework. IEEE Trans Neural Netw 22(8):1218–1230CrossRef
13.
Zurück zum Zitat Guan N, Tao D, Luo Z, Yuan B (2012) Nenmf: an optimal gradient method for nonnegative matrix factorization. IEEE Trans Signal Process 60(6):2882–2898CrossRefMathSciNet Guan N, Tao D, Luo Z, Yuan B (2012) Nenmf: an optimal gradient method for nonnegative matrix factorization. IEEE Trans Signal Process 60(6):2882–2898CrossRefMathSciNet
14.
Zurück zum Zitat Guan N, Tao D, Luo Z, Yuan B (2012) Online nonnegative matrix factorization with robust stochastic approximation. IEEE Trans Neural Netw Learn Syst 23(7):1087–1099CrossRef Guan N, Tao D, Luo Z, Yuan B (2012) Online nonnegative matrix factorization with robust stochastic approximation. IEEE Trans Neural Netw Learn Syst 23(7):1087–1099CrossRef
15.
Zurück zum Zitat He X, Cai D, Niyogi P (2005) Tensor subspace analysis. In: Advances in neural information processing systems, vol 18. MIT Press, Cambridge He X, Cai D, Niyogi P (2005) Tensor subspace analysis. In: Advances in neural information processing systems, vol 18. MIT Press, Cambridge
16.
Zurück zum Zitat He XF, Niyogi P (2004) Locality preserving projections. In: Advances in neural information processing systems, vol 16. The MIT Press, Cambridge, pp 153–160 He XF, Niyogi P (2004) Locality preserving projections. In: Advances in neural information processing systems, vol 16. The MIT Press, Cambridge, pp 153–160
17.
Zurück zum Zitat Huang G (2003) Learning capability and storage capacity of two-hidden-layer feedforward networks. IEEE Trans Neural Netw 14(2):274–281CrossRef Huang G (2003) Learning capability and storage capacity of two-hidden-layer feedforward networks. IEEE Trans Neural Netw 14(2):274–281CrossRef
18.
Zurück zum Zitat Huang G, Babri H (1998) Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans Neural Netw 9(1):224–229CrossRef Huang G, Babri H (1998) Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans Neural Netw 9(1):224–229CrossRef
19.
Zurück zum Zitat Huang G, Chen L, Siew C (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17(4):879–892CrossRef Huang G, Chen L, Siew C (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17(4):879–892CrossRef
20.
Zurück zum Zitat Huang G, Zhu Q, Siew C (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. In: 2004 IEEE international joint conference on neural networks, vol 2. IEEE, New York, pp. 985–990 Huang G, Zhu Q, Siew C (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. In: 2004 IEEE international joint conference on neural networks, vol 2. IEEE, New York, pp. 985–990
21.
Zurück zum Zitat Huang G, Zhu Q, Siew C (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501CrossRef Huang G, Zhu Q, Siew C (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501CrossRef
22.
Zurück zum Zitat Joachims T (1998) Text categorization with support vector machines: Learning with many relevant features. Machine Learning. In: ECML-98, Springer Verlag, Heidelberg, pp 137–142 Joachims T (1998) Text categorization with support vector machines: Learning with many relevant features. Machine Learning. In: ECML-98, Springer Verlag, Heidelberg, pp 137–142
23.
Zurück zum Zitat Li J, Tao D (2010) Simple exponential family PCA. J Mach Learn Res 9:453–460, Proceedings of the 13th International Conterence on Artificial Intelligence and Statistics, AISTATS 2010 Li J, Tao D (2010) Simple exponential family PCA. J Mach Learn Res 9:453–460, Proceedings of the 13th International Conterence on Artificial Intelligence and Statistics, AISTATS 2010
24.
Zurück zum Zitat Li M, Yuan BZ (2005) 2D-LDA: a statistical linear discriminant analysis for image matrix. Pattern Recogn Lett 26(5):527–532CrossRef Li M, Yuan BZ (2005) 2D-LDA: a statistical linear discriminant analysis for image matrix. Pattern Recogn Lett 26(5):527–532CrossRef
25.
Zurück zum Zitat Lu H, Plataniotis KN, Venetsanopoulos AN (2008) MPCA: multilinear principal component analysis of tensor objects. IEEE Trans Neural Netw 19(1):18–39CrossRef Lu H, Plataniotis KN, Venetsanopoulos AN (2008) MPCA: multilinear principal component analysis of tensor objects. IEEE Trans Neural Netw 19(1):18–39CrossRef
26.
Zurück zum Zitat Van der Maaten L, Postma E, Van Den Herik H (2009) Dimensionality reduction: a comparative review. Tilburg University, Technical report Van der Maaten L, Postma E, Van Den Herik H (2009) Dimensionality reduction: a comparative review. Tilburg University, Technical report
27.
Zurück zum Zitat Nizar A, Dong Z, Wang Y (2008) Power utility nontechnical loss analysis with extreme learning machine method. IEEE Trans Power Syst 23(3):946–955CrossRef Nizar A, Dong Z, Wang Y (2008) Power utility nontechnical loss analysis with extreme learning machine method. IEEE Trans Power Syst 23(3):946–955CrossRef
28.
Zurück zum Zitat Osuna E, Freund R, Girosi F (1997) Training support vector machines: an application to face detection. In: 1997 IEEE computer society conference on computer vision and, pattern recognition, pp 130–136 Osuna E, Freund R, Girosi F (1997) Training support vector machines: an application to face detection. In: 1997 IEEE computer society conference on computer vision and, pattern recognition, pp 130–136
29.
Zurück zum Zitat Song F, Zhang D, Chen Q, Wang J (2007) Face recognition based on a novel linear discriminant criterion. Pattern Anal Appl 10(3):165–174CrossRefMathSciNet Song F, Zhang D, Chen Q, Wang J (2007) Face recognition based on a novel linear discriminant criterion. Pattern Anal Appl 10(3):165–174CrossRefMathSciNet
30.
Zurück zum Zitat Tao D, Li X, Wu X, Hu W, Maybank S (2007) Supervised tensor learning. Knowl Inf Syst 13(1):1–42CrossRef Tao D, Li X, Wu X, Hu W, Maybank S (2007) Supervised tensor learning. Knowl Inf Syst 13(1):1–42CrossRef
31.
Zurück zum Zitat Tao D, Li X, Wu, X Maybank S (2007) General tensor discriminant analysis and gabor features for gait recognition. IEEE Trans Pattern Anal Machine Intell 29:1700–1715 Tao D, Li X, Wu, X Maybank S (2007) General tensor discriminant analysis and gabor features for gait recognition. IEEE Trans Pattern Anal Machine Intell 29:1700–1715
32.
Zurück zum Zitat Tao D, Song M, Li X, Shen J, Sun J, Wu X, Faloutsos C, Maybank S (2008) Bayesian tensor approach for 3-d face modeling. IEEE Trans Circuits Syst Video Technol 18(10):1397–1410CrossRef Tao D, Song M, Li X, Shen J, Sun J, Wu X, Faloutsos C, Maybank S (2008) Bayesian tensor approach for 3-d face modeling. IEEE Trans Circuits Syst Video Technol 18(10):1397–1410CrossRef
33.
Zurück zum Zitat Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRef Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRef
34.
Zurück zum Zitat Vapnik V (2000) The nature of statistical learning theory. Springer Verlag, Berlin Vapnik V (2000) The nature of statistical learning theory. Springer Verlag, Berlin
35.
Zurück zum Zitat Wang SJ, Yang J, Sun MF, Peng XJ, Sun MM, Zhou CG (2012) Sparse tensor discriminant color space for face verification. IEEE Trans Neural Netw Learn Syst 23(6):876–888CrossRef Wang SJ, Yang J, Sun MF, Peng XJ, Sun MM, Zhou CG (2012) Sparse tensor discriminant color space for face verification. IEEE Trans Neural Netw Learn Syst 23(6):876–888CrossRef
36.
Zurück zum Zitat Wang SJ, Yang J, Zhang N, Zhou CG (2011) Tensor discriminant color space for face recognition. IEEE Trans Image Process 20(9):2490–2501CrossRefMathSciNet Wang SJ, Yang J, Zhang N, Zhou CG (2011) Tensor discriminant color space for face recognition. IEEE Trans Image Process 20(9):2490–2501CrossRefMathSciNet
37.
Zurück zum Zitat Wang SJ, Zhou CG, Zhang N, Peng XJ, Chen YH, Liu X (2011) Face recognition using second-order discriminant tensor subspace analysis. Neurocomputing 74(12–13):2142–2156CrossRef Wang SJ, Zhou CG, Zhang N, Peng XJ, Chen YH, Liu X (2011) Face recognition using second-order discriminant tensor subspace analysis. Neurocomputing 74(12–13):2142–2156CrossRef
38.
Zurück zum Zitat Xu Y, Feng G, Zhao YN (2009) One improvement to two-dimensional locality preserving projection method for use with face recognition. Neurocomputing 73(1–3):245–249CrossRef Xu Y, Feng G, Zhao YN (2009) One improvement to two-dimensional locality preserving projection method for use with face recognition. Neurocomputing 73(1–3):245–249CrossRef
39.
Zurück zum Zitat Yan S, Xu D, Yang Q, Zhang L, Tang X, Zhang HJ (2005) Discriminant analysis with tensor representation. Proc IEEE Comput Soc Conf Comput Vision Pattern Recogn 1:526–532 Yan S, Xu D, Yang Q, Zhang L, Tang X, Zhang HJ (2005) Discriminant analysis with tensor representation. Proc IEEE Comput Soc Conf Comput Vision Pattern Recogn 1:526–532
40.
Zurück zum Zitat Yan WJ, Wu Q, Liu YJ, Wang SJ, FU X (2013) CASME Database: a dataset of spontaneous micro-expressions collected from neutralized faces. In: 10th IEEE conference on automatic face and gesture recognition, Shanghai Yan WJ, Wu Q, Liu YJ, Wang SJ, FU X (2013) CASME Database: a dataset of spontaneous micro-expressions collected from neutralized faces. In: 10th IEEE conference on automatic face and gesture recognition, Shanghai
41.
Zurück zum Zitat Yang J, Zhang D, Frangi AF, Yang JY (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Machine Intell 26(1):131–137CrossRef Yang J, Zhang D, Frangi AF, Yang JY (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Machine Intell 26(1):131–137CrossRef
42.
Zurück zum Zitat Yu W (2009) Two-dimensional discriminant locality preserving projections for face recognition. Pattern Recogn Lett 30(15):1378–1383CrossRef Yu W (2009) Two-dimensional discriminant locality preserving projections for face recognition. Pattern Recogn Lett 30(15):1378–1383CrossRef
43.
Zurück zum Zitat Yu WW, Teng XL, Liu CQ (2006) Face recognition using discriminant locality preserving projections. Image Vis Comput 24(3):239–248CrossRef Yu WW, Teng XL, Liu CQ (2006) Face recognition using discriminant locality preserving projections. Image Vis Comput 24(3):239–248CrossRef
44.
Zurück zum Zitat Zhang R, Huang G, Sundararajan N, Saratchandran P (2007) Multicategory classification using an extreme learning machine for microarray gene expression cancer diagnosis. IEEE/ACM Trans Comput Biol Bioinformatics 4(3):485–495 Zhang R, Huang G, Sundararajan N, Saratchandran P (2007) Multicategory classification using an extreme learning machine for microarray gene expression cancer diagnosis. IEEE/ACM Trans Comput Biol Bioinformatics 4(3):485–495
45.
Zurück zum Zitat Zhang T, Tao D, Li X, Yang J (2008) Patch alignment for dimensionality reduction. IEEE Trans Knowl Data Eng 21:1299–1313 Zhang T, Tao D, Li X, Yang J (2008) Patch alignment for dimensionality reduction. IEEE Trans Knowl Data Eng 21:1299–1313
46.
Zurück zum Zitat Zhou T, Tao D, Wu X (2010) Manifold elastic net: a unified framework for sparse dimension reduction. In: Data mining and knowledge discovery, Springer, Heidelberg, pp 1–32 Zhou T, Tao D, Wu X (2010) Manifold elastic net: a unified framework for sparse dimension reduction. In: Data mining and knowledge discovery, Springer, Heidelberg, pp 1–32
Metadaten
Titel
Face Recognition and Micro-expression Recognition Based on Discriminant Tensor Subspace Analysis Plus Extreme Learning Machine
verfasst von
Su-Jing Wang
Hui-Ling Chen
Wen-Jing Yan
Yu-Hsin Chen
Xiaolan Fu
Publikationsdatum
01.02.2014
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 1/2014
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-013-9288-7

Weitere Artikel der Ausgabe 1/2014

Neural Processing Letters 1/2014 Zur Ausgabe