Skip to main content
Erschienen in: Neural Processing Letters 1/2017

29.04.2016

Fractional-Order Embedding Supervised Canonical Correlations Analysis with Applications to Feature Extraction and Recognition

verfasst von: Hong-Kun Ji, Quan-Sen Sun, Yun-Hao Yuan, Ze-Xuan Ji

Erschienen in: Neural Processing Letters | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Due to the noise disturbance and limited number of training samples, within-set and between-set sample covariance matrices in canonical correlations analysis (CCA) based methods usually deviate from the true ones. In this paper, we re-estimate the covariance matrices by embedding fractional order and incorporate the class label information. First, we illustrate the effectiveness of the fractional-order embedding model through theory analysis and experiments. Then, we quote fractional-order within-set and between-set scatter matrices, which can significantly reduce the deviation of sample covariance matrices. Finally, we incorporate the supervised information, novel generalized CCA and discriminative CCA are presented for multi-view dimensionality reduction and recognition, called fractional-order embedding generalized canonical correlations analysis and fractional-order embedding discriminative canonical correlations analysis. Extensive experimental results on various handwritten numeral, face and object recognition problems show that the proposed methods are very effective and obviously outperform the existing methods in terms of classification accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Truk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRef Truk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRef
3.
Zurück zum Zitat Fisher RA (1936) The use of multiple measurements in taxonomic problems. Ann Eugen 7:178–188 Fisher RA (1936) The use of multiple measurements in taxonomic problems. Ann Eugen 7:178–188
4.
Zurück zum Zitat Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef
5.
Zurück zum Zitat Tenenbaum JB, Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–1323CrossRef Tenenbaum JB, Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–1323CrossRef
6.
Zurück zum Zitat Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
7.
Zurück zum Zitat Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATH Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATH
8.
Zurück zum Zitat Zhang Z, Zha H (2004) Principal manifolds and nonlinear dimension reduction via local tangent space alignment. SIAM J Sci Comput 26(1):313–338MathSciNetCrossRefMATH Zhang Z, Zha H (2004) Principal manifolds and nonlinear dimension reduction via local tangent space alignment. SIAM J Sci Comput 26(1):313–338MathSciNetCrossRefMATH
9.
Zurück zum Zitat Hou C, Wang J, Yi W, Yi D (2009) Locally linear transformation embedding. Neurocomputing 72(10–12):2368–2378CrossRef Hou C, Wang J, Yi W, Yi D (2009) Locally linear transformation embedding. Neurocomputing 72(10–12):2368–2378CrossRef
10.
Zurück zum Zitat Sargin M, Yemez Y, Erzin E, Tekalp A (2007) Audio-visual synchronization and fusion using canonical correlation analysis. IEEE Trans Multimedia 9(7):1396–1403CrossRef Sargin M, Yemez Y, Erzin E, Tekalp A (2007) Audio-visual synchronization and fusion using canonical correlation analysis. IEEE Trans Multimedia 9(7):1396–1403CrossRef
11.
Zurück zum Zitat Slaney M, Covell M (2000) FaceSync: a linear operator for measuring synchronization of video facial images and audio tracks. In: Leen TK, Dietterich TG, Tresp V (eds) Advances in neural information processing systems (NIPS), vol 13. MIT Press, Cambridge, pp 814–820 Slaney M, Covell M (2000) FaceSync: a linear operator for measuring synchronization of video facial images and audio tracks. In: Leen TK, Dietterich TG, Tresp V (eds) Advances in neural information processing systems (NIPS), vol 13. MIT Press, Cambridge, pp 814–820
12.
Zurück zum Zitat Chibelushi CC, Deravi F, Mason JSD (2002) A review of speech-based bimodal recognition. IEEE Trans Multimedia 4(1):23–37CrossRef Chibelushi CC, Deravi F, Mason JSD (2002) A review of speech-based bimodal recognition. IEEE Trans Multimedia 4(1):23–37CrossRef
13.
Zurück zum Zitat Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans Pattern Anal Mach Intell 22(1):4–37CrossRef Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans Pattern Anal Mach Intell 22(1):4–37CrossRef
14.
Zurück zum Zitat Hou C, Zhang C, Wu Y, Nie F (2010) Multiple view semi-supervised dimensionality reduction. Pattern Recognit 43(3):720–730CrossRefMATH Hou C, Zhang C, Wu Y, Nie F (2010) Multiple view semi-supervised dimensionality reduction. Pattern Recognit 43(3):720–730CrossRefMATH
15.
Zurück zum Zitat Hotelling H (1936) Relations between two sets of variates. Biometrika 28(3/4):321–377CrossRefMATH Hotelling H (1936) Relations between two sets of variates. Biometrika 28(3/4):321–377CrossRefMATH
16.
Zurück zum Zitat Sun QS, Zeng SG, Liu Y, Heng PA, Xia DS (2005) A new method of feature fusion and its application in image recognition. Pattern Recognit 38(12):2437–2448CrossRef Sun QS, Zeng SG, Liu Y, Heng PA, Xia DS (2005) A new method of feature fusion and its application in image recognition. Pattern Recognit 38(12):2437–2448CrossRef
17.
Zurück zum Zitat Sun QS, Zeng SG, Wang PA, Xia DS (2005) The theory of canonical correlation analysis with its applications to feature fusion. Chin J Comput 28(9):1524–1533MathSciNet Sun QS, Zeng SG, Wang PA, Xia DS (2005) The theory of canonical correlation analysis with its applications to feature fusion. Chin J Comput 28(9):1524–1533MathSciNet
18.
Zurück zum Zitat Hardoon DR, Szedmak SR, Shawe-Taylor JR (2004) Canonical correlation analysis: an overview with application to learning methods. Neural Comput 16(12):2639–2664CrossRefMATH Hardoon DR, Szedmak SR, Shawe-Taylor JR (2004) Canonical correlation analysis: an overview with application to learning methods. Neural Comput 16(12):2639–2664CrossRefMATH
19.
Zurück zum Zitat Sun Q-S, Liu Z-D, Heng P-A, Xia D-S (2005) A theorem on the generalized canonical projective vectors. Pattern Recognit 38(3):449–452CrossRefMATH Sun Q-S, Liu Z-D, Heng P-A, Xia D-S (2005) A theorem on the generalized canonical projective vectors. Pattern Recognit 38(3):449–452CrossRefMATH
20.
Zurück zum Zitat Sun TK, Chen SC, Yang JY, Shi PF (2008) A novel method of combined feature extraction for recognition. In: IEEE international conference on data mining, Pisa, Italy, pp 1043–1048 Sun TK, Chen SC, Yang JY, Shi PF (2008) A novel method of combined feature extraction for recognition. In: IEEE international conference on data mining, Pisa, Italy, pp 1043–1048
21.
Zurück zum Zitat Yuan Y-H, Sun Q-S, Ge H-W (2014) Fractional-order embedding canonical correlation analysis and its applications to multi-view dimensionality reduction and recognition. Pattern Recognit 47:1411–1424CrossRefMATH Yuan Y-H, Sun Q-S, Ge H-W (2014) Fractional-order embedding canonical correlation analysis and its applications to multi-view dimensionality reduction and recognition. Pattern Recognit 47:1411–1424CrossRefMATH
22.
Zurück zum Zitat Yuan Y-H, Sun Q-S (2013) Fractional-order embedding multiset canonical correlations with applications to multi-feature fusion and recognition. Neurocomputing 122:229–238CrossRef Yuan Y-H, Sun Q-S (2013) Fractional-order embedding multiset canonical correlations with applications to multi-feature fusion and recognition. Neurocomputing 122:229–238CrossRef
23.
Zurück zum Zitat Golub GH, Van Loan CF (1996) Matrix computations, vol 47(5 Series II). The Johns Hopkins University Press, Baltimore, pp 392–396 Golub GH, Van Loan CF (1996) Matrix computations, vol 47(5 Series II). The Johns Hopkins University Press, Baltimore, pp 392–396
24.
Zurück zum Zitat Liu J, Chen S-C, Tan X-Y (2008) Fractional order singular value decomposition representation for face recognition. Pattern Recognit 41:378–395CrossRefMATH Liu J, Chen S-C, Tan X-Y (2008) Fractional order singular value decomposition representation for face recognition. Pattern Recognit 41:378–395CrossRefMATH
25.
Zurück zum Zitat Martinez AM, Benavente R (1998) The AR face database. CVC Technical Report #24, June 1998 Martinez AM, Benavente R (1998) The AR face database. CVC Technical Report #24, June 1998
26.
Zurück zum Zitat Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660CrossRef Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660CrossRef
27.
Zurück zum Zitat Lee K, Ho J, Kriegman D (2005) Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans Pattern Anal Mach Intell 27(5):684–698CrossRef Lee K, Ho J, Kriegman D (2005) Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans Pattern Anal Mach Intell 27(5):684–698CrossRef
28.
Zurück zum Zitat Fu Y, Yan S, Huang TS (2008) Correlation metric for generalized feature extraction. IEEE Trans Pattern Anal Mach Intell 30(12):2229–2235CrossRef Fu Y, Yan S, Huang TS (2008) Correlation metric for generalized feature extraction. IEEE Trans Pattern Anal Mach Intell 30(12):2229–2235CrossRef
29.
Zurück zum Zitat Yan S, Xu D, Zhang B, Zhang H, Yang Q, Lin S (2007) Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans Pattern Anal Mach Intell 29(1):40–51CrossRef Yan S, Xu D, Zhang B, Zhang H, Yang Q, Lin S (2007) Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans Pattern Anal Mach Intell 29(1):40–51CrossRef
30.
Zurück zum Zitat He X, Ji M, Zhang C, Bao H (2011) A variance minimization criterion to feature selection using Laplacian regularization. IEEE Trans Pattern Anal Mach Intell 33(10):2013–2025CrossRef He X, Ji M, Zhang C, Bao H (2011) A variance minimization criterion to feature selection using Laplacian regularization. IEEE Trans Pattern Anal Mach Intell 33(10):2013–2025CrossRef
31.
Zurück zum Zitat Nene SA, Nayar SK, Murase H (1996) Columbia object image library (COIL-20). Technical Report CUCS-005-96 Nene SA, Nayar SK, Murase H (1996) Columbia object image library (COIL-20). Technical Report CUCS-005-96
32.
Zurück zum Zitat Warfield S (1996) Fast k-NN classification for multichannel image data. Pattern Recognit Lett 17(7):713–721CrossRef Warfield S (1996) Fast k-NN classification for multichannel image data. Pattern Recognit Lett 17(7):713–721CrossRef
33.
Zurück zum Zitat Barlaud M, Mathieu P, Daubechies I (1990) The wavelet transform, time-frequency localization and signal analysis. IEEE Trans Inf Theory 36(5):961–1005MathSciNetCrossRefMATH Barlaud M, Mathieu P, Daubechies I (1990) The wavelet transform, time-frequency localization and signal analysis. IEEE Trans Inf Theory 36(5):961–1005MathSciNetCrossRefMATH
34.
Zurück zum Zitat Dai D-Q, Yuen PC (2007) Face recognition by regularized discriminant analysis. IEEE Trans Syst Man Cybern Part B Cybern 37(4):1080–1085CrossRef Dai D-Q, Yuen PC (2007) Face recognition by regularized discriminant analysis. IEEE Trans Syst Man Cybern Part B Cybern 37(4):1080–1085CrossRef
35.
Zurück zum Zitat Ji S, Ye J (2008) Kernel uncorrelated and regularized discriminant analysis: a theoretical and computational study. IEEE Trans Knowl Data Eng 20(10):1311–1321CrossRef Ji S, Ye J (2008) Kernel uncorrelated and regularized discriminant analysis: a theoretical and computational study. IEEE Trans Knowl Data Eng 20(10):1311–1321CrossRef
Metadaten
Titel
Fractional-Order Embedding Supervised Canonical Correlations Analysis with Applications to Feature Extraction and Recognition
verfasst von
Hong-Kun Ji
Quan-Sen Sun
Yun-Hao Yuan
Ze-Xuan Ji
Publikationsdatum
29.04.2016
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 1/2017
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-016-9524-z

Weitere Artikel der Ausgabe 1/2017

Neural Processing Letters 1/2017 Zur Ausgabe

Neuer Inhalt