Skip to main content
Erschienen in: Neural Processing Letters 2/2015

01.10.2015

Orthogonal Multiset Canonical Correlation Analysis based on Fractional-Order and Its Application in Multiple Feature Extraction and Recognition

verfasst von: Xiaobo Shen, Quansen Sun

Erschienen in: Neural Processing Letters | Ausgabe 2/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multiset canonical correlation analysis (MCCA) can simultaneously reduce the dimensionality of multi-set data. Thus, MCCA is a very important method for multiple feature extraction. However, in small sample size problem, covariance matrix cannot be estimated accurately so that the projections in MCCA are usually not optimal in such case for recognition purpose. In order to address this problem, we propose a novel method called orthogonal MCCA based on fractional-order (FbOMCCA). Compared with MCCA, there are two improvements in FbOMCCA: firstly, orthogonality constraint, as a popular criterion used in feature extraction, is introduced. It makes multiset canonical projective vectors less affected by poor estimation of covariance matrix. Secondly, inspired with the idea of fractional order, we incorporate fractional-order within-set and between-set scatter matrices to further reduce the deviations of sample covariance matrices. Furthermore, a novel algorithm based on eigen decomposition is proposed to gradually obtain multiset canonical projective vectors. Experimental results on UCI multiple feature dataset, and CENPARMI handwritten Arabic numerals database show that FMOCCA has better recognition rates and robustness than existing MCCA-related methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ross A, Jain AK (2004) Multimodal biometrics: an overview. In: Proceedings of 12th European signal processing conference, pp 1221–1224 Ross A, Jain AK (2004) Multimodal biometrics: an overview. In: Proceedings of 12th European signal processing conference, pp 1221–1224
2.
Zurück zum Zitat Yang J, Yang JY, Zhang D, Lu JF (2003) Feature fusion: parallel strategy vs. serial strategy. Pattern Recogn 36:1369–1381CrossRefMATH Yang J, Yang JY, Zhang D, Lu JF (2003) Feature fusion: parallel strategy vs. serial strategy. Pattern Recogn 36:1369–1381CrossRefMATH
3.
Zurück zum Zitat Chen X, Chen S, Xue H, Zhou X (2012) A unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data. Pattern Recogn 45:2005–2018CrossRef Chen X, Chen S, Xue H, Zhou X (2012) A unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data. Pattern Recogn 45:2005–2018CrossRef
4.
Zurück zum Zitat Chaudhuri K, Kakade SM, Livescu K, Sridharan K (2009) Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th annual international conference on machine learning, pp 129–136 Chaudhuri K, Kakade SM, Livescu K, Sridharan K (2009) Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th annual international conference on machine learning, pp 129–136
5.
Zurück zum Zitat Fukunaga K (1990) Introduction to statistical pattern recognition. Academic Press, New York Fukunaga K (1990) Introduction to statistical pattern recognition. Academic Press, New York
6.
Zurück zum Zitat Hotelling H (1936) Relations between two sets of variates. Biometrika 28:321–377CrossRef Hotelling H (1936) Relations between two sets of variates. Biometrika 28:321–377CrossRef
8.
Zurück zum Zitat Nielsen AA (2002) Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data. IEEE Trans Image Process 11:293–305CrossRef Nielsen AA (2002) Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data. IEEE Trans Image Process 11:293–305CrossRef
9.
Zurück zum Zitat Hasan MA (2009) On multi-set canonical correlation analysis. In: International joint conference on Neural Networks, 2009 (IJCNN 2009), pp 1128–1133 Hasan MA (2009) On multi-set canonical correlation analysis. In: International joint conference on Neural Networks, 2009 (IJCNN 2009), pp 1128–1133
10.
Zurück zum Zitat Sun QS, Zeng SG, Liu Y, Heng PA, Xia DS (2005) A new method of feature fusion and its application in image recognition. Pattern Recogn 38:2437–2448CrossRef Sun QS, Zeng SG, Liu Y, Heng PA, Xia DS (2005) A new method of feature fusion and its application in image recognition. Pattern Recogn 38:2437–2448CrossRef
11.
Zurück zum Zitat Sun QS, Liu ZD, Heng PA, Xia DS (2005) A theorem on the generalized canonical projective vectors. Pattern Recogn 38:449–452CrossRef Sun QS, Liu ZD, Heng PA, Xia DS (2005) A theorem on the generalized canonical projective vectors. Pattern Recogn 38:449–452CrossRef
12.
Zurück zum Zitat Sun T, Chen S, Yang J, Shi P (2008) A novel method of combined feature extraction for recognition. In: Eighth IEEE international conference on data mining, 2008 (ICDM’08), pp 1043–1048 Sun T, Chen S, Yang J, Shi P (2008) A novel method of combined feature extraction for recognition. In: Eighth IEEE international conference on data mining, 2008 (ICDM’08), pp 1043–1048
13.
Zurück zum Zitat Sun TK, Chen SC (2007) Locality preserving CCA with applications to data visualization and pose estimation. Image Vis Comput 25:531–543CrossRefMATH Sun TK, Chen SC (2007) Locality preserving CCA with applications to data visualization and pose estimation. Image Vis Comput 25:531–543CrossRefMATH
14.
Zurück zum Zitat Sun LA, Ji SW, Ye JP (2011) Canonical correlation analysis for multilabel classification: a least-squares formulation, extensions, and analysis. IEEE Trans Pattern Anal Mach Intell 33:194–U204CrossRef Sun LA, Ji SW, Ye JP (2011) Canonical correlation analysis for multilabel classification: a least-squares formulation, extensions, and analysis. IEEE Trans Pattern Anal Mach Intell 33:194–U204CrossRef
15.
Zurück zum Zitat Kim TK, Kittler J, Cipolla R (2007) Discriminative learning and recognition of image set classes using canonical correlations. IEEE Trans Pattern Anal Mach Intell 29:1005–1018CrossRef Kim TK, Kittler J, Cipolla R (2007) Discriminative learning and recognition of image set classes using canonical correlations. IEEE Trans Pattern Anal Mach Intell 29:1005–1018CrossRef
16.
Zurück zum Zitat Yuan YH, Sun QS, Zhou QA, Xia DS (2011) A novel multiset integrated canonical correlation analysis framework and its application in feature fusion. Pattern Recogn 44:1031–1040CrossRef Yuan YH, Sun QS, Zhou QA, Xia DS (2011) A novel multiset integrated canonical correlation analysis framework and its application in feature fusion. Pattern Recogn 44:1031–1040CrossRef
17.
Zurück zum Zitat Jing XY, Li S, Lan C, Zhang D, Yang JY, Liu Q (2011) Color image canonical correlation analysis for face feature extraction and recognition. Signal Process 91:2132–2140CrossRefMATH Jing XY, Li S, Lan C, Zhang D, Yang JY, Liu Q (2011) Color image canonical correlation analysis for face feature extraction and recognition. Signal Process 91:2132–2140CrossRefMATH
18.
Zurück zum Zitat Fu Y, Cao L, Guo G, Huang TS (2008) Multiple feature fusion by subspace learning. In: Proceedings of the 2008 international conference on Content-based image and video retrieval, pp 127–134 Fu Y, Cao L, Guo G, Huang TS (2008) Multiple feature fusion by subspace learning. In: Proceedings of the 2008 international conference on Content-based image and video retrieval, pp 127–134
19.
Zurück zum Zitat Su Y, Fu Y, Gao X, Tian Q (2012) Discriminant learning through multiple principal angles for visual recognition. IEEE Trans Image Process 21:1381–1390MathSciNetCrossRef Su Y, Fu Y, Gao X, Tian Q (2012) Discriminant learning through multiple principal angles for visual recognition. IEEE Trans Image Process 21:1381–1390MathSciNetCrossRef
20.
Zurück zum Zitat Ye JP (2005) Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. J Mach Learn Res 6:483–502MathSciNet Ye JP (2005) Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. J Mach Learn Res 6:483–502MathSciNet
21.
Zurück zum Zitat Chu DL, Goh ST (2010) A new and fast orthogonal linear discriminant analysis on undersampled problems. Siam J Sci Comput 32:2274–2297MathSciNetCrossRef Chu DL, Goh ST (2010) A new and fast orthogonal linear discriminant analysis on undersampled problems. Siam J Sci Comput 32:2274–2297MathSciNetCrossRef
22.
Zurück zum Zitat Cai D, He X, Han J, Zhang HJ (2006) Orthogonal laplacianfaces for face recognition. IEEE Trans Image Process 15:3608–3614CrossRef Cai D, He X, Han J, Zhang HJ (2006) Orthogonal laplacianfaces for face recognition. IEEE Trans Image Process 15:3608–3614CrossRef
23.
Zurück zum Zitat Kokiopoulou E, Saad Y (2007) Orthogonal neighborhood preserving projections: a projection-based dimensionality reduction technique. IEEE Trans Pattern Anal Mach Intell 29:2143–2156CrossRef Kokiopoulou E, Saad Y (2007) Orthogonal neighborhood preserving projections: a projection-based dimensionality reduction technique. IEEE Trans Pattern Anal Mach Intell 29:2143–2156CrossRef
24.
Zurück zum Zitat Gao Q, Ma J, Zhang H, Gao X, Liu Y (2013) Stable orthogonal local discriminant embedding for linear dimensionality reduction. In: IEEE transactions on image processing: a publication of the IEEE Signal Processing Society Gao Q, Ma J, Zhang H, Gao X, Liu Y (2013) Stable orthogonal local discriminant embedding for linear dimensionality reduction. In: IEEE transactions on image processing: a publication of the IEEE Signal Processing Society
25.
Zurück zum Zitat Foley DH, Sammon JW Jr (1975) An optimal set of discriminant vectors. IEEE Trans Comput 100: 281–289 Foley DH, Sammon JW Jr (1975) An optimal set of discriminant vectors. IEEE Trans Comput 100: 281–289
26.
Zurück zum Zitat Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326CrossRef
27.
Zurück zum Zitat Shen XB, Sun QS, & Yuan YH (2013) Orthogonal canonical correlation analysis and its application in feature fusion. In: Information Fusion (FUSION), 2013 16th International conference on IEEE, pp 151–157 Shen XB, Sun QS, & Yuan YH (2013) Orthogonal canonical correlation analysis and its application in feature fusion. In: Information Fusion (FUSION), 2013 16th International conference on IEEE, pp 151–157
28.
Zurück zum Zitat Yuan YH, Sun QS (2013) Fractional-order embedding multiset canonical correlations with applications to multi-feature fusion and recognition. Neurocomputing 122:229–238 Yuan YH, Sun QS (2013) Fractional-order embedding multiset canonical correlations with applications to multi-feature fusion and recognition. Neurocomputing 122:229–238
29.
Zurück zum Zitat Duchene J, Leclercq S (1988) An optimal transformation for discriminant and principal component analysis. IEEE Trans Pattern Anal Mach Intell 10:978–983CrossRef Duchene J, Leclercq S (1988) An optimal transformation for discriminant and principal component analysis. IEEE Trans Pattern Anal Mach Intell 10:978–983CrossRef
31.
Zurück zum Zitat Franke J, Lam L, Legault R, Nadal C, Suen C (1993) Experiments with the CENPARMI database combining different classification approaches. In: 3rd International workshop on frontiers in handwriting recognition, pp 305–311 Franke J, Lam L, Legault R, Nadal C, Suen C (1993) Experiments with the CENPARMI database combining different classification approaches. In: 3rd International workshop on frontiers in handwriting recognition, pp 305–311
32.
Zurück zum Zitat Hou S, Sun Q, Xia D (2011) Feature fusion using multiple component analysis. Neural Process Lett 34:259–275CrossRef Hou S, Sun Q, Xia D (2011) Feature fusion using multiple component analysis. Neural Process Lett 34:259–275CrossRef
33.
Zurück zum Zitat Zhong-Shan H, Zhen L, Jing-Yu Y, Ke L (1999) Handwritten digit recognition based on multi-classifier combination. Chin J Comput 22:369–374 Zhong-Shan H, Zhen L, Jing-Yu Y, Ke L (1999) Handwritten digit recognition based on multi-classifier combination. Chin J Comput 22:369–374
Metadaten
Titel
Orthogonal Multiset Canonical Correlation Analysis based on Fractional-Order and Its Application in Multiple Feature Extraction and Recognition
verfasst von
Xiaobo Shen
Quansen Sun
Publikationsdatum
01.10.2015
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2015
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-014-9358-5

Weitere Artikel der Ausgabe 2/2015

Neural Processing Letters 2/2015 Zur Ausgabe

Neuer Inhalt