Skip to main content
Erschienen in: Neural Computing and Applications 11/2019

07.06.2018 | Original Article

Sparse regularized discriminative canonical correlation analysis for multi-view semi-supervised learning

verfasst von: Shudong Hou, Heng Liu, Quansen Sun

Erschienen in: Neural Computing and Applications | Ausgabe 11/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

For multi-view data representation learning, recently the traditional unsupervised CCA method has been converted to supervised ways by introducing label information from samples. However, such supervised CCA variants require large numbers of labeled samples which hampers its practical application. In this paper, in order to mine the most discriminant information only from a few labeled samples, inspired by sparse representation we propose a novel sparse regularized discriminative CCA method to make use of the label information as much as possible. Through constructing sparse weighted matrices in multiple views, we incorporate the structure information into the original CCA framework to extract fused multi-view features which not only are the most correlated but also carry the important discriminative structure information. Our approach is evaluated on both handwritten dataset and face dataset. The experimental results and the comparisons with other related algorithms demonstrate its effectiveness and superiority.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Andrew G, Arora R, Bilmes J, Livescu K (2013) Deep canonical correlation analysis. In: Proceedings of the 30th international conference on machine learning, pp 1247–1255 Andrew G, Arora R, Bilmes J, Livescu K (2013) Deep canonical correlation analysis. In: Proceedings of the 30th international conference on machine learning, pp 1247–1255
2.
Zurück zum Zitat Belhumeur P, Hespanha J, Kriegman D (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19:711–720CrossRef Belhumeur P, Hespanha J, Kriegman D (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19:711–720CrossRef
3.
Zurück zum Zitat Belkin M, Sindhwani V, Niyogi P (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7(11):2399–896MathSciNetMATH Belkin M, Sindhwani V, Niyogi P (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7(11):2399–896MathSciNetMATH
4.
Zurück zum Zitat Cai D, He X, Han J (2007) Semi-supervised discriminant analysis. In: Proceedings of international conference on computer vision Cai D, He X, Han J (2007) Semi-supervised discriminant analysis. In: Proceedings of international conference on computer vision
5.
Zurück zum Zitat Chen X, Chen S, Xue H, Zhou X (2012) A unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data. Pattern Recogn 45(5):2005–2018CrossRefMATH Chen X, Chen S, Xue H, Zhou X (2012) A unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data. Pattern Recogn 45(5):2005–2018CrossRefMATH
6.
Zurück zum Zitat Chu D, Liao LZ, Ng MK, Zhang X (2013) Sparse canonical correlation analysis: new formulation and algorithm. IEEE Trans Pattern Anal Mach Intell 35(12):3050–3065CrossRef Chu D, Liao LZ, Ng MK, Zhang X (2013) Sparse canonical correlation analysis: new formulation and algorithm. IEEE Trans Pattern Anal Mach Intell 35(12):3050–3065CrossRef
7.
Zurück zum Zitat Eisenschtat A, Wolf L (2017) Linking image and text with 2-way nets. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1855–1865 Eisenschtat A, Wolf L (2017) Linking image and text with 2-way nets. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1855–1865
8.
Zurück zum Zitat Fan J, Chow TW (2017) Matrix completion by least-square, low-rank, and sparse self-representations. Pattern Recogn 71:290–305CrossRef Fan J, Chow TW (2017) Matrix completion by least-square, low-rank, and sparse self-representations. Pattern Recogn 71:290–305CrossRef
9.
Zurück zum Zitat Fan J, Tian Z, Zhao M, Chow TW (2018) Accelerated low-rank representation for subspace clustering and semi-supervised classification on large-scale data. Neural Netw 100:39–48CrossRef Fan J, Tian Z, Zhao M, Chow TW (2018) Accelerated low-rank representation for subspace clustering and semi-supervised classification on large-scale data. Neural Netw 100:39–48CrossRef
10.
Zurück zum Zitat Fan M, Gu N, Qiao H, Zhang B (2011) Sparse regularization for semi-supervised classification. Pattern Recogn 44(8):1777–1784CrossRefMATH Fan M, Gu N, Qiao H, Zhang B (2011) Sparse regularization for semi-supervised classification. Pattern Recogn 44(8):1777–1784CrossRefMATH
11.
Zurück zum Zitat Ferdinando S, Andy H (1994) Parameterisation of a stochastic model for human face identification. In: Proceedings of 2nd IEEE workshop on applications of computer vision, pp 138–142 Ferdinando S, Andy H (1994) Parameterisation of a stochastic model for human face identification. In: Proceedings of 2nd IEEE workshop on applications of computer vision, pp 138–142
12.
Zurück zum Zitat Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23:643–660CrossRef Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23:643–660CrossRef
13.
Zurück zum Zitat Guan N, Zhang X, Luo Z, Lan L (2012) Sparse representation based discriminative canonical correlation analysis for face recognition. In: Proceedings of international conference on machine learning and applications Guan N, Zhang X, Luo Z, Lan L (2012) Sparse representation based discriminative canonical correlation analysis for face recognition. In: Proceedings of international conference on machine learning and applications
15.
Zurück zum Zitat Hotelling H (1936) Relations between tow sets of variates. Biometrika 28(3/4):321–377CrossRefMATH Hotelling H (1936) Relations between tow sets of variates. Biometrika 28(3/4):321–377CrossRefMATH
16.
Zurück zum Zitat Hu Z, Lou Z, Yang J, Liu K, Suen C (1999) Handwritten digital recognition based on multi-classifier combination. Chin J Comput 22(4):369–374 Hu Z, Lou Z, Yang J, Liu K, Suen C (1999) Handwritten digital recognition based on multi-classifier combination. Chin J Comput 22(4):369–374
17.
Zurück zum Zitat Kim TK, Cipolla R (2009) Canonical correlation analysis of video volume tensors for action categorization and detection. IEEE Trans Pattern Anal Mach Intell 31(8):1415–1428CrossRef Kim TK, Cipolla R (2009) Canonical correlation analysis of video volume tensors for action categorization and detection. IEEE Trans Pattern Anal Mach Intell 31(8):1415–1428CrossRef
18.
Zurück zum Zitat Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2013) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–184CrossRef Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2013) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–184CrossRef
19.
Zurück zum Zitat Martinez A, Benavente R (1998) The ar face database. Technical Report 24, CVC Martinez A, Benavente R (1998) The ar face database. Technical Report 24, CVC
20.
Zurück zum Zitat Nie F, Cai G, Li J, Li X (2018) Auto-weighted multi-view learning for image clustering and semi-supervised classification. IEEE Trans Image Process 27(3):1501–1511CrossRefMathSciNetMATH Nie F, Cai G, Li J, Li X (2018) Auto-weighted multi-view learning for image clustering and semi-supervised classification. IEEE Trans Image Process 27(3):1501–1511CrossRefMathSciNetMATH
21.
Zurück zum Zitat Peng Y, Zhang DQ (2008) Semi-supervised canonical correlation analysis algorithm. J Softw 19(11):2822–2832CrossRef Peng Y, Zhang DQ (2008) Semi-supervised canonical correlation analysis algorithm. J Softw 19(11):2822–2832CrossRef
22.
Zurück zum Zitat Qiao L, Chen S, Tan X (2010) Sparsity preserving projections with applications to face recognition. Pattern Recogn 43(1):331–341CrossRefMATH Qiao L, Chen S, Tan X (2010) Sparsity preserving projections with applications to face recognition. Pattern Recogn 43(1):331–341CrossRefMATH
23.
Zurück zum Zitat Sakar CO, Kursun O (2017) Discriminative feature extraction by a neural implementation of canonical correlation analysis. IEEE Trans Neural Netw Learn Syst 28(1):164–176CrossRef Sakar CO, Kursun O (2017) Discriminative feature extraction by a neural implementation of canonical correlation analysis. IEEE Trans Neural Netw Learn Syst 28(1):164–176CrossRef
24.
Zurück zum Zitat Shen X, Sun Q (2014) A novel semi-supervised canonical correlation analysis and extensions for multi-view dimensionality reduction. J Vis Commun Image Represent 83(3):1894–1904CrossRef Shen X, Sun Q (2014) A novel semi-supervised canonical correlation analysis and extensions for multi-view dimensionality reduction. J Vis Commun Image Represent 83(3):1894–1904CrossRef
25.
Zurück zum Zitat Sim T, Baker S, Bsat M (2003) The cmu pose, illumination, and expression database. IEEE Trans Pattern Anal Mach Intell 25:1615–1618CrossRef Sim T, Baker S, Bsat M (2003) The cmu pose, illumination, and expression database. IEEE Trans Pattern Anal Mach Intell 25:1615–1618CrossRef
26.
Zurück zum Zitat Sun Q, Liu Z, Heng PA, Xia D (2005) A theorem on the generalized canonical projective vectors. Pattern Recogn 38(3):449–452CrossRefMATH Sun Q, Liu Z, Heng PA, Xia D (2005) A theorem on the generalized canonical projective vectors. Pattern Recogn 38(3):449–452CrossRefMATH
27.
Zurück zum Zitat Sun Q, Zeng S, Liu Y, Heng PA, Xia D (2005) A new method of feature fusion and its application in image recognition. Pattern Recogn 38(12):2437–2448CrossRef Sun Q, Zeng S, Liu Y, Heng PA, Xia D (2005) A new method of feature fusion and its application in image recognition. Pattern Recogn 38(12):2437–2448CrossRef
28.
Zurück zum Zitat Sun S (2013) A survey of multi-view machine learning. Neural Comput Appl 23(7):2031–2038CrossRef Sun S (2013) A survey of multi-view machine learning. Neural Comput Appl 23(7):2031–2038CrossRef
29.
Zurück zum Zitat Sun T, Chen S (2005) Locality preserving cca with applications to data visualization and pose estimation. Image Vis Comput 25(5):531–543CrossRef Sun T, Chen S (2005) Locality preserving cca with applications to data visualization and pose estimation. Image Vis Comput 25(5):531–543CrossRef
30.
Zurück zum Zitat Sun T, Chen S, Yang J, Shi P (2008) A supervised combined feature extraction method for recognition. In: Proceedings of IEEE international conference on data mining Sun T, Chen S, Yang J, Shi P (2008) A supervised combined feature extraction method for recognition. In: Proceedings of IEEE international conference on data mining
31.
Zurück zum Zitat Wright J, Yang A, Ganesh A, Sastry S, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef Wright J, Yang A, Ganesh A, Sastry S, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef
32.
Zurück zum Zitat Zhang L, Ma B, Li G, Huang Q, Tian Q (2018) Generalized semi-supervised and structured subspace learning for cross-modal retrieval. IEEE Trans Multimed 20(1):128–141CrossRef Zhang L, Ma B, Li G, Huang Q, Tian Q (2018) Generalized semi-supervised and structured subspace learning for cross-modal retrieval. IEEE Trans Multimed 20(1):128–141CrossRef
33.
Zurück zum Zitat Zhang Z, Zhao K (2013) Low-rank matrix approximation with manifold regularization. IEEE Trans Pattern Anal Mach Intell 35(7):1717–1729CrossRef Zhang Z, Zhao K (2013) Low-rank matrix approximation with manifold regularization. IEEE Trans Pattern Anal Mach Intell 35(7):1717–1729CrossRef
34.
Zurück zum Zitat Zhao M, Zhang Z, Chow TW, Li B (2014) A general soft label based linear discriminant analysis for semi-supervised dimensionality reduction. Neural Netw 55:83–97CrossRefMATH Zhao M, Zhang Z, Chow TW, Li B (2014) A general soft label based linear discriminant analysis for semi-supervised dimensionality reduction. Neural Netw 55:83–97CrossRefMATH
35.
Zurück zum Zitat Zhao M, Chow TW, Wu Z, Zhang Z, Li B (2015) Learning from normalized local and global discriminative information for semi-supervised regression and dimensionality reduction. Inf Sci 324:286–309CrossRefMATH Zhao M, Chow TW, Wu Z, Zhang Z, Li B (2015) Learning from normalized local and global discriminative information for semi-supervised regression and dimensionality reduction. Inf Sci 324:286–309CrossRefMATH
36.
Zurück zum Zitat Zhao M, Chow TW, Zhang Z, Li B (2015) Automatic image annotation via compact graph based semi-supervised learning. Knowl Based Syst 76:148–165CrossRef Zhao M, Chow TW, Zhang Z, Li B (2015) Automatic image annotation via compact graph based semi-supervised learning. Knowl Based Syst 76:148–165CrossRef
37.
Zurück zum Zitat Zheng W, Zhou X, Zou C, Zhao L (2006) Facial expression recognition using kernel canonical correlation analysis. IEEE Trans Neural Netw 17(1):233–238CrossRef Zheng W, Zhou X, Zou C, Zhao L (2006) Facial expression recognition using kernel canonical correlation analysis. IEEE Trans Neural Netw 17(1):233–238CrossRef
38.
Zurück zum Zitat Zu C, Zhang D (2016) Canonical sparse cross-view correlation analysis. Neurocomputing 191:263–272CrossRef Zu C, Zhang D (2016) Canonical sparse cross-view correlation analysis. Neurocomputing 191:263–272CrossRef
Metadaten
Titel
Sparse regularized discriminative canonical correlation analysis for multi-view semi-supervised learning
verfasst von
Shudong Hou
Heng Liu
Quansen Sun
Publikationsdatum
07.06.2018
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 11/2019
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-018-3582-2

Weitere Artikel der Ausgabe 11/2019

Neural Computing and Applications 11/2019 Zur Ausgabe