Skip to main content
Erschienen in: Machine Vision and Applications 7/2014

01.10.2014 | Special Issue Paper

Semi-supervised Unified Latent Factor learning with multi-view data

verfasst von: Yu Jiang, Jing Liu, Zechao Li, Hanqing Lu

Erschienen in: Machine Vision and Applications | Ausgabe 7/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Explosive multimedia resources are generated on web, which can be typically considered as a kind of multi-view data in nature. In this paper, we present a Semi-supervised Unified Latent Factor learning approach (SULF) to learn a predictive unified latent representation by leveraging both complementary information among multiple views and the supervision from the partially label information. On one hand, SULF employs a collaborative Nonnegative Matrix Factorization formulation to discover a unified latent space shared across multiple views. On the other hand, SULF adopts a regularized regression model to minimize a prediction loss on partially labeled data with the latent representation. Consequently, the obtained parts-based representation can have more discriminating power. In addition, we also develop a mechanism to learn the weights of different views automatically. To solve the proposed optimization problem, we design an effective iterative algorithm. Extensive experiments are conducted for both classification and clustering tasks on three real-world datasets and the compared results demonstrate the superiority of our approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
\(\mathbf {w}_k\) is the \(k\)th row of \(\mathbf {W}\). In practice, \(||\mathbf {w}_k||_2\) could be close to zero but not zero. Theoretically, it could be zeros. For this case, we can let \(\varepsilon \) is very small constant, and regularize \(e_{kk}=\frac{1}{2\sqrt{\mathbf {w}_k^T\mathbf {w}_k+\varepsilon }}\).
 
2
For convenience, \(\mathbf {A}\) is approximately as constant matrix when requiring the derivatives of \(\frac{\partial {\mathcal {L}}}{\partial \mathbf {V}_l}\).
 
Literatur
1.
Zurück zum Zitat Amini, M.R., Usunier, N., Goutte, C.: Learning from multiple partially observed views—an application to multilingual text categorization. In: Neural Information Processing Systems, pp. 28–36 (2009) Amini, M.R., Usunier, N., Goutte, C.: Learning from multiple partially observed views—an application to multilingual text categorization. In: Neural Information Processing Systems, pp. 28–36 (2009)
2.
Zurück zum Zitat Ando, R.K., Zhang, T.: Two-view feature generation model for semi-supervised learning. In: International Conference on Machine Learning, pp. 25–32 (2007) Ando, R.K., Zhang, T.: Two-view feature generation model for semi-supervised learning. In: International Conference on Machine Learning, pp. 25–32 (2007)
3.
Zurück zum Zitat Blum, A., Mitchell, T.M.: Combining labeled and unlabeled data with co-training. In: Computational Learning Theory, pp. 92–100 (1998) Blum, A., Mitchell, T.M.: Combining labeled and unlabeled data with co-training. In: Computational Learning Theory, pp. 92–100 (1998)
4.
Zurück zum Zitat Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1548–1560 (2011)CrossRef Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1548–1560 (2011)CrossRef
5.
Zurück zum Zitat Chaudhuri, K., Kakade, S.M., Livescu, K., Sridharan, K.: Multi-view clustering via canonical correlation analysis. In: International Conference on Machine Learning, pp. 17–136 (2009) Chaudhuri, K., Kakade, S.M., Livescu, K., Sridharan, K.: Multi-view clustering via canonical correlation analysis. In: International Conference on Machine Learning, pp. 17–136 (2009)
6.
Zurück zum Zitat Chen, N., Zhu, J., Sun, F., Xing, E.P.: Large-margin predictive latent subspace learning for multiview data analysis. IEEE Trans. Pattern Anal. Mach. Intell. 34, 2365–2378 (2012)CrossRef Chen, N., Zhu, J., Sun, F., Xing, E.P.: Large-margin predictive latent subspace learning for multiview data analysis. IEEE Trans. Pattern Anal. Mach. Intell. 34, 2365–2378 (2012)CrossRef
7.
Zurück zum Zitat Chen, X., Chen, S., Xue, H., Zhou, X.: A unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data. Pattern Recognit. 45(5), 2005–2018 (2012)CrossRefMATH Chen, X., Chen, S., Xue, H., Zhou, X.: A unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data. Pattern Recognit. 45(5), 2005–2018 (2012)CrossRefMATH
8.
Zurück zum Zitat Chen, Y., Rege, M., Dong, M., Hua, J.: Nonnegative matrix factorization for semi-supervised data clustering. Knowl. Inf. Syst. 17, 355–379 (2008)CrossRef Chen, Y., Rege, M., Dong, M., Hua, J.: Nonnegative matrix factorization for semi-supervised data clustering. Knowl. Inf. Syst. 17, 355–379 (2008)CrossRef
9.
Zurück zum Zitat Chua, T.S., Tang, J., Hong, R., Li, H., Luo, Z., Zheng, Y.: NUS-WIDE: a real-world web image database from National University of Singapore. In: Conference on Image and Video Retrieval, pp. 1–9 (2009) Chua, T.S., Tang, J., Hong, R., Li, H., Luo, Z., Zheng, Y.: NUS-WIDE: a real-world web image database from National University of Singapore. In: Conference on Image and Video Retrieval, pp. 1–9 (2009)
10.
Zurück zum Zitat Ding, C.H.Q., Li, T., Jordan, M.I.: Convex and semi-nonnegative matrix factorizations. IEEE Trans. Pattern Anal. Mach. Intell. 32, 45–55 (2010)CrossRef Ding, C.H.Q., Li, T., Jordan, M.I.: Convex and semi-nonnegative matrix factorizations. IEEE Trans. Pattern Anal. Mach. Intell. 32, 45–55 (2010)CrossRef
11.
Zurück zum Zitat Ding, C.H.Q., Zhou, D., He, X., Zha, H.: R1PCA: rotational invariant L1-norm principal component analysis for robust subspace factorization. In: International Conference on Machine Learning, pp. 281–288 (2006) Ding, C.H.Q., Zhou, D., He, X., Zha, H.: R1PCA: rotational invariant L1-norm principal component analysis for robust subspace factorization. In: International Conference on Machine Learning, pp. 281–288 (2006)
12.
Zurück zum Zitat Duygulu, P., Barnard, K., Freitas, J.F.G.D., Forsyth, D.A.: Object recognition as machine translation: learning a Lexicon for a fixed image vocabulary. In: European Conference on Computer Vision, pp. 97–112 (2002) Duygulu, P., Barnard, K., Freitas, J.F.G.D., Forsyth, D.A.: Object recognition as machine translation: learning a Lexicon for a fixed image vocabulary. In: European Conference on Computer Vision, pp. 97–112 (2002)
13.
Zurück zum Zitat Hong, R., Tang, J., Tan, H.K., Ngo, C.W., Yan, S., Chua, T.S.: Beyond search: event-driven summarization for web videos. ACM Trans. Multimed. Comput. Commun. Appl. 7(4), 35:1–35:18 (2011) Hong, R., Tang, J., Tan, H.K., Ngo, C.W., Yan, S., Chua, T.S.: Beyond search: event-driven summarization for web videos. ACM Trans. Multimed. Comput. Commun. Appl. 7(4), 35:1–35:18 (2011)
14.
Zurück zum Zitat Hong, R., Wang, M., Li, G., Nie, L., Zha, Z.J., Chua, T.S.: Multimedia question answering. IEEE Trans. Multimed. 19(4), 72–78 (2012)CrossRef Hong, R., Wang, M., Li, G., Nie, L., Zha, Z.J., Chua, T.S.: Multimedia question answering. IEEE Trans. Multimed. 19(4), 72–78 (2012)CrossRef
15.
Zurück zum Zitat Hotelling, H.: Relations between two sets of variates. Biometrika 28, 321–377 (1936)CrossRefMATH Hotelling, H.: Relations between two sets of variates. Biometrika 28, 321–377 (1936)CrossRefMATH
16.
Zurück zum Zitat Kumar, A., Rai, P., Daume, III H.: Co-regularized multi-view spectral clustering. In: Neural Information Processing Systems, pp. 1413–1421 (2011) Kumar, A., Rai, P., Daume, III H.: Co-regularized multi-view spectral clustering. In: Neural Information Processing Systems, pp. 1413–1421 (2011)
17.
Zurück zum Zitat Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature (1999) Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature (1999)
18.
Zurück zum Zitat Lee, D.D., Seung, H.S.: Algorithms for nonnegative matrix factorization. In: Neural Information Processing Systems, Vol. 13, pp. 556–562 (2000) Lee, D.D., Seung, H.S.: Algorithms for nonnegative matrix factorization. In: Neural Information Processing Systems, Vol. 13, pp. 556–562 (2000)
19.
Zurück zum Zitat Li, Z., Liu, J., Lu, H.: Structure preserving non-negative matrix factorization for dimensionality reduction. Comput. Vis. Image Underst. 117(9), 1175–1189 (2013) Li, Z., Liu, J., Lu, H.: Structure preserving non-negative matrix factorization for dimensionality reduction. Comput. Vis. Image Underst. 117(9), 1175–1189 (2013)
20.
Zurück zum Zitat Li, Z., Liu, J., Zhu, X., Liu, T., Lu, H.: Image annotation using multi-correlation probabilistic matrix factorization. In: ACM Multimedia, pp. 1187–1190 (2010) Li, Z., Liu, J., Zhu, X., Liu, T., Lu, H.: Image annotation using multi-correlation probabilistic matrix factorization. In: ACM Multimedia, pp. 1187–1190 (2010)
21.
Zurück zum Zitat Li, Z., Yang, Y., Liu, J., Zhou, X., Lu, H.: Unsupervised feature selection using nonnegative spectral analysis. In: AAAI (2012) Li, Z., Yang, Y., Liu, J., Zhou, X., Lu, H.: Unsupervised feature selection using nonnegative spectral analysis. In: AAAI (2012)
22.
Zurück zum Zitat Liu, H., Wu, Z., Cai, D., Huang, T.S.: Constrained nonnegative matrix factorization for image representation. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1299–1311 (2012)CrossRef Liu, H., Wu, Z., Cai, D., Huang, T.S.: Constrained nonnegative matrix factorization for image representation. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1299–1311 (2012)CrossRef
23.
Zurück zum Zitat Nigam, K., McCallum, A.K., Thrun, S., Mitchell, T.M.: Text classification from labeled and unlabeled documents using EM. Mach. Learn. 39, 103–134 (2000)CrossRefMATH Nigam, K., McCallum, A.K., Thrun, S., Mitchell, T.M.: Text classification from labeled and unlabeled documents using EM. Mach. Learn. 39, 103–134 (2000)CrossRefMATH
24.
Zurück zum Zitat van de Sande, K.E.A., Gevers, T., Snoek, C.G.M.: Evaluating color descriptors for object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1582–1596 (2010)CrossRef van de Sande, K.E.A., Gevers, T., Snoek, C.G.M.: Evaluating color descriptors for object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1582–1596 (2010)CrossRef
25.
Zurück zum Zitat Sun, T., Chen, S., yu Yang, J., Shi, P.: A novel method of combined feature extraction for recognition. In: IEEE International Conference on Data Mining, pp. 1043–1048 (2008) Sun, T., Chen, S., yu Yang, J., Shi, P.: A novel method of combined feature extraction for recognition. In: IEEE International Conference on Data Mining, pp. 1043–1048 (2008)
26.
Zurück zum Zitat Wang, M., Hong, R., Li, G., Zha, Z.J., Yan, S., Chua, T.S.: Event driven web video summarization by tag localization and key-shot identification. IEEE Trans. Multimed. 14(4), 975–985 (2012)CrossRef Wang, M., Hong, R., Li, G., Zha, Z.J., Yan, S., Chua, T.S.: Event driven web video summarization by tag localization and key-shot identification. IEEE Trans. Multimed. 14(4), 975–985 (2012)CrossRef
Metadaten
Titel
Semi-supervised Unified Latent Factor learning with multi-view data
verfasst von
Yu Jiang
Jing Liu
Zechao Li
Hanqing Lu
Publikationsdatum
01.10.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
Machine Vision and Applications / Ausgabe 7/2014
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-013-0556-3

Weitere Artikel der Ausgabe 7/2014

Machine Vision and Applications 7/2014 Zur Ausgabe

Premium Partner