Skip to main content

2016 | OriginalPaper | Buchkapitel

Learning Latent Features for Multi-view Clustering Based on NMF

verfasst von : Mengjiao He, Yan Yang, Hongjun Wang

Erschienen in: Rough Sets

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multi-view data coming from multiple ways or being presented in multiple forms, have more information than single-view data. So multi-view clustering benefits from exploiting the more information. Nonnegative matrix factorization (NMF) is an efficient method to learn low-rank approximation of nonnegative matrix of nonnegative data, but it may not be good at clustering. This paper presents a novel multi-view clustering algorithm (called MVCS) which properly combines the similarity and NMF. It aims to obtain latent features shared by multiple views with factorizations, which is a common factor matrix attained from the views and the common similarity matrix. Besides, according to the reconstruction precisions of data matrices, MVCS could adaptively learn the weight. Experiments on real-world data sets demonstrate that our approach may effectively facilitate multi-view clustering and induce superior clustering results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Liu, J., Jiang, Y., Li, Z., Zhou, Z.H., Lu, H.: Partially shared latent factor learning with multiview data. IEEE Trans. Neural Netw. Learn. Syst. 26(6), 1233–1246 (2015)MathSciNetCrossRef Liu, J., Jiang, Y., Li, Z., Zhou, Z.H., Lu, H.: Partially shared latent factor learning with multiview data. IEEE Trans. Neural Netw. Learn. Syst. 26(6), 1233–1246 (2015)MathSciNetCrossRef
3.
Zurück zum Zitat Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the Workshop on Computational Learning, pp. 92–100 (1998) Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the Workshop on Computational Learning, pp. 92–100 (1998)
4.
Zurück zum Zitat Wang, Z., Chen, S., Sun, T.: MultiK-MHKS: a novel multiple kernel learning algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 348–353 (2008)CrossRef Wang, Z., Chen, S., Sun, T.: MultiK-MHKS: a novel multiple kernel learning algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 348–353 (2008)CrossRef
5.
Zurück zum Zitat Subrahmanya, N., Shin, Y.C.: Sparse multiple kernel learning for signal processing applications. IEEE Trans. Pattern Anal. Mach. Intell. 32(5), 788–798 (2010)CrossRef Subrahmanya, N., Shin, Y.C.: Sparse multiple kernel learning for signal processing applications. IEEE Trans. Pattern Anal. Mach. Intell. 32(5), 788–798 (2010)CrossRef
6.
Zurück zum Zitat Wang, W., Zhou, Z.H.: A new analysis of co-training. In: Proceedings of the 27th International Conference on Machine Learning, pp. 1135–1142 (2010) Wang, W., Zhou, Z.H.: A new analysis of co-training. In: Proceedings of the 27th International Conference on Machine Learning, pp. 1135–1142 (2010)
7.
Zurück zum Zitat Yu, S., Krishnapuram, B., Rosales, R., Rao, R.B.: Bayesian co-training. J. Mach. Learn. Res. 12, 2649–2680 (2011)MathSciNetMATH Yu, S., Krishnapuram, B., Rosales, R., Rao, R.B.: Bayesian co-training. J. Mach. Learn. Res. 12, 2649–2680 (2011)MathSciNetMATH
8.
Zurück zum Zitat Amini, M.R., Usunier, N., Goutte, C., et al.: Learning from multiple partially observed viewsan application to multilingual text categorization. In: Advances in Neural Information Processing Systems, vol. 22, no. 1, pp. 28–36 (2010) Amini, M.R., Usunier, N., Goutte, C., et al.: Learning from multiple partially observed viewsan application to multilingual text categorization. In: Advances in Neural Information Processing Systems, vol. 22, no. 1, pp. 28–36 (2010)
9.
Zurück zum Zitat Quadrianto, N., Lampert, C.H.: Learning multi-view neighborhood preserving projections. In: Proceedings of the International Conference on Machine Learning, pp. 425–432 (2011) Quadrianto, N., Lampert, C.H.: Learning multi-view neighborhood preserving projections. In: Proceedings of the International Conference on Machine Learning, pp. 425–432 (2011)
10.
Zurück zum Zitat Zhang, J.S., Wang, C.P., Yang, Y.Q.: Learning latent features by nonnegative matrix factorization combining similarity judgments. Neurocomputing 155, 43–52 (2015)CrossRef Zhang, J.S., Wang, C.P., Yang, Y.Q.: Learning latent features by nonnegative matrix factorization combining similarity judgments. Neurocomputing 155, 43–52 (2015)CrossRef
11.
Zurück zum Zitat Muslea, I., Minton, S., Knoblock, C.A.: Active+Semi-supervised Learning=Robust Multiview Learning. In: Machine Learning-international Workshop then Conference, pp. 435–442 (2002) Muslea, I., Minton, S., Knoblock, C.A.: Active+Semi-supervised Learning=Robust Multiview Learning. In: Machine Learning-international Workshop then Conference, pp. 435–442 (2002)
12.
Zurück zum Zitat Kumar, A., Rai, P., Daume III, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp. 1413–1432 (2011) Kumar, A., Rai, P., Daume III, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp. 1413–1432 (2011)
13.
Zurück zum Zitat Lanckriet, G.R.G., Cristianini, N., Bartlett, P., Ghaoui, L.E., Jordan, M.I.: Learning the kernel matrix with semidefinite programming. J. Mach. Learn. Res. 5, 27–72 (2004)MathSciNetMATH Lanckriet, G.R.G., Cristianini, N., Bartlett, P., Ghaoui, L.E., Jordan, M.I.: Learning the kernel matrix with semidefinite programming. J. Mach. Learn. Res. 5, 27–72 (2004)MathSciNetMATH
15.
Zurück zum Zitat Kursun, O., Alpaydin, E.: Canonical correlation analysis for multiview semisupervised feature extraction. In: Rutkowski, L., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2010. LNCS, vol. 6113, pp. 430–436. Springer, Heidelberg (2010). doi:10.1007/978-3-642-13208-7_54 CrossRef Kursun, O., Alpaydin, E.: Canonical correlation analysis for multiview semisupervised feature extraction. In: Rutkowski, L., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2010. LNCS, vol. 6113, pp. 430–436. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-13208-7_​54 CrossRef
16.
Zurück zum Zitat Lee, D., Seung, H.S.: Learning the parts of objects by nonnegative matrix factorization. Nature 401, 788–791 (1999)CrossRef Lee, D., Seung, H.S.: Learning the parts of objects by nonnegative matrix factorization. Nature 401, 788–791 (1999)CrossRef
17.
Zurück zum Zitat Lee, H., Yoo, J., Choi, S.: Semi-supervised nonnegative matrix factorization. IEEE Sign. Process. Lett. 17, 4–7 (2010)CrossRef Lee, H., Yoo, J., Choi, S.: Semi-supervised nonnegative matrix factorization. IEEE Sign. Process. Lett. 17, 4–7 (2010)CrossRef
18.
Zurück zum Zitat Sato, M., Sato, Y.: Structural model of similarity for fuzzy clustering. In: IEEE International Conference on Fuzzy Systems, vol. 2, pp. 963–968 (1997) Sato, M., Sato, Y.: Structural model of similarity for fuzzy clustering. In: IEEE International Conference on Fuzzy Systems, vol. 2, pp. 963–968 (1997)
19.
Zurück zum Zitat Wang, H., Nie, F., Huang, H., Yang, Y.: Learning frame relevance for video classification. In: Proceedings of the 2011 ACM Multimedia Conference and Co-located Workshops, pp. 1345–1348 (2011) Wang, H., Nie, F., Huang, H., Yang, Y.: Learning frame relevance for video classification. In: Proceedings of the 2011 ACM Multimedia Conference and Co-located Workshops, pp. 1345–1348 (2011)
20.
Zurück zum Zitat Miao, L.D., Qi, H.R.: Endmember extraction from highly mixed data using minimum volume constrained nonnegative matrix factorization. IEEE Trans. Geosci. Remote Sens. 45(3), 765–777 (2007)CrossRef Miao, L.D., Qi, H.R.: Endmember extraction from highly mixed data using minimum volume constrained nonnegative matrix factorization. IEEE Trans. Geosci. Remote Sens. 45(3), 765–777 (2007)CrossRef
21.
Zurück zum Zitat Xiao, C., Nie, F., Huang, H.: Multi-view K-means clustering on Big Data. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence, pp. 2598–2604 (2013) Xiao, C., Nie, F., Huang, H.: Multi-view K-means clustering on Big Data. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence, pp. 2598–2604 (2013)
22.
Zurück zum Zitat Xia, R., Pan, Y., Du, L., Yin, J.: Robust multi-view spectral clustering via low-rank, sparse decomposition. In: Proceedings of 28th AAAI Conference on Artificial Intelligence, vol. 3, pp. 2149–2155 (2011) Xia, R., Pan, Y., Du, L., Yin, J.: Robust multi-view spectral clustering via low-rank, sparse decomposition. In: Proceedings of 28th AAAI Conference on Artificial Intelligence, vol. 3, pp. 2149–2155 (2011)
23.
Zurück zum Zitat Kumar, A., Rai, P., Daum, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems (2011) Kumar, A., Rai, P., Daum, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems (2011)
24.
Zurück zum Zitat Tzortz, G., Likas, A.: Kernel-based weighted multi-view clustering. In: Proceedings of 12th International Conference on Data Mining, pp. 675–684 (2012) Tzortz, G., Likas, A.: Kernel-based weighted multi-view clustering. In: Proceedings of 12th International Conference on Data Mining, pp. 675–684 (2012)
25.
Zurück zum Zitat Chen, X., Xu, X., Huang, J., Ye, Y.: TW-K-means: automated two-level variable weighting clustering algorithm for multiview data. IEEE Trans. Knowl. Data Eng. 25(4), 932–944 (2013)CrossRef Chen, X., Xu, X., Huang, J., Ye, Y.: TW-K-means: automated two-level variable weighting clustering algorithm for multiview data. IEEE Trans. Knowl. Data Eng. 25(4), 932–944 (2013)CrossRef
26.
Zurück zum Zitat Liu, J., Wang, C., Gao, J., Han, J.: Multi-view clustering via joint nonnegative matrix factorization. In: Proceedings of the 2013 SIAN International Conference on Data Mining, pp. 252–260 (2013) Liu, J., Wang, C., Gao, J., Han, J.: Multi-view clustering via joint nonnegative matrix factorization. In: Proceedings of the 2013 SIAN International Conference on Data Mining, pp. 252–260 (2013)
27.
Zurück zum Zitat Rand, W.M.: Objective critera for the evaluation of clustering methods. J. Am. Stat. Assoc. 66(336), 846–850 (1971)CrossRef Rand, W.M.: Objective critera for the evaluation of clustering methods. J. Am. Stat. Assoc. 66(336), 846–850 (1971)CrossRef
Metadaten
Titel
Learning Latent Features for Multi-view Clustering Based on NMF
verfasst von
Mengjiao He
Yan Yang
Hongjun Wang
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-47160-0_42