Skip to main content

2019 | OriginalPaper | Buchkapitel

Hybrid Matrix Factorization for Multi-view Clustering

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multi-view clustering (MVC) has gained considerable attention recently. In this paper, we present a hybrid matrix factorization (HMF) framework which is a combination of the nonnegative factorization and the symmetric nonnegative matrix factorization for MVC. HMF can uncover linear and nonlinear manifold within multi-view dataset. In addition, HMF also learns weights for each view to characterize the contribution of each view to the final common clustering assignment. The proposed model can be solved by nonnegative least squares. Unlike previous approaches, our approach can obtain the clustering results straightforwardly due to the nonnegative constraints. We conduct experiments on multi-view benchmark datasets to verify the effectiveness of our proposed approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Amini, M.R., Usunier, N., Goutte, C.: Learning from multiple partially observed views - an application to multilingual text categorization. Adv. Neural Inf. Process. Syst. 22, 28–36 (2009) Amini, M.R., Usunier, N., Goutte, C.: Learning from multiple partially observed views - an application to multilingual text categorization. Adv. Neural Inf. Process. Syst. 22, 28–36 (2009)
2.
Zurück zum Zitat Bickel, S., Scheffer, T.: Multi-view clustering. In: ICDM vol. 4, pp. 19–26 (2004) Bickel, S., Scheffer, T.: Multi-view clustering. In: ICDM vol. 4, pp. 19–26 (2004)
3.
Zurück zum Zitat Blaschko, M.B., Lampert, C.H.: Correlational spectral clustering. In: IEEE Conference on Computer Vision and Pattern Recognition, 2008. CVPR 2008, pp. 1–8. IEEE (2008) Blaschko, M.B., Lampert, C.H.: Correlational spectral clustering. In: IEEE Conference on Computer Vision and Pattern Recognition, 2008. CVPR 2008, pp. 1–8. IEEE (2008)
4.
Zurück zum Zitat Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3(Jan), 993–1022 (2003)MATH Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3(Jan), 993–1022 (2003)MATH
5.
Zurück zum Zitat Blum, A., Mitchell, T.M.: Combining labeled and unlabeled data with co-training. In: Proceedings of the Eleventh Annual Conference on Computational Learning Theory, pp. 92–100 (1998) Blum, A., Mitchell, T.M.: Combining labeled and unlabeled data with co-training. In: Proceedings of the Eleventh Annual Conference on Computational Learning Theory, pp. 92–100 (1998)
6.
Zurück zum Zitat Cai, X., Nie, F., Huang, H.: Multi-view k-means clustering on big data. In: Proceedings of the Twenty-Third international joint conference on Artificial Intelligence, pp. 2598–2604. AAAI Press (2013) Cai, X., Nie, F., Huang, H.: Multi-view k-means clustering on big data. In: Proceedings of the Twenty-Third international joint conference on Artificial Intelligence, pp. 2598–2604. AAAI Press (2013)
7.
Zurück zum Zitat Chaudhuri, K., Kakade, S.M., Livescu, K., Sridharan, K.: Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 129–136. ACM (2009) Chaudhuri, K., Kakade, S.M., Livescu, K., Sridharan, K.: Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 129–136. ACM (2009)
8.
Zurück zum Zitat Ding, C.H.Q., Li, T., Peng, W.: Nonnegative matrix factorization and probabilistic latent semantic indexing: equivalence, chi-square statistic, and a hybrid method. In: AAAI 2006 Proceedings of the 21st National Conference on Artificial Intelligence , vol. 1, pp. 342–347 (2006) Ding, C.H.Q., Li, T., Peng, W.: Nonnegative matrix factorization and probabilistic latent semantic indexing: equivalence, chi-square statistic, and a hybrid method. In: AAAI 2006 Proceedings of the 21st National Conference on Artificial Intelligence , vol. 1, pp. 342–347 (2006)
9.
Zurück zum Zitat Du, R., Drake, B.L., Park, H.: Hybrid clustering based on content and connection structure using joint nonnegative matrix factorization. J. Global Optim. 74, 1–17 (2017) MathSciNetMATH Du, R., Drake, B.L., Park, H.: Hybrid clustering based on content and connection structure using joint nonnegative matrix factorization. J. Global Optim. 74, 1–17 (2017) MathSciNetMATH
11.
Zurück zum Zitat Jain, A., Murty, M., Flynn, P.: Data clustering: a review. ACM Comput. Surv. 31(3), 264–323 (1999)CrossRef Jain, A., Murty, M., Flynn, P.: Data clustering: a review. ACM Comput. Surv. 31(3), 264–323 (1999)CrossRef
12.
Zurück zum Zitat Kim, H., Park, H.: Nonnegative matrix factorization based on alternating nonnegativity constrained least squares and active set method. SIAM J. Matrix Anal. Appl. 30(2), 713–730 (2008)MathSciNetCrossRef Kim, H., Park, H.: Nonnegative matrix factorization based on alternating nonnegativity constrained least squares and active set method. SIAM J. Matrix Anal. Appl. 30(2), 713–730 (2008)MathSciNetCrossRef
13.
Zurück zum Zitat Kuang, D., Ding, C., Park, H.: Symmetric nonnegative matrix factorization for graph clustering. In: 12th SIAM International Conference on Data Mining, SDM 2012, pp. 106–117 (2012) Kuang, D., Ding, C., Park, H.: Symmetric nonnegative matrix factorization for graph clustering. In: 12th SIAM International Conference on Data Mining, SDM 2012, pp. 106–117 (2012)
14.
Zurück zum Zitat Kumar, A., Daumé, H.: A co-training approach for multi-view spectral clustering. In: Proceedings of the 28th International Conference on Machine Learning (ICML-11), pp. 393–400 (2011) Kumar, A., Daumé, H.: A co-training approach for multi-view spectral clustering. In: Proceedings of the 28th International Conference on Machine Learning (ICML-11), pp. 393–400 (2011)
15.
Zurück zum Zitat Kumar, A., Rai, P., Daume, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp. 1413–1421 (2011) Kumar, A., Rai, P., Daume, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp. 1413–1421 (2011)
16.
Zurück zum Zitat Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401(6755), 788–791 (1999)CrossRef Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401(6755), 788–791 (1999)CrossRef
17.
Zurück zum Zitat Liu, J., Wang, C., Gao, J., Han, J.: Multi-view clustering via joint nonnegative matrix factorization. In: Proceedings of SDM, vol. 13, pp. 252–260. SIAM (2013) Liu, J., Wang, C., Gao, J., Han, J.: Multi-view clustering via joint nonnegative matrix factorization. In: Proceedings of SDM, vol. 13, pp. 252–260. SIAM (2013)
18.
Zurück zum Zitat Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
19.
Zurück zum Zitat Manning, C.D., Raghavan, P., Schütze, H., et al.: Introduction to Information Retrieval, vol. 1. Cambridge University Press, Cambridge (2008)CrossRef Manning, C.D., Raghavan, P., Schütze, H., et al.: Introduction to Information Retrieval, vol. 1. Cambridge University Press, Cambridge (2008)CrossRef
20.
Zurück zum Zitat Ng, A.Y., Jordan, M.I., Weiss, Y., et al.: On spectral clustering: Analysis and an algorithm. In: Advances in neural information processing systems, vol. 2, 849–856 (2002) Ng, A.Y., Jordan, M.I., Weiss, Y., et al.: On spectral clustering: Analysis and an algorithm. In: Advances in neural information processing systems, vol. 2, 849–856 (2002)
21.
Zurück zum Zitat Rasiwasia, N., et al.: A new approach to cross-modal multimedia retrieval. In: Proceedings of the 18th ACM International Conference on Multimedia, pp. 251–260. ACM (2010) Rasiwasia, N., et al.: A new approach to cross-modal multimedia retrieval. In: Proceedings of the 18th ACM International Conference on Multimedia, pp. 251–260. ACM (2010)
22.
Zurück zum Zitat de Sa, V.R.: Spectral clustering with two views. In: ICML Workshop on Learning with Multiple Views, pp. 20–27 (2005) de Sa, V.R.: Spectral clustering with two views. In: ICML Workshop on Learning with Multiple Views, pp. 20–27 (2005)
23.
Zurück zum Zitat Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Patt. Anal. Mach. Intell. 22(8), 888–905 (2000)CrossRef Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Patt. Anal. Mach. Intell. 22(8), 888–905 (2000)CrossRef
24.
Zurück zum Zitat Tang, W., Lu, Z., Dhillon, I.S.: Clustering with multiple graphs. In: Ninth IEEE International Conference on Data Mining, 2009. ICDM 2009, pp. 1016–1021. IEEE (2009) Tang, W., Lu, Z., Dhillon, I.S.: Clustering with multiple graphs. In: Ninth IEEE International Conference on Data Mining, 2009. ICDM 2009, pp. 1016–1021. IEEE (2009)
25.
Zurück zum Zitat Zhao, X., Evans, N., Dugelay, J.L.: A subspace co-training framework for multi-view clustering. Patt. Recogn. Lett. 41, 73–82 (2014)CrossRef Zhao, X., Evans, N., Dugelay, J.L.: A subspace co-training framework for multi-view clustering. Patt. Recogn. Lett. 41, 73–82 (2014)CrossRef
26.
Zurück zum Zitat Zhou, D., Burges, C.J.C.: Spectral clustering and transductive learning with multiple views. In: International Conference on Machine Learning (2007) Zhou, D., Burges, C.J.C.: Spectral clustering and transductive learning with multiple views. In: International Conference on Machine Learning (2007)
Metadaten
Titel
Hybrid Matrix Factorization for Multi-view Clustering
verfasst von
Hongbin Yu
Xin Shu
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-36204-1_25