Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 11/2023

27.05.2023 | Original Article

Consensus latent incomplete multi-view clustering with low-rank tensor constraint

verfasst von: Guangyan Ji, Gui-Fu Lu

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 11/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Traditional multi-view clustering (MVC) assumes that all views are complete and it cannot address a lack of views. In real life, a lack of views often occurs, thus leading to the problem of incomplete MVC (IMVC). Although the existing IMVC methods have achieved good performance, they have the following weaknesses. (1) The completion method is not flexible enough for the case where view information is arbitrarily missing. (2) They fail to adequately explore the higher-order correlations among views. (3) The cluster structure of the input data is not considered. Thus, to solve these problems, in this paper, we propose a novel method, i.e., consensus latent incomplete multi-view clustering with low-rank tensor constraint (CLIMVC/LTC). Specifically, we first use a latent model to generate the missing views to make the completion process more flexible. Then, we utilize the low-rank tensor constraint and consensus representation term to jointly explore the higher-order correlations, the cluster structure of the data and the consistency between different views. That is, CLIMVC/LTC combines missing view completion, which is implemented by a latent model, low-rank tensor constraint and consensus representation learning into a unified framework, and their interaction yields improved clustering performance. An optimization procedure based on the augmented Lagrange multiplier (ALM) method is also designed to solve CLIMVC/LTC. The effectiveness of CLIMVC/LTC is verified on several well-known datasets, and it has good clustering performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Fußnoten
2
Image Understanding—Microsoft Research.
 
4
UCI Machine Learning Repository: Multiple Features Data Set.
 
Literatur
1.
Zurück zum Zitat Jain AK, Murty MN, Flynn PJ (1999) Data clustering: a review. ACM Comput Surv (CSUR) 31:264–323CrossRef Jain AK, Murty MN, Flynn PJ (1999) Data clustering: a review. ACM Comput Surv (CSUR) 31:264–323CrossRef
2.
Zurück zum Zitat Chao G, Sun S, Bi J (2021) A survey on multiview clustering. IEEE Trans Artif Intell 2:146–168CrossRef Chao G, Sun S, Bi J (2021) A survey on multiview clustering. IEEE Trans Artif Intell 2:146–168CrossRef
3.
Zurück zum Zitat A. Blum, T. Mitchell, 1998 Combining labeled and unlabeled data with co-training, in: Proceedings of the eleventh annual Conference on Computational Learning Theory, pp. 92–100 A. Blum, T. Mitchell, 1998 Combining labeled and unlabeled data with co-training, in: Proceedings of the eleventh annual Conference on Computational Learning Theory, pp. 92–100
4.
Zurück zum Zitat Yan K, Fang X, Xu Y, Liu B (2019) Protein fold recognition based on multi-view modeling. Bioinformatics 35:2982–2990CrossRef Yan K, Fang X, Xu Y, Liu B (2019) Protein fold recognition based on multi-view modeling. Bioinformatics 35:2982–2990CrossRef
5.
Zurück zum Zitat Wen J, Zhang Z, Zhang Z, Fei L, Wang M (2020) Generalized incomplete multiview clustering with flexible locality structure diffusion. IEEE Trans Cybern 51:101–114CrossRef Wen J, Zhang Z, Zhang Z, Fei L, Wang M (2020) Generalized incomplete multiview clustering with flexible locality structure diffusion. IEEE Trans Cybern 51:101–114CrossRef
6.
Zurück zum Zitat Li J, Lu G, Zhang B, You JJ, Zhang DD (2021) Shared linear encoder-based multikernel gaussian process latent variable model for visual classification. IEEE Trans Cybern 51:534–547CrossRef Li J, Lu G, Zhang B, You JJ, Zhang DD (2021) Shared linear encoder-based multikernel gaussian process latent variable model for visual classification. IEEE Trans Cybern 51:534–547CrossRef
7.
Zurück zum Zitat Yang Y, Wang H (2018) Multi-view clustering: a survey. Big Data Min Anal 1:83–107CrossRef Yang Y, Wang H (2018) Multi-view clustering: a survey. Big Data Min Anal 1:83–107CrossRef
8.
Zurück zum Zitat C. Zhang, H. Fu, S. Liu, G. Liu, X. 2015 Cao, Low-rank tensor constrained multiview subspace clustering, in: Proceedings of the IEEE international conference on computer vision, pp. 1582–1590 C. Zhang, H. Fu, S. Liu, G. Liu, X. 2015 Cao, Low-rank tensor constrained multiview subspace clustering, in: Proceedings of the IEEE international conference on computer vision, pp. 1582–1590
9.
Zurück zum Zitat S.-Y. Li, Y. Jiang, Z.-H. Zhou, 2014 Partial multi-view clustering, in: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 1968–1974 S.-Y. Li, Y. Jiang, Z.-H. Zhou, 2014 Partial multi-view clustering, in: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 1968–1974
10.
Zurück zum Zitat Trivedi A, Rai P, Daumé H III, DuVall SL (2010) Multiview clustering with incomplete views. NIPS workshop, Citeseer, New Jersey, pp 1–8 Trivedi A, Rai P, Daumé H III, DuVall SL (2010) Multiview clustering with incomplete views. NIPS workshop, Citeseer, New Jersey, pp 1–8
11.
Zurück zum Zitat Zhan K, Nie F, Wang J, Yang Y (2018) Multiview consensus graph clustering. IEEE Trans Image Process 28:1261–1270MathSciNetCrossRef Zhan K, Nie F, Wang J, Yang Y (2018) Multiview consensus graph clustering. IEEE Trans Image Process 28:1261–1270MathSciNetCrossRef
12.
Zurück zum Zitat Wen J, Xu Y, Liu H (2018) Incomplete multiview spectral clustering with adaptive graph learning. IEEE Trans Cybern 50:1418–1429CrossRef Wen J, Xu Y, Liu H (2018) Incomplete multiview spectral clustering with adaptive graph learning. IEEE Trans Cybern 50:1418–1429CrossRef
13.
Zurück zum Zitat Y. Lin, Y. Gou, Z. Liu, B. Li, J. Lv, X. Peng, (2021) COMPLETER: Incomplete multi-view clustering via contrastive prediction, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11174–11183 Y. Lin, Y. Gou, Z. Liu, B. Li, J. Lv, X. Peng, (2021) COMPLETER: Incomplete multi-view clustering via contrastive prediction, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11174–11183
14.
Zurück zum Zitat H. Zhao, H. Liu, Y. Fu, (2016) Incomplete multi-modal visual data grouping, in: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 2392–2398 H. Zhao, H. Liu, Y. Fu, (2016) Incomplete multi-modal visual data grouping, in: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 2392–2398
15.
Zurück zum Zitat W Shao, L He, SY 2015 Philip, Multiple incomplete views clustering via weighted nonnegative matrix factorization with L2,1 regularization, in: Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 318–334 W Shao, L He, SY 2015 Philip, Multiple incomplete views clustering via weighted nonnegative matrix factorization with L2,1 regularization, in: Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 318–334
16.
Zurück zum Zitat W Shao, L He, C-t Lu, SY Philip, 2016 Online multi-view clustering with incomplete views, in: 2016 IEEE International Conference on Big Data (Big Data), pp. 1012-1017 W Shao, L He, C-t Lu, SY Philip, 2016 Online multi-view clustering with incomplete views, in: 2016 IEEE International Conference on Big Data (Big Data), pp. 1012-1017
18.
Zurück zum Zitat Q. Yin, S. Wu, L. Wang, 2015 Incomplete Multi-view Clustering via Subspace Learning, in: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, pp. 383–392 Q. Yin, S. Wu, L. Wang, 2015 Incomplete Multi-view Clustering via Subspace Learning, in: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, pp. 383–392
19.
Zurück zum Zitat H. Wang, L. Zong, B. Liu, Y. Yang, W. Zhou, 2019 Spectral Perturbation Meets Incomplete Multi-view Data, in: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, pp. 3677–3683 H. Wang, L. Zong, B. Liu, Y. Yang, W. Zhou, 2019 Spectral Perturbation Meets Incomplete Multi-view Data, in: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, pp. 3677–3683
20.
Zurück zum Zitat Zhao B-Y, Zhang C-Q, Chen L, Liu X-W, Li Z-C, Hu Q-H (2021) Generative model for partial multi-view clustering. Acta Automatica Sinica 45:1867–1875MATH Zhao B-Y, Zhang C-Q, Chen L, Liu X-W, Li Z-C, Hu Q-H (2021) Generative model for partial multi-view clustering. Acta Automatica Sinica 45:1867–1875MATH
21.
Zurück zum Zitat Kilmer ME, Braman KS, Hao N, Hoover RC (2013) Third-order tensors as operators on matrices: a theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34:148–172MathSciNetCrossRefMATH Kilmer ME, Braman KS, Hao N, Hoover RC (2013) Third-order tensors as operators on matrices: a theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34:148–172MathSciNetCrossRefMATH
23.
Zurück zum Zitat Z. Zhang, G. Ely, S. Aeron, N. Hao, M. Kilmer, 2014 Novel methods for multilinear data completion and de-noising based on tensor-SVD, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3842–3849 Z. Zhang, G. Ely, S. Aeron, N. Hao, M. Kilmer, 2014 Novel methods for multilinear data completion and de-noising based on tensor-SVD, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3842–3849
24.
Zurück zum Zitat Semerci O, Hao N, Kilmer ME, Miller EL (2014) Tensor-based formulation and nuclear norm regularization for multienergy computed tomography. IEEE Trans Image Process 23:1678–1693MathSciNetCrossRefMATH Semerci O, Hao N, Kilmer ME, Miller EL (2014) Tensor-based formulation and nuclear norm regularization for multienergy computed tomography. IEEE Trans Image Process 23:1678–1693MathSciNetCrossRefMATH
25.
Zurück zum Zitat Zhang C, Fu H, Hu Q, Cao X, Xie Y, Tao D, Xu D (2020) Generalized latent multi-view subspace clustering. IEEE Trans Pattern Anal Mach Intell 42:86–99CrossRef Zhang C, Fu H, Hu Q, Cao X, Xie Y, Tao D, Xu D (2020) Generalized latent multi-view subspace clustering. IEEE Trans Pattern Anal Mach Intell 42:86–99CrossRef
26.
Zurück zum Zitat Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2013) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35:171–184CrossRef Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2013) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35:171–184CrossRef
27.
Zurück zum Zitat Bertsekas DP (2014) Constrained optimization and lagrange multiplier methods. Academic press, CambridgeMATH Bertsekas DP (2014) Constrained optimization and lagrange multiplier methods. Academic press, CambridgeMATH
28.
Zurück zum Zitat Iliadis M, Wang H, Molina R, Katsaggelos AK (2017) Robust and low-rank representation for fast face identification with occlusions. IEEE Trans Image Process 26:2203–2218MathSciNetCrossRefMATH Iliadis M, Wang H, Molina R, Katsaggelos AK (2017) Robust and low-rank representation for fast face identification with occlusions. IEEE Trans Image Process 26:2203–2218MathSciNetCrossRefMATH
29.
Zurück zum Zitat Ren Z, Sun Q (2021) Simultaneous global and local graph structure preserving for multiple Kernel clustering. IEEE Trans Neural Netw Learn Syst 32:1839–1851MathSciNetCrossRef Ren Z, Sun Q (2021) Simultaneous global and local graph structure preserving for multiple Kernel clustering. IEEE Trans Neural Netw Learn Syst 32:1839–1851MathSciNetCrossRef
30.
Zurück zum Zitat J. Huang, F. Nie, H. Huang, 2015 A new simplex sparse learning model to measure data similarity for clustering, in: Twenty-fourth International Joint Conference on Artificial Intelligence, pp. 3569–3575 J. Huang, F. Nie, H. Huang, 2015 A new simplex sparse learning model to measure data similarity for clustering, in: Twenty-fourth International Joint Conference on Artificial Intelligence, pp. 3569–3575
31.
Zurück zum Zitat Gao Q, Xia W, Wan Z, Xie D, Zhang P (2020) Tensor-SVD based graph learning for multi-view subspace clustering. Proc AAAI Conf Artif Intell 34:3930–3937 Gao Q, Xia W, Wan Z, Xie D, Zhang P (2020) Tensor-SVD based graph learning for multi-view subspace clustering. Proc AAAI Conf Artif Intell 34:3930–3937
32.
Zurück zum Zitat He X, Yan S, Hu Y, Niyogi P, Zhang H-J (2005) Face recognition using laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27:328–340CrossRef He X, Yan S, Hu Y, Niyogi P, Zhang H-J (2005) Face recognition using laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27:328–340CrossRef
33.
Zurück zum Zitat J. Winn, A. Criminisi, T. Minka, 2005 Object categorization by learned universal visual dictionary, in: Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1, IEEE, pp. 1800–1807 J. Winn, A. Criminisi, T. Minka, 2005 Object categorization by learned universal visual dictionary, in: Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1, IEEE, pp. 1800–1807
34.
Zurück zum Zitat FS Samaria, AC Harter, 1994 Parameterisation of a stochastic model for human face identification, In: Proceedings of 1994 IEEE workshop on applications of computer vision, IEEE, pp. 138–142 FS Samaria, AC Harter, 1994 Parameterisation of a stochastic model for human face identification, In: Proceedings of 1994 IEEE workshop on applications of computer vision, IEEE, pp. 138–142
35.
Zurück zum Zitat van Breukelen M, Duin RP, Tax DM, Den Hartog J (1998) Handwritten digit recognition by combined classifiers. Kybernetika 34:381–386MATH van Breukelen M, Duin RP, Tax DM, Den Hartog J (1998) Handwritten digit recognition by combined classifiers. Kybernetika 34:381–386MATH
36.
Zurück zum Zitat M. Hu, S. Chen, 2018 Doubly Aligned Incomplete Multi-view Clustering, In: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence. pp. 2262–2268. M. Hu, S. Chen, 2018 Doubly Aligned Incomplete Multi-view Clustering, In: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence. pp. 2262–2268.
37.
Zurück zum Zitat J Wen, Z Zhang, Y Xu, B Zhang, L Fei, H Liu, 2019 Unified embedding alignment with missing views inferring for incomplete multi-view clustering. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 5393–5400 J Wen, Z Zhang, Y Xu, B Zhang, L Fei, H Liu, 2019 Unified embedding alignment with missing views inferring for incomplete multi-view clustering. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 5393–5400
38.
Zurück zum Zitat Wen J, Yan K, Zhang Z, Xu Y, Wang J, Fei L, Zhang B (2021) Adaptive graph completion based incomplete multi-view clustering. IEEE Trans Multimedia 23:2493–2504CrossRef Wen J, Yan K, Zhang Z, Xu Y, Wang J, Fei L, Zhang B (2021) Adaptive graph completion based incomplete multi-view clustering. IEEE Trans Multimedia 23:2493–2504CrossRef
Metadaten
Titel
Consensus latent incomplete multi-view clustering with low-rank tensor constraint
verfasst von
Guangyan Ji
Gui-Fu Lu
Publikationsdatum
27.05.2023
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 11/2023
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-023-01866-x

Weitere Artikel der Ausgabe 11/2023

International Journal of Machine Learning and Cybernetics 11/2023 Zur Ausgabe

Neuer Inhalt