Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 12/2023

05.06.2023 | Original Article

Incomplete multi-view clustering via attention-based contrast learning

verfasst von: Yanhao Zhang, Changming Zhu

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 12/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multi-view clustering (MVC) is an essential and challenging task in machine learning and data mining. In recent years, this field has attracted a lot of attention and achieved remarkable results. The success of multi-view clustering relies heavily on the consistency and integrity of data views to ensure complete data information. In the process of data collection and transmission, data inevitably be lost, which leads to the occurrence of partial view unalignment (VN) and partial view missing (VM). This situation reduces the available information and increases the difficulty of joint learning of multi-view data. To address the incomplete information problem, in this article, we present a novel incomplete multi-view clustering via attention-based contrast learning framework (MCAC) to address the VN and VM puzzles. Due to the diversity of different views, negative samples are formed by randomly selecting some cross-view samples from positive samples, then computing the correlation between local features and latent features for each view by maximizing mutual information and, fusing each specific low-dimensional representation into a joint representation through an attention fusion layer, in addition, adding noise contrast loss reduces or even eliminates the effect of negative samples. MCAC conducts experiments on seven multi-view datasets and demonstrates the effectiveness compared to eleven state-of-the-art methods on the multi-view clustering task.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Lu C, Lin Z, Yan S (2016) Convex sparse spectral clustering: single-view to multi-view. IEEE Trans Image Process 25(6):2833–2843MathSciNetCrossRefMATH Lu C, Lin Z, Yan S (2016) Convex sparse spectral clustering: single-view to multi-view. IEEE Trans Image Process 25(6):2833–2843MathSciNetCrossRefMATH
2.
Zurück zum Zitat Noori M, Bahri A, Mohammadi K (2019) Attention-guided version of 2D unet for automatic brain tumor segmentation. International Conference on Computer and Knowledge Engineering (ICCKE), pp 269–275 Noori M, Bahri A, Mohammadi K (2019) Attention-guided version of 2D unet for automatic brain tumor segmentation. International Conference on Computer and Knowledge Engineering (ICCKE), pp 269–275
4.
Zurück zum Zitat Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: NIPS (11):6000–6010 Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: NIPS (11):6000–6010
6.
Zurück zum Zitat Eric E, Marie D, Sara J (2014) Multi-view constrained clustering with an incomplete mapping between views. Knowl Inf Syst 38(1):231–257CrossRef Eric E, Marie D, Sara J (2014) Multi-view constrained clustering with an incomplete mapping between views. Knowl Inf Syst 38(1):231–257CrossRef
9.
Zurück zum Zitat Shao W, He L, Yu PS (2015) Multiple incomplete views clustering via weighted nonnegative matrix factorization with L2,1 regularization. ECML/PKDD. Springer, pp 318–334 Shao W, He L, Yu PS (2015) Multiple incomplete views clustering via weighted nonnegative matrix factorization with L2,1 regularization. ECML/PKDD. Springer, pp 318–334
11.
Zurück zum Zitat Xie M, Ye Z, Pan G, Liu X (2021) Incomplete multi-view subspace clustering with adaptive instance-sample mapping and deep feature fusion. Appl Intell 51(8):5584–5597CrossRef Xie M, Ye Z, Pan G, Liu X (2021) Incomplete multi-view subspace clustering with adaptive instance-sample mapping and deep feature fusion. Appl Intell 51(8):5584–5597CrossRef
12.
Zurück zum Zitat Wen J, Xu Y, Liu H (2020) Incomplete multiview spectral clustering with adaptive graph learning. IEEE Trans Cybern 50(4):1418–1429CrossRef Wen J, Xu Y, Liu H (2020) Incomplete multiview spectral clustering with adaptive graph learning. IEEE Trans Cybern 50(4):1418–1429CrossRef
13.
Zurück zum Zitat Xia D, Yang Y, Yang S, Li T (2023) Incomplete multi-view clustering via Kernelized graph learning. Inf Sci 625:1–19CrossRef Xia D, Yang Y, Yang S, Li T (2023) Incomplete multi-view clustering via Kernelized graph learning. Inf Sci 625:1–19CrossRef
14.
Zurück zum Zitat Xia D, Yang Y, Yang S (2023) Incomplete multi-view clustering via auto-weighted fusion in partition space. Tsinghua Sci Technol 28(3):595–611CrossRef Xia D, Yang Y, Yang S (2023) Incomplete multi-view clustering via auto-weighted fusion in partition space. Tsinghua Sci Technol 28(3):595–611CrossRef
16.
Zurück zum Zitat Du G, Zhou L, Yang Y, Lü K, Wang L (2021) Deep multiple auto-encoder-based multi-view clustering. Data Sci Eng 6(3):323–338CrossRef Du G, Zhou L, Yang Y, Lü K, Wang L (2021) Deep multiple auto-encoder-based multi-view clustering. Data Sci Eng 6(3):323–338CrossRef
18.
Zurück zum Zitat Wen J, Zhang Z, Xu Y, Zhang B, Fei L, Xie GS (2020) CDIMC-net: cognitive deep incomplete multi-view clustering network. In: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, pp 3230–3236 Wen J, Zhang Z, Xu Y, Zhang B, Fei L, Xie GS (2020) CDIMC-net: cognitive deep incomplete multi-view clustering network. In: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, pp 3230–3236
19.
Zurück zum Zitat Hyvarinen A, Morioka H (2016) Unsupervised feature extraction by time-contrastive learning and nonlinear ica. NIPS’16, pp 3772–3780 Hyvarinen A, Morioka H (2016) Unsupervised feature extraction by time-contrastive learning and nonlinear ica. NIPS’16, pp 3772–3780
20.
Zurück zum Zitat Zhu C, Miao D (2020) Entropy-based multi-view matrix completion for clustering with side information. Pattern Anal Appl 23(1):359–370MathSciNetCrossRef Zhu C, Miao D (2020) Entropy-based multi-view matrix completion for clustering with side information. Pattern Anal Appl 23(1):359–370MathSciNetCrossRef
25.
Zurück zum Zitat Kraskov A, Stögbauer H, Andrzejak RG, Grassberger P (2005) Hierarchical clustering using mutual information. Europhysics Lett (EPL) 70(2):278–284MathSciNetCrossRef Kraskov A, Stögbauer H, Andrzejak RG, Grassberger P (2005) Hierarchical clustering using mutual information. Europhysics Lett (EPL) 70(2):278–284MathSciNetCrossRef
26.
Zurück zum Zitat Alush A, Friedman A, Goldberger J (2016) Pairwise clustering based on the mutual-information criterion. Neurocomputing 182:284–293CrossRef Alush A, Friedman A, Goldberger J (2016) Pairwise clustering based on the mutual-information criterion. Neurocomputing 182:284–293CrossRef
28.
Zurück zum Zitat Lin Y, Gou Y, Liu Z, Li B, Lv J, Peng X (2021) COMPLETER: incomplete multi-view clustering via contrastive prediction. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 11169–11178 Lin Y, Gou Y, Liu Z, Li B, Lv J, Peng X (2021) COMPLETER: incomplete multi-view clustering via contrastive prediction. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 11169–11178
29.
Zurück zum Zitat Kumar A, Rai P, Daume H (2011) Co-regularized multi-view spectral clustering. Neural Information Processing Systems. Curran Associates Inc, pp 1413–1421 Kumar A, Rai P, Daume H (2011) Co-regularized multi-view spectral clustering. Neural Information Processing Systems. Curran Associates Inc, pp 1413–1421
30.
Zurück zum Zitat Vinokourov A, Shawe-Taylor J, Cristianini N (2003) Inferring a semantic representation of text via cross-language correlation analysis. NIPS, pp 1497–1504 Vinokourov A, Shawe-Taylor J, Cristianini N (2003) Inferring a semantic representation of text via cross-language correlation analysis. NIPS, pp 1497–1504
31.
Zurück zum Zitat Andrew G, Arora R, Bilmes J, Livescu K (2013) Deep canonical correlation analysis. Int Conf Int Conf Mach Learn 28(3):1247–1255 Andrew G, Arora R, Bilmes J, Livescu K (2013) Deep canonical correlation analysis. Int Conf Int Conf Mach Learn 28(3):1247–1255
32.
Zurück zum Zitat Bach FR, Jordan MI (2002) Kernel independent component analysis. J Mach Learn Res 3(1):1–48MathSciNetMATH Bach FR, Jordan MI (2002) Kernel independent component analysis. J Mach Learn Res 3(1):1–48MathSciNetMATH
33.
Zurück zum Zitat Wang W, Arora R, Livescu K, Bilmes J (2016) On deep multi-view representation learning: objectives and optimization. In ICML, pp 1083–1092 Wang W, Arora R, Livescu K, Bilmes J (2016) On deep multi-view representation learning: objectives and optimization. In ICML, pp 1083–1092
34.
Zurück zum Zitat Zhang Z, Liu L, Shen F, Shen H, Shao L (2019) Binary multi-view clustering. IEEE Trans Pattern Anal Mach Intell 41(7):1774–1782CrossRef Zhang Z, Liu L, Shen F, Shen H, Shao L (2019) Binary multi-view clustering. IEEE Trans Pattern Anal Mach Intell 41(7):1774–1782CrossRef
35.
Zurück zum Zitat Zhang C, Liu Y, Fu H (2019) Ae2-nets: autoencoder in autoencoder networks. In CVPR, pp 2577–2585 Zhang C, Liu Y, Fu H (2019) Ae2-nets: autoencoder in autoencoder networks. In CVPR, pp 2577–2585
36.
Zurück zum Zitat Liu X, Li M, Tang C, Xia J, Xiong J, Liu L, Kloft M, Zhu E (2021) Efficient and effective regularized incomplete multi-view clustering. IEEE Trans Pattern Anal Mach Intell 43(8):2634–2646 Liu X, Li M, Tang C, Xia J, Xiong J, Liu L, Kloft M, Zhu E (2021) Efficient and effective regularized incomplete multi-view clustering. IEEE Trans Pattern Anal Mach Intell 43(8):2634–2646
37.
Zurück zum Zitat Hu M, Chen S (2019) Doubly aligned incomplete multi-view clustering. In: Twenty-Seventh International Joint Conference on Artificial Intelligence, pp 2262–2268 Hu M, Chen S (2019) Doubly aligned incomplete multi-view clustering. In: Twenty-Seventh International Joint Conference on Artificial Intelligence, pp 2262–2268
38.
Zurück zum Zitat Huang Z, Hu P, Zhou JT, Lv J, Peng X (2020) Partially view-aligned clustering. NeurIPS Huang Z, Hu P, Zhou JT, Lv J, Peng X (2020) Partially view-aligned clustering. NeurIPS
41.
Zurück zum Zitat Zhao H, Ding Z, Fu Y (2017) Multi-view clustering via deep matrix factorization. In AAAI, pp 2921–2927 Zhao H, Ding Z, Fu Y (2017) Multi-view clustering via deep matrix factorization. In AAAI, pp 2921–2927
42.
Zurück zum Zitat Nie F, Li J, Li X (2017) Self-weighted multiview clustering with multiple graphs. In: Twenty-Sixth International Joint Conference on Artificial Intelligence, pp 2564–2570 Nie F, Li J, Li X (2017) Self-weighted multiview clustering with multiple graphs. In: Twenty-Sixth International Joint Conference on Artificial Intelligence, pp 2564–2570
43.
Zurück zum Zitat Yang M, Li Y, Huang Z, Liu Z, Hu P, Peng X (2021) Partially view-aligned representation learning with noise-robust contrastive loss. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 1134–1143 Yang M, Li Y, Huang Z, Liu Z, Hu P, Peng X (2021) Partially view-aligned representation learning with noise-robust contrastive loss. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 1134–1143
Metadaten
Titel
Incomplete multi-view clustering via attention-based contrast learning
verfasst von
Yanhao Zhang
Changming Zhu
Publikationsdatum
05.06.2023
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 12/2023
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-023-01883-w

Weitere Artikel der Ausgabe 12/2023

International Journal of Machine Learning and Cybernetics 12/2023 Zur Ausgabe

Neuer Inhalt