Skip to main content
Erschienen in: Pattern Analysis and Applications 3/2023

06.05.2023 | Theoretical Advances

Multi-view clustering indicator learning with scaled similarity

verfasst von: Liang Yao, Gui-Fu Lu

Erschienen in: Pattern Analysis and Applications | Ausgabe 3/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The similarity of data plays an important role in clustering task, and good clustering performance often requires a reliable similarity matrix. A variety of metrics are used to define a similarity matrix in the past, and great achievements are obtained. However, due to the noise and outliers of data in the real world, the quality of the similarity matrix is often poor. Besides, the similarity matrix is often inflexible, which will degrade the clustering performance. To solve this problem, in this paper, we proposed a novel Multi-view Clustering Indicator Learning with Scaled Similarity (MCILSS). Our model uses the self-representation method to reconstruct the data matrix, and then obtain the similarity matrix by minimizing the reconstruction error. More importantly, in our model, we can adjust s \(\left( {0 < s \le 1} \right)\) to constrain the similarity matrix to gain the best clustering indicator matrix. In addition, the rank constraint is further used to improve the clustering performance. Finally, the indicator matrix is applied to obtain clustering results by k-means. Considering the nonlinear relationship in the data, we also proposed the kernel MCILSS which maps the original data to the kernel space. To solve the proposed models, two efficient optimization algorithms based on Augmented Lagrange Method (ALM) are also designed. The experimental results on some data sets show that our algorithm has better clustering performance than some representative algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Elhamifar E and Vidal R (2009) Sparse subspace clustering. In: IEEE Conference on computer vision and pattern recognition, pp 2790–2797 Elhamifar E and Vidal R (2009) Sparse subspace clustering. In: IEEE Conference on computer vision and pattern recognition, pp 2790–2797
2.
Zurück zum Zitat Liu G et al. (2012) Robust and efficient subspace segmentation via least squares regression. In: Springer-Verlag, pp 347–360 Liu G et al. (2012) Robust and efficient subspace segmentation via least squares regression. In: Springer-Verlag, pp 347–360
3.
Zurück zum Zitat Elhamifar E, Vidal R (2012) Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35:2765–2781CrossRef Elhamifar E, Vidal R (2012) Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35:2765–2781CrossRef
4.
Zurück zum Zitat Kang Z et al (2020) Robust graph learning from noisy data. IEEE Int Conf Acoustics, Speech Signal Process 50:1833–1843 Kang Z et al (2020) Robust graph learning from noisy data. IEEE Int Conf Acoustics, Speech Signal Process 50:1833–1843
5.
Zurück zum Zitat Cai D et al. (2011) Graph regularized nonnegative matrix factorization for data representation. In: IEEE Transactions on pattern analysis and machine intelligence, pp 1548–1560 Cai D et al. (2011) Graph regularized nonnegative matrix factorization for data representation. In: IEEE Transactions on pattern analysis and machine intelligence, pp 1548–1560
6.
Zurück zum Zitat Zhou P, et al. (2015) Recovery of corrupted multiple kernels for clustering. In: Proceedings of the twenty-fourth international joint conference on artificial intelligence, pp 4105–4111 Zhou P, et al. (2015) Recovery of corrupted multiple kernels for clustering. In: Proceedings of the twenty-fourth international joint conference on artificial intelligence, pp 4105–4111
7.
Zurück zum Zitat Ren Z and Sun Q (2021) Simultaneous global and local graph structure preserving for multiple kernel clustering. In: IEEE international conference on acoustics, speech and signal processing, pp 4057–4064 Ren Z and Sun Q (2021) Simultaneous global and local graph structure preserving for multiple kernel clustering. In: IEEE international conference on acoustics, speech and signal processing, pp 4057–4064
8.
Zurück zum Zitat Huang J et al. (2013) Spectral rotation versus K-means in spectral clustering. In: Proceedings of the Twenty-Seventh AAAI conference on artificial intelligence, pp 431–437 Huang J et al. (2013) Spectral rotation versus K-means in spectral clustering. In: Proceedings of the Twenty-Seventh AAAI conference on artificial intelligence, pp 431–437
9.
Zurück zum Zitat Wilkin GA and Huang X (2007) K-means clustering algorithms: implementation and comparison. In: Second international multi-symposiums on computer and computational sciences, pp 133–136 Wilkin GA and Huang X (2007) K-means clustering algorithms: implementation and comparison. In: Second international multi-symposiums on computer and computational sciences, pp 133–136
10.
Zurück zum Zitat Austin A et al. (2009) Robust subspace segmentation by low rank representation. In: Proceedings of the 27th international conference on international conference on machine learning, pp 663–670 Austin A et al. (2009) Robust subspace segmentation by low rank representation. In: Proceedings of the 27th international conference on international conference on machine learning, pp 663–670
11.
Zurück zum Zitat Kang Z et al (2020) Structure learning with similarity preserving. Neural Netw 129:138–148CrossRef Kang Z et al (2020) Structure learning with similarity preserving. Neural Netw 129:138–148CrossRef
12.
Zurück zum Zitat Gao H et al. (2015) "Multi-view Subspace Clustering. In: 2015 IEEE international conference on computer vision, Santiago, Chile, pp 4238–4246 Gao H et al. (2015) "Multi-view Subspace Clustering. In: 2015 IEEE international conference on computer vision, Santiago, Chile, pp 4238–4246
13.
Zurück zum Zitat Lele Fu et al (2020) An overview of recent multi-view clustering. Neurocomputing 402:148–161CrossRef Lele Fu et al (2020) An overview of recent multi-view clustering. Neurocomputing 402:148–161CrossRef
14.
Zurück zum Zitat Zheng Q et al (2020) Feature concatenation multi-view subspace clustering. Neurocomputing 379:89–102CrossRef Zheng Q et al (2020) Feature concatenation multi-view subspace clustering. Neurocomputing 379:89–102CrossRef
15.
Zurück zum Zitat Zhang C et al. (2017) Latent multi-view subspace clustering. In: 2017 IEEE conference on computer vision and pattern recognition, pp 4333–4341 Zhang C et al. (2017) Latent multi-view subspace clustering. In: 2017 IEEE conference on computer vision and pattern recognition, pp 4333–4341
16.
Zurück zum Zitat Xie D et al (2020) Adaptive latent similarity learning for multi-view clustering. Neural Netw 121:409–418CrossRef Xie D et al (2020) Adaptive latent similarity learning for multi-view clustering. Neural Netw 121:409–418CrossRef
17.
18.
Zurück zum Zitat Zhang P et al. (2020) Consensus one-step multi-view subspace clustering. In: IEEE transactions on knowledge and data engineering, pp 1–1 Zhang P et al. (2020) Consensus one-step multi-view subspace clustering. In: IEEE transactions on knowledge and data engineering, pp 1–1
19.
Zurück zum Zitat Lin Z et al. (2011) Linearized alternating direction method with adaptive penalty for low-rank representation. In: Advances in neural information processing systems, pp 612–620 Lin Z et al. (2011) Linearized alternating direction method with adaptive penalty for low-rank representation. In: Advances in neural information processing systems, pp 612–620
20.
Zurück zum Zitat Yin M et al (2015) Dual graph regularized latent low-rank representation for subspace clustering. IEEE Trans Image Process 24:4918–4933MathSciNetCrossRefMATH Yin M et al (2015) Dual graph regularized latent low-rank representation for subspace clustering. IEEE Trans Image Process 24:4918–4933MathSciNetCrossRefMATH
21.
Zurück zum Zitat Chao G et al (2021) A survey on multiview clustering. IEEE Trans Artif Intell 2:146–168CrossRef Chao G et al (2021) A survey on multiview clustering. IEEE Trans Artif Intell 2:146–168CrossRef
22.
Zurück zum Zitat Chen M-S et al (2022) Representation learning in multi-view clustering: a literature review. Data Sci Eng 7:225–241CrossRef Chen M-S et al (2022) Representation learning in multi-view clustering: a literature review. Data Sci Eng 7:225–241CrossRef
23.
Zurück zum Zitat Li Y et al (2019) A survey of multi-view representation learning. IEEE Trans Knowl Data Eng 31:1863–1883CrossRef Li Y et al (2019) A survey of multi-view representation learning. IEEE Trans Knowl Data Eng 31:1863–1883CrossRef
24.
Zurück zum Zitat Xu J et al (2021) Scaled simplex representation for subspace clustering. IEEE Trans Cybern 51:1493–1505CrossRef Xu J et al (2021) Scaled simplex representation for subspace clustering. IEEE Trans Cybern 51:1493–1505CrossRef
26.
Zurück zum Zitat Fan K (1950) On a theorem of weyl concerning eigenvalues of linear transformations: II. In: Proceedings of the national academy of sciences of the United States of America, pp 31–35 Fan K (1950) On a theorem of weyl concerning eigenvalues of linear transformations: II. In: Proceedings of the national academy of sciences of the United States of America, pp 31–35
27.
Zurück zum Zitat He B, Yang H (1998) Some convergence properties of a method of multipliers for linearly constrained monotone variational inequalities. Op Res Lett 23:151–161MathSciNetCrossRefMATH He B, Yang H (1998) Some convergence properties of a method of multipliers for linearly constrained monotone variational inequalities. Op Res Lett 23:151–161MathSciNetCrossRefMATH
31.
Zurück zum Zitat Wen J et al (2018) Low-rank representation with adaptive graph regularization. Neural Netw 108:83–96CrossRefMATH Wen J et al (2018) Low-rank representation with adaptive graph regularization. Neural Netw 108:83–96CrossRefMATH
32.
Zurück zum Zitat Iliadis M, et al. (2017) Robust and low-rank representation for fast face identification with occlusions. In: IEEE international conference on acoustics, speech and signal processing, pp 2203–2218 Iliadis M, et al. (2017) Robust and low-rank representation for fast face identification with occlusions. In: IEEE international conference on acoustics, speech and signal processing, pp 2203–2218
33.
Zurück zum Zitat Elhamifar E et al. (2016) Dissimilarity-based sparse subset selection. In: IEEE Transactions on pattern analysis and machine intelligence, pp 2182–2197 Elhamifar E et al. (2016) Dissimilarity-based sparse subset selection. In: IEEE Transactions on pattern analysis and machine intelligence, pp 2182–2197
34.
Zurück zum Zitat Michelot C (1986) A finite algorithm for finding the projection of a point onto the canonical simplex of RN. J Optim Theory Appl 50:195–200MathSciNetCrossRefMATH Michelot C (1986) A finite algorithm for finding the projection of a point onto the canonical simplex of RN. J Optim Theory Appl 50:195–200MathSciNetCrossRefMATH
35.
Zurück zum Zitat Duchi J et al. (2008) Efficient projections onto the L1-Ball for learning in high dimensions. In: Proceedings of the 25th international conference on machine learning, pp. 272–279 Duchi J et al. (2008) Efficient projections onto the L1-Ball for learning in high dimensions. In: Proceedings of the 25th international conference on machine learning, pp. 272–279
36.
Zurück zum Zitat Kuybeda O et al (2013) A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. J Struct Biol 181:116–127CrossRef Kuybeda O et al (2013) A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. J Struct Biol 181:116–127CrossRef
37.
Zurück zum Zitat Wang Q et al. (2019) Spectral embedded adaptive neighbors clustering. In: IEEE transactions on neural networks and learning systems, pp 1265–1271 Wang Q et al. (2019) Spectral embedded adaptive neighbors clustering. In: IEEE transactions on neural networks and learning systems, pp 1265–1271
38.
Zurück zum Zitat Chen M et al. (2020) Multi-view clustering in latent embedding space. In: AAAI Chen M et al. (2020) Multi-view clustering in latent embedding space. In: AAAI
39.
Zurück zum Zitat Wang Y et al. (2015) Consistent multiple graph embedding for multi-view clustering. In: IEEE transactions on multimedia Wang Y et al. (2015) Consistent multiple graph embedding for multi-view clustering. In: IEEE transactions on multimedia
40.
Zurück zum Zitat Guowang Du et al (2021) Deep multiple auto-encoder-based multi-view clustering. Data Sci Eng 6:323–338CrossRef Guowang Du et al (2021) Deep multiple auto-encoder-based multi-view clustering. Data Sci Eng 6:323–338CrossRef
Metadaten
Titel
Multi-view clustering indicator learning with scaled similarity
verfasst von
Liang Yao
Gui-Fu Lu
Publikationsdatum
06.05.2023
Verlag
Springer London
Erschienen in
Pattern Analysis and Applications / Ausgabe 3/2023
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-023-01167-7

Weitere Artikel der Ausgabe 3/2023

Pattern Analysis and Applications 3/2023 Zur Ausgabe

Premium Partner