Skip to main content
Top
Published in: Pattern Analysis and Applications 3/2023

06-05-2023 | Theoretical Advances

Multi-view clustering indicator learning with scaled similarity

Authors: Liang Yao, Gui-Fu Lu

Published in: Pattern Analysis and Applications | Issue 3/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The similarity of data plays an important role in clustering task, and good clustering performance often requires a reliable similarity matrix. A variety of metrics are used to define a similarity matrix in the past, and great achievements are obtained. However, due to the noise and outliers of data in the real world, the quality of the similarity matrix is often poor. Besides, the similarity matrix is often inflexible, which will degrade the clustering performance. To solve this problem, in this paper, we proposed a novel Multi-view Clustering Indicator Learning with Scaled Similarity (MCILSS). Our model uses the self-representation method to reconstruct the data matrix, and then obtain the similarity matrix by minimizing the reconstruction error. More importantly, in our model, we can adjust s \(\left( {0 < s \le 1} \right)\) to constrain the similarity matrix to gain the best clustering indicator matrix. In addition, the rank constraint is further used to improve the clustering performance. Finally, the indicator matrix is applied to obtain clustering results by k-means. Considering the nonlinear relationship in the data, we also proposed the kernel MCILSS which maps the original data to the kernel space. To solve the proposed models, two efficient optimization algorithms based on Augmented Lagrange Method (ALM) are also designed. The experimental results on some data sets show that our algorithm has better clustering performance than some representative algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Elhamifar E and Vidal R (2009) Sparse subspace clustering. In: IEEE Conference on computer vision and pattern recognition, pp 2790–2797 Elhamifar E and Vidal R (2009) Sparse subspace clustering. In: IEEE Conference on computer vision and pattern recognition, pp 2790–2797
2.
go back to reference Liu G et al. (2012) Robust and efficient subspace segmentation via least squares regression. In: Springer-Verlag, pp 347–360 Liu G et al. (2012) Robust and efficient subspace segmentation via least squares regression. In: Springer-Verlag, pp 347–360
3.
go back to reference Elhamifar E, Vidal R (2012) Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35:2765–2781CrossRef Elhamifar E, Vidal R (2012) Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35:2765–2781CrossRef
4.
go back to reference Kang Z et al (2020) Robust graph learning from noisy data. IEEE Int Conf Acoustics, Speech Signal Process 50:1833–1843 Kang Z et al (2020) Robust graph learning from noisy data. IEEE Int Conf Acoustics, Speech Signal Process 50:1833–1843
5.
go back to reference Cai D et al. (2011) Graph regularized nonnegative matrix factorization for data representation. In: IEEE Transactions on pattern analysis and machine intelligence, pp 1548–1560 Cai D et al. (2011) Graph regularized nonnegative matrix factorization for data representation. In: IEEE Transactions on pattern analysis and machine intelligence, pp 1548–1560
6.
go back to reference Zhou P, et al. (2015) Recovery of corrupted multiple kernels for clustering. In: Proceedings of the twenty-fourth international joint conference on artificial intelligence, pp 4105–4111 Zhou P, et al. (2015) Recovery of corrupted multiple kernels for clustering. In: Proceedings of the twenty-fourth international joint conference on artificial intelligence, pp 4105–4111
7.
go back to reference Ren Z and Sun Q (2021) Simultaneous global and local graph structure preserving for multiple kernel clustering. In: IEEE international conference on acoustics, speech and signal processing, pp 4057–4064 Ren Z and Sun Q (2021) Simultaneous global and local graph structure preserving for multiple kernel clustering. In: IEEE international conference on acoustics, speech and signal processing, pp 4057–4064
8.
go back to reference Huang J et al. (2013) Spectral rotation versus K-means in spectral clustering. In: Proceedings of the Twenty-Seventh AAAI conference on artificial intelligence, pp 431–437 Huang J et al. (2013) Spectral rotation versus K-means in spectral clustering. In: Proceedings of the Twenty-Seventh AAAI conference on artificial intelligence, pp 431–437
9.
go back to reference Wilkin GA and Huang X (2007) K-means clustering algorithms: implementation and comparison. In: Second international multi-symposiums on computer and computational sciences, pp 133–136 Wilkin GA and Huang X (2007) K-means clustering algorithms: implementation and comparison. In: Second international multi-symposiums on computer and computational sciences, pp 133–136
10.
go back to reference Austin A et al. (2009) Robust subspace segmentation by low rank representation. In: Proceedings of the 27th international conference on international conference on machine learning, pp 663–670 Austin A et al. (2009) Robust subspace segmentation by low rank representation. In: Proceedings of the 27th international conference on international conference on machine learning, pp 663–670
11.
go back to reference Kang Z et al (2020) Structure learning with similarity preserving. Neural Netw 129:138–148CrossRef Kang Z et al (2020) Structure learning with similarity preserving. Neural Netw 129:138–148CrossRef
12.
go back to reference Gao H et al. (2015) "Multi-view Subspace Clustering. In: 2015 IEEE international conference on computer vision, Santiago, Chile, pp 4238–4246 Gao H et al. (2015) "Multi-view Subspace Clustering. In: 2015 IEEE international conference on computer vision, Santiago, Chile, pp 4238–4246
13.
go back to reference Lele Fu et al (2020) An overview of recent multi-view clustering. Neurocomputing 402:148–161CrossRef Lele Fu et al (2020) An overview of recent multi-view clustering. Neurocomputing 402:148–161CrossRef
14.
go back to reference Zheng Q et al (2020) Feature concatenation multi-view subspace clustering. Neurocomputing 379:89–102CrossRef Zheng Q et al (2020) Feature concatenation multi-view subspace clustering. Neurocomputing 379:89–102CrossRef
15.
go back to reference Zhang C et al. (2017) Latent multi-view subspace clustering. In: 2017 IEEE conference on computer vision and pattern recognition, pp 4333–4341 Zhang C et al. (2017) Latent multi-view subspace clustering. In: 2017 IEEE conference on computer vision and pattern recognition, pp 4333–4341
16.
go back to reference Xie D et al (2020) Adaptive latent similarity learning for multi-view clustering. Neural Netw 121:409–418CrossRef Xie D et al (2020) Adaptive latent similarity learning for multi-view clustering. Neural Netw 121:409–418CrossRef
18.
go back to reference Zhang P et al. (2020) Consensus one-step multi-view subspace clustering. In: IEEE transactions on knowledge and data engineering, pp 1–1 Zhang P et al. (2020) Consensus one-step multi-view subspace clustering. In: IEEE transactions on knowledge and data engineering, pp 1–1
19.
go back to reference Lin Z et al. (2011) Linearized alternating direction method with adaptive penalty for low-rank representation. In: Advances in neural information processing systems, pp 612–620 Lin Z et al. (2011) Linearized alternating direction method with adaptive penalty for low-rank representation. In: Advances in neural information processing systems, pp 612–620
20.
go back to reference Yin M et al (2015) Dual graph regularized latent low-rank representation for subspace clustering. IEEE Trans Image Process 24:4918–4933MathSciNetCrossRefMATH Yin M et al (2015) Dual graph regularized latent low-rank representation for subspace clustering. IEEE Trans Image Process 24:4918–4933MathSciNetCrossRefMATH
21.
go back to reference Chao G et al (2021) A survey on multiview clustering. IEEE Trans Artif Intell 2:146–168CrossRef Chao G et al (2021) A survey on multiview clustering. IEEE Trans Artif Intell 2:146–168CrossRef
22.
go back to reference Chen M-S et al (2022) Representation learning in multi-view clustering: a literature review. Data Sci Eng 7:225–241CrossRef Chen M-S et al (2022) Representation learning in multi-view clustering: a literature review. Data Sci Eng 7:225–241CrossRef
23.
go back to reference Li Y et al (2019) A survey of multi-view representation learning. IEEE Trans Knowl Data Eng 31:1863–1883CrossRef Li Y et al (2019) A survey of multi-view representation learning. IEEE Trans Knowl Data Eng 31:1863–1883CrossRef
24.
go back to reference Xu J et al (2021) Scaled simplex representation for subspace clustering. IEEE Trans Cybern 51:1493–1505CrossRef Xu J et al (2021) Scaled simplex representation for subspace clustering. IEEE Trans Cybern 51:1493–1505CrossRef
26.
go back to reference Fan K (1950) On a theorem of weyl concerning eigenvalues of linear transformations: II. In: Proceedings of the national academy of sciences of the United States of America, pp 31–35 Fan K (1950) On a theorem of weyl concerning eigenvalues of linear transformations: II. In: Proceedings of the national academy of sciences of the United States of America, pp 31–35
27.
go back to reference He B, Yang H (1998) Some convergence properties of a method of multipliers for linearly constrained monotone variational inequalities. Op Res Lett 23:151–161MathSciNetCrossRefMATH He B, Yang H (1998) Some convergence properties of a method of multipliers for linearly constrained monotone variational inequalities. Op Res Lett 23:151–161MathSciNetCrossRefMATH
31.
go back to reference Wen J et al (2018) Low-rank representation with adaptive graph regularization. Neural Netw 108:83–96CrossRefMATH Wen J et al (2018) Low-rank representation with adaptive graph regularization. Neural Netw 108:83–96CrossRefMATH
32.
go back to reference Iliadis M, et al. (2017) Robust and low-rank representation for fast face identification with occlusions. In: IEEE international conference on acoustics, speech and signal processing, pp 2203–2218 Iliadis M, et al. (2017) Robust and low-rank representation for fast face identification with occlusions. In: IEEE international conference on acoustics, speech and signal processing, pp 2203–2218
33.
go back to reference Elhamifar E et al. (2016) Dissimilarity-based sparse subset selection. In: IEEE Transactions on pattern analysis and machine intelligence, pp 2182–2197 Elhamifar E et al. (2016) Dissimilarity-based sparse subset selection. In: IEEE Transactions on pattern analysis and machine intelligence, pp 2182–2197
34.
go back to reference Michelot C (1986) A finite algorithm for finding the projection of a point onto the canonical simplex of RN. J Optim Theory Appl 50:195–200MathSciNetCrossRefMATH Michelot C (1986) A finite algorithm for finding the projection of a point onto the canonical simplex of RN. J Optim Theory Appl 50:195–200MathSciNetCrossRefMATH
35.
go back to reference Duchi J et al. (2008) Efficient projections onto the L1-Ball for learning in high dimensions. In: Proceedings of the 25th international conference on machine learning, pp. 272–279 Duchi J et al. (2008) Efficient projections onto the L1-Ball for learning in high dimensions. In: Proceedings of the 25th international conference on machine learning, pp. 272–279
36.
go back to reference Kuybeda O et al (2013) A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. J Struct Biol 181:116–127CrossRef Kuybeda O et al (2013) A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. J Struct Biol 181:116–127CrossRef
37.
go back to reference Wang Q et al. (2019) Spectral embedded adaptive neighbors clustering. In: IEEE transactions on neural networks and learning systems, pp 1265–1271 Wang Q et al. (2019) Spectral embedded adaptive neighbors clustering. In: IEEE transactions on neural networks and learning systems, pp 1265–1271
38.
go back to reference Chen M et al. (2020) Multi-view clustering in latent embedding space. In: AAAI Chen M et al. (2020) Multi-view clustering in latent embedding space. In: AAAI
39.
go back to reference Wang Y et al. (2015) Consistent multiple graph embedding for multi-view clustering. In: IEEE transactions on multimedia Wang Y et al. (2015) Consistent multiple graph embedding for multi-view clustering. In: IEEE transactions on multimedia
40.
go back to reference Guowang Du et al (2021) Deep multiple auto-encoder-based multi-view clustering. Data Sci Eng 6:323–338CrossRef Guowang Du et al (2021) Deep multiple auto-encoder-based multi-view clustering. Data Sci Eng 6:323–338CrossRef
Metadata
Title
Multi-view clustering indicator learning with scaled similarity
Authors
Liang Yao
Gui-Fu Lu
Publication date
06-05-2023
Publisher
Springer London
Published in
Pattern Analysis and Applications / Issue 3/2023
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-023-01167-7

Other articles of this Issue 3/2023

Pattern Analysis and Applications 3/2023 Go to the issue

Premium Partner