Skip to main content
Top
Published in: Neural Processing Letters 1/2022

01-09-2021

Multi-view Clustering Based on Low-rank Representation and Adaptive Graph Learning

Authors: Yixuan Huang, Qingjiang Xiao, Shiqiang Du, Yao Yu

Published in: Neural Processing Letters | Issue 1/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The multi-view algorithm based on graph learning pays attention to the manifold structure of data and shows good performance in clustering task. However, multi-view data usually contains noise, which reduces the robustness of the multi-view clustering algorithm. Besides, any single local information cannot adequately express the whole frame perfectly. Graph learning method often ignores the global structure of data, resulting in suboptimal clustering effect. In order to address the above problems, we propose a novel multi-view clustering model, namely multi-view clustering based on low-rank representation and adaptive graph learning (LRAGL). The noise and outliers in the original data are considered when constructing the graph and the adaptive learning graphs are employed to describe the relationship between samples. Specifically, LRAGL enjoys the following advantages: (1) The graph constructed on the low-rank representation coefficients after filtering out the noise can more accurately reveal the relationship between the samples; (2) Both the global structure (low-rank constraints) and the local structure (adaptive neighbors learning) in the multi-view data are captured; (3) The filtering of noise and the construction of the similarity graph of each view data are integrated into a framework to obtain the overall optimal solution; LRAGL model can be optimized efficiently by utilizing the augmented Lagrangian multiplier with Alternating Direction Minimization Method (ADMM). Extensive experimental results on six benchmark datasets verify the superiority of the proposed method in clustering.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Peng C, Kang Z, Cheng Q (2017) Subspace clustering via variance regularized ridge regression. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2931–2940 Peng C, Kang Z, Cheng Q (2017) Subspace clustering via variance regularized ridge regression. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2931–2940
2.
go back to reference Ren Y, Hu K, Dai X, Pan L, Hoi SC, Xu Z (2019) Semi-supervised deep embedded clustering. Neurocomputing 325:121–130CrossRef Ren Y, Hu K, Dai X, Pan L, Hoi SC, Xu Z (2019) Semi-supervised deep embedded clustering. Neurocomputing 325:121–130CrossRef
3.
go back to reference Chen X, Hong W, Nie F, He D, Yang M, Huang J (2018) Directly minimizing normalized cut for large scale data. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining, KDD-18, pp 1206–1215 Chen X, Hong W, Nie F, He D, Yang M, Huang J (2018) Directly minimizing normalized cut for large scale data. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining, KDD-18, pp 1206–1215
4.
go back to reference Kang Z, Pan H, Hoi SC, Xu Z (2019) Robust graph learning from noisy data. IEEE Trans Cybern 50(5):1833–1843CrossRef Kang Z, Pan H, Hoi SC, Xu Z (2019) Robust graph learning from noisy data. IEEE Trans Cybern 50(5):1833–1843CrossRef
5.
go back to reference Hu Z, Nie F, Chang W, Hao S, Wang R, Li X (2020) Multi-view spectral clustering via sparse graph learning. Neurocomputing 384:1–10CrossRef Hu Z, Nie F, Chang W, Hao S, Wang R, Li X (2020) Multi-view spectral clustering via sparse graph learning. Neurocomputing 384:1–10CrossRef
6.
go back to reference Huang S, Ren Y, Xu Z (2018) Robust multi-view data clustering with multi-view capped-norm k-means. Neurocomputing 311:197–208CrossRef Huang S, Ren Y, Xu Z (2018) Robust multi-view data clustering with multi-view capped-norm k-means. Neurocomputing 311:197–208CrossRef
7.
go back to reference Du L, Zhou P, Shi L, Wang H, Fan M, Wang W, Shen YD (2015) Robust multiple kernel k-means using l21-norm. In: IJCAI Du L, Zhou P, Shi L, Wang H, Fan M, Wang W, Shen YD (2015) Robust multiple kernel k-means using l21-norm. In: IJCAI
8.
go back to reference Peng C, Kang Z, Cai S, Cheng Q (2018) Integrate and conquer: double-sided two-dimensional k-means via integrating of projection and manifold construction. ACM Trans Intell Syst Technol (TIST) 9(5):1–25 Peng C, Kang Z, Cai S, Cheng Q (2018) Integrate and conquer: double-sided two-dimensional k-means via integrating of projection and manifold construction. ACM Trans Intell Syst Technol (TIST) 9(5):1–25
9.
go back to reference Cai X, Nie F, Huang H (2013) Multi-view k-means clustering on big data. In: IJCAI Cai X, Nie F, Huang H (2013) Multi-view k-means clustering on big data. In: IJCAI
10.
go back to reference Wang Y, Wu L, Lin X, Gao J (2018) Multiview spectral clustering via structured low-rank matrix factorization. IEEE Trans Neural Netw Learn Syst 29(10):4833–4843CrossRef Wang Y, Wu L, Lin X, Gao J (2018) Multiview spectral clustering via structured low-rank matrix factorization. IEEE Trans Neural Netw Learn Syst 29(10):4833–4843CrossRef
11.
go back to reference Nie F, Wang X, Jordan MI, Huang H (2016) The constrained laplacian rank algorithm for graph-based clustering. In: AAAI, Citeseer, pp 1969–1976 Nie F, Wang X, Jordan MI, Huang H (2016) The constrained laplacian rank algorithm for graph-based clustering. In: AAAI, Citeseer, pp 1969–1976
12.
go back to reference Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRef Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRef
13.
go back to reference Saha M (2013) A graph based approach to multiview clustering. In: International conference on pattern recognition and machine intelligence, Springer, pp 128–133 Saha M (2013) A graph based approach to multiview clustering. In: International conference on pattern recognition and machine intelligence, Springer, pp 128–133
14.
go back to reference Zhan K, Chang X, Guan J, Chen L, Ma Z, Yang Y (2018) Adaptive structure discovery for multimedia analysis using multiple features. IEEE Trans Cybern 49(5):1826–1834CrossRef Zhan K, Chang X, Guan J, Chen L, Ma Z, Yang Y (2018) Adaptive structure discovery for multimedia analysis using multiple features. IEEE Trans Cybern 49(5):1826–1834CrossRef
15.
go back to reference Tang C, Zhu X, Liu X, Li M, Wang P, Zhang C, Wang L (2018) Learning a joint affinity graph for multiview subspace clustering. IEEE Trans Multimed 21(7):1724–1736CrossRef Tang C, Zhu X, Liu X, Li M, Wang P, Zhang C, Wang L (2018) Learning a joint affinity graph for multiview subspace clustering. IEEE Trans Multimed 21(7):1724–1736CrossRef
16.
go back to reference Jain M, Murty MN et al (1999) Flynn: data clustering: a review. ACM Comput Surv 31(3):264–323CrossRef Jain M, Murty MN et al (1999) Flynn: data clustering: a review. ACM Comput Surv 31(3):264–323CrossRef
17.
go back to reference Wang H, Yang Y, Liu B, Fujita H (2019) A study of graph-based system for multi-view clustering. Knowl-Based Syst 163:1009–1019CrossRef Wang H, Yang Y, Liu B, Fujita H (2019) A study of graph-based system for multi-view clustering. Knowl-Based Syst 163:1009–1019CrossRef
18.
go back to reference Nie F, Wang X, Huang H (2014) Clustering and projected clustering with adaptive neighbors. In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 977–986 Nie F, Wang X, Huang H (2014) Clustering and projected clustering with adaptive neighbors. In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 977–986
19.
go back to reference Zhang L, Zhang Q, Du B, You J, Tao D (2017) Adaptive manifold regularized matrix factorization for data clustering. In: IJCAI, pp 3399–3405 Zhang L, Zhang Q, Du B, You J, Tao D (2017) Adaptive manifold regularized matrix factorization for data clustering. In: IJCAI, pp 3399–3405
20.
go back to reference Liu X, Wang L, Zhang J, Yin J, Liu H (2013) Global and local structure preservation for feature selection. IEEE Trans Neural Netw Learn Syst 25(6):1083–1095 Liu X, Wang L, Zhang J, Yin J, Liu H (2013) Global and local structure preservation for feature selection. IEEE Trans Neural Netw Learn Syst 25(6):1083–1095
21.
go back to reference Nie F, Cai G, Li X (2017) Multi-view clustering and semi-supervised classification with adaptive neighbours. In: Proceedings of the thirty-first AAAI conference on artificial intelligence, pp 2408–2414 Nie F, Cai G, Li X (2017) Multi-view clustering and semi-supervised classification with adaptive neighbours. In: Proceedings of the thirty-first AAAI conference on artificial intelligence, pp 2408–2414
22.
go back to reference Hou C, Nie F, Tao H, Yi D (2017) Multi-view unsupervised feature selection with adaptive similarity and view weight. IEEE Trans Knowl Data Eng 29(9):1998–2011CrossRef Hou C, Nie F, Tao H, Yi D (2017) Multi-view unsupervised feature selection with adaptive similarity and view weight. IEEE Trans Knowl Data Eng 29(9):1998–2011CrossRef
23.
go back to reference Nie F, Li J, Li X, et al. (2017) Self-weighted multiview clustering with multiple graphs. In: IJCAI, pp 2564–2570 Nie F, Li J, Li X, et al. (2017) Self-weighted multiview clustering with multiple graphs. In: IJCAI, pp 2564–2570
24.
go back to reference Tao H, Hou C, Zhu J, Yi D (2017) Multi-view clustering with adaptively learned graph. In: Asian conference on machine learning, pp 113–128 Tao H, Hou C, Zhu J, Yi D (2017) Multi-view clustering with adaptively learned graph. In: Asian conference on machine learning, pp 113–128
25.
go back to reference Zhan K, Zhang C, Guan J, Wang J (2017) Graph learning for multiview clustering. IEEE Trans Cybern 48(10):2887–2895CrossRef Zhan K, Zhang C, Guan J, Wang J (2017) Graph learning for multiview clustering. IEEE Trans Cybern 48(10):2887–2895CrossRef
26.
go back to reference Liu G, Lin Z, Yu Y (2010) Robust subspace segmentation by low-rank representation. In: Proceedings of the 27th international conference on machine learning, pp 663–670 Liu G, Lin Z, Yu Y (2010) Robust subspace segmentation by low-rank representation. In: Proceedings of the 27th international conference on machine learning, pp 663–670
27.
go back to reference Lu C, Tang J, Lin M, Lin L, Yan S, Lin Z (2013) Correntropy induced l2 graph for robust subspace clustering. In: Proceedings of IEEE international conference on computer vision, pp 1801–1808 Lu C, Tang J, Lin M, Lin L, Yan S, Lin Z (2013) Correntropy induced l2 graph for robust subspace clustering. In: Proceedings of IEEE international conference on computer vision, pp 1801–1808
28.
go back to reference Peng C, Kang Z, Cheng Q (2017) Integrating feature and graph learning with low-rank representation. Neurocomputing 249:106–116CrossRef Peng C, Kang Z, Cheng Q (2017) Integrating feature and graph learning with low-rank representation. Neurocomputing 249:106–116CrossRef
29.
go back to reference Wang H, Yang Y, Liu B (2019) Gmc: graph-based multi-view clustering. IEEE Trans Knowl Data Eng 32(6):1116–1129CrossRef Wang H, Yang Y, Liu B (2019) Gmc: graph-based multi-view clustering. IEEE Trans Knowl Data Eng 32(6):1116–1129CrossRef
30.
go back to reference Xie D, Gao Q, Wang Q, Zhang X, Gao X (2020) Adaptive latent similarity learning for multi-view clustering. Neural Netw 121:409–418CrossRef Xie D, Gao Q, Wang Q, Zhang X, Gao X (2020) Adaptive latent similarity learning for multi-view clustering. Neural Netw 121:409–418CrossRef
31.
go back to reference Zhu J, Jang JS, Liu T, Zhou J (2021) Joint spectral clustering based on optimal graph and feature selection. Neural Process Lett 53:257–273CrossRef Zhu J, Jang JS, Liu T, Zhou J (2021) Joint spectral clustering based on optimal graph and feature selection. Neural Process Lett 53:257–273CrossRef
32.
go back to reference Du H, Wang Y, Zhang F, Zhou Y (2020) Low-rank discriminative adaptive graph preserving subspace learning. Neural Process Lett 52(1):1–23CrossRef Du H, Wang Y, Zhang F, Zhou Y (2020) Low-rank discriminative adaptive graph preserving subspace learning. Neural Process Lett 52(1):1–23CrossRef
33.
go back to reference Feng L, Cai L, Liu Y, Liu S (2017) Multi-view spectral clustering via robust local subspace learning. Soft Comput 21(8):1937–1948CrossRef Feng L, Cai L, Liu Y, Liu S (2017) Multi-view spectral clustering via robust local subspace learning. Soft Comput 21(8):1937–1948CrossRef
34.
go back to reference Son JW, Jeon J, Lee A, Kim SJ (2017) Spectral clustering with brainstorming process for multi-view data. In: AAAI Son JW, Jeon J, Lee A, Kim SJ (2017) Spectral clustering with brainstorming process for multi-view data. In: AAAI
35.
go back to reference Boyd SP, Parikh N, Chu E, Peleato B, Eckstein J (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3:1–122CrossRef Boyd SP, Parikh N, Chu E, Peleato B, Eckstein J (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3:1–122CrossRef
36.
go back to reference Cai JF, Candès EJ, Shen Z (2010) A singular value thresholding algorithm for matrix completion. SIAM J Optim 20(4):1956–1982MathSciNetCrossRef Cai JF, Candès EJ, Shen Z (2010) A singular value thresholding algorithm for matrix completion. SIAM J Optim 20(4):1956–1982MathSciNetCrossRef
37.
go back to reference Du S, Ma Y, Ma Y (2017) Graph regularized compact low rank representation for subspace clustering. Knowl-Based Syst 118:56–69CrossRef Du S, Ma Y, Ma Y (2017) Graph regularized compact low rank representation for subspace clustering. Knowl-Based Syst 118:56–69CrossRef
38.
go back to reference Wen J, Han N, Fang X, Fei L, Yan K, Zhan S (2018) Low-rank preserving projection via graph regularized reconstruction. IEEE Trans Cybern 49(4):1279–1291CrossRef Wen J, Han N, Fang X, Fei L, Yan K, Zhan S (2018) Low-rank preserving projection via graph regularized reconstruction. IEEE Trans Cybern 49(4):1279–1291CrossRef
39.
go back to reference Zhang Y (2010) An alternating direction algorithm for nonnegative matrix factorization Zhang Y (2010) An alternating direction algorithm for nonnegative matrix factorization
40.
go back to reference Xia R, Pan Y, Du L, Yin J (2014) Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, pp 2149–2155 Xia R, Pan Y, Du L, Yin J (2014) Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, pp 2149–2155
41.
go back to reference Nie F, Tian L, Li X (2018) Multiview clustering via adaptively weighted procrustes. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 2022–2030 Nie F, Tian L, Li X (2018) Multiview clustering via adaptively weighted procrustes. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 2022–2030
42.
go back to reference Nie F, Li J, Li X, et al. (2016) Parameter-free auto-weighted multiple graph learning: A framework for multiview clustering and semi-supervised classification. In: IJCAI, pp 1881–1887 Nie F, Li J, Li X, et al. (2016) Parameter-free auto-weighted multiple graph learning: A framework for multiview clustering and semi-supervised classification. In: IJCAI, pp 1881–1887
43.
go back to reference Luo S, Zhang C, Zhang W, Cao X (2018) Consistent and specific multi-view subspace clustering. In: AAAI, pp 3730–3737 Luo S, Zhang C, Zhang W, Cao X (2018) Consistent and specific multi-view subspace clustering. In: AAAI, pp 3730–3737
Metadata
Title
Multi-view Clustering Based on Low-rank Representation and Adaptive Graph Learning
Authors
Yixuan Huang
Qingjiang Xiao
Shiqiang Du
Yao Yu
Publication date
01-09-2021
Publisher
Springer US
Published in
Neural Processing Letters / Issue 1/2022
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10634-3

Other articles of this Issue 1/2022

Neural Processing Letters 1/2022 Go to the issue