Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 3/2022

21-03-2021 | Original Article

Multi-view data clustering via non-negative matrix factorization with manifold regularization

Authors: Ghufran Ahmad Khan, Jie Hu, Tianrui Li, Bassoma Diallo, Hongjun Wang

Published in: International Journal of Machine Learning and Cybernetics | Issue 3/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nowadays, non-negative matrix factorization (NMF) based cluster analysis for multi-view data shows impressive behavior in machine learning. Usually, multi-view data have complementary information from various views. The main concern behind the NMF is how to factorize the data to achieve a significant clustering solution from these complementary views. However, NMF does not focus to conserve the geometrical structures of the data space. In this article, we intensify on the above issue and evolve a new NMF clustering method with manifold regularization for multi-view data. The manifold regularization factor is exploited to retain the locally geometrical structure of the data space and gives extensively common clustering solution from multiple views. The weight control term is adopted to handle the distribution of each view weight. An iterative optimization strategy depended on multiplicative update rule is applied on the objective function to achieve optimization. Experimental analysis on the real-world datasets are exhibited that the proposed approach achieves better clustering performance than some state-of-the-art algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Yang Y, Wang H (2018) Multi-view clustering: a survey. Big Data Min Anal 1(2):83–107CrossRef Yang Y, Wang H (2018) Multi-view clustering: a survey. Big Data Min Anal 1(2):83–107CrossRef
2.
go back to reference Li J, Zhou G, Qiu Y, Wang Y, Xie S (2020) Deep graph regularized non-negative matrix factorization for multi-view clustering. Neurocomputing 390:108–116CrossRef Li J, Zhou G, Qiu Y, Wang Y, Xie S (2020) Deep graph regularized non-negative matrix factorization for multi-view clustering. Neurocomputing 390:108–116CrossRef
3.
go back to reference Akrami A, Habib R, Khosravi MR (2020) Design of a reservoir for cloud-enabled echo state network with high clustering coefficient. EURASIP J Wirel Commun Netw 2020(1):1–14CrossRef Akrami A, Habib R, Khosravi MR (2020) Design of a reservoir for cloud-enabled echo state network with high clustering coefficient. EURASIP J Wirel Commun Netw 2020(1):1–14CrossRef
4.
go back to reference Zhao J, Xie X, Xu X, Sun S (2017) Multi-view learning overview: recent progress and new challenges. Inf Fusion 38:43–54CrossRef Zhao J, Xie X, Xu X, Sun S (2017) Multi-view learning overview: recent progress and new challenges. Inf Fusion 38:43–54CrossRef
5.
go back to reference Bickel S, Scheffer T (2004) Multi-view clustering. In: Proc. of the 4th international conference on data mining, ICDM, vol 4, pp 19–26 Bickel S, Scheffer T (2004) Multi-view clustering. In: Proc. of the 4th international conference on data mining, ICDM, vol 4, pp 19–26
6.
go back to reference Tavallali P, Tavallali P, Khosarvi MR, Mukesh S ( 2020) Interpretable synthetic reduced nearest neighbor: an expectation maximization approach. In: Proc.of the 27th IEEE international conference on image processing, ICIP, pp 1921–1925 Tavallali P, Tavallali P, Khosarvi MR, Mukesh S ( 2020) Interpretable synthetic reduced nearest neighbor: an expectation maximization approach. In: Proc.of the 27th IEEE international conference on image processing, ICIP, pp 1921–1925
7.
go back to reference Abbasi M, Shokrollahi A, Khosaravi MR, Menon VG (2020) High-performance flow classification using hybrid clusters in software defined mobile edge computing. Comput Commun 160:643–660CrossRef Abbasi M, Shokrollahi A, Khosaravi MR, Menon VG (2020) High-performance flow classification using hybrid clusters in software defined mobile edge computing. Comput Commun 160:643–660CrossRef
8.
go back to reference Yang S, Hou C, Zhang C, Wu Y, Weng S (2013) Robust non-negative matrix factorization via joint sparse and graph regularization. In: Proc. of international joint conference on neural networks, IJCNN, pp 1–5 Yang S, Hou C, Zhang C, Wu Y, Weng S (2013) Robust non-negative matrix factorization via joint sparse and graph regularization. In: Proc. of international joint conference on neural networks, IJCNN, pp 1–5
9.
go back to reference Sun F, Xu M, Hu X, Jiang X (2016) Graph regularized and sparse nonnegative matrix factorization with hard constraints for data representation. Neurocomputing 173:233–244CrossRef Sun F, Xu M, Hu X, Jiang X (2016) Graph regularized and sparse nonnegative matrix factorization with hard constraints for data representation. Neurocomputing 173:233–244CrossRef
10.
go back to reference Gao S, Yu Z, Jin T, Yin M (2019) Multi-view low-rank matrix factorization using multiple manifold regularization. Neurocomputing 335:143–152CrossRef Gao S, Yu Z, Jin T, Yin M (2019) Multi-view low-rank matrix factorization using multiple manifold regularization. Neurocomputing 335:143–152CrossRef
11.
go back to reference Ren P, Xiao Y, Xu P, Guo J, Chen X, Wang X, Fang D (2019) Robust auto-weighted multi-view clustering. In: Proc. of 27th international joint conference on artificial intelligence, IJCAI, pp 2644–2650 Ren P, Xiao Y, Xu P, Guo J, Chen X, Wang X, Fang D (2019) Robust auto-weighted multi-view clustering. In: Proc. of 27th international joint conference on artificial intelligence, IJCAI, pp 2644–2650
12.
go back to reference Khan GA, Hu J, Li T, Diallo B, Huang Q (2019) Weighted multi-view data clustering via joint non-negative matrix factorization. In: Proc. of 14th international conference on intelligent systems and knowledge engineering, ISKE, pp 1159–1165 Khan GA, Hu J, Li T, Diallo B, Huang Q (2019) Weighted multi-view data clustering via joint non-negative matrix factorization. In: Proc. of 14th international conference on intelligent systems and knowledge engineering, ISKE, pp 1159–1165
13.
go back to reference Liu J, Wang C, Gao J, Han J (2013) Multi-view clustering via joint nonnegative matrix factorization. In: Proc. of SIAM international conference on data mining, pp 252–260 Liu J, Wang C, Gao J, Han J (2013) Multi-view clustering via joint nonnegative matrix factorization. In: Proc. of SIAM international conference on data mining, pp 252–260
14.
go back to reference Wang J, Wang X, Tian F, Liu CH, Yu H, Liu Y (2016) Adaptive multi-view semi-supervised nonnegative matrix factorization. In: Proc. of 23th international conference on neural information processing, ICONIP, pp 435–444 Wang J, Wang X, Tian F, Liu CH, Yu H, Liu Y (2016) Adaptive multi-view semi-supervised nonnegative matrix factorization. In: Proc. of 23th international conference on neural information processing, ICONIP, pp 435–444
15.
go back to reference Cai X, Nie F, Huang H (2013) Multi-view \(k\)-means clustering on big data. In: Proc. of 23rd international joint conference on artificial intelligence, IJCAI, pp 2598C–2604 Cai X, Nie F, Huang H (2013) Multi-view \(k\)-means clustering on big data. In: Proc. of 23rd international joint conference on artificial intelligence, IJCAI, pp 2598C–2604
16.
go back to reference Zong L, Zhang X, Zhao L, Yu H, Zhao Q (2017) Multi-view clustering via multi-manifold regularized non-negative matrix factorization. Neural Netw 88:74–89MATHCrossRef Zong L, Zhang X, Zhao L, Yu H, Zhao Q (2017) Multi-view clustering via multi-manifold regularized non-negative matrix factorization. Neural Netw 88:74–89MATHCrossRef
17.
go back to reference Wang Y-X, Zhang Y-J (2012) Nonnegative matrix factorization: a comprehensive review. IEEE Trans Knowl Data Eng 25(6):1336–1353MathSciNetCrossRef Wang Y-X, Zhang Y-J (2012) Nonnegative matrix factorization: a comprehensive review. IEEE Trans Knowl Data Eng 25(6):1336–1353MathSciNetCrossRef
18.
go back to reference Cai D, He X, Han J, Huang TS (2010) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560 Cai D, He X, Han J, Huang TS (2010) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560
19.
go back to reference Cai D, He X, Wu X, Han J (2008) Non-negative matrix factorization on manifold. In: Proc. of 8th international conference on data mining, ICDM, pp 63–72 Cai D, He X, Wu X, Han J (2008) Non-negative matrix factorization on manifold. In: Proc. of 8th international conference on data mining, ICDM, pp 63–72
20.
go back to reference Zhang X, Zhao L, Zong L, Liu X, Yu H (2014) Multi-view clustering via multi-manifold regularized nonnegative matrix factorization. In: Proc. of 14th international conference on data mining, ICDM, pp 1103–1108 Zhang X, Zhao L, Zong L, Liu X, Yu H (2014) Multi-view clustering via multi-manifold regularized nonnegative matrix factorization. In: Proc. of 14th international conference on data mining, ICDM, pp 1103–1108
21.
go back to reference Wang H, Yang Y, Li T (2016) Multi-view clustering via concept factorization with local manifold regularization. In: Proc. of 16th international conference on data mining, ICDM, pp 1245–1250 Wang H, Yang Y, Li T (2016) Multi-view clustering via concept factorization with local manifold regularization. In: Proc. of 16th international conference on data mining, ICDM, pp 1245–1250
22.
go back to reference Wu B, Wang E, Zhu Z, Chen W, Xiao P (2018) Manifold NMF with \(L_{21}\) norm for clustering. Neurocomputing 273:78–88 Wu B, Wang E, Zhu Z, Chen W, Xiao P (2018) Manifold NMF with \(L_{21}\) norm for clustering. Neurocomputing 273:78–88
23.
go back to reference Pu J, Zhang Q, Zhang L, Du B, You J (2016) Multi-view clustering based on robust and regularized matrix approximation. In: Proc. of 23rd international conference on pattern recognition, ICPR, pp 2550–2555 Pu J, Zhang Q, Zhang L, Du B, You J (2016) Multi-view clustering based on robust and regularized matrix approximation. In: Proc. of 23rd international conference on pattern recognition, ICPR, pp 2550–2555
25.
go back to reference Zhao Q, Zong L, Zhang X-C, Liu X, Yu H (2020) Multi-view clustering via clusterwise weights learning. Knowl Based Syst 193:105459CrossRef Zhao Q, Zong L, Zhang X-C, Liu X, Yu H (2020) Multi-view clustering via clusterwise weights learning. Knowl Based Syst 193:105459CrossRef
26.
go back to reference Huang S, Xu Z, Kang Z, Ren Y (2020) Regularized nonnegative matrix factorization with adaptive local structure learning. Neurocomputing 382:196–209CrossRef Huang S, Xu Z, Kang Z, Ren Y (2020) Regularized nonnegative matrix factorization with adaptive local structure learning. Neurocomputing 382:196–209CrossRef
27.
go back to reference Liang N, Yang Z, Li Z, Su CY (2020) Semi-supervised multi-view clustering with graph-regularized partially shared non-negative matrix factorization. Knowl Based Syst 190:105185CrossRef Liang N, Yang Z, Li Z, Su CY (2020) Semi-supervised multi-view clustering with graph-regularized partially shared non-negative matrix factorization. Knowl Based Syst 190:105185CrossRef
28.
go back to reference Liang N, Yang Z, Li Z, Sun W, Xie S (2020) Multi-view clustering by non-negative matrix factorization with co-orthogonal constraints. Knowl Based Syst 194:105582CrossRef Liang N, Yang Z, Li Z, Sun W, Xie S (2020) Multi-view clustering by non-negative matrix factorization with co-orthogonal constraints. Knowl Based Syst 194:105582CrossRef
30.
go back to reference Chen F, Li G, Li Z, Wang S, Pan Z (2019) Multiview clustering via robust neighboring constraint non-negative matrix factorization. Math Probl Eng 2019:1–10MATH Chen F, Li G, Li Z, Wang S, Pan Z (2019) Multiview clustering via robust neighboring constraint non-negative matrix factorization. Math Probl Eng 2019:1–10MATH
32.
go back to reference Yang Z, Liang N, Yan W, Li Z, Xie S (2020) Multi-view non-negative matrix factorization discriminant learning via cross entropy loss. In: Proc. of the 32nd Chinese control and decision conference, CCDC, pp 3964–3971 Yang Z, Liang N, Yan W, Li Z, Xie S (2020) Multi-view non-negative matrix factorization discriminant learning via cross entropy loss. In: Proc. of the 32nd Chinese control and decision conference, CCDC, pp 3964–3971
33.
go back to reference Zhu X, Guo J, Nejdl W, Liao X, Dietze S (2020) Multi-view image clustering based on sparse coding and manifold consensus. Neurocomputing 403:53–62CrossRef Zhu X, Guo J, Nejdl W, Liao X, Dietze S (2020) Multi-view image clustering based on sparse coding and manifold consensus. Neurocomputing 403:53–62CrossRef
34.
go back to reference Rai N, Negi S, Chaudhury S, Deshmukh O (2016) Partial multi-view clustering using graph regularized NMF. In: Proc. of 23rd international conference on pattern recognition, ICPR, pp 2192–2197 Rai N, Negi S, Chaudhury S, Deshmukh O (2016) Partial multi-view clustering using graph regularized NMF. In: Proc. of 23rd international conference on pattern recognition, ICPR, pp 2192–2197
35.
go back to reference Shen B, Si L (2010) Non-negative matrix factorization clustering on multiple manifolds. In: Proc. of 24th AAAI conference on artificial intelligence, AAAI, pp 575–580 Shen B, Si L (2010) Non-negative matrix factorization clustering on multiple manifolds. In: Proc. of 24th AAAI conference on artificial intelligence, AAAI, pp 575–580
36.
go back to reference Qian B, Shen X, Gu Y, Tang Z, Ding Y (2016) Double constrained NMF for partial multi-view clustering. In: Proc. of international conference on digital image computing: techniques and applications, DICTA, pp 1–7 Qian B, Shen X, Gu Y, Tang Z, Ding Y (2016) Double constrained NMF for partial multi-view clustering. In: Proc. of international conference on digital image computing: techniques and applications, DICTA, pp 1–7
37.
go back to reference Luo P, Peng J, Guan Z, Fan J (2018) Dual regularized multi-view non-negative matrix factorization for clustering. Neurocomputing 294:1–11CrossRef Luo P, Peng J, Guan Z, Fan J (2018) Dual regularized multi-view non-negative matrix factorization for clustering. Neurocomputing 294:1–11CrossRef
38.
go back to reference Wang Z, Kong X, Fu H, Li M, Zhang Y (2015) Feature extraction via multi-view non-negative matrix factorization with local graph regularization. In: Proc. of international conference on image processing, ICIP, pp 3500–3504 Wang Z, Kong X, Fu H, Li M, Zhang Y (2015) Feature extraction via multi-view non-negative matrix factorization with local graph regularization. In: Proc. of international conference on image processing, ICIP, pp 3500–3504
39.
go back to reference Wang X, Zhang T, Gao X (2018) Multiview clustering based on non-negative matrix factorization and pairwise measurements. IEEE Trans Cybern 49(9):3333–3346CrossRef Wang X, Zhang T, Gao X (2018) Multiview clustering based on non-negative matrix factorization and pairwise measurements. IEEE Trans Cybern 49(9):3333–3346CrossRef
40.
go back to reference Ou W, Long F, Tan Y, Yu S, Wang P (2018) Co-regularized multi-view nonnegative matrix factorization with correlation constraint for representation learning. Multimed Tools Appl 77(10):12955–12978CrossRef Ou W, Long F, Tan Y, Yu S, Wang P (2018) Co-regularized multi-view nonnegative matrix factorization with correlation constraint for representation learning. Multimed Tools Appl 77(10):12955–12978CrossRef
41.
go back to reference Wang J, Tian F, Yu H, Liu CH, Zhan K, Wang X (2017) Diverse non-negative matrix factorization for multi-view data representation. IEEE Trans Cybern 48(9):2620–2632CrossRef Wang J, Tian F, Yu H, Liu CH, Zhan K, Wang X (2017) Diverse non-negative matrix factorization for multi-view data representation. IEEE Trans Cybern 48(9):2620–2632CrossRef
42.
go back to reference Babaee M, Tsoukalas S, Babaee M, Rigoll G, Datcu M (2016) Discriminative nonnegative matrix factorization for dimensionality reduction. Neurocomputing 173:212–223CrossRef Babaee M, Tsoukalas S, Babaee M, Rigoll G, Datcu M (2016) Discriminative nonnegative matrix factorization for dimensionality reduction. Neurocomputing 173:212–223CrossRef
43.
44.
go back to reference Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791MATHCrossRef Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791MATHCrossRef
45.
go back to reference Cai D, He X, Wang X, Bao H, Han J (2009) Locality preserving nonnegative matrix factorization. In: Proc. of 21st international joint conference on artificial intelligence, IJCAI, pp 1010–1015 Cai D, He X, Wang X, Bao H, Han J (2009) Locality preserving nonnegative matrix factorization. In: Proc. of 21st international joint conference on artificial intelligence, IJCAI, pp 1010–1015
46.
go back to reference Zhang Z, Zhao K (2012) Low-rank matrix approximation with manifold regularization. IEEE Trans Pattern Anal Mach Intell 35(7):1717–1729MathSciNetCrossRef Zhang Z, Zhao K (2012) Low-rank matrix approximation with manifold regularization. IEEE Trans Pattern Anal Mach Intell 35(7):1717–1729MathSciNetCrossRef
47.
go back to reference Tzortzis G, Likas A (2012) Kernel-based weighted multi-view clustering. In: Proc. of 12th international conference on data mining, ICDM, pp 675–C684 Tzortzis G, Likas A (2012) Kernel-based weighted multi-view clustering. In: Proc. of 12th international conference on data mining, ICDM, pp 675–C684
48.
go back to reference Shang F, Jiao LC, Wang F (2012) Graph dual regularization non-negative matrix factorization for co-clustering. Pattern Recognit 45(6):2237–2250MATHCrossRef Shang F, Jiao LC, Wang F (2012) Graph dual regularization non-negative matrix factorization for co-clustering. Pattern Recognit 45(6):2237–2250MATHCrossRef
49.
go back to reference Nie F, Li J, Li X (2016) Parameter-free auto-weighted multiple graph learning: A framework for multiview clustering and semi-supervised classification. In: Proc. of 25th international joint conference on artificial intelligence, IJCAI, pp 1881–C1887 Nie F, Li J, Li X (2016) Parameter-free auto-weighted multiple graph learning: A framework for multiview clustering and semi-supervised classification. In: Proc. of 25th international joint conference on artificial intelligence, IJCAI, pp 1881–C1887
50.
go back to reference Shao W, He L, Yu Philip S (2015) Multiple incomplete views clustering via weighted nonnegative matrix factorization with \(l_{2,1}\) regularization. In: Joint European conference on machine learning and knowledge discovery in databases, pp 318–334 Shao W, He L, Yu Philip S (2015) Multiple incomplete views clustering via weighted nonnegative matrix factorization with \(l_{2,1}\) regularization. In: Joint European conference on machine learning and knowledge discovery in databases, pp 318–334
51.
go back to reference Zhao H, Ding Z, Fu Y (2017) Multi-view clustering via deep matrix factorization. In: Proc. of 31st AAAI conference on artificial intelligence, AAAI, pp 2921C–2927 Zhao H, Ding Z, Fu Y (2017) Multi-view clustering via deep matrix factorization. In: Proc. of 31st AAAI conference on artificial intelligence, AAAI, pp 2921C–2927
Metadata
Title
Multi-view data clustering via non-negative matrix factorization with manifold regularization
Authors
Ghufran Ahmad Khan
Jie Hu
Tianrui Li
Bassoma Diallo
Hongjun Wang
Publication date
21-03-2021
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 3/2022
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-021-01307-7

Other articles of this Issue 3/2022

International Journal of Machine Learning and Cybernetics 3/2022 Go to the issue