Skip to main content
Erschienen in: Pattern Analysis and Applications 3/2023

11.07.2023 | Theoretical Advances

Multiple kernel k-means clustering with block diagonal property

verfasst von: Cuiling Chen, Jian Wei, Zhi Li

Erschienen in: Pattern Analysis and Applications | Ausgabe 3/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multiple kernel k-means clustering (MKKC) is proposed to efficiently incorporate multiple base kernels to generate an optimal kernel. However, many existing MKKC methods all involve two stages: learning a clustering indicator matrix and performing clustering on it. This cannot ensure the ultimate clustering results are optimal because the optimal values of two steps are not equivalent to those of the original problem. To address this issue, in this paper, we propose a novel method named multiple kernel k-means clustering with block diagonal property (MKKC-BD). It is the first time to find the relationship between an indicator matrix and Laplacian matrix of the graph theory and get a block diagonal (BD) representation of the indicator matrix. By imposing the BD constraint on the indicator matrix, the BD property of the indicator matrix is ensured. Further, the explicit clustering results are generated directly from the unified framework integrating the three processes of learning an optimal kernel, an indicator matrix and clustering results, which shows the clustering task is executed just by one step. In addition, a simple kernel weight strategy is used in this framework to obtain the optimal kernel, where the value of each kernel weight directly reveals the relationship of each base kernel and the optimal kernel. Finally, by extensive experiments on ten data sets and comparison of clustering results with eight state-of-the-art multiple kernel clustering methods, it is concluded that MKKC-BD is effective. Our code is available at https://​github.​com/​mathchen-git/​MKKC-BD.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hartigan JA (1975) Clustering Algorithm. Wiley, New YorkMATH Hartigan JA (1975) Clustering Algorithm. Wiley, New YorkMATH
2.
Zurück zum Zitat MacQueen J (1967) Some methods for classification and analysis of multi-variate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability,Vol 1, pp 281-297 MacQueen J (1967) Some methods for classification and analysis of multi-variate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability,Vol 1, pp 281-297
3.
Zurück zum Zitat Andrew YN, Jordan MI, Weiss Y (2001) On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst 14:849–856 Andrew YN, Jordan MI, Weiss Y (2001) On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst 14:849–856
4.
Zurück zum Zitat Nie FP, Wang XQ, Huang H (2014) Clustering and projected clustering with adaptive neighbors. In: SIGKDD, pp 977-986 Nie FP, Wang XQ, Huang H (2014) Clustering and projected clustering with adaptive neighbors. In: SIGKDD, pp 977-986
5.
Zurück zum Zitat Girolami MA (2002) Mercer kernel-based clustering in feature space. IEEE Trans Neural Netw 13(3):780–784CrossRef Girolami MA (2002) Mercer kernel-based clustering in feature space. IEEE Trans Neural Netw 13(3):780–784CrossRef
6.
Zurück zum Zitat Huang HC, Chuang YY, Chen CS (2012) Multiple kernel fuzzy clustering. IEEE Trans Fuzzy Syst 20(1):120–134CrossRef Huang HC, Chuang YY, Chen CS (2012) Multiple kernel fuzzy clustering. IEEE Trans Fuzzy Syst 20(1):120–134CrossRef
7.
Zurück zum Zitat Du L, Zhou P, Shi L et al (2015) Robust multiple kernel \(k\)-means using \(\ell _{2,1}\)-norm. In: IJCAI, pp 3476-3482 Du L, Zhou P, Shi L et al (2015) Robust multiple kernel \(k\)-means using \(\ell _{2,1}\)-norm. In: IJCAI, pp 3476-3482
8.
Zurück zum Zitat Zhou SH, Zhu E, Liu XW et al (2020) Subspace segmentation-based robust multiple kernel clustering. Inf Fus 53:145–154CrossRef Zhou SH, Zhu E, Liu XW et al (2020) Subspace segmentation-based robust multiple kernel clustering. Inf Fus 53:145–154CrossRef
9.
Zurück zum Zitat Lu JT, Lu YH, Wang R, Nie FP et al (2022) Multiple kernel \(k\)-means clustering with simultaneous spectral rotation. In: ICASSP, pp 4143-4147 Lu JT, Lu YH, Wang R, Nie FP et al (2022) Multiple kernel \(k\)-means clustering with simultaneous spectral rotation. In: ICASSP, pp 4143-4147
10.
Zurück zum Zitat Liu XW, Zhou SH, Liu L et al (2021) Localized simple multiple kernel \(k\)-means. In: ICCV, pp 9273-9281 Liu XW, Zhou SH, Liu L et al (2021) Localized simple multiple kernel \(k\)-means. In: ICCV, pp 9273-9281
11.
Zurück zum Zitat Zhu XZ, Liu XW, Li MM et al (2018) Localized incomplete multiple kernel \(k\)-means. In: IJCAI, pp 3271-3277 Zhu XZ, Liu XW, Li MM et al (2018) Localized incomplete multiple kernel \(k\)-means. In: IJCAI, pp 3271-3277
12.
Zurück zum Zitat Liu XW, Dou Y, Yin JP et al (2016) Multiple kernel \(k\)-means clustering with matrix-induced regularization. In: AAAI, pp 1888-1894 Liu XW, Dou Y, Yin JP et al (2016) Multiple kernel \(k\)-means clustering with matrix-induced regularization. In: AAAI, pp 1888-1894
13.
Zurück zum Zitat Yao YQ, Li Y, Jiang BB et al (2021) Multiple kernel \(k\)-means clustering by selecting representative kernels. IEEE Trans Neural Netw Learn Syst 32(11):4983–4996MathSciNetCrossRef Yao YQ, Li Y, Jiang BB et al (2021) Multiple kernel \(k\)-means clustering by selecting representative kernels. IEEE Trans Neural Netw Learn Syst 32(11):4983–4996MathSciNetCrossRef
14.
Zurück zum Zitat Liu XW, Zhou SH, Wang YQ et al (2017) Optimal neighborhood kernel clustering with multiple kernels. In: AAAI, pp 2266-2272 Liu XW, Zhou SH, Wang YQ et al (2017) Optimal neighborhood kernel clustering with multiple kernels. In: AAAI, pp 2266-2272
15.
Zurück zum Zitat Zhou SH, Liu XW, Li MM et al (2020) Multiple kernel clustering with neighbor-kernel subspace segmentation. IEEE Trans Neural Netw Learn Syst 31(4):1351–1362MathSciNetCrossRef Zhou SH, Liu XW, Li MM et al (2020) Multiple kernel clustering with neighbor-kernel subspace segmentation. IEEE Trans Neural Netw Learn Syst 31(4):1351–1362MathSciNetCrossRef
16.
Zurück zum Zitat Ren ZW, Li HR, Yang C et al (2020) Multiple kernel subspace clustering with local structural graph and low-rank consensus kernel learning. Knowl Based Syst 188:1–9CrossRef Ren ZW, Li HR, Yang C et al (2020) Multiple kernel subspace clustering with local structural graph and low-rank consensus kernel learning. Knowl Based Syst 188:1–9CrossRef
17.
Zurück zum Zitat Ren ZW, Sun QS (2021) Simultaneous global and local graph structure preserving for multiple kernel clustering. IEEE Trans Neural Netw Learn Syst 32(5):1839–1851MathSciNetCrossRef Ren ZW, Sun QS (2021) Simultaneous global and local graph structure preserving for multiple kernel clustering. IEEE Trans Neural Netw Learn Syst 32(5):1839–1851MathSciNetCrossRef
18.
Zurück zum Zitat Liu JY, Liu XW, Xiong J et al (2022) Optimal neighborhood multiple kernel clustering with adaptive local kernels. IEEE Trans Knowl Data Eng 34(6):2872–2885 Liu JY, Liu XW, Xiong J et al (2022) Optimal neighborhood multiple kernel clustering with adaptive local kernels. IEEE Trans Knowl Data Eng 34(6):2872–2885
19.
Zurück zum Zitat Wang R, Lu JT, Lu YH et al (2021) Discrete multiple kernel \(k\)-means. In: IJCAI, pp 3111-3117 Wang R, Lu JT, Lu YH et al (2021) Discrete multiple kernel \(k\)-means. In: IJCAI, pp 3111-3117
20.
Zurück zum Zitat Lu CY, Feng JS, Lin ZC et al (2019) Subspace clustering by block diagonal representation. IEEE Trans Pattern Anal Mach Intell 41(2):487–501MathSciNetCrossRef Lu CY, Feng JS, Lin ZC et al (2019) Subspace clustering by block diagonal representation. IEEE Trans Pattern Anal Mach Intell 41(2):487–501MathSciNetCrossRef
21.
Zurück zum Zitat Elhamifar E, Vidal R (2013) Sparse subspace clustering: Algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35(11):2765–2781CrossRef Elhamifar E, Vidal R (2013) Sparse subspace clustering: Algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35(11):2765–2781CrossRef
22.
Zurück zum Zitat Liu GC, Lin ZC, Yan SC et al (2013) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–184CrossRef Liu GC, Lin ZC, Yan SC et al (2013) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–184CrossRef
23.
Zurück zum Zitat Feng JS, Lin ZC, Xu H et al (2014) Robust subspace segmentation with block-diagonal prior. In: CVPR, pp 3818-3825 Feng JS, Lin ZC, Xu H et al (2014) Robust subspace segmentation with block-diagonal prior. In: CVPR, pp 3818-3825
24.
Zurück zum Zitat Kang Z, Lu X, Yi JF et al (2018) Self-weighted multiple kernel learning for graph-based clustering and semi-supervised classification. In: IJCAI, pp 2312-2318 Kang Z, Lu X, Yi JF et al (2018) Self-weighted multiple kernel learning for graph-based clustering and semi-supervised classification. In: IJCAI, pp 2312-2318
26.
Zurück zum Zitat Nie FP, Zhang R, Li XL (2017) A generalized power iteration method for solving quadratic problem on the Stiefel manifold. Sci China Inf Sci 60(11):112101:1-112101:10MathSciNetCrossRef Nie FP, Zhang R, Li XL (2017) A generalized power iteration method for solving quadratic problem on the Stiefel manifold. Sci China Inf Sci 60(11):112101:1-112101:10MathSciNetCrossRef
27.
Zurück zum Zitat Schölkopf B, Smola AJ, Müller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef Schölkopf B, Smola AJ, Müller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef
29.
Zurück zum Zitat Sun MJ, Wang SW, Zhang P et al (2022) Projective multiple kernel subspace clustering. IEEE Trans Multim 24:2567–2579CrossRef Sun MJ, Wang SW, Zhang P et al (2022) Projective multiple kernel subspace clustering. IEEE Trans Multim 24:2567–2579CrossRef
30.
Zurück zum Zitat Zhan K, Nie FP, Wang J et al (2019) Multiview consensus graph clustering. IEEE Trans Image Process 28(3):1261–1270MathSciNetCrossRef Zhan K, Nie FP, Wang J et al (2019) Multiview consensus graph clustering. IEEE Trans Image Process 28(3):1261–1270MathSciNetCrossRef
31.
Zurück zum Zitat Shi ZQ, Liu JL (2023) Noise-tolerant clustering via joint doubly stochastic matrix regularization and dual sparse coding. Expert Syst Appl 222:119814CrossRef Shi ZQ, Liu JL (2023) Noise-tolerant clustering via joint doubly stochastic matrix regularization and dual sparse coding. Expert Syst Appl 222:119814CrossRef
Metadaten
Titel
Multiple kernel k-means clustering with block diagonal property
verfasst von
Cuiling Chen
Jian Wei
Zhi Li
Publikationsdatum
11.07.2023
Verlag
Springer London
Erschienen in
Pattern Analysis and Applications / Ausgabe 3/2023
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-023-01183-7

Weitere Artikel der Ausgabe 3/2023

Pattern Analysis and Applications 3/2023 Zur Ausgabe

Industrial and Commercial Application

Body condition scoring network based on improved YOLOX

Premium Partner