Skip to main content
Erschienen in: Neural Computing and Applications 9/2024

18.12.2023 | Original Article

A new semi-supervised fuzzy K-means clustering method with dynamic adjustment and label discrimination

verfasst von: Hengdong Zhu, Wenxiu Xie, Yuanyuan Mu, Juan Xu, Fu Lee Wang, Yingying Qu, Tianyong Hao

Erschienen in: Neural Computing and Applications | Ausgabe 9/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Conventional unsupervised Fuzzy K-means methods (FKM) usually analyze the structure of data solely without considering the influence of label information carried by data, which limits the performance and stability of clustering. How to leverage annotated label information to improve the performance of unsupervised FKM methods is still a challenging research problem. To that end, this paper proposes a new Semi-Supervised Fuzzy K-means method (SSFKM) consisting of dynamic adjustment and label discrimination. Specifically, dynamic adjustment aligns label information and clustering results to distinguish the learning difficulties of labeled data and enable the method to focus on simple but reliable label information. Moreover, a new distance measure is designed to re-evaluate the membership of labeled data with cluster centers, forcing labeled data to be classified into correct cluster for enhancing label discrimination. Comprehensive experiments demonstrate that the SSFKM method achieves the best performance compared with existing state-of-the-art semi-supervised clustering methods. In addition, the results demonstrate that the SSFKM method reduces the impact of data noise effectively during clustering.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Sulaiman SN, Isa NAM (2011) Adaptive fuzzy-K-means clustering algorithm for image segmentation. IEEE Trans Consum Electron 56(4):2661–2668CrossRef Sulaiman SN, Isa NAM (2011) Adaptive fuzzy-K-means clustering algorithm for image segmentation. IEEE Trans Consum Electron 56(4):2661–2668CrossRef
2.
Zurück zum Zitat Thaipanich T, Oh BT, Wu PH, Xu DR (2011) Improved image denoising with adaptive nonlocal means (ANL-Means) algorithm. IEEE Trans Consum Electron 56(4):2623–2630CrossRef Thaipanich T, Oh BT, Wu PH, Xu DR (2011) Improved image denoising with adaptive nonlocal means (ANL-Means) algorithm. IEEE Trans Consum Electron 56(4):2623–2630CrossRef
3.
Zurück zum Zitat Shanthi I, Valarmathi ML (2013) SAR image despeckling using possibilistic fuzzy C-means clustering and edge detection in bandelet domain. Neural Comput Appl 23(1):279-S291CrossRef Shanthi I, Valarmathi ML (2013) SAR image despeckling using possibilistic fuzzy C-means clustering and edge detection in bandelet domain. Neural Comput Appl 23(1):279-S291CrossRef
4.
5.
Zurück zum Zitat Xu C, Tao D, Xu C (2015) Multi-view intact space learning. IEEE Trans Pattern Anal Mach Intell 37(12):2531–2544CrossRefPubMed Xu C, Tao D, Xu C (2015) Multi-view intact space learning. IEEE Trans Pattern Anal Mach Intell 37(12):2531–2544CrossRefPubMed
6.
Zurück zum Zitat Zhou B, Liu W, Zhang W et al (2022) Multi-kernel graph fusion for spectral clustering. Inf Process Manage 59(5):103003CrossRef Zhou B, Liu W, Zhang W et al (2022) Multi-kernel graph fusion for spectral clustering. Inf Process Manage 59(5):103003CrossRef
7.
Zurück zum Zitat Choi M, Chang IJ, Kim J (2016) Optimal reference view selection algorithm for low complexity disparity estimation. IEEE Trans Consum Electron 62(1):45–52CrossRef Choi M, Chang IJ, Kim J (2016) Optimal reference view selection algorithm for low complexity disparity estimation. IEEE Trans Consum Electron 62(1):45–52CrossRef
8.
Zurück zum Zitat McQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematics Statistics and Probability pp 281–297 McQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematics Statistics and Probability pp 281–297
9.
Zurück zum Zitat Ruspini E (1969) A new approach to clustering. Inf Control 15(1):22–32CrossRef Ruspini E (1969) A new approach to clustering. Inf Control 15(1):22–32CrossRef
10.
Zurück zum Zitat Bezdek J (1981) Pattern recognition with fuzzy objective function algorithms. Plenum Press, LondonCrossRef Bezdek J (1981) Pattern recognition with fuzzy objective function algorithms. Plenum Press, LondonCrossRef
11.
Zurück zum Zitat Xu J, Han J, Kai X, et al (2016) Robust and sparse fuzzy k-means clustering. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence, pp 2224–2230 Xu J, Han J, Kai X, et al (2016) Robust and sparse fuzzy k-means clustering. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence, pp 2224–2230
12.
Zurück zum Zitat Bui Q, Vo B, Snasel V et al (2020) SFCM: a fuzzy clustering algorithm of extracting the shape information of data. IEEE Trans Fuzzy Syst 29(1):75–89CrossRef Bui Q, Vo B, Snasel V et al (2020) SFCM: a fuzzy clustering algorithm of extracting the shape information of data. IEEE Trans Fuzzy Syst 29(1):75–89CrossRef
13.
Zurück zum Zitat Nie F, Wang C, Li X (2019) K-Multiple-Means: a multiple-means clustering method with specified k clusters. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining pp 959–967 Nie F, Wang C, Li X (2019) K-Multiple-Means: a multiple-means clustering method with specified k clusters. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining pp 959–967
14.
Zurück zum Zitat Zhou J, Pedrycz W, Yue X et al (2022) Projected fuzzy C-means clustering with locality preservation. Pattern Recogn 113(6):107748 Zhou J, Pedrycz W, Yue X et al (2022) Projected fuzzy C-means clustering with locality preservation. Pattern Recogn 113(6):107748
15.
Zurück zum Zitat Guo Y, Sengur A (2015) NCM: neutrosophic c-means clustering algorithm. Pattern Recogn 48(8):2710–2714ADSCrossRef Guo Y, Sengur A (2015) NCM: neutrosophic c-means clustering algorithm. Pattern Recogn 48(8):2710–2714ADSCrossRef
16.
Zurück zum Zitat Guo Y, Sengur A (2015) NECM: neutrosophic evidential c-means clustering algorithm. Neural Comput Appl 26(3):561–571CrossRef Guo Y, Sengur A (2015) NECM: neutrosophic evidential c-means clustering algorithm. Neural Comput Appl 26(3):561–571CrossRef
17.
Zurück zum Zitat Akbulut Y, Abdulkadir S, Guo Y et al (2017) KNCM: kernel neutrosophic c-means clustering. Appl Soft Comput 52:714–724CrossRef Akbulut Y, Abdulkadir S, Guo Y et al (2017) KNCM: kernel neutrosophic c-means clustering. Appl Soft Comput 52:714–724CrossRef
18.
Zurück zum Zitat Xi L, Zhang FB (2020) An adaptive artificial-fish-swarm-inspired fuzzy C-means algorithm. Neural Comput Appl 32(22):16891–16899CrossRef Xi L, Zhang FB (2020) An adaptive artificial-fish-swarm-inspired fuzzy C-means algorithm. Neural Comput Appl 32(22):16891–16899CrossRef
19.
Zurück zum Zitat Nguyen TPQ, Kuo RJ, Le MD et al (2022) Local search genetic algorithm-based possibilistic weighted fuzzy c-means for clustering mixed numerical and categorical data. Neural Comput Appl 34(20):18059–18074CrossRef Nguyen TPQ, Kuo RJ, Le MD et al (2022) Local search genetic algorithm-based possibilistic weighted fuzzy c-means for clustering mixed numerical and categorical data. Neural Comput Appl 34(20):18059–18074CrossRef
20.
Zurück zum Zitat Grira N, Crucianu M, Boujemaa N (2008) Active semi-supervised fuzzy clustering. Pattern Recogn 41(5):1834–1844ADSCrossRef Grira N, Crucianu M, Boujemaa N (2008) Active semi-supervised fuzzy clustering. Pattern Recogn 41(5):1834–1844ADSCrossRef
21.
Zurück zum Zitat Zhang H, Jing L (2009) Semi-supervised fuzzy clustering: a kernel-based approach. Knowl-Based Syst 22(6):477–481CrossRef Zhang H, Jing L (2009) Semi-supervised fuzzy clustering: a kernel-based approach. Knowl-Based Syst 22(6):477–481CrossRef
22.
Zurück zum Zitat Zhang R, Nie F, Guo M et al (2018) Joint learning of fuzzy k-means and nonnegative spectral clustering with side information. IEEE Trans Image Process 28(5):2152–2162ADSMathSciNetCrossRefPubMed Zhang R, Nie F, Guo M et al (2018) Joint learning of fuzzy k-means and nonnegative spectral clustering with side information. IEEE Trans Image Process 28(5):2152–2162ADSMathSciNetCrossRefPubMed
23.
Zurück zum Zitat Li L, Garibaldi JM, He D et al (2015) Semi-supervised fuzzy clustering with feature discrimination. PLoS ONE 10(9):131–160 Li L, Garibaldi JM, He D et al (2015) Semi-supervised fuzzy clustering with feature discrimination. PLoS ONE 10(9):131–160
24.
Zurück zum Zitat Zhang D, Ma Y, Zhu H et al (2022) A label-guided weighted semi-supervised neutrosophic clustering algorithm. J Intell Fuzzy Syst 43(5):5661–5672CrossRef Zhang D, Ma Y, Zhu H et al (2022) A label-guided weighted semi-supervised neutrosophic clustering algorithm. J Intell Fuzzy Syst 43(5):5661–5672CrossRef
25.
Zurück zum Zitat Shi C, Gu Z, Duan C et al (2020) Multi-view adaptive semi-supervised feature selection with the self-paced learning. Signal Process 168:107332CrossRef Shi C, Gu Z, Duan C et al (2020) Multi-view adaptive semi-supervised feature selection with the self-paced learning. Signal Process 168:107332CrossRef
26.
Zurück zum Zitat Chen L, Lu J (2021) Adaptive graph learning for semi-supervised self-paced classification. Neural Process Lett 54(4):2695–2716CrossRef Chen L, Lu J (2021) Adaptive graph learning for semi-supervised self-paced classification. Neural Process Lett 54(4):2695–2716CrossRef
27.
Zurück zum Zitat Basu S, Banerjee A, Mooney R (2002) Semi-supervised clustering by seeding. In: Proceedings of the 19th International Conference on Machine Learning, pp 19–26 Basu S, Banerjee A, Mooney R (2002) Semi-supervised clustering by seeding. In: Proceedings of the 19th International Conference on Machine Learning, pp 19–26
28.
Zurück zum Zitat Wagstaff K, Cardie C (2000) Clustering with instance level constraints. In: Proceedings of the 17th International Conference on Machine Learning, pp 1097–1103 Wagstaff K, Cardie C (2000) Clustering with instance level constraints. In: Proceedings of the 17th International Conference on Machine Learning, pp 1097–1103
29.
Zurück zum Zitat Wagstaff K, Cardie C, Rogerss S, et al (2001) Constrained K-means clustering with background knowledge. In Proceedings of the 18th International Conference on Machine Learning, pp 577–584 Wagstaff K, Cardie C, Rogerss S, et al (2001) Constrained K-means clustering with background knowledge. In Proceedings of the 18th International Conference on Machine Learning, pp 577–584
30.
Zurück zum Zitat Nie F, Cai G, Li X (2017) Multi-view clustering and semi-supervised classification with adaptive neighbours. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp 2415–2421 Nie F, Cai G, Li X (2017) Multi-view clustering and semi-supervised classification with adaptive neighbours. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp 2415–2421
31.
Zurück zum Zitat Zhuang L, Zhou Z, Gao S et al (2017) Label information guided graph construction for semi-supervised learning. IEEE Trans Image Process 26(9):4182–4192ADSMathSciNetCrossRefPubMed Zhuang L, Zhou Z, Gao S et al (2017) Label information guided graph construction for semi-supervised learning. IEEE Trans Image Process 26(9):4182–4192ADSMathSciNetCrossRefPubMed
32.
Zurück zum Zitat Chen L, Zhong Z (2022) Adaptive and structured graph learning for semi-supervised clustering. Inf Process Manage 59(4):102949CrossRef Chen L, Zhong Z (2022) Adaptive and structured graph learning for semi-supervised clustering. Inf Process Manage 59(4):102949CrossRef
33.
Zurück zum Zitat Wang D, Nie F, Huang H (2014) Large-scale adaptive semi-supervised learning via unified inductive and transductive model. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp 482–491 Wang D, Nie F, Huang H (2014) Large-scale adaptive semi-supervised learning via unified inductive and transductive model. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp 482–491
34.
Zurück zum Zitat Nie F, Hua W, Huang H, et al (2013) Adaptive loss minimization for semi-supervised elastic embedding. In: Proceedings of the 23th International Joint Conference on Artificial Intelligence, pp 1565–1571 Nie F, Hua W, Huang H, et al (2013) Adaptive loss minimization for semi-supervised elastic embedding. In: Proceedings of the 23th International Joint Conference on Artificial Intelligence, pp 1565–1571
35.
Zurück zum Zitat Qiu S, Nie F, Xu X et al (2018) Accelerating flexible manifold embedding for scalable semi-supervised learning. IEEE Trans Circuits Syst Video Technol 29(9):2286–2295 Qiu S, Nie F, Xu X et al (2018) Accelerating flexible manifold embedding for scalable semi-supervised learning. IEEE Trans Circuits Syst Video Technol 29(9):2286–2295
36.
Zurück zum Zitat Chang X, Nie F, Yang Y, et a1 (2014) A convex formulation for semi-supervised multi-label feature selection. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp 1171–1177 Chang X, Nie F, Yang Y, et a1 (2014) A convex formulation for semi-supervised multi-label feature selection. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp 1171–1177
37.
Zurück zum Zitat Ding S, Jia H, Du M et al (2018) A semi-supervised approximate spectral clustering algorithm based on HMRF model. Inf Sci 429:215–228MathSciNetCrossRef Ding S, Jia H, Du M et al (2018) A semi-supervised approximate spectral clustering algorithm based on HMRF model. Inf Sci 429:215–228MathSciNetCrossRef
38.
Zurück zum Zitat Nie F, Wang X, Jordan M I, et al (2016) The constrained laplacian rank algorithm for graph-based clustering. In: Proceedings of the 30th AAAI Conference on Artificial Intelligence, pp 1969–1976 Nie F, Wang X, Jordan M I, et al (2016) The constrained laplacian rank algorithm for graph-based clustering. In: Proceedings of the 30th AAAI Conference on Artificial Intelligence, pp 1969–1976
39.
Zurück zum Zitat Strehl A, Ghosh J (2002) Cluster ensembles-a knowledge reuse framework for combining multiple partitions. J Mach Learn Res 3(3):583–617MathSciNet Strehl A, Ghosh J (2002) Cluster ensembles-a knowledge reuse framework for combining multiple partitions. J Mach Learn Res 3(3):583–617MathSciNet
40.
Zurück zum Zitat William M (1971) Objective criteria for the evaluation of clustering methods. J Am Stat Assoc 66(336):846–850CrossRef William M (1971) Objective criteria for the evaluation of clustering methods. J Am Stat Assoc 66(336):846–850CrossRef
41.
Zurück zum Zitat Demiar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNet Demiar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNet
Metadaten
Titel
A new semi-supervised fuzzy K-means clustering method with dynamic adjustment and label discrimination
verfasst von
Hengdong Zhu
Wenxiu Xie
Yuanyuan Mu
Juan Xu
Fu Lee Wang
Yingying Qu
Tianyong Hao
Publikationsdatum
18.12.2023
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 9/2024
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-023-09115-6

Weitere Artikel der Ausgabe 9/2024

Neural Computing and Applications 9/2024 Zur Ausgabe

Premium Partner