Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 10/2019

02.01.2019 | Original Article

Three-way k-means: integrating k-means and three-way decision

verfasst von: Pingxin Wang, Hong Shi, Xibei Yang, Jusheng Mi

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 10/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The traditional k-means, which unambiguously assigns an object precisely to a single cluster with crisp boundary, does not adequately show the fact that a cluster may not have a well-defined cluster boundary. This paper presents a three-way k-means clustering algorithm based on three-way strategy. In the proposed method, an overlap clustering is used to obtain the supports (unions of the core regions and the fringe regions) of the clusters and perturbation analysis is applied to separate the core regions from the supports. The difference between the support and the core region is regarded as the fringe region of the specific cluster. Therefore, a three-way explanation of the cluster is naturally formed. Davies–Bouldin index (DB), Average Silhouette index (AS) and Accuracy (ACC) are computed by using core region to evaluate the structure of three-way k-means result. The experimental results on UCI data sets and USPS data sets show that such strategy is effective in improving the structure of clustering results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
2.
Zurück zum Zitat Bezdek J (1981) Pattern recognition with fuzzy objective function algorithms. Plenum Press, New YorkCrossRef Bezdek J (1981) Pattern recognition with fuzzy objective function algorithms. Plenum Press, New YorkCrossRef
3.
Zurück zum Zitat Bezdek J, Pal N (1998) Some new indexes of cluster validity. IEEE Trans Syst Man Cybern B 28:301–315CrossRef Bezdek J, Pal N (1998) Some new indexes of cluster validity. IEEE Trans Syst Man Cybern B 28:301–315CrossRef
5.
Zurück zum Zitat Hao C, Li JH, Fan M, Liu WQ, Tsang ECC (2017) Optimal scale selection in dynamic multi-scale decision tables based on sequential three-way decisions. Inf Sci 415:213–232CrossRef Hao C, Li JH, Fan M, Liu WQ, Tsang ECC (2017) Optimal scale selection in dynamic multi-scale decision tables based on sequential three-way decisions. Inf Sci 415:213–232CrossRef
6.
Zurück zum Zitat Huang CC, Li JH, Mei CL, Wu WZ (2017) Three-way concept learning based on cognitive operators: an information fusion viewpoint. Int J Approx Reason 83:218–242MathSciNetCrossRef Huang CC, Li JH, Mei CL, Wu WZ (2017) Three-way concept learning based on cognitive operators: an information fusion viewpoint. Int J Approx Reason 83:218–242MathSciNetCrossRef
7.
Zurück zum Zitat Jain AK (2010) Data clustering: 50 years beyond k-means. Pattern Recognit Lett 31:651–666CrossRef Jain AK (2010) Data clustering: 50 years beyond k-means. Pattern Recognit Lett 31:651–666CrossRef
8.
Zurück zum Zitat Jain AK, Murty MN, Flynn PJ (1999) Data clustering: a review. ACM Comput Surv 31:264–323CrossRef Jain AK, Murty MN, Flynn PJ (1999) Data clustering: a review. ACM Comput Surv 31:264–323CrossRef
9.
Zurück zum Zitat Kaufman L, Rousseeuw PJ (1990) Finding groups in data: an introduction to cluster analysis. Wiley, New YorkCrossRef Kaufman L, Rousseeuw PJ (1990) Finding groups in data: an introduction to cluster analysis. Wiley, New YorkCrossRef
10.
Zurück zum Zitat Lang GM, Miao DQ, Cai MJ (2017) Three-way decision approaches to conflict analysis using decision-theoretic rough set theory. Inf Sci 406:185–207CrossRef Lang GM, Miao DQ, Cai MJ (2017) Three-way decision approaches to conflict analysis using decision-theoretic rough set theory. Inf Sci 406:185–207CrossRef
12.
Zurück zum Zitat Li CP, Li JH, He M (2016) Concept lattice compression in incomplete contexts based on k-medoids clustering. Int J Mach Learn Cybern 7:539–552CrossRef Li CP, Li JH, He M (2016) Concept lattice compression in incomplete contexts based on k-medoids clustering. Int J Mach Learn Cybern 7:539–552CrossRef
13.
Zurück zum Zitat Li HX, Zhou XZ (2011) Risk decision making based on decision-theoretic rough set: a three-way view decision model. Int J Comput Inf Sys 4:1–11CrossRef Li HX, Zhou XZ (2011) Risk decision making based on decision-theoretic rough set: a three-way view decision model. Int J Comput Inf Sys 4:1–11CrossRef
14.
Zurück zum Zitat Li JH, Huang CC, Qi JJ, Qia YH, Liu WQ (2017) Three-way cognitive concept learning via multi-granularity. Inf Sci 378:244–263CrossRef Li JH, Huang CC, Qi JJ, Qia YH, Liu WQ (2017) Three-way cognitive concept learning via multi-granularity. Inf Sci 378:244–263CrossRef
15.
Zurück zum Zitat Li W, Miao DQ, Wang WL, Zhang N (2010) Hierarchical rough decision theoretic framework for text classification. In: IEEE international conference on cognitive informatics, pp 484–489 Li W, Miao DQ, Wang WL, Zhang N (2010) Hierarchical rough decision theoretic framework for text classification. In: IEEE international conference on cognitive informatics, pp 484–489
16.
Zurück zum Zitat Li Y, Zhang C, Swan JR (2000) An information filtering model on the web and its application in jobagent. Knowl-Based Syst 13:285–296CrossRef Li Y, Zhang C, Swan JR (2000) An information filtering model on the web and its application in jobagent. Knowl-Based Syst 13:285–296CrossRef
17.
Zurück zum Zitat Liang DC, Liu D (2015) A novel risk decision-making based on decision-theoretic rough sets under hesitant fuzzy information. IEEE Trans Fuzzy Syst 23:237–247CrossRef Liang DC, Liu D (2015) A novel risk decision-making based on decision-theoretic rough sets under hesitant fuzzy information. IEEE Trans Fuzzy Syst 23:237–247CrossRef
18.
Zurück zum Zitat Lingras P, West C (2004) Interval set clustering of web users with rough k-means. J Intell Inf Syst 23:5–16CrossRef Lingras P, West C (2004) Interval set clustering of web users with rough k-means. J Intell Inf Syst 23:5–16CrossRef
19.
Zurück zum Zitat Liu D, Li TR, Liang DC (2012) Three-way government decision analysis with decision-theoretic rough sets. Int J Uncertain Fuzz 20:119–132CrossRef Liu D, Li TR, Liang DC (2012) Three-way government decision analysis with decision-theoretic rough sets. Int J Uncertain Fuzz 20:119–132CrossRef
20.
Zurück zum Zitat Liu D, Yao YY, Li TR (2011) Three-way investment decisions with decision-theoretic rough sets. Int J Comput Inf Sys 4:66–74CrossRef Liu D, Yao YY, Li TR (2011) Three-way investment decisions with decision-theoretic rough sets. Int J Comput Inf Sys 4:66–74CrossRef
21.
Zurück zum Zitat Macqueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of 5th Berkeley symposium on mathematical statistics and probability, pp 281–197 Macqueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of 5th Berkeley symposium on mathematical statistics and probability, pp 281–197
22.
Zurück zum Zitat Maulik U, Bandyopadhyay S (2002) Performance evaluation of some clustering algorithms and validity indices. IEEE Trans Pattern Anal 24:1650–1654CrossRef Maulik U, Bandyopadhyay S (2002) Performance evaluation of some clustering algorithms and validity indices. IEEE Trans Pattern Anal 24:1650–1654CrossRef
23.
Zurück zum Zitat Mirkin B (1991) Mathematical classification and clustering. Kluwer, BostonMATH Mirkin B (1991) Mathematical classification and clustering. Kluwer, BostonMATH
24.
Zurück zum Zitat Mitra S, Banka H, Pedrycz W (2006) Rough-fuzzy collaborative clustering. IEEE Trans Syst Man Cybern B 36:795–805CrossRef Mitra S, Banka H, Pedrycz W (2006) Rough-fuzzy collaborative clustering. IEEE Trans Syst Man Cybern B 36:795–805CrossRef
25.
Zurück zum Zitat Mitra S, Pedrycz W, Barman B (2010) Shadowed c-means: integrating fuzzy and rough clustering. Pattern Recognit 43:1282–1291CrossRef Mitra S, Pedrycz W, Barman B (2010) Shadowed c-means: integrating fuzzy and rough clustering. Pattern Recognit 43:1282–1291CrossRef
26.
27.
Zurück zum Zitat Pawlak Z (1991) Rough sets: theoretical aspects of reasoning about data. Kluwer, BostonCrossRef Pawlak Z (1991) Rough sets: theoretical aspects of reasoning about data. Kluwer, BostonCrossRef
28.
Zurück zum Zitat Pawlak Z (2004) Some issues on rough sets. Trans Rough Sets I 3100:1–58CrossRef Pawlak Z (2004) Some issues on rough sets. Trans Rough Sets I 3100:1–58CrossRef
29.
Zurück zum Zitat Pedrycz W (1998) Shadowed sets: representing and processing fuzzy sets. IEEE Trans Syst Man Cybern B 28:103–109CrossRef Pedrycz W (1998) Shadowed sets: representing and processing fuzzy sets. IEEE Trans Syst Man Cybern B 28:103–109CrossRef
30.
Zurück zum Zitat Qi JJ, Qian T, Wei L (2016) The connections between three-way and classical concept lattices. Knowl-Based Syst 91:143–151CrossRef Qi JJ, Qian T, Wei L (2016) The connections between three-way and classical concept lattices. Knowl-Based Syst 91:143–151CrossRef
31.
Zurück zum Zitat Rousseeuw P (1987) Silhouettes: a graphical aid to the interpreta-tion and validation of cluster analysis. J Comput Math Appl Math 20:53–65CrossRef Rousseeuw P (1987) Silhouettes: a graphical aid to the interpreta-tion and validation of cluster analysis. J Comput Math Appl Math 20:53–65CrossRef
32.
Zurück zum Zitat Shivhare R, Cherukuri AK (2017) Three-way conceptual approach for cognitive memory functionalities. Int J Mach Learn Cybern 8:21–34CrossRef Shivhare R, Cherukuri AK (2017) Three-way conceptual approach for cognitive memory functionalities. Int J Mach Learn Cybern 8:21–34CrossRef
33.
Zurück zum Zitat Singh PK (2016) Three-way fuzzy concept lattice representation using neutrosophic set. Int J Mach Learn Cybern 8:1–11 Singh PK (2016) Three-way fuzzy concept lattice representation using neutrosophic set. Int J Mach Learn Cybern 8:1–11
34.
Zurück zum Zitat Singh PK (2017) Interval-valued neutrosophic graph representation of concept lattice and its (\(\alpha,\beta,\gamma\))-decomposition. Arab J Sci Eng 43:1–18 Singh PK (2017) Interval-valued neutrosophic graph representation of concept lattice and its (\(\alpha,\beta,\gamma\))-decomposition. Arab J Sci Eng 43:1–18
35.
Zurück zum Zitat Singh PK (2018) Similar vague concepts selection using their Euclidean distance at different granulation. Cogn Comput 10:228–241CrossRef Singh PK (2018) Similar vague concepts selection using their Euclidean distance at different granulation. Cogn Comput 10:228–241CrossRef
36.
Zurück zum Zitat Singh PK (2018) Concept learning using vague concept lattice. Neural Process Lett 48:31–52CrossRef Singh PK (2018) Concept learning using vague concept lattice. Neural Process Lett 48:31–52CrossRef
37.
Zurück zum Zitat Singh PK (2017) Medical diagnoses using three-way fuzzy concept lattice and their euclidean distance. Comp Appl Math 3:1–24CrossRef Singh PK (2017) Medical diagnoses using three-way fuzzy concept lattice and their euclidean distance. Comp Appl Math 3:1–24CrossRef
38.
Zurück zum Zitat Tou JT, Gonzalez RC (1974) Pattern recognition principles. Addison-Wesley, LondonMATH Tou JT, Gonzalez RC (1974) Pattern recognition principles. Addison-Wesley, LondonMATH
39.
Zurück zum Zitat Wang PX, Yao YY (2018) CE3: A three-way clustering method based on mathematical morphology. Knowl-Based Syst 155:54–65CrossRef Wang PX, Yao YY (2018) CE3: A three-way clustering method based on mathematical morphology. Knowl-Based Syst 155:54–65CrossRef
40.
Zurück zum Zitat Xu R, Wunsch DC (2005) Survey of clustering algorithms. IEEE Trans Neural Netw 16:645–678CrossRef Xu R, Wunsch DC (2005) Survey of clustering algorithms. IEEE Trans Neural Netw 16:645–678CrossRef
41.
Zurück zum Zitat Yang X, Li TR, Fujita H, Liu D, Yao YY (2017) A unified model of sequential three-way decisions and multilevel incremental processing. Knowl-Based Syst 134:172–188CrossRef Yang X, Li TR, Fujita H, Liu D, Yao YY (2017) A unified model of sequential three-way decisions and multilevel incremental processing. Knowl-Based Syst 134:172–188CrossRef
42.
Zurück zum Zitat Yao JT (2015) Web-based medical decision support systems for three-way medical decision making with game-theoretic rough sets. IEEE Trans Fuzzy Syst 23:3–15CrossRef Yao JT (2015) Web-based medical decision support systems for three-way medical decision making with game-theoretic rough sets. IEEE Trans Fuzzy Syst 23:3–15CrossRef
43.
Zurück zum Zitat Yao YY (2009) Three-way decision: an interpretation of rules in rough set theory. In: Proceedings of RSKT’09, vol 5589, pp 642–649CrossRef Yao YY (2009) Three-way decision: an interpretation of rules in rough set theory. In: Proceedings of RSKT’09, vol 5589, pp 642–649CrossRef
45.
Zurück zum Zitat Yao YY (2011) The superiority of three-way decisions in probabilistic rough set models. Inf Sci 181:1080–1096MathSciNetCrossRef Yao YY (2011) The superiority of three-way decisions in probabilistic rough set models. Inf Sci 181:1080–1096MathSciNetCrossRef
46.
Zurück zum Zitat Yao YY (2012) An outline of a theory of three-way decisions. In: Proceedings of RSCTC’12, vol 7413, pp 1–17CrossRef Yao YY (2012) An outline of a theory of three-way decisions. In: Proceedings of RSCTC’12, vol 7413, pp 1–17CrossRef
47.
Zurück zum Zitat Yao YY (2016) Three-way decisions and cognitive computing. Cogn Comput 8:543–554CrossRef Yao YY (2016) Three-way decisions and cognitive computing. Cogn Comput 8:543–554CrossRef
48.
Zurück zum Zitat Yao YY (2017) Interval sets and three-way concept analysis in incomplete contexts. Int J Mach Learn Cybern 8:3–20CrossRef Yao YY (2017) Interval sets and three-way concept analysis in incomplete contexts. Int J Mach Learn Cybern 8:3–20CrossRef
49.
Zurück zum Zitat Yu H (2017) A framework of three-way cluster analysis. In: Proceedings of international joint conference on rough sets, pp 300–312CrossRef Yu H (2017) A framework of three-way cluster analysis. In: Proceedings of international joint conference on rough sets, pp 300–312CrossRef
50.
Zurück zum Zitat Yu H, Jiao P, Yao YY, Wang GY (2016) Detecting and refining overlapping regions in complex networks with three-way decisions. Inf Sci 373:21–41CrossRef Yu H, Jiao P, Yao YY, Wang GY (2016) Detecting and refining overlapping regions in complex networks with three-way decisions. Inf Sci 373:21–41CrossRef
52.
Zurück zum Zitat Yu H, Zhang C, Wang GY (2016) A tree-based incremental overlapping clustering method using the three-way decision theory. Knowl-Based Syst 91:189–203CrossRef Yu H, Zhang C, Wang GY (2016) A tree-based incremental overlapping clustering method using the three-way decision theory. Knowl-Based Syst 91:189–203CrossRef
53.
Zurück zum Zitat Zhang QH, Lv GX, Chen YH, Wang GY (2018) A dynamic three-way decision model based on the updating of attribute values. Knowl-Based Syst 142:71–84CrossRef Zhang QH, Lv GX, Chen YH, Wang GY (2018) A dynamic three-way decision model based on the updating of attribute values. Knowl-Based Syst 142:71–84CrossRef
54.
Zurück zum Zitat Zhang QH, Xia DY, Wang GY (2017) Three-way decision model with two types of classification errors. Inf Sci 420:431–453MathSciNetCrossRef Zhang QH, Xia DY, Wang GY (2017) Three-way decision model with two types of classification errors. Inf Sci 420:431–453MathSciNetCrossRef
Metadaten
Titel
Three-way k-means: integrating k-means and three-way decision
verfasst von
Pingxin Wang
Hong Shi
Xibei Yang
Jusheng Mi
Publikationsdatum
02.01.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 10/2019
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-018-0901-y

Weitere Artikel der Ausgabe 10/2019

International Journal of Machine Learning and Cybernetics 10/2019 Zur Ausgabe