Skip to main content
Top

2017 | OriginalPaper | Chapter

Contributions of Fuzzy Concepts to Data Clustering

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter tries to answer the fundamental question of what main contributions of fuzzy clustering to the theory of cluster analysis from theoretical viewpoints. While fuzzy clustering is thought to be clearly useful by users of this technique, others think that the concept of fuzziness is not needed in clustering. Thus the usefulness of fuzzy clustering is not trivial. The discussion here is divided into two: one is on fuzzy c-means which is best-known fuzzy method of clustering. However, there is another techniques, discussed by Zadeh, in hierarchical clustering which is equivalent to the old technique of the single linkage. This chapter overviews the both techniques, beginning from basic discussion of fuzzy c-means, and introducing the fundamental concept of fuzzy classifiers and its usefulness. A concept of inductive clustering is introduced which means that a result of clustering can be extended to a partition of the whole space. Moreover hierarchical fuzzy clustering is briefly discussed where the transitive closure gives a simple algebraic form of clusters.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference S. Basu, I. Davidson, K.L. Wagstaff, Constrained Clustering, CRC Press, Boca Raton, 2009. S. Basu, I. Davidson, K.L. Wagstaff, Constrained Clustering, CRC Press, Boca Raton, 2009.
2.
go back to reference J.C. Bezdek, Fuzzy Mathematics in Pattern Classification, Ph.D. Thesis, Cornell Univ., Ithaca, NY, 1973. J.C. Bezdek, Fuzzy Mathematics in Pattern Classification, Ph.D. Thesis, Cornell Univ., Ithaca, NY, 1973.
3.
go back to reference J.C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, 1981. J.C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, 1981.
4.
go back to reference J.C. Bezdek, J. Keller, R. Krishnapuram, N.R. Pal, Fuzzy Models and Algorithms for Pattern Recognition and Image Processing, Kluwer, Boston, 1999. J.C. Bezdek, J. Keller, R. Krishnapuram, N.R. Pal, Fuzzy Models and Algorithms for Pattern Recognition and Image Processing, Kluwer, Boston, 1999.
5.
go back to reference O. Chapelle, B. Schölkopf, A. Zien, eds., Semi-Supervised Learning, MIT Press, Cambridge, Massachusetts, 2006. O. Chapelle, B. Schölkopf, A. Zien, eds., Semi-Supervised Learning, MIT Press, Cambridge, Massachusetts, 2006.
6.
go back to reference R.N. Davé, R. Krishnapuram, Robust clustering methods: a unified view, IEEE Trans. on Fuzzy Systems, Vol. 5, pp. 270–293, 1997. R.N. Davé, R. Krishnapuram, Robust clustering methods: a unified view, IEEE Trans. on Fuzzy Systems, Vol. 5, pp. 270–293, 1997.
7.
go back to reference D. Dumitrescu, B. Lazzerini, L.C. Jain, Fuzzy Sets and Their Application to Clustering and Training, CRC Press, Boca Raton, Florida, 2000. D. Dumitrescu, B. Lazzerini, L.C. Jain, Fuzzy Sets and Their Application to Clustering and Training, CRC Press, Boca Raton, Florida, 2000.
8.
go back to reference R.O. Duda, P.E. Hart, Pattern Classification and Scene Analysis, John Wiley & Sons, 1973. R.O. Duda, P.E. Hart, Pattern Classification and Scene Analysis, John Wiley & Sons, 1973.
9.
go back to reference J.C. Dunn, A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters, J. of Cybernetics, Vol. 3, pp. 32–57, 1974. J.C. Dunn, A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters, J. of Cybernetics, Vol. 3, pp. 32–57, 1974.
10.
go back to reference J.C. Dunn, Well-separated clusters and optimal fuzzy partitions, J. of Cybernetics, Vol. 4, pp. 95–104, 1974. J.C. Dunn, Well-separated clusters and optimal fuzzy partitions, J. of Cybernetics, Vol. 4, pp. 95–104, 1974.
11.
go back to reference M. Ester, H.-P. Kriegel, J. Sander, X.W. Xu, A density-based algorithm for discovering clusters in large spatial databases with noise, Proc. of 2nd Intern. Conf. on Knowledge Discovery and Data Mining (KDD-96), AAAI Press, pp. 226–231, 1996. M. Ester, H.-P. Kriegel, J. Sander, X.W. Xu, A density-based algorithm for discovering clusters in large spatial databases with noise, Proc. of 2nd Intern. Conf. on Knowledge Discovery and Data Mining (KDD-96), AAAI Press, pp. 226–231, 1996.
12.
go back to reference B.S. Everitt, Cluster Analysis, 3rd Ed., Arnold, London, 1993. B.S. Everitt, Cluster Analysis, 3rd Ed., Arnold, London, 1993.
13.
go back to reference M. Girolami, Mercer kernel based clustering in feature space, IEEE Trans. on Neural Networks, Vol. 13, No. 3, pp. 780–784, 2002. M. Girolami, Mercer kernel based clustering in feature space, IEEE Trans. on Neural Networks, Vol. 13, No. 3, pp. 780–784, 2002.
14.
go back to reference E.E. Gustafson, W.C. Kessel, Fuzzy clustering with a fuzzy covariance matrix, IEEE CDC, San Diego, California, pp. 761–766, 1979. E.E. Gustafson, W.C. Kessel, Fuzzy clustering with a fuzzy covariance matrix, IEEE CDC, San Diego, California, pp. 761–766, 1979.
15.
go back to reference R.J. Hathaway, J.C. Bezdek, Switching regression models and fuzzy clustering, IEEE Trans. on Fuzzy Systems, Vol. 1, No. 3, pp. 195–204, 1993. R.J. Hathaway, J.C. Bezdek, Switching regression models and fuzzy clustering, IEEE Trans. on Fuzzy Systems, Vol. 1, No. 3, pp. 195–204, 1993.
16.
go back to reference F. Höppner, F. Klawonn, R. Kruse, T. Runkler, Fuzzy Cluster Analysis, Jhon Wiley & Sons, 1999 F. Höppner, F. Klawonn, R. Kruse, T. Runkler, Fuzzy Cluster Analysis, Jhon Wiley & Sons, 1999
17.
go back to reference H. Ichihashi, K. Honda, N. Tani, Gaussian mixture PDF approximation and fuzzy c-means clustering with entropy regularization, Proc. of Fourth Asian Fuzzy Systems Symposium, Vol. 1, pp. 217–221, 2000. H. Ichihashi, K. Honda, N. Tani, Gaussian mixture PDF approximation and fuzzy c-means clustering with entropy regularization, Proc. of Fourth Asian Fuzzy Systems Symposium, Vol. 1, pp. 217–221, 2000.
18.
go back to reference H. Ichihashi, K. Miyagishi, K. Honda, Fuzzy c-means clustering with regularization by K-L information, Proc. of 10th IEEE International Conference on Fuzzy Systems, Vol. 2, pp. 924–927, 2001. H. Ichihashi, K. Miyagishi, K. Honda, Fuzzy c-means clustering with regularization by K-L information, Proc. of 10th IEEE International Conference on Fuzzy Systems, Vol. 2, pp. 924–927, 2001.
19.
go back to reference A.K. Jain, R.C. Dubes, Algorithms for Clustering Data, Prentice Hall, Englewood Cliffs, NJ, 1988. A.K. Jain, R.C. Dubes, Algorithms for Clustering Data, Prentice Hall, Englewood Cliffs, NJ, 1988.
20.
go back to reference L. Kaufman, P.J. Rousseeuw, Finding Groups in Data: An Introduction to Cluster Analysis, Wiley, New York, 1990. L. Kaufman, P.J. Rousseeuw, Finding Groups in Data: An Introduction to Cluster Analysis, Wiley, New York, 1990.
21.
go back to reference T. Kohonen, Self-Organizing Maps, 2nd Ed., Springer, Berlin, 1997. T. Kohonen, Self-Organizing Maps, 2nd Ed., Springer, Berlin, 1997.
22.
go back to reference R. Krishnapuram, J. M. Keller, A possibilistic approach to clustering, IEEE Trans. on Fuzzy Systems, Vol. 1, pp. 98–110, 1993. R. Krishnapuram, J. M. Keller, A possibilistic approach to clustering, IEEE Trans. on Fuzzy Systems, Vol. 1, pp. 98–110, 1993.
23.
go back to reference R.-P. Li and M. Mukaidono, A maximum entropy approach to fuzzy clustering, Proc. of the 4th IEEE Intern. Conf. on Fuzzy Systems (FUZZ-IEEE/IFES’95), Yokohama, Japan, March 20–24, 1995, pp. 2227–2232, 1995. R.-P. Li and M. Mukaidono, A maximum entropy approach to fuzzy clustering, Proc. of the 4th IEEE Intern. Conf. on Fuzzy Systems (FUZZ-IEEE/IFES’95), Yokohama, Japan, March 20–24, 1995, pp. 2227–2232, 1995.
24.
go back to reference J.B. MacQueen, Some methods of classification and analysis of multivariate observations, Proc. of 5th Berkeley Symposium on Math. Stat. and Prob., pp. 281–297, 1967. J.B. MacQueen, Some methods of classification and analysis of multivariate observations, Proc. of 5th Berkeley Symposium on Math. Stat. and Prob., pp. 281–297, 1967.
25.
go back to reference G. McLachlan, D. Peel, Finite Mixture Models, Wiley, New York, 2000. G. McLachlan, D. Peel, Finite Mixture Models, Wiley, New York, 2000.
26.
go back to reference S. Miyamoto, Fuzzy Sets in Information Retrieval and Cluster Analysis, Kluwer, Dordrecht, 1990. S. Miyamoto, Fuzzy Sets in Information Retrieval and Cluster Analysis, Kluwer, Dordrecht, 1990.
27.
go back to reference S. Miyamoto, M. Mukaidono, Fuzzy \(c\)-means as a regularization and maximum entropy approach, Proc. of the 7th International Fuzzy Systems Association World Congress (IFSA’97), June 25–30, 1997, Prague, Czech, Vol. II, pp. 86–92, 1997. S. Miyamoto, M. Mukaidono, Fuzzy \(c\)-means as a regularization and maximum entropy approach, Proc. of the 7th International Fuzzy Systems Association World Congress (IFSA’97), June 25–30, 1997, Prague, Czech, Vol. II, pp. 86–92, 1997.
28.
go back to reference S. Miyamoto, Introduction to Cluster Analysis, Morikita-Shuppan, Tokyo, 1999 (in Japanese). S. Miyamoto, Introduction to Cluster Analysis, Morikita-Shuppan, Tokyo, 1999 (in Japanese).
29.
go back to reference S. Miyamoto, D. Suizu, Fuzzy \(c\)-means clustering using kernel functions in support vector machines, Journal of Advanced Computational Intelligence and Intelligent Informatics, Vol. 7, No. 1, pp. 25–30, 2003. S. Miyamoto, D. Suizu, Fuzzy \(c\)-means clustering using kernel functions in support vector machines, Journal of Advanced Computational Intelligence and Intelligent Informatics, Vol. 7, No. 1, pp. 25–30, 2003.
30.
go back to reference S. Miyamoto, H. Ichihashi, K. Honda, Algorithms for Fuzzy Clustering, Springer, Berlin, 2008. S. Miyamoto, H. Ichihashi, K. Honda, Algorithms for Fuzzy Clustering, Springer, Berlin, 2008.
31.
go back to reference S. Miyamoto, Statistical and non-statistical models in clustering: an introduction and recent topics, A. Okada, D. Vicari, G. Ragozini, Eds., Analysis and Modelling of Complex Data in Behavioural and Social Sciences, JCS-CLADAG 12, Anacapri, Italy, Sept. 3–4, 2012, Cleup, Padova, ISBN 978-88-6129-916-0, pp. 3–6 (Web and USB Proc.) 2012. S. Miyamoto, Statistical and non-statistical models in clustering: an introduction and recent topics, A. Okada, D. Vicari, G. Ragozini, Eds., Analysis and Modelling of Complex Data in Behavioural and Social Sciences, JCS-CLADAG 12, Anacapri, Italy, Sept. 3–4, 2012, Cleup, Padova, ISBN 978-88-6129-916-0, pp. 3–6 (Web and USB Proc.) 2012.
32.
go back to reference S. Miyamoto, An Overview of Hierarchical and Non-hierarchical Algorithms of Clustering for Semi-supervised Classification, V. Torra et al. (Eds.): MDAI 2012, LNAI 7647, pp. 1–10, 2012. S. Miyamoto, An Overview of Hierarchical and Non-hierarchical Algorithms of Clustering for Semi-supervised Classification, V. Torra et al. (Eds.): MDAI 2012, LNAI 7647, pp. 1–10, 2012.
33.
go back to reference S. Miyamoto, Inductive and Non-inductive Methods of Clustering, Proc. of 2012 IEEE International Conference on Granular Computing, Aug. 11–12, Hangzhou, China, pp. 12–17, 2012. S. Miyamoto, Inductive and Non-inductive Methods of Clustering, Proc. of 2012 IEEE International Conference on Granular Computing, Aug. 11–12, Hangzhou, China, pp. 12–17, 2012.
34.
go back to reference R.A. Redner, H.F. Walker, Mixture densities, maximum likelihood and the EM algorithm, SIAM Review, Vol. 26, No. 2, pp. 195–239, 1984. R.A. Redner, H.F. Walker, Mixture densities, maximum likelihood and the EM algorithm, SIAM Review, Vol. 26, No. 2, pp. 195–239, 1984.
35.
go back to reference K. Rose, E. Gurewitz, and G. Fox, “A deterministic annealing approach to clustering,” Pattern Recognition Letters, Vol. 11, pp. 589–594, 1990. K. Rose, E. Gurewitz, and G. Fox, “A deterministic annealing approach to clustering,” Pattern Recognition Letters, Vol. 11, pp. 589–594, 1990.
36.
go back to reference B. Schölkopf, A.J. Smola, Learning with Kernels, the MIT Press, 2002. B. Schölkopf, A.J. Smola, Learning with Kernels, the MIT Press, 2002.
37.
go back to reference N. Shental, A. Bar-Hillel, T. Hertz, D. Weinshall, Computing Gaussian mixture models with EM using equivalence constraints, In: Advances in Neural Information Processing Systems, Vol. 16, 2004. N. Shental, A. Bar-Hillel, T. Hertz, D. Weinshall, Computing Gaussian mixture models with EM using equivalence constraints, In: Advances in Neural Information Processing Systems, Vol. 16, 2004.
38.
go back to reference V.N. Vapnik, Statistical Learning Theory, Wiley, New York, 1998. V.N. Vapnik, Statistical Learning Theory, Wiley, New York, 1998.
39.
go back to reference V.N. Vapnik, The Nature of Statistical Learning Theory: 2nd Ed., Springer, New York, 2000. V.N. Vapnik, The Nature of Statistical Learning Theory: 2nd Ed., Springer, New York, 2000.
40.
go back to reference N. Wang, X. Li, X. Luo, Semi-supervised Kernel-based Fuzzy \(c\)-Means with Pairwise Constraints, Proc. of WCCI 2008, pp. 1099–1103, 2008. N. Wang, X. Li, X. Luo, Semi-supervised Kernel-based Fuzzy \(c\)-Means with Pairwise Constraints, Proc. of WCCI 2008, pp. 1099–1103, 2008.
41.
go back to reference Wishart, D.: Mode analysis: a generalization of nearest neighbour which reduces chaining effects, In: A.J. Cole, ed., Numerical Taxonomy, Proc. Colloq., in Numerical Taxonomy, Univ. of St. Andrews, pp. 283–311, 1968. Wishart, D.: Mode analysis: a generalization of nearest neighbour which reduces chaining effects, In: A.J. Cole, ed., Numerical Taxonomy, Proc. Colloq., in Numerical Taxonomy, Univ. of St. Andrews, pp. 283–311, 1968.
42.
go back to reference L.A. Zadeh, Similarity relations and fuzzy orderings, Information Sciences, Vol. 3, pp. 177–200, 1971. L.A. Zadeh, Similarity relations and fuzzy orderings, Information Sciences, Vol. 3, pp. 177–200, 1971.
43.
go back to reference X. Zhu, A.B. Goldberg, Introduction to Semi-Supervised Learning, Morgan and Claypool, 2009. X. Zhu, A.B. Goldberg, Introduction to Semi-Supervised Learning, Morgan and Claypool, 2009.
Metadata
Title
Contributions of Fuzzy Concepts to Data Clustering
Author
Sadaaki Miyamoto
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-47557-8_2

Premium Partner