Skip to main content

2012 | OriginalPaper | Buchkapitel

3. Generalizing Distance Functions for Fuzzy c-Means Clustering

verfasst von : Junjie Wu

Erschienen in: Advances in K-means Clustering

Verlag: Springer Berlin Heidelberg

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Fuzzy \(c\)-means (FCM) is a well-known partitional clustering method, which allows an object to belong to two or more clusters with a membership grade between zero and one. Recently, due to the rich information conveyed by the membership grade matrix, FCM has been widely used in many real-world application domains where well-separated clusters are typically not available. In addition, people also recognize that the simple centroid-based iterative procedure of FCM is very appealing when dealing with large volume data.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Banerjee, A., Merugu, S., Dhillon, I., Ghosh, J.: Clusteringwith bregman divergences. J. Mach. Learn. Res. 6, 1705–1749 (2005)MathSciNetMATH Banerjee, A., Merugu, S., Dhillon, I., Ghosh, J.: Clusteringwith bregman divergences. J. Mach. Learn. Res. 6, 1705–1749 (2005)MathSciNetMATH
Zurück zum Zitat Bezdek, J.: A convergence theorem for the fuzzy isodata clustering algorithms. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-2(1), 1–8 (1980). Bezdek, J.: A convergence theorem for the fuzzy isodata clustering algorithms. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-2(1), 1–8 (1980).
Zurück zum Zitat Bezdek, J.: Pattern Recognition with Fuzzy Objective Function Algoritms. Plenum Press, New York (1981)CrossRef Bezdek, J.: Pattern Recognition with Fuzzy Objective Function Algoritms. Plenum Press, New York (1981)CrossRef
Zurück zum Zitat Bezdek, J., Hathaway, R., Huggins, V.: Parametric estimation for normal mixtures. Pattern Recognit. Lett. 3, 79–84 (1985)MATHCrossRef Bezdek, J., Hathaway, R., Huggins, V.: Parametric estimation for normal mixtures. Pattern Recognit. Lett. 3, 79–84 (1985)MATHCrossRef
Zurück zum Zitat Bobrowski, L., Bezdek, J.: C-means clustering with the \(l_1\) and \(l_\infty \) norms. IEEE Trans. Syst. Man Cybern. 21(3), 545–554 (1991)MathSciNetMATHCrossRef Bobrowski, L., Bezdek, J.: C-means clustering with the \(l_1\) and \(l_\infty \) norms. IEEE Trans. Syst. Man Cybern. 21(3), 545–554 (1991)MathSciNetMATHCrossRef
Zurück zum Zitat Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press, Cambridge (2004)MATH Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press, Cambridge (2004)MATH
Zurück zum Zitat Bregman, L.: The relaxation method of finding the common points of convex sets and its application to the solution of problems in convex programming. USSR Comput. Math. Math. Phys. 7, 200–217 (1967)CrossRef Bregman, L.: The relaxation method of finding the common points of convex sets and its application to the solution of problems in convex programming. USSR Comput. Math. Math. Phys. 7, 200–217 (1967)CrossRef
Zurück zum Zitat Chen, L., Ng, R.: On the marriage of lp-norms and edit distance. In: Proceedings of the 13th International Conference on Very Large Data Bases, pp. 792–803. Toronto, Canada (2004). Chen, L., Ng, R.: On the marriage of lp-norms and edit distance. In: Proceedings of the 13th International Conference on Very Large Data Bases, pp. 792–803. Toronto, Canada (2004).
Zurück zum Zitat Dav\(\acute{e}\), R.: Characterization and detection of noise in clustering. Pattern Recognit. Lett. 12(11), 657–664 (1991). Dav\(\acute{e}\), R.: Characterization and detection of noise in clustering. Pattern Recognit. Lett. 12(11), 657–664 (1991).
Zurück zum Zitat Dunn, J.: A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters. J. Cybern. 3, 32–57 (1973)MathSciNetMATHCrossRef Dunn, J.: A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters. J. Cybern. 3, 32–57 (1973)MathSciNetMATHCrossRef
Zurück zum Zitat Flanders, H.: Differential Forms with Applications to the Physical Sciences. Dover Publications, New York (1989)MATH Flanders, H.: Differential Forms with Applications to the Physical Sciences. Dover Publications, New York (1989)MATH
Zurück zum Zitat Golub, G., van Loan, C.: Matrix Computations. Johns Hopkins, Baltimore (1996)MATH Golub, G., van Loan, C.: Matrix Computations. Johns Hopkins, Baltimore (1996)MATH
Zurück zum Zitat Groll, L., Jakel, J.: A new convergence proof of fuzzy \(c\)-means. IEEE Trans. Fuzzy Syst. 13(5), 717–720 (2005)CrossRef Groll, L., Jakel, J.: A new convergence proof of fuzzy \(c\)-means. IEEE Trans. Fuzzy Syst. 13(5), 717–720 (2005)CrossRef
Zurück zum Zitat Hathaway, R., Bezdek, J.: Local convergence of the fuzzy \(c\)-means algorithms. Pattern Recognit. 19, 477–480 (1986)MATHCrossRef Hathaway, R., Bezdek, J.: Local convergence of the fuzzy \(c\)-means algorithms. Pattern Recognit. 19, 477–480 (1986)MATHCrossRef
Zurück zum Zitat Hathaway, R., Bezdek, J.: Recent convergence results for the fuzzy c-means clustering algorithms. J. Classif. 5, 237–247 (1988)MathSciNetCrossRef Hathaway, R., Bezdek, J.: Recent convergence results for the fuzzy c-means clustering algorithms. J. Classif. 5, 237–247 (1988)MathSciNetCrossRef
Zurück zum Zitat Hathaway, R., Bezdek, J., Tucker, W.: An improved convergence theory for the fuzzy c-means clustering algorithms. In: Bezdek, J. (ed.) Analysis of Fuzzy Information, vol. 3, pp. 123–131. CRC Press, Boca Raton (1987) Hathaway, R., Bezdek, J., Tucker, W.: An improved convergence theory for the fuzzy c-means clustering algorithms. In: Bezdek, J. (ed.) Analysis of Fuzzy Information, vol. 3, pp. 123–131. CRC Press, Boca Raton (1987)
Zurück zum Zitat Hathaway, R.J., Bezdek, J.C., Hu, Y.: Generalized fuzzy c-means clustering strategies using \(l_p\) norm distances. IEEE Trans. Fuzzy Syst. 8(5), 576–582 (2000)CrossRef Hathaway, R.J., Bezdek, J.C., Hu, Y.: Generalized fuzzy c-means clustering strategies using \(l_p\) norm distances. IEEE Trans. Fuzzy Syst. 8(5), 576–582 (2000)CrossRef
Zurück zum Zitat Honda, K., Notsu, A., Ichihashi, H.: Fuzzy pca-guided robust k-means clustering. IEEE Trans. Fuzzy Syst. 18(1), 67–79 (2010)CrossRef Honda, K., Notsu, A., Ichihashi, H.: Fuzzy pca-guided robust k-means clustering. IEEE Trans. Fuzzy Syst. 18(1), 67–79 (2010)CrossRef
Zurück zum Zitat Hoppner, F., Klawonn, F.: A contribution to convergence theory of fuzzy c-means and derivatives. IEEE Trans. Fuzzy Syst. 11(5), 682–694 (2003)CrossRef Hoppner, F., Klawonn, F.: A contribution to convergence theory of fuzzy c-means and derivatives. IEEE Trans. Fuzzy Syst. 11(5), 682–694 (2003)CrossRef
Zurück zum Zitat Hoppner, F., Klawonn, F., Kruse, R., Runkler, T.: Fuzzy Cluster Analysis. Wiley, New York (1999) Hoppner, F., Klawonn, F., Kruse, R., Runkler, T.: Fuzzy Cluster Analysis. Wiley, New York (1999)
Zurück zum Zitat Ismail, M., Selim, S.: Fuzzy \(c\)-means: optimality of solutions and effective termination of the algorithm. Pattern Recognit. 19, 481–485 (1984)CrossRef Ismail, M., Selim, S.: Fuzzy \(c\)-means: optimality of solutions and effective termination of the algorithm. Pattern Recognit. 19, 481–485 (1984)CrossRef
Zurück zum Zitat Karoubi, M., Leruste, C.: Algebraic Topology via Differential Geometry. Cambridge University Press, Cambridge (1987)MATH Karoubi, M., Leruste, C.: Algebraic Topology via Differential Geometry. Cambridge University Press, Cambridge (1987)MATH
Zurück zum Zitat Kersten, P.: Fuzzy order statistics and their application to fuzzy clustering. IEEE Trans. Fuzzy Syst. 7, 708–712 (1999)CrossRef Kersten, P.: Fuzzy order statistics and their application to fuzzy clustering. IEEE Trans. Fuzzy Syst. 7, 708–712 (1999)CrossRef
Zurück zum Zitat Kim, T., Bezdek, J., Hathaway, R.: Optimality tests for fixed points of the fcm algorithm. Pattern Recognit. 21(6), 651–663 (1988)MathSciNetMATHCrossRef Kim, T., Bezdek, J., Hathaway, R.: Optimality tests for fixed points of the fcm algorithm. Pattern Recognit. 21(6), 651–663 (1988)MathSciNetMATHCrossRef
Zurück zum Zitat Klawonn, F., Keller, A.: Fuzzy clustering based on modified distance measures. In: Proceedings of the 3rd International Symposium on Advances in, Intelligent Data Analysis, pp. 291–302 (1999). Klawonn, F., Keller, A.: Fuzzy clustering based on modified distance measures. In: Proceedings of the 3rd International Symposium on Advances in, Intelligent Data Analysis, pp. 291–302 (1999).
Zurück zum Zitat Leski, J.M.: Generalized weighted conditional fuzzy clustering. IEEE Trans. Fuzzy Syst. 11(6), 709–715 (2003)CrossRef Leski, J.M.: Generalized weighted conditional fuzzy clustering. IEEE Trans. Fuzzy Syst. 11(6), 709–715 (2003)CrossRef
Zurück zum Zitat Li, R., Mukaidono, M.: A maximum entropy to fuzzy clustering. In: Proceedings of 4th IEEE Internation Conference on Fuzzy Systems, pp. 2227–2232. Yokohama, Japan (1995). Li, R., Mukaidono, M.: A maximum entropy to fuzzy clustering. In: Proceedings of 4th IEEE Internation Conference on Fuzzy Systems, pp. 2227–2232. Yokohama, Japan (1995).
Zurück zum Zitat Luenberger, D., Ye, Y.: Linear and Nonlinear Programming, 3rd edn. Springer, New York (2008)MATH Luenberger, D., Ye, Y.: Linear and Nonlinear Programming, 3rd edn. Springer, New York (2008)MATH
Zurück zum Zitat MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, pp. 281–297 (1967). MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, pp. 281–297 (1967).
Zurück zum Zitat Meila, M.: Comparing clusterings-an axiomatic view. In: Proceedings of the 22nd International Conference on, Machine Learning, pp. 577–584 (2005). Meila, M.: Comparing clusterings-an axiomatic view. In: Proceedings of the 22nd International Conference on, Machine Learning, pp. 577–584 (2005).
Zurück zum Zitat Menard, M., Courboulay, V., Dardignac, P.: Possibistic and probabilistic fuzzy clustering: Unification within the framework of the nonextensive thermostatistics. Pattern Recognit. 36(6), 1325–1342 (2003)MATHCrossRef Menard, M., Courboulay, V., Dardignac, P.: Possibistic and probabilistic fuzzy clustering: Unification within the framework of the nonextensive thermostatistics. Pattern Recognit. 36(6), 1325–1342 (2003)MATHCrossRef
Zurück zum Zitat Miyamoto, S., Agusta, Y.: An efficient algorithm for \(l_1\) fuzzy \(c\)-means and its termination. Control Cybern. 24(4), 421–436 (1995)MATH Miyamoto, S., Agusta, Y.: An efficient algorithm for \(l_1\) fuzzy \(c\)-means and its termination. Control Cybern. 24(4), 421–436 (1995)MATH
Zurück zum Zitat Miyamoto, S., Ichihashi, H., Honda, K.: Algorithms for Fuzzy Clustering: Methods in c-Means Clustering with Applications. Springer, Berlin (2008)MATH Miyamoto, S., Ichihashi, H., Honda, K.: Algorithms for Fuzzy Clustering: Methods in c-Means Clustering with Applications. Springer, Berlin (2008)MATH
Zurück zum Zitat Miyamoto, S., Umayahara, K.: Fuzzy clustering by quadratic regularization. In: Proceedings of the 7th IEEE Internation Conference on Fuzzy Systems, pp. 394–1399 (1998). Miyamoto, S., Umayahara, K.: Fuzzy clustering by quadratic regularization. In: Proceedings of the 7th IEEE Internation Conference on Fuzzy Systems, pp. 394–1399 (1998).
Zurück zum Zitat Ohashi, Y.: Fuzzy clustering and robust estimation. In: Proceedings of the 9th SAS Users Group International Meeting. Hollywood Beach, FL, USA (1984). Ohashi, Y.: Fuzzy clustering and robust estimation. In: Proceedings of the 9th SAS Users Group International Meeting. Hollywood Beach, FL, USA (1984).
Zurück zum Zitat Pedrycz, W.: Conditional fuzzy \(c\)-means. Pattern Recognit. Lett. 17, 625–632 (1996)CrossRef Pedrycz, W.: Conditional fuzzy \(c\)-means. Pattern Recognit. Lett. 17, 625–632 (1996)CrossRef
Zurück zum Zitat Pedrycz, W., Loia, V., Senatore, S.: Fuzzy clustering with viewpoints. IEEE Trans. Fuzzy Syst. 18(2), 274–284 (2010) Pedrycz, W., Loia, V., Senatore, S.: Fuzzy clustering with viewpoints. IEEE Trans. Fuzzy Syst. 18(2), 274–284 (2010)
Zurück zum Zitat Rose, K., Gurewitz, E., Fox, G.: A deterministic annealing approach to clustering. Pattern Recognit. Lett. 11, 589–594 (1990)MATHCrossRef Rose, K., Gurewitz, E., Fox, G.: A deterministic annealing approach to clustering. Pattern Recognit. Lett. 11, 589–594 (1990)MATHCrossRef
Zurück zum Zitat Selim, S., Ismail, M.: On the local optimality of the fuzzy isodata clustering algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 8, 284–288 (1986)MATHCrossRef Selim, S., Ismail, M.: On the local optimality of the fuzzy isodata clustering algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 8, 284–288 (1986)MATHCrossRef
Zurück zum Zitat Sledge, I., Bezdek, J., Havens, T., Keller, J.: Relational generalizations of cluster validity indices. IEEE Trans. Fuzzy Syst. 18(4), 771–786 (2010)CrossRef Sledge, I., Bezdek, J., Havens, T., Keller, J.: Relational generalizations of cluster validity indices. IEEE Trans. Fuzzy Syst. 18(4), 771–786 (2010)CrossRef
Zurück zum Zitat Tan, P.N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Addison-Wesley, Boston (2005) Tan, P.N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Addison-Wesley, Boston (2005)
Zurück zum Zitat Teboulle, M.: A unified continuous optimization framework for center-based clustering methods. J. Mach. Learn. Res. 8, 65–102 (2007)MathSciNetMATH Teboulle, M.: A unified continuous optimization framework for center-based clustering methods. J. Mach. Learn. Res. 8, 65–102 (2007)MathSciNetMATH
Zurück zum Zitat Tucker, W.: Counterexamples to the convergence theorem for fuzzy isodata clustering algorithm. In: Bezdek, J. (ed.) Analysis of Fuzzy Information, vol. 3, pp. 109–122. CRC Press, Boca Raton (1987) Tucker, W.: Counterexamples to the convergence theorem for fuzzy isodata clustering algorithm. In: Bezdek, J. (ed.) Analysis of Fuzzy Information, vol. 3, pp. 109–122. CRC Press, Boca Raton (1987)
Zurück zum Zitat Wu, J., Xiong, H., Chen, J.: Adapting the right measures for k-means clustering. In: Proceedings of The 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 877–886 (2009). Wu, J., Xiong, H., Chen, J.: Adapting the right measures for k-means clustering. In: Proceedings of The 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 877–886 (2009).
Zurück zum Zitat Wu, J., Xiong, H., Liu, C., Chen, J.: A generalization of distance functions for fuzzy \(c\)-means clustering with centroids of arithmetic means. IEEE Trans. Fuzzy Syst. (Forthcoming, 2012). Wu, J., Xiong, H., Liu, C., Chen, J.: A generalization of distance functions for fuzzy \(c\)-means clustering with centroids of arithmetic means. IEEE Trans. Fuzzy Syst. (Forthcoming, 2012).
Zurück zum Zitat Wu, K., Yang, M.: Alternative \(c\)-means clustering algorithms. Pattern Recognit. 35, 2267–2278 (2002)MATHCrossRef Wu, K., Yang, M.: Alternative \(c\)-means clustering algorithms. Pattern Recognit. 35, 2267–2278 (2002)MATHCrossRef
Zurück zum Zitat Yang, M.: On a class of fuzzy classification maximum likelihood procedures. Fuzzy Sets Syst. 57, 365–375 (1993)MATHCrossRef Yang, M.: On a class of fuzzy classification maximum likelihood procedures. Fuzzy Sets Syst. 57, 365–375 (1993)MATHCrossRef
Zurück zum Zitat Yi, B.K., Faloutsos, C.: Fast time sequence indexing for arbitrary lp norms. In: Proceedings of the 26th International Conference on Very Large Data Bases, pp. 792–803. Cairo, Egypt (2000). Yi, B.K., Faloutsos, C.: Fast time sequence indexing for arbitrary lp norms. In: Proceedings of the 26th International Conference on Very Large Data Bases, pp. 792–803. Cairo, Egypt (2000).
Zurück zum Zitat Yu, J., Yang, M.S.: Optimality test for generalized fcm and its application to parameter selection. IEEE Trans. Fuzzy Syst. 13(1), 164–176 (2005)CrossRef Yu, J., Yang, M.S.: Optimality test for generalized fcm and its application to parameter selection. IEEE Trans. Fuzzy Syst. 13(1), 164–176 (2005)CrossRef
Zurück zum Zitat Yu, J., Yang, M.S.: A generalized fuzzy clustering regularization model with optimality tests and model complexity analysis. IEEE Trans. Fuzzy Syst. 15(5), 904–915 (2007)CrossRef Yu, J., Yang, M.S.: A generalized fuzzy clustering regularization model with optimality tests and model complexity analysis. IEEE Trans. Fuzzy Syst. 15(5), 904–915 (2007)CrossRef
Zurück zum Zitat Zangwill, W.: Nonlinear Programming: A Unified Approach. Prentice-Hall, Englewood Cliffs (1969)MATH Zangwill, W.: Nonlinear Programming: A Unified Approach. Prentice-Hall, Englewood Cliffs (1969)MATH
Zurück zum Zitat Zhao, Y., Karypis, G.: Criterion functions for document clustering: experiments and analysis. Mach. Learn. 55(3), 311–331 (2004)MATHCrossRef Zhao, Y., Karypis, G.: Criterion functions for document clustering: experiments and analysis. Mach. Learn. 55(3), 311–331 (2004)MATHCrossRef
Metadaten
Titel
Generalizing Distance Functions for Fuzzy c-Means Clustering
verfasst von
Junjie Wu
Copyright-Jahr
2012
Verlag
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-29807-3_3