Skip to main content

2015 | OriginalPaper | Buchkapitel

On Possibilistic Clustering Methods Based on Shannon/Tsallis-Entropy for Spherical Data and Categorical Multivariate Data

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, four possibilistic clustering methods are proposed. First, we propose two possibilistic clustering methods for spherical data — one based on Shannon entropy, and the other on Tsallis entropy. These methods are derived by subtracting the cosine correlation between an object and a cluster center from 1, to obtain the object-cluster dissimilarity. These methods are derived from the proposed spherical data methods by considering analogies between the spherical and categorical multivariate fuzzy clustering methods, in which the fuzzy methods’ object-cluster similarity calculation is modified to accommodate the proposed possibilistic methods. The validity of the proposed methods is verified through numerical examples.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bezdek, J.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)CrossRefMATH Bezdek, J.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)CrossRefMATH
2.
Zurück zum Zitat MacQueen, J.B.: Some methods of classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and probability, pp. 281–297 (1967) MacQueen, J.B.: Some methods of classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and probability, pp. 281–297 (1967)
3.
Zurück zum Zitat Miyamoto, S., Mukaidono, M.: Fuzzy \(c\)-means as a regularization and maximum entropy approach. In: Proceedings of 7th International Fuzzy Systems Association World Congress (IFSA 1997), vol. 2, pp. 86–92 (1997) Miyamoto, S., Mukaidono, M.: Fuzzy \(c\)-means as a regularization and maximum entropy approach. In: Proceedings of 7th International Fuzzy Systems Association World Congress (IFSA 1997), vol. 2, pp. 86–92 (1997)
4.
Zurück zum Zitat Ménard, M., Courboulay, V., Dardignac, P.: Possibilistic and probabilistic fuzzy clustering: unification within the framework of the non-extensive thermostatistics. Pattern Recogn. 36, 1325–1342 (2003)CrossRefMATH Ménard, M., Courboulay, V., Dardignac, P.: Possibilistic and probabilistic fuzzy clustering: unification within the framework of the non-extensive thermostatistics. Pattern Recogn. 36, 1325–1342 (2003)CrossRefMATH
5.
Zurück zum Zitat Krishnapuram, R., Keller, J.M.: A possibilistic approach to clustering. IEEE Trans. Fuzzy Syst. 1, 98–110 (1993)CrossRefMATH Krishnapuram, R., Keller, J.M.: A possibilistic approach to clustering. IEEE Trans. Fuzzy Syst. 1, 98–110 (1993)CrossRefMATH
6.
Zurück zum Zitat Krishnapuram, R., Keller, J.M.: The possibilistic \(c\)-means algorithm: insights and recommendations. IEEE Trans. Fuzzy Syst. 4, 393–396 (1996)CrossRefMATH Krishnapuram, R., Keller, J.M.: The possibilistic \(c\)-means algorithm: insights and recommendations. IEEE Trans. Fuzzy Syst. 4, 393–396 (1996)CrossRefMATH
7.
Zurück zum Zitat Strehl, A., Ghosh, J., Mooney, R.: Impact of similarity measures on web-page clustering. In: Proceedings of AAAI 2000, pp. 58–64 (2000) Strehl, A., Ghosh, J., Mooney, R.: Impact of similarity measures on web-page clustering. In: Proceedings of AAAI 2000, pp. 58–64 (2000)
8.
Zurück zum Zitat Dhillon, I.S., Modha, D.S.: Concept decompositions for large sparse text data using clustering. Mach. Learn. 42, 143–175 (2001)CrossRefMATH Dhillon, I.S., Modha, D.S.: Concept decompositions for large sparse text data using clustering. Mach. Learn. 42, 143–175 (2001)CrossRefMATH
9.
Zurück zum Zitat Miyamoto, S., Mizutani, K.: Fuzzy multiset model and methods of nonlinear document clustering for information retrieval. In: Torra, V., Narukawa, Y. (eds.) MDAI 2004. LNCS (LNAI), vol. 3131, pp. 273–283. Springer, Heidelberg (2004) CrossRef Miyamoto, S., Mizutani, K.: Fuzzy multiset model and methods of nonlinear document clustering for information retrieval. In: Torra, V., Narukawa, Y. (eds.) MDAI 2004. LNCS (LNAI), vol. 3131, pp. 273–283. Springer, Heidelberg (2004) CrossRef
10.
Zurück zum Zitat Mizutani, K., Inokuchi, R., Miyamoto, S.: Algorithms of nonlinear document clustering based on fuzzy set model. Int. J. Intell. Syst. 23(2), 176–198 (2008)CrossRefMATH Mizutani, K., Inokuchi, R., Miyamoto, S.: Algorithms of nonlinear document clustering based on fuzzy set model. Int. J. Intell. Syst. 23(2), 176–198 (2008)CrossRefMATH
11.
Zurück zum Zitat Kanzawa, Y.: Maximizing model of bezdek-like spherical fuzzy \(c\)-means clustering. In: Proceedings of the FUZZ-IEEE 2014, pp. 2482–2488 (2014) Kanzawa, Y.: Maximizing model of bezdek-like spherical fuzzy \(c\)-means clustering. In: Proceedings of the FUZZ-IEEE 2014, pp. 2482–2488 (2014)
12.
Zurück zum Zitat Kanzawa, Y.: On kernelization for a maximizing model of bezdek-like spherical fuzzy c-means clustering. In: Torra, V., Narukawa, Y., Endo, Y. (eds.) MDAI 2014. LNCS, vol. 8825, pp. 108–121. Springer, Heidelberg (2014) Kanzawa, Y.: On kernelization for a maximizing model of bezdek-like spherical fuzzy c-means clustering. In: Torra, V., Narukawa, Y., Endo, Y. (eds.) MDAI 2014. LNCS, vol. 8825, pp. 108–121. Springer, Heidelberg (2014)
13.
Zurück zum Zitat Kanzawa, Y: Fuzzy clustering based on \(\alpha \)-divergence for spherical data and for categorical multivariate data. In: Proceedings of the FUZZ-IEEE 2015, (to appear) Kanzawa, Y: Fuzzy clustering based on \(\alpha \)-divergence for spherical data and for categorical multivariate data. In: Proceedings of the FUZZ-IEEE 2015, (to appear)
14.
Zurück zum Zitat Oh, C., Honda, K., Ichihashi, H.: Fuzzy clustering for categorical multivariate data. In: Proceedings of the IFSA World Congress and 20th NAFIPS International Conference, pp. 2154–2159 (2001) Oh, C., Honda, K., Ichihashi, H.: Fuzzy clustering for categorical multivariate data. In: Proceedings of the IFSA World Congress and 20th NAFIPS International Conference, pp. 2154–2159 (2001)
15.
Zurück zum Zitat Honda, K., Oshio, S., Notsu, A.: FCM-type fuzzy co-clustering by K-L information regularization. In: Proceedings of 2014 IEEE International Conference on Fuzzy Systems, pp. 2505–2510 (2014) Honda, K., Oshio, S., Notsu, A.: FCM-type fuzzy co-clustering by K-L information regularization. In: Proceedings of 2014 IEEE International Conference on Fuzzy Systems, pp. 2505–2510 (2014)
16.
Zurück zum Zitat Honda, K., Oshio, S., Notsu, A.: Item membership fuzzification in fuzzy co-clustering based on multinomial mixture concept. In: Proceedings of 2014 IEEE International Conference on Granular Computing, pp. 94–99 (2014) Honda, K., Oshio, S., Notsu, A.: Item membership fuzzification in fuzzy co-clustering based on multinomial mixture concept. In: Proceedings of 2014 IEEE International Conference on Granular Computing, pp. 94–99 (2014)
17.
Zurück zum Zitat Kummamuru, K., Dhawaie, A., Krishnapuram, R.: Fuzzy co-clustering of document and keywords. In: IEEE Proceedings of FUZZ 2003, vol. 2, pp. 772–777 (2003) Kummamuru, K., Dhawaie, A., Krishnapuram, R.: Fuzzy co-clustering of document and keywords. In: IEEE Proceedings of FUZZ 2003, vol. 2, pp. 772–777 (2003)
18.
Zurück zum Zitat Miyamoto, S., Inokuchi, R., Kuroda, Y.: Possibilistic and fuzzy \(c\)-means clustering with weighted objects. In: Proceedings of 2006 IEEE International Conference on Fuzzy Systems, pp. 869–874 (2006) Miyamoto, S., Inokuchi, R., Kuroda, Y.: Possibilistic and fuzzy \(c\)-means clustering with weighted objects. In: Proceedings of 2006 IEEE International Conference on Fuzzy Systems, pp. 869–874 (2006)
19.
Zurück zum Zitat Miyamoto, S., Ichihashi, H., Honda, K.: Algorithms for Fuzzy Clustering. Springer, Heidelberg (2008) MATH Miyamoto, S., Ichihashi, H., Honda, K.: Algorithms for Fuzzy Clustering. Springer, Heidelberg (2008) MATH
21.
Zurück zum Zitat Buchta, C., Kober, M., Feinerer, I., Hornik, K.: Spherical k-means clustering. J. Stat. Softw. 50(10), 1–22 (2012)MATH Buchta, C., Kober, M., Feinerer, I., Hornik, K.: Spherical k-means clustering. J. Stat. Softw. 50(10), 1–22 (2012)MATH
23.
Zurück zum Zitat Davis, A., Gardner, B.B., Gardner, M.R.: Deep South. University of Chicago Press, Chicago (1941) Davis, A., Gardner, B.B., Gardner, M.R.: Deep South. University of Chicago Press, Chicago (1941)
24.
Zurück zum Zitat Kanzawa, Y.: Sequential cluster extraction using power-regularized possibilistic \(c\)-means. JACIII 19(1), 67–73 (2015) Kanzawa, Y.: Sequential cluster extraction using power-regularized possibilistic \(c\)-means. JACIII 19(1), 67–73 (2015)
Metadaten
Titel
On Possibilistic Clustering Methods Based on Shannon/Tsallis-Entropy for Spherical Data and Categorical Multivariate Data
verfasst von
Yuchi Kanzawa
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-23240-9_10