Skip to main content
Erschienen in: Soft Computing 3/2011

01.03.2011 | Original Paper

An application of particle swarm optimization algorithm to clustering analysis

verfasst von: R. J. Kuo, M. J. Wang, T. W. Huang

Erschienen in: Soft Computing | Ausgabe 3/2011

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Particle swarm optimization algorithm (PSOA), which maintains a population of particles, where each particle represents a potential solution to an optimization problem, is a population-based stochastic search process. This study intends to integrate PSOA with K-means to cluster data. It is shown that PSOA can be employed to find the centroids of a user-specified number of clusters. The proposed PSOA is evaluated using four data sets, and compared to the performance of some other PSOA-based methods and K-means method. Computational results show that the proposed method has much potential. A real-world problem for order clustering also illustrates that the proposed method is quite promising.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Al-Sultan K (1995) A Tabu search approach to the clustering problem. Pattern Recogn 28(9):1443–1451CrossRef Al-Sultan K (1995) A Tabu search approach to the clustering problem. Pattern Recogn 28(9):1443–1451CrossRef
Zurück zum Zitat Barbará D, Chen P (2000) Using the fractal dimension to cluster datasets. In: Proceedings of the 6th ACM SIGKDD international conference on knowledge discovery and data mining, pp 260–264 Barbará D, Chen P (2000) Using the fractal dimension to cluster datasets. In: Proceedings of the 6th ACM SIGKDD international conference on knowledge discovery and data mining, pp 260–264
Zurück zum Zitat Bezdek J, Hathaway R (1992) Numerical convergence and interpretation of the fuzzy c-shells clustering algorithms. IEEE Trans Neural Netw 3(5):787–793CrossRef Bezdek J, Hathaway R (1992) Numerical convergence and interpretation of the fuzzy c-shells clustering algorithms. IEEE Trans Neural Netw 3(5):787–793CrossRef
Zurück zum Zitat Brown D, Huntley C (1992) A practical application of simulated annealing to clustering. Pattern Recognit 25(4):401–412CrossRef Brown D, Huntley C (1992) A practical application of simulated annealing to clustering. Pattern Recognit 25(4):401–412CrossRef
Zurück zum Zitat Carpenter G, Grossberg S (1987a) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37:54–115CrossRef Carpenter G, Grossberg S (1987a) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37:54–115CrossRef
Zurück zum Zitat Carpenter G, Grossberg S (1987b) ART2: self-organization of stable category recognition codes for analog input patterns. Appl Opt 26(23):4919–4930CrossRef Carpenter G, Grossberg S (1987b) ART2: self-organization of stable category recognition codes for analog input patterns. Appl Opt 26(23):4919–4930CrossRef
Zurück zum Zitat Carpenter G, Grossberg S, Rosen D (1991) Fuzzy ART: fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Netw 4:759–771CrossRef Carpenter G, Grossberg S, Rosen D (1991) Fuzzy ART: fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Netw 4:759–771CrossRef
Zurück zum Zitat Chen CY, Ye F (2004) Particle swarm optimization algorithm and its application to clustering analysis. In: 2004 IEEE international conference on networking, pp 789–794 Chen CY, Ye F (2004) Particle swarm optimization algorithm and its application to clustering analysis. In: 2004 IEEE international conference on networking, pp 789–794
Zurück zum Zitat Clerc M (1999) The swarm and the queen: towards a deterministic and adaptive particle swarm optimization. Evol Comput, pp 1951–1957 Clerc M (1999) The swarm and the queen: towards a deterministic and adaptive particle swarm optimization. Evol Comput, pp 1951–1957
Zurück zum Zitat Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of the sixth international symposium on micro machine and human science, pp 39–43 Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of the sixth international symposium on micro machine and human science, pp 39–43
Zurück zum Zitat Geva A (1999) Hierarchical unsupervised fuzzy clustering. IEEE Trans Fuzzy Syst 7(6):723–733CrossRef Geva A (1999) Hierarchical unsupervised fuzzy clustering. IEEE Trans Fuzzy Syst 7(6):723–733CrossRef
Zurück zum Zitat Hair JF, Black WC, Babin B, Anderson RE (2010) Multivariate data analysis: a global perspective. Prentice-Hall, Englewood Cliffs Hair JF, Black WC, Babin B, Anderson RE (2010) Multivariate data analysis: a global perspective. Prentice-Hall, Englewood Cliffs
Zurück zum Zitat Hall L, Özyurt I, Bezdek J (1999) Clustering with a genetically optimized approach. IEEE Trans Evol Comput 3(2):103–112CrossRef Hall L, Özyurt I, Bezdek J (1999) Clustering with a genetically optimized approach. IEEE Trans Evol Comput 3(2):103–112CrossRef
Zurück zum Zitat Han J, Kamber M (2006) Data mining: concepts and techniques, 2nd edn. Morgan Kaufmann, Menlo Park Han J, Kamber M (2006) Data mining: concepts and techniques, 2nd edn. Morgan Kaufmann, Menlo Park
Zurück zum Zitat Höppner F, Klawonn F, Kruse R (1999) Fuzzy cluster analysis: methods for classification, data analysis, and image recognition. Wiley, New YorkMATH Höppner F, Klawonn F, Kruse R (1999) Fuzzy cluster analysis: methods for classification, data analysis, and image recognition. Wiley, New YorkMATH
Zurück zum Zitat Kaufman L, Rousseeuw P (1990) Finding groups in data: an introduction to cluster analysis. Wiley, New York Kaufman L, Rousseeuw P (1990) Finding groups in data: an introduction to cluster analysis. Wiley, New York
Zurück zum Zitat Koay CA, Srinivasan D (2003) Particle swarm optimization-based approach for generator maintenance scheduling. In: Proceedings of the 2003 IEEE swarm intelligence symposium, pp 167–173 Koay CA, Srinivasan D (2003) Particle swarm optimization-based approach for generator maintenance scheduling. In: Proceedings of the 2003 IEEE swarm intelligence symposium, pp 167–173
Zurück zum Zitat Kohonen T (1990) The self-organizing map. Proc IEEE 78(9):1464–1480 Kohonen T (1990) The self-organizing map. Proc IEEE 78(9):1464–1480
Zurück zum Zitat Krishna K, Murty MN (1999) Genetic K-means algorithm. IEEE Trans Syst Man Cybern 29(3):433–439CrossRef Krishna K, Murty MN (1999) Genetic K-means algorithm. IEEE Trans Syst Man Cybern 29(3):433–439CrossRef
Zurück zum Zitat Krishnapuram R, Keller J (1993) A possibilistic approach to clustering. IEEE Trans Fuzzy Syst 1(2):98–110CrossRef Krishnapuram R, Keller J (1993) A possibilistic approach to clustering. IEEE Trans Fuzzy Syst 1(2):98–110CrossRef
Zurück zum Zitat Kuo RJ, Ho LM, Hu CM (2002) Integration of self-organizing feature map and K-means algorithm for market segmentation. Int J Comput Oper Res 29:1475–1493MATHCrossRef Kuo RJ, Ho LM, Hu CM (2002) Integration of self-organizing feature map and K-means algorithm for market segmentation. Int J Comput Oper Res 29:1475–1493MATHCrossRef
Zurück zum Zitat Kuo RJ, Chang K, Chien SY (2004) Integration of self-organizing feature maps and genetic algorithm based clustering method for market segmentation. J Organ Comput Electron Commer 14(1):43–60 Kuo RJ, Chang K, Chien SY (2004) Integration of self-organizing feature maps and genetic algorithm based clustering method for market segmentation. J Organ Comput Electron Commer 14(1):43–60
Zurück zum Zitat Kuo RJ, Liao JL, Tu C (2005a) Integration of ART2 neural network and genetic K-means algorithm for analyzing Web browsing paths in electronic commerce. Decision Support Syst 40(2):355–374CrossRef Kuo RJ, Liao JL, Tu C (2005a) Integration of ART2 neural network and genetic K-means algorithm for analyzing Web browsing paths in electronic commerce. Decision Support Syst 40(2):355–374CrossRef
Zurück zum Zitat Kuo RJ, Wang HS, Tung-Lai Hu, Chou SH (2005b) Application of ant K-means on clustering analysis in data mining. Int J Comput Math Appl 50:1709–1724MATH Kuo RJ, Wang HS, Tung-Lai Hu, Chou SH (2005b) Application of ant K-means on clustering analysis in data mining. Int J Comput Math Appl 50:1709–1724MATH
Zurück zum Zitat Kuo RJ, An YL, Wang HS, Chung WJ (2006) Integration of self-organizing feature maps neural network and genetic K-means algorithm for market segmentation. Int J Expert Syst Appl 30(2):313–324CrossRef Kuo RJ, An YL, Wang HS, Chung WJ (2006) Integration of self-organizing feature maps neural network and genetic K-means algorithm for market segmentation. Int J Expert Syst Appl 30(2):313–324CrossRef
Zurück zum Zitat Ressom H, Wang D, Natarajan P (2003) Adaptive double self-organizing maps for clustering gene expression profiles. Neural Netw 16:633–640CrossRef Ressom H, Wang D, Natarajan P (2003) Adaptive double self-organizing maps for clustering gene expression profiles. Neural Netw 16:633–640CrossRef
Zurück zum Zitat Salerno J (1997) Using the particle swarm optimization technique to train a recurrent neural model. In: Proceedings of the ninth IEEE international conference on tools with artificial intelligence, pp 45–49 Salerno J (1997) Using the particle swarm optimization technique to train a recurrent neural model. In: Proceedings of the ninth IEEE international conference on tools with artificial intelligence, pp 45–49
Zurück zum Zitat Sheikholeslami G, Chatterjee S, Zhang A (1998) WaveCluster: a multiresolution clustering approach for very large spatial databases. In: Proceeding of 24th VLDB conference, pp 428–439 Sheikholeslami G, Chatterjee S, Zhang A (1998) WaveCluster: a multiresolution clustering approach for very large spatial databases. In: Proceeding of 24th VLDB conference, pp 428–439
Zurück zum Zitat Shi Y, Eberhart R (1998a) A modified particle swarm optimizer. In: Proceedings of the IEEE international conference on evolutionary computation, pp 69–73 Shi Y, Eberhart R (1998a) A modified particle swarm optimizer. In: Proceedings of the IEEE international conference on evolutionary computation, pp 69–73
Zurück zum Zitat Shi Y, Eberhart R (1998b) Parameter selection in particle swarm optimization. In: Evolutionary programming VI/: Proceedings of EP98. Springer, New York Shi Y, Eberhart R (1998b) Parameter selection in particle swarm optimization. In: Evolutionary programming VI/: Proceedings of EP98. Springer, New York
Zurück zum Zitat Smyth P (1998) Model selection for probabilistic clustering using cross validated likelihood. Stat Comput 10:63–72CrossRef Smyth P (1998) Model selection for probabilistic clustering using cross validated likelihood. Stat Comput 10:63–72CrossRef
Zurück zum Zitat Van der Merwe DW, Engelbrecht AP (2003) Data clustering using particle swarm optimization. In: The 2003 congress on evolutionary computation, pp 215–220 Van der Merwe DW, Engelbrecht AP (2003) Data clustering using particle swarm optimization. In: The 2003 congress on evolutionary computation, pp 215–220
Zurück zum Zitat Wang KP, Huang L, Zhou CG, Pang W (2003) Particle swarm optimization for traveling salesman problem. In: 2003 International conference on machine learning and cybernetics, pp 1583–1585 Wang KP, Huang L, Zhou CG, Pang W (2003) Particle swarm optimization for traveling salesman problem. In: 2003 International conference on machine learning and cybernetics, pp 1583–1585
Zurück zum Zitat Weijun X, Zhiming W, Wei Z, Genke Y (2004) A new hybrid optimization algorithm for the job-shop scheduling problem. In: Proceedings of the 2004 American control conference, pp 5552–5557 Weijun X, Zhiming W, Wei Z, Genke Y (2004) A new hybrid optimization algorithm for the job-shop scheduling problem. In: Proceedings of the 2004 American control conference, pp 5552–5557
Zurück zum Zitat Wu B, Yanwei Z, Yaliang M, Hongzhao D, Weian W (2004) Particle swarm optimization method for vehicle routing problem. In: Fifth world congress on intelligent control and automation, pp 2219–2221 Wu B, Yanwei Z, Yaliang M, Hongzhao D, Weian W (2004) Particle swarm optimization method for vehicle routing problem. In: Fifth world congress on intelligent control and automation, pp 2219–2221
Zurück zum Zitat Xiao X, Dow ER, Eberhart R, Miled ZB, Oppelt RJ (2003) Gene clustering using self-organizing maps and particle swarm optimization. In: Proceedings of the international parallel and distributed processing symposium, pp 22–28 Xiao X, Dow ER, Eberhart R, Miled ZB, Oppelt RJ (2003) Gene clustering using self-organizing maps and particle swarm optimization. In: Proceedings of the international parallel and distributed processing symposium, pp 22–28
Zurück zum Zitat Xu R, Wunsch D (2005) Survey of clustering algorithms. IEEE Trans Neural Netw 16(3):645–678CrossRef Xu R, Wunsch D (2005) Survey of clustering algorithms. IEEE Trans Neural Netw 16(3):645–678CrossRef
Zurück zum Zitat Yin H (2002) ViSOM—a novel method for multivariate data projection and structure visualization. IEEE Trans Neural Netw 13(1):135–144 Yin H (2002) ViSOM—a novel method for multivariate data projection and structure visualization. IEEE Trans Neural Netw 13(1):135–144
Zurück zum Zitat Zhang C, Shao H, Li Y (2000) Particle swarm optimization for evolving artificial neural network. In: 2000 IEEE international conference on systems, man and cybernetics, pp 2487–2490 Zhang C, Shao H, Li Y (2000) Particle swarm optimization for evolving artificial neural network. In: 2000 IEEE international conference on systems, man and cybernetics, pp 2487–2490
Metadaten
Titel
An application of particle swarm optimization algorithm to clustering analysis
verfasst von
R. J. Kuo
M. J. Wang
T. W. Huang
Publikationsdatum
01.03.2011
Verlag
Springer-Verlag
Erschienen in
Soft Computing / Ausgabe 3/2011
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-009-0539-5

Weitere Artikel der Ausgabe 3/2011

Soft Computing 3/2011 Zur Ausgabe