Skip to main content
Erschienen in: Cluster Computing 6/2019

02.03.2018

Cuckoo, Bat and Krill Herd based k-means++ clustering algorithms

verfasst von: Shruti Aggarwal, Paramvir Singh

Erschienen in: Cluster Computing | Sonderheft 6/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Traditional k-means clustering algorithm is sensitive to the choice of initial cluster centers and leads to local optimal results. k-means++ is a hybrid k-means clustering algorithm which specifies the procedure to initialize the cluster centers before proceeding with the standard k-means algorithm. Inspired by nature, some contemporary optimization techniques such as Cuckoo, Bat and Krill Herd algorithms etc., are used for optimization as they mimic the swarming behaviour and allows to cooperatively move towards an optimal objective within a reasonable time. In this paper, these nature-inspired techniques are used for optimizing k-means++ clustering algorithm to enhance clustering quality and generate new hybrids of unprecedented performance. The results of the evaluation experiments on the integration of nature-inspired optimization methods with k-means++ algorithm are reported.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM comput. Surv. (CSUR). 31, 264–323 (1999)CrossRef Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM comput. Surv. (CSUR). 31, 264–323 (1999)CrossRef
2.
Zurück zum Zitat MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297 (1967) MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297 (1967)
4.
Zurück zum Zitat Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Proceedings of the Sixth International Symposium on Micro Machine and Human Science, MHS’95, pp. 39–43 (1995) Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Proceedings of the Sixth International Symposium on Micro Machine and Human Science, MHS’95, pp. 39–43 (1995)
5.
Zurück zum Zitat Maniezzo, A.C.: Distributed optimization by ant colonies. In: Toward a Practice of Autonomous Systems: Proceedings of the First European Conference on Artificial Life, Mit Press, pp. 134–152 (1992) Maniezzo, A.C.: Distributed optimization by ant colonies. In: Toward a Practice of Autonomous Systems: Proceedings of the First European Conference on Artificial Life, Mit Press, pp. 134–152 (1992)
6.
Zurück zum Zitat Yang, X.S., Deb, S.: Eagle strategy using Lévy walk and firefly algorithms for stochastic optimization. In: Nature Inspired Cooperative Strategies for Optimization (NICSO 2010), pp. 101–111. Springer, Berlin (2010)CrossRef Yang, X.S., Deb, S.: Eagle strategy using Lévy walk and firefly algorithms for stochastic optimization. In: Nature Inspired Cooperative Strategies for Optimization (NICSO 2010), pp. 101–111. Springer, Berlin (2010)CrossRef
7.
Zurück zum Zitat Chakraborty, A., Kar, A.K.: Swarm intelligence: a review of algorithms. In: Nature-Inspired Computing and Optimization, pp. 475–494. Springer, Berlin (2017)CrossRef Chakraborty, A., Kar, A.K.: Swarm intelligence: a review of algorithms. In: Nature-Inspired Computing and Optimization, pp. 475–494. Springer, Berlin (2017)CrossRef
8.
Zurück zum Zitat de Amorim, R.C., Makarenkov, V.: Applying subclustering and L p distance in Weighted K-Means with distributed centroids. Neurocomputing 173, 700–707 (2016)CrossRef de Amorim, R.C., Makarenkov, V.: Applying subclustering and L p distance in Weighted K-Means with distributed centroids. Neurocomputing 173, 700–707 (2016)CrossRef
9.
Zurück zum Zitat Jothi, R., Mohanty, S.K., Ojha, A.: On careful selection of initial centers for k-means algorithm. In: Proceedings of 3rd International Conference on Advanced Computing, Networking and Informatics, pp. 435–445. Springer, New Delhi (2016) Jothi, R., Mohanty, S.K., Ojha, A.: On careful selection of initial centers for k-means algorithm. In: Proceedings of 3rd International Conference on Advanced Computing, Networking and Informatics, pp. 435–445. Springer, New Delhi (2016)
10.
Zurück zum Zitat Sawaqed, L., AlShabi, M., Alshaer, S., Salameh, I.: An improved k-means clustering algorithm for two half-moon classification. In: IEEE 10th International Symposium on Mechatronics and its Applications (ISMA), pp. 1–4 (2015) Sawaqed, L., AlShabi, M., Alshaer, S., Salameh, I.: An improved k-means clustering algorithm for two half-moon classification. In: IEEE 10th International Symposium on Mechatronics and its Applications (ISMA), pp. 1–4 (2015)
11.
Zurück zum Zitat Ayech, M.W., Ziou, D.: Segmentation of Terahertz imaging using k-means clustering based on ranked set sampling. Expert. Syst. Appl. 42(6), 2959–2974 (2015)CrossRef Ayech, M.W., Ziou, D.: Segmentation of Terahertz imaging using k-means clustering based on ranked set sampling. Expert. Syst. Appl. 42(6), 2959–2974 (2015)CrossRef
12.
Zurück zum Zitat Dhillon, I.S., Guan Y., Kulis, B.: Kernel k-means: spectral clustering and normalized cuts. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 551-556. ACM (2004) Dhillon, I.S., Guan Y., Kulis, B.: Kernel k-means: spectral clustering and normalized cuts. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 551-556. ACM (2004)
13.
Zurück zum Zitat Singh, R.V., Bhatia, M.P.S.: Data clustering with modified k-means algorithm. In: 2011 International Conference on Recent Trends in Information Technology (ICRTIT), pp. 717–721. IEEE (2011) Singh, R.V., Bhatia, M.P.S.: Data clustering with modified k-means algorithm. In: 2011 International Conference on Recent Trends in Information Technology (ICRTIT), pp. 717–721. IEEE (2011)
14.
Zurück zum Zitat Bhavani, R., Sadasivam, G.S., Kumaran, R.: A novel parallel hybrid k-means-DE-ACO clustering approach for genomic clustering using MapReduce. In: World Congress on Information and Communication Technologies (WICT), pp. 132–137 (2011) Bhavani, R., Sadasivam, G.S., Kumaran, R.: A novel parallel hybrid k-means-DE-ACO clustering approach for genomic clustering using MapReduce. In: World Congress on Information and Communication Technologies (WICT), pp. 132–137 (2011)
15.
Zurück zum Zitat Mahdavi, M., Abolhassani, H.: Harmony k-means algorithm for document clustering. Data Min. Knowl. Discov. 18(3), 370–391 (2009)MathSciNetCrossRef Mahdavi, M., Abolhassani, H.: Harmony k-means algorithm for document clustering. Data Min. Knowl. Discov. 18(3), 370–391 (2009)MathSciNetCrossRef
16.
Zurück zum Zitat Li, M.J., Ng, M.K., Cheung, Y.M. and Huang, J.Z.: Agglomerative fuzzy k-means clustering algorithm with selection of number of clusters. IEEE Trans. Knowl. Data Eng. 20(11), 1519–1534 (2008)CrossRef Li, M.J., Ng, M.K., Cheung, Y.M. and Huang, J.Z.: Agglomerative fuzzy k-means clustering algorithm with selection of number of clusters. IEEE Trans. Knowl. Data Eng. 20(11), 1519–1534 (2008)CrossRef
17.
Zurück zum Zitat Arthur, D., Vassilvitskii, S.: K-means++: the advantages of careful seeding. In: Proceedings of the Eighteenth Annual ACMSIAM Symposium on Discrete Algorithms, Society for Industrial and Applied Mathematics, pp. 1027–1035 (2007) Arthur, D., Vassilvitskii, S.: K-means++: the advantages of careful seeding. In: Proceedings of the Eighteenth Annual ACMSIAM Symposium on Discrete Algorithms, Society for Industrial and Applied Mathematics, pp. 1027–1035 (2007)
18.
Zurück zum Zitat Fahim, A.M., Salem, A.M., Torkey, F.A., Ramadan, M.A.: An efficient enhanced k-means clustering algorithm. J. Zhejiang Univ. Sci. 7(10), 1626–1633 (2006)CrossRef Fahim, A.M., Salem, A.M., Torkey, F.A., Ramadan, M.A.: An efficient enhanced k-means clustering algorithm. J. Zhejiang Univ. Sci. 7(10), 1626–1633 (2006)CrossRef
19.
Zurück zum Zitat Zhang, Q., Couloigner, I.: A new and efficient k-medoid algorithm for spatial clustering. In: International Conference on Computational Science and Its Applications, pp. 181–189. Springer, Berlin, Heidelberg, (2005)CrossRef Zhang, Q., Couloigner, I.: A new and efficient k-medoid algorithm for spatial clustering. In: International Conference on Computational Science and Its Applications, pp. 181–189. Springer, Berlin, Heidelberg, (2005)CrossRef
20.
Zurück zum Zitat Ishioka, T.: Extended k-means with an efficient estimation of the number of clusters. Ouyou toukeigaku, 29(3), 141–149 (2000)CrossRef Ishioka, T.: Extended k-means with an efficient estimation of the number of clusters. Ouyou toukeigaku, 29(3), 141–149 (2000)CrossRef
21.
Zurück zum Zitat Su, M.C., Chou, C.H.: A modified version of the k-means algorithm with a distance based on cluster symmetry. IEEE Trans. Pattern. Anal. Mach. Intell. 23(6), 674–680 (2001)CrossRef Su, M.C., Chou, C.H.: A modified version of the k-means algorithm with a distance based on cluster symmetry. IEEE Trans. Pattern. Anal. Mach. Intell. 23(6), 674–680 (2001)CrossRef
22.
Zurück zum Zitat Tang, R., Fong, S., Yang, X.S., Deb, S.: Integrating nature-inspired optimization algorithms to k-means clustering. In: Seventh International Conference on Digital Information Management (ICDIM), 2012, pp. 116–123. IEEE (2012) Tang, R., Fong, S., Yang, X.S., Deb, S.: Integrating nature-inspired optimization algorithms to k-means clustering. In: Seventh International Conference on Digital Information Management (ICDIM), 2012, pp. 116–123. IEEE (2012)
23.
Zurück zum Zitat Nayak, J., Kanungo, D.P., Naik, B., Behera, H.S.: Evolutionary improved swarm-based hybrid k-means algorithm for cluster analysis. In: Proceedings of the Second International Conference on Computer and Communication Technologies, pp. 343–352. Springer, New Delhi (2016) Nayak, J., Kanungo, D.P., Naik, B., Behera, H.S.: Evolutionary improved swarm-based hybrid k-means algorithm for cluster analysis. In: Proceedings of the Second International Conference on Computer and Communication Technologies, pp. 343–352. Springer, New Delhi (2016)
24.
Zurück zum Zitat Hatamlou, A., Abdullah, S., Nezamabadi-pour, H.: A combined approach for clustering based on k-means and gravitational search algorithms. Swarm Evolut. Comput. 6, 47–52 (2012)CrossRef Hatamlou, A., Abdullah, S., Nezamabadi-pour, H.: A combined approach for clustering based on k-means and gravitational search algorithms. Swarm Evolut. Comput. 6, 47–52 (2012)CrossRef
25.
Zurück zum Zitat Ahmed, H., Shedeed, H.A., Hamad, S., Tolba, M.F.: On combining nature-inspired algorithms for data clustering. In: Handbook of Research on Machine Learning Innovations and Trends, pp. 826–855. IGI Global, Hershey (2017) Ahmed, H., Shedeed, H.A., Hamad, S., Tolba, M.F.: On combining nature-inspired algorithms for data clustering. In: Handbook of Research on Machine Learning Innovations and Trends, pp. 826–855. IGI Global, Hershey (2017)
29.
Zurück zum Zitat Hatamlou, A.: A Hybrid Bio-inspired Algorithm and its Application. Applied Intelligence, pp. 1–9. Springer, New York (2017) Hatamlou, A.: A Hybrid Bio-inspired Algorithm and its Application. Applied Intelligence, pp. 1–9. Springer, New York (2017)
31.
Zurück zum Zitat Mohammed, A.J., Yusof, Y., Husni, H.: Gf-Clust: a nature-inspired algorithm for automatic text clustering. J. Inf. Commun. Technol. 15(1), 57–81 (2016) Mohammed, A.J., Yusof, Y., Husni, H.: Gf-Clust: a nature-inspired algorithm for automatic text clustering. J. Inf. Commun. Technol. 15(1), 57–81 (2016)
32.
Zurück zum Zitat Yazdani, M., Jolai, F.: Lion optimization algorithm (LOA): a nature-inspired metaheuristic algorithm. J. Comput. Des. Eng. 3(1), 24–36 (2016) Yazdani, M., Jolai, F.: Lion optimization algorithm (LOA): a nature-inspired metaheuristic algorithm. J. Comput. Des. Eng. 3(1), 24–36 (2016)
35.
Zurück zum Zitat Yang, X.S., Deb, S.: Cuckoo Search via Lévy flights. In: Proceedings of the IEEE World Congress on Nature & Biologically Inspired Computing, NaBIC, pp. 210–214 (2009) Yang, X.S., Deb, S.: Cuckoo Search via Lévy flights. In: Proceedings of the IEEE World Congress on Nature & Biologically Inspired Computing, NaBIC, pp. 210–214 (2009)
36.
Zurück zum Zitat Yang, X.S.: A new metaheuristic Bat inspired algorithm. In: Nature inspired cooperative strategies for optimization (NICSO 2010), pp. 65–74. Springer, Berlin (2010)CrossRef Yang, X.S.: A new metaheuristic Bat inspired algorithm. In: Nature inspired cooperative strategies for optimization (NICSO 2010), pp. 65–74. Springer, Berlin (2010)CrossRef
37.
Zurück zum Zitat Gandomi, A.H., Alavi, A.H.: Krill herd: a new bio-inspired optimization algorithm. Commun. Nonlinear Sci. Numer. Simul. 17(12), 4831–4845 (2012)MathSciNetCrossRef Gandomi, A.H., Alavi, A.H.: Krill herd: a new bio-inspired optimization algorithm. Commun. Nonlinear Sci. Numer. Simul. 17(12), 4831–4845 (2012)MathSciNetCrossRef
39.
Zurück zum Zitat Saida, I.B., Nadjet, K., Omar, B.: A new algorithm for data clustering based on cuckoo search optimization. In: Genetic and Evolutionary Computing, pp. 55-64. Springer, Cham, 2014. Saida, I.B., Nadjet, K., Omar, B.: A new algorithm for data clustering based on cuckoo search optimization. In: Genetic and Evolutionary Computing, pp. 55-64. Springer, Cham, 2014.
41.
Zurück zum Zitat Komarasamy, G., Wahi, A.: An optimized k-means clustering technique using bat algorithm. Eur. J. Sci. Res. 84(2), 263–273 (2012) Komarasamy, G., Wahi, A.: An optimized k-means clustering technique using bat algorithm. Eur. J. Sci. Res. 84(2), 263–273 (2012)
42.
Zurück zum Zitat Nikbakht, H., Mirvaziri, H.: A new clustering approach based on k-means and Krill Herd algorithm. In: IEEE 23rd Iranian Conference on Electrical Engineering (ICEE), pp. 662–667 (2015) Nikbakht, H., Mirvaziri, H.: A new clustering approach based on k-means and Krill Herd algorithm. In: IEEE 23rd Iranian Conference on Electrical Engineering (ICEE), pp. 662–667 (2015)
Metadaten
Titel
Cuckoo, Bat and Krill Herd based k-means++ clustering algorithms
verfasst von
Shruti Aggarwal
Paramvir Singh
Publikationsdatum
02.03.2018
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe Sonderheft 6/2019
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-018-2262-4

Weitere Artikel der Sonderheft 6/2019

Cluster Computing 6/2019 Zur Ausgabe