Skip to main content
Top

2018 | OriginalPaper | Chapter

Energy-Based Clustering for Pruning Heterogeneous Ensembles

Authors : Javier Cela, Alberto Suárez

Published in: Artificial Neural Networks and Machine Learning – ICANN 2018

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this work, an energy-based clustering method is used to prune heterogeneous ensembles. Specifically, the classifiers are grouped according to their predictions in a set of validation instances that are independent from the ones used to build the ensemble. In the empirical evaluation carried out, the cluster that minimizes the error in the validations set, besides reducing computational costs for storage and the prediction times, is almost as accurate as the complete ensemble. Furthermore, it outperforms subensembles that summarize the complete ensemble by including representatives from each of the identified clusters.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Bakker, B., Heskes, T.: Clustering ensembles of neural network models. Neural Netw. 16, 261–269 (2003)CrossRef Bakker, B., Heskes, T.: Clustering ensembles of neural network models. Neural Netw. 16, 261–269 (2003)CrossRef
go back to reference Bezdek, J., Elrich, R., Full, W.: The fuzzy C-means clustering algorithm. Comput. Geosci. 10, 191–203 (1984)CrossRef Bezdek, J., Elrich, R., Full, W.: The fuzzy C-means clustering algorithm. Comput. Geosci. 10, 191–203 (1984)CrossRef
go back to reference Buhmann, J., Kühnel, H.: Vector quantization with complexity costs. IEEE Trans. Inf. Theory 39, 1133–1145 (1993)CrossRef Buhmann, J., Kühnel, H.: Vector quantization with complexity costs. IEEE Trans. Inf. Theory 39, 1133–1145 (1993)CrossRef
go back to reference Dietterich, T.G.: Ensemble methods in machine learning. In: Proceedings of Multiple Classifier Systems: First International Workshop, MCs 2000, Cagliari, Italy, 21–23 June 2000, pp. 1–15 (2000) Dietterich, T.G.: Ensemble methods in machine learning. In: Proceedings of Multiple Classifier Systems: First International Workshop, MCs 2000, Cagliari, Italy, 21–23 June 2000, pp. 1–15 (2000)
go back to reference Lobato, D.H., Muñoz, G.M., Suárez, A.: On the independence of the individual predictions in parallel randomized Ensembles. In: 20th European Symposium on Artificial Neural Networks, Bruges (2012) Lobato, D.H., Muñoz, G.M., Suárez, A.: On the independence of the individual predictions in parallel randomized Ensembles. In: 20th European Symposium on Artificial Neural Networks, Bruges (2012)
go back to reference MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, pp. 281–297 (1967) MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, pp. 281–297 (1967)
go back to reference Rose, K.: Statistical mechanics of phase transition in clustering. Phys. Rev. Lett. 65, 945–948 (1990)CrossRef Rose, K.: Statistical mechanics of phase transition in clustering. Phys. Rev. Lett. 65, 945–948 (1990)CrossRef
go back to reference Rose, K.: Deterministic annealing for clustering, compression, classification, regression and related optimization problems. In: Proceedings for the IEEE, pp. 2210–2239 (1998)CrossRef Rose, K.: Deterministic annealing for clustering, compression, classification, regression and related optimization problems. In: Proceedings for the IEEE, pp. 2210–2239 (1998)CrossRef
go back to reference Suárez, A., Hernández-Lobato, D., Martínez-Muñoz, G.: An analysis of ensemble pruning techniques based on ordered aggregation. IEEE Trans. Pattern Anal. Mach. Intell. 31, 245–259 (2009)CrossRef Suárez, A., Hernández-Lobato, D., Martínez-Muñoz, G.: An analysis of ensemble pruning techniques based on ordered aggregation. IEEE Trans. Pattern Anal. Mach. Intell. 31, 245–259 (2009)CrossRef
Metadata
Title
Energy-Based Clustering for Pruning Heterogeneous Ensembles
Authors
Javier Cela
Alberto Suárez
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-01418-6_34

Premium Partner