Skip to main content
Top

2016 | OriginalPaper | Chapter

Hybrid Optimization Method Applied to Adaptive Splitting and Selection Algorithm

Authors : Pedro Lopez-Garcia, Michał Woźniak, Enrique Onieva, Asier Perallos

Published in: Hybrid Artificial Intelligent Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The paper presents an approach to train combined classifiers based on feature space splitting and selection of the best classifier ensemble to each subspace of feature space. The learning method uses a hybrid algorithm that combines a Genetic Algorithm and Cross Entropy Method. The proposed approach was evaluated on the basis of the comprehensive computer experiments run on balanced and imbalanced datasets, and compared with Cluster and Selection algorithm, improving the results obtained by this technique.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Akhand, M.A.H., Murase, K.: Ensembles of neural networks based on the alteration of input feature values. Int. J. Neural Syst. 22(1), 77–87 (2012)CrossRef Akhand, M.A.H., Murase, K.: Ensembles of neural networks based on the alteration of input feature values. Int. J. Neural Syst. 22(1), 77–87 (2012)CrossRef
2.
go back to reference Bäck, T., Schwefel, H.: An overview of evolutionary algorithms for parameter optimization. Evol. Comput. 1(1), 1–23 (1993)CrossRef Bäck, T., Schwefel, H.: An overview of evolutionary algorithms for parameter optimization. Evol. Comput. 1(1), 1–23 (1993)CrossRef
3.
go back to reference Brown, G., Wyatt, J.L., Harris, R., Yao, X.: Diversity creation methods: a survey and categorisation. Inf. Fusion 6(1), 5–20 (2005)CrossRef Brown, G., Wyatt, J.L., Harris, R., Yao, X.: Diversity creation methods: a survey and categorisation. Inf. Fusion 6(1), 5–20 (2005)CrossRef
4.
go back to reference Caballero, R., Hernndez-Daz, A.G., Laguna, M., Molina, J.: Cross entropy for multiobjective combinatorial optimization problems with linear relaxations. Eur. J. Oper. Res. 243(2), 362–368 (2015)MathSciNetCrossRef Caballero, R., Hernndez-Daz, A.G., Laguna, M., Molina, J.: Cross entropy for multiobjective combinatorial optimization problems with linear relaxations. Eur. J. Oper. Res. 243(2), 362–368 (2015)MathSciNetCrossRef
5.
go back to reference Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via error-correcting output codes. J. Artif. Intell. Res. 2, 263–286 (1995)MATH Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via error-correcting output codes. J. Artif. Intell. Res. 2, 263–286 (1995)MATH
6.
go back to reference Giacinto, G., Roli, F.: Dynamic classifier selection based on multiple classifier behaviour. Pattern Recogn. 34(9), 1879–1881 (2001)CrossRefMATH Giacinto, G., Roli, F.: Dynamic classifier selection based on multiple classifier behaviour. Pattern Recogn. 34(9), 1879–1881 (2001)CrossRefMATH
7.
go back to reference Goldberg, D.E., Deb, K.: A comparative analysis of selection schemes used in genetic algorithms. Found. Genet. Algorithms 1, 69–93 (1991)MathSciNet Goldberg, D.E., Deb, K.: A comparative analysis of selection schemes used in genetic algorithms. Found. Genet. Algorithms 1, 69–93 (1991)MathSciNet
8.
go back to reference Herrera, F., Lozano, M., Verdegay, J.L.: Tackling real-coded genetic algorithms: Operators and tools for behavioural analysis. Artif. Intell. Rev. 12(4), 265–319 (1998)CrossRefMATH Herrera, F., Lozano, M., Verdegay, J.L.: Tackling real-coded genetic algorithms: Operators and tools for behavioural analysis. Artif. Intell. Rev. 12(4), 265–319 (1998)CrossRefMATH
9.
go back to reference Jackowski, K., Wozniak, M.: Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas. Pattern Anal. Appl. 12(4), 415–425 (2009)MathSciNetCrossRef Jackowski, K., Wozniak, M.: Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas. Pattern Anal. Appl. 12(4), 415–425 (2009)MathSciNetCrossRef
10.
go back to reference Kanungo, T., Mount, D.M., Netanyahu, N.S., Piatko, C.D., Silverman, R., Wu, A.Y.: An efficient k-means clustering algorithm: analysis and implementation. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 881–892 (2002)CrossRefMATH Kanungo, T., Mount, D.M., Netanyahu, N.S., Piatko, C.D., Silverman, R., Wu, A.Y.: An efficient k-means clustering algorithm: analysis and implementation. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 881–892 (2002)CrossRefMATH
11.
go back to reference Krogh, A., Vedelsby, J.: Neural network ensembles, cross validation, and active learning. Adv. Neural Inf. Process. Syst. 7, 231–238 (1995) Krogh, A., Vedelsby, J.: Neural network ensembles, cross validation, and active learning. Adv. Neural Inf. Process. Syst. 7, 231–238 (1995)
12.
go back to reference L.I. Kuncheva. Clustering-and-selection model for classifier combination. In: Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies, Proceedings. vol. 1, pp. 185–188 (2000) L.I. Kuncheva. Clustering-and-selection model for classifier combination. In: Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies, Proceedings. vol. 1, pp. 185–188 (2000)
13.
go back to reference Kuncheva, L.I.: Combining Pattern Classifiers: Methods and Algorithms. Wiley-Interscience, Piscataway (2004)CrossRefMATH Kuncheva, L.I.: Combining Pattern Classifiers: Methods and Algorithms. Wiley-Interscience, Piscataway (2004)CrossRefMATH
14.
go back to reference Lopez-Garcia, P., Onieva, E., Osaba, E., Masegosa, A.D., Perallos, A.: A hybrid method for short-term traffic congestion forecasting using genetic algorithms and cross entropy. IEEE Trans. Intell. Transp. Syst. 17(2), 557–569 (2016)CrossRef Lopez-Garcia, P., Onieva, E., Osaba, E., Masegosa, A.D., Perallos, A.: A hybrid method for short-term traffic congestion forecasting using genetic algorithms and cross entropy. IEEE Trans. Intell. Transp. Syst. 17(2), 557–569 (2016)CrossRef
15.
go back to reference Onieva, E., Naranjo, J.E., Milanés, V., Alonso, J., García, R., Pérez, J.: Automatic lateral control for unmanned vehicles via genetic algorithms. Appl. Soft Comput. 11(1), 1303–1309 (2011)CrossRef Onieva, E., Naranjo, J.E., Milanés, V., Alonso, J., García, R., Pérez, J.: Automatic lateral control for unmanned vehicles via genetic algorithms. Appl. Soft Comput. 11(1), 1303–1309 (2011)CrossRef
16.
go back to reference Osaba, E., Diaz, F., Onieva, E.: Golden ball: a novel meta-heuristic to solve combinatorial optimization problems based on soccer concepts. Appl. Intell. 41(1), 145–166 (2014)CrossRef Osaba, E., Diaz, F., Onieva, E.: Golden ball: a novel meta-heuristic to solve combinatorial optimization problems based on soccer concepts. Appl. Intell. 41(1), 145–166 (2014)CrossRef
17.
go back to reference Rastrigin, L.A., Erenstein, R.H.: Method of Collective Recognition. Energoizdat, Moscow (1981) Rastrigin, L.A., Erenstein, R.H.: Method of Collective Recognition. Energoizdat, Moscow (1981)
18.
go back to reference Rubinstein, R.: The cross-entropy method for combinatorial and continuous optimization. Methodol. Comput. Appl. Probab. 1(2), 127–190 (1999)MathSciNetCrossRefMATH Rubinstein, R.: The cross-entropy method for combinatorial and continuous optimization. Methodol. Comput. Appl. Probab. 1(2), 127–190 (1999)MathSciNetCrossRefMATH
19.
go back to reference Wozniak, M., Graña, M., Corchado, E.: A survey of multiple classifier systems as hybrid systems. Inf. Fusion 16, 3–17 (2014). Special Issue on Information Fusion in Hybrid Intelligent Fusion SystemsCrossRef Wozniak, M., Graña, M., Corchado, E.: A survey of multiple classifier systems as hybrid systems. Inf. Fusion 16, 3–17 (2014). Special Issue on Information Fusion in Hybrid Intelligent Fusion SystemsCrossRef
Metadata
Title
Hybrid Optimization Method Applied to Adaptive Splitting and Selection Algorithm
Authors
Pedro Lopez-Garcia
Michał Woźniak
Enrique Onieva
Asier Perallos
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-32034-2_62

Premium Partner