Top

Published in:

2020 | OriginalPaper | Chapter

Differential Evolution Algorithms Used to Optimize Weights of Neural Network Solving Pole-Balancing Problem

Authors : Jan Vargovsky, Lenka Skanderova

Published in: AETA 2018 - Recent Advances in Electrical Engineering and Related Sciences: Theory and Application

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Differential evolution (DE) has been successfully used to solve difficult optimization problems. Every year, novel DE algorithms are developed to outperform the previous versions. The JADE is a famous DE algorithm using a mutation strategy current-to-pbest and the adaptation of control parameters. The SHADE has been developed to eliminate some bottlenecks of the JADE, especially its tendency to a premature convergence. The performance of these algorithms has been demonstrated on various benchmarks. The goal of this work is to compare the performance of the selected DE algorithms which are used to optimize the weights of the artificial neural network solving the pole-balancing problem.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Pupil Localization Using Self-organizing Migrating Algorithm

next chapter The Use of Radial Basis Function Surrogate Models for Sampling Process Acceleration in Bayesian Inversion

Brest, J., Greiner, S., Bošković, B., Mernik, M., Zumer, V.: Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans. Evol. Comput. 10(6), 646–657 (2006)CrossRef

Brownlee, J., et al.: The pole balancing problem: A Benchmark Control Theory Problem (2005)

Chiang, C.-W., Lee, W.-P., Heh, J.-S.: A 2-opt based differential evolution for global optimization. Appl. Soft Comput. 10(4), 1200–1207 (2010)CrossRef

Ilonen, J., Kamarainen, J.-K., Lampinen, J.: Differential evolution training algorithm for feed-forward neural networks. Neural Process. Lett. 17(1), 93–105 (2003)CrossRef

Liang, J., Qu, B., Suganthan, P., Hernández-Díaz, A.G.: Problem definitions and evaluation criteria for the CEC 2013 special session on real-parameter optimization. In: Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou, China and Nanyang Technological University, Singapore, Technical Report 201212, 3–18 (2013)

Mallipeddi, R., Suganthan, P.N., Pan, Q.-K., Tasgetiren, M.F.: Differential evolution algorithm with ensemble of parameters and mutation strategies. Appl. Soft Comput. 11(2), 1679–1696 (2011)CrossRef

Real, E., Moore, S., Selle, A., Saxena, S., Suematsu, Y.L., Tan, J., Le, Q., Kurakin, A.: Large-scale evolution of image classifiers. arXiv preprint. arXiv:1703.01041 (2017)

Slowik, A., Bialko, M.: Training of artificial neural networks using differential evolution algorithm. In: 2008 Conference on Human System Interactions, pp. 60–65. IEEE (2008)

Stanley, K.O., Miikkulainen, R.: Evolving neural networks through augmenting topologies. Evol. Comput. 10(2), 99–127 (2002)CrossRef

10.

Storn, R., Price, K.: Differential evolution-a simple and efficient adaptive scheme for global optimization over continuous spaces, vol. 3. ICSI, Berkeley (1995)

11.

Suganthan, P.N., Hansen, N., Liang, J.J., Deb, K., Chen, Y.-P., Auger, A., Tiwari, S.: Problem definitions and evaluation criteria for the cec 2005 special session on real-parameter optimization. KanGAL report 2005005, 2005 (2005)

12.

Tanabe, R., Fukunaga, A.: Success-history based parameter adaptation for differential evolution. In: 2013 IEEE Congress on Evolutionary Computation (CEC), pp. 71–78. IEEE (2013)

13.

Tanabe, R., Fukunaga, A.S.: Improving the search performance of shade using linear population size reduction. In: 2014 IEEE Congress on Evolutionary Computation (CEC), pp. 1658–1665. IEEE (2014)

14.

Wang, Y., Cai, Z., Zhang, Q.: Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans. Evol. Comput. 15(1), 55–66 (2011)CrossRef

15.

Yao, X., Liu, Y., Lin, G.: Evolutionary programming made faster. IEEE Trans. Evol. Comput. 3(2), 82–102 (1999)CrossRef

16.

Yi, W., Gao, L., Li, X., Zhou, Y.: A new differential evolution algorithm with a hybrid mutation operator and self-adapting control parameters for global optimization problems. Appl. Intell. 42(4), 642–660 (2015)CrossRef

17.

Zhang, J., Sanderson, A.C.: JADE: adaptive differential evolution with optional external archive. IEEE Trans. Evol. Comput. 13(5), 945–958 (2009)CrossRef

18.

Zhou, Y., Li, X., Gao, L.: A differential evolution algorithm with intersect mutation operator. Appl. Soft Comput. 13(1), 390–401 (2013)CrossRef

Title: Differential Evolution Algorithms Used to Optimize Weights of Neural Network Solving Pole-Balancing Problem
Authors: Jan Vargovsky
Lenka Skanderova
Publisher: Springer International Publishing
Book: AETA 2018 - Recent Advances in Electrical Engineering and Related Sciences: Theory and Application
Print ISBN: 978-3-030-14906-2

Electronic ISBN: 978-3-030-14907-9

Copyright Year: 2020
DOI: https://doi.org/10.1007/978-3-030-14907-9_22