Skip to main content

2015 | OriginalPaper | Buchkapitel

Comparison of Parameter Control Mechanisms in Multi-objective Differential Evolution

verfasst von : Martin Drozdik, Hernan Aguirre, Youhei Akimoto, Kiyoshi Tanaka

Erschienen in: Learning and Intelligent Optimization

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Differential evolution (DE) is a powerful and simple algorithm for single- and multi-objective optimization. However, its performance is highly dependent on the right choice of parameters. To mitigate this problem, mechanisms have been developed to automatically control the parameters during the algorithm run. These mechanisms are usually a part of a unified DE algorithm, which makes it difficult to compare them in isolation. In this paper, we go through various deterministic, adaptive, and self-adaptive approaches to parameter control, isolate the underlying mechanisms, and apply them to a single, simple differential evolution algorithm. We observe its performance and behavior on a set of benchmark problems. We find that even the simplest mechanisms can compete with parameter values found by exhaustive grid search. We also notice that self-adaptive mechanisms seem to perform better on problems which can be optimized with a very limited set of parameters. Yet, adaptive mechanisms seem to behave in a problem-independent way, detrimental to their performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Details on this methodology can be found in [4].
 
Literatur
1.
Zurück zum Zitat Abbass, H.A.: The self-adaptive Pareto differential evolution algorithm. In: Proceedings of the 2002 Congress on Evolutionary Computation, CEC 2002, vol. 1, pp. 831–836 (May 2002) Abbass, H.A.: The self-adaptive Pareto differential evolution algorithm. In: Proceedings of the 2002 Congress on Evolutionary Computation, CEC 2002, vol. 1, pp. 831–836 (May 2002)
2.
Zurück zum Zitat Brest, J., Bošković, B., Greiner, S., Žumer, V., Maučec, M.S.: Performance comparison of self-adaptive and adaptive differential evolution algorithms. Soft Comput. 11(7), 617–629 (2007)CrossRefMATH Brest, J., Bošković, B., Greiner, S., Žumer, V., Maučec, M.S.: Performance comparison of self-adaptive and adaptive differential evolution algorithms. Soft Comput. 11(7), 617–629 (2007)CrossRefMATH
3.
Zurück zum Zitat Brest, J., Greiner, S., Boskovic, B., Mernik, M., Zumer, V.: Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans. Evol. Comput. 10(6), 646–657 (2006)CrossRef Brest, J., Greiner, S., Boskovic, B., Mernik, M., Zumer, V.: Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans. Evol. Comput. 10(6), 646–657 (2006)CrossRef
4.
Zurück zum Zitat Drozdik, M., Tanaka, K., Aguirre, H., Verel, S., Liefooghe, A., Derbel, B.: An analysis of differential evolution parameters on rotated bi-objective optimization functions. In: Dick, G., Browne, W.N., Whigham, P., Zhang, M., Bui, L.T., Ishibuchi, H., Jin, Y., Li, X., Shi, Y., Singh, P., Tan, K.C., Tang, K. (eds.) SEAL 2014. LNCS, vol. 8886, pp. 143–154. Springer, Heidelberg (2014) CrossRef Drozdik, M., Tanaka, K., Aguirre, H., Verel, S., Liefooghe, A., Derbel, B.: An analysis of differential evolution parameters on rotated bi-objective optimization functions. In: Dick, G., Browne, W.N., Whigham, P., Zhang, M., Bui, L.T., Ishibuchi, H., Jin, Y., Li, X., Shi, Y., Singh, P., Tan, K.C., Tang, K. (eds.) SEAL 2014. LNCS, vol. 8886, pp. 143–154. Springer, Heidelberg (2014) CrossRef
5.
Zurück zum Zitat Eiben, A.E., Hinterding, R., Michalewicz, Z.: Parameter control in evolutionary algorithms. IEEE Trans. Evol. Comput. 3(2), 124–141 (1999)CrossRef Eiben, A.E., Hinterding, R., Michalewicz, Z.: Parameter control in evolutionary algorithms. IEEE Trans. Evol. Comput. 3(2), 124–141 (1999)CrossRef
6.
Zurück zum Zitat Huang, V.L., Zhao, S.Z., Mallipeddi, R., Suganthan, P.N.: Multi-objective optimization using self-adaptive differential evolution algorithm. In: IEEE Congress on Evolutionary Computation, CEC 2009, pp. 190–194 (May 2009) Huang, V.L., Zhao, S.Z., Mallipeddi, R., Suganthan, P.N.: Multi-objective optimization using self-adaptive differential evolution algorithm. In: IEEE Congress on Evolutionary Computation, CEC 2009, pp. 190–194 (May 2009)
7.
Zurück zum Zitat Huband, S., Hingston, P., Barone, L., While, L.: A review of multiobjective test problems and a scalable test problem toolkit. IEEE Trans. Evol. Comput. 10(5), 477–506 (2006)CrossRef Huband, S., Hingston, P., Barone, L., While, L.: A review of multiobjective test problems and a scalable test problem toolkit. IEEE Trans. Evol. Comput. 10(5), 477–506 (2006)CrossRef
8.
Zurück zum Zitat Hutter, F., Hoos, H.H., Leyton-Brown, K., Sttzle, T.: ParamILS: an automatic algorithm configuration framework. J. Artif. Int. Res. 36(1), 267–306 (2009)MATH Hutter, F., Hoos, H.H., Leyton-Brown, K., Sttzle, T.: ParamILS: an automatic algorithm configuration framework. J. Artif. Int. Res. 36(1), 267–306 (2009)MATH
9.
Zurück zum Zitat Kukkonen, S., Deb, K.: A fast and effective method for pruning of non-dominated solutions in many-objective problems. In: Runarsson, T.P., Beyer, H.-G., Burke, E.K., Merelo-Guervós, J.J., Whitley, L.D., Yao, X. (eds.) PPSN 2006. LNCS, vol. 4193, pp. 553–562. Springer, Heidelberg (2006) Kukkonen, S., Deb, K.: A fast and effective method for pruning of non-dominated solutions in many-objective problems. In: Runarsson, T.P., Beyer, H.-G., Burke, E.K., Merelo-Guervós, J.J., Whitley, L.D., Yao, X. (eds.) PPSN 2006. LNCS, vol. 4193, pp. 553–562. Springer, Heidelberg (2006)
10.
Zurück zum Zitat Kukkonen, S., Lampinen, J.: An empirical study of control parameters for the third version of generalized differential evolution (GDE3). In: IEEE Congress on Evolutionary Computation, pp. 2002–2009 (2006) Kukkonen, S., Lampinen, J.: An empirical study of control parameters for the third version of generalized differential evolution (GDE3). In: IEEE Congress on Evolutionary Computation, pp. 2002–2009 (2006)
11.
Zurück zum Zitat Liu, J., Lampinen, J.: A fuzzy adaptive differential evolution algorithm. Soft Comput. 9(6), 448 (2005)CrossRefMATH Liu, J., Lampinen, J.: A fuzzy adaptive differential evolution algorithm. Soft Comput. 9(6), 448 (2005)CrossRefMATH
12.
Zurück zum Zitat Pedrosa Silva, R.C., Lopes, R.A., Guimares, F.G.: Self-adaptive mutation in the differential evolution. In: GECCO, GECCO 2011, pp. 1939–1946. ACM, New York (2011) Pedrosa Silva, R.C., Lopes, R.A., Guimares, F.G.: Self-adaptive mutation in the differential evolution. In: GECCO, GECCO 2011, pp. 1939–1946. ACM, New York (2011)
13.
Zurück zum Zitat Pellegrini, P., Sttzle, T., Birattari, M.: A critical analysis of parameter adaptation in ant colony optimization. Swarm Intell. 6(1), 23–48 (2012)CrossRef Pellegrini, P., Sttzle, T., Birattari, M.: A critical analysis of parameter adaptation in ant colony optimization. Swarm Intell. 6(1), 23–48 (2012)CrossRef
14.
Zurück zum Zitat Price, K., Storn, R.M., Lampinen, J.A.: Differential Evolution: A Practical Approach to Global Optimization. Springer, New York (2005) Price, K., Storn, R.M., Lampinen, J.A.: Differential Evolution: A Practical Approach to Global Optimization. Springer, New York (2005)
15.
Zurück zum Zitat Qin, A.K., Huang, V.L., Suganthan, P.N.: Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans. Evol. Comput. 13(2), 398–417 (2009)CrossRef Qin, A.K., Huang, V.L., Suganthan, P.N.: Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans. Evol. Comput. 13(2), 398–417 (2009)CrossRef
16.
Zurück zum Zitat Robič, T., Filipič, B.: DEMO: differential evolution for multiobjective optimization. In: Coello Coello, C.A., Hernández Aguirre, A., Zitzler, E. (eds.) EMO 2005. LNCS, vol. 3410, pp. 520–533. Springer, Heidelberg (2005) CrossRef Robič, T., Filipič, B.: DEMO: differential evolution for multiobjective optimization. In: Coello Coello, C.A., Hernández Aguirre, A., Zitzler, E. (eds.) EMO 2005. LNCS, vol. 3410, pp. 520–533. Springer, Heidelberg (2005) CrossRef
17.
Zurück zum Zitat Teo, J.: Exploring dynamic self-adaptive populations in differential evolution. Soft Comput. 10(8), 673–686 (2006)CrossRef Teo, J.: Exploring dynamic self-adaptive populations in differential evolution. Soft Comput. 10(8), 673–686 (2006)CrossRef
18.
Zurück zum Zitat Zaharie, D.: Critical values for the control parameters of differential evolution algorithm. In: Proceedings of MENDEL 2002 (2002) Zaharie, D.: Critical values for the control parameters of differential evolution algorithm. In: Proceedings of MENDEL 2002 (2002)
19.
Zurück zum Zitat Zaharie, D.: Control of population diversity and adaptation in differential evolution algorithms. In: Matousek, R., Osmera, P. (eds.) Proceedings of Mendel 2003, 9th International Conference on Soft Computing, pp. 41–46, Brno, Czech Republic (jun 2003) Zaharie, D.: Control of population diversity and adaptation in differential evolution algorithms. In: Matousek, R., Osmera, P. (eds.) Proceedings of Mendel 2003, 9th International Conference on Soft Computing, pp. 41–46, Brno, Czech Republic (jun 2003)
20.
Zurück zum Zitat Zamuda, A., Brest, J., Boskovic, B., Zumer, V.: Differential evolution for multiobjective optimization with self adaptation. In: IEEE Congress on Evolutionary Computation, CEC 2007, pp. 3617–3624 (Sept 2007) Zamuda, A., Brest, J., Boskovic, B., Zumer, V.: Differential evolution for multiobjective optimization with self adaptation. In: IEEE Congress on Evolutionary Computation, CEC 2007, pp. 3617–3624 (Sept 2007)
21.
Zurück zum Zitat Zhang, J., Sanderson, A.C.: JADE: adaptive differential evolution with optional external archive. IEEE Trans. Evol. Comput. 13(5), 945–958 (2009)CrossRef Zhang, J., Sanderson, A.C.: JADE: adaptive differential evolution with optional external archive. IEEE Trans. Evol. Comput. 13(5), 945–958 (2009)CrossRef
22.
Zurück zum Zitat Zhang, M., Zhao, S., Wang, X.: Multi-objective evolutionary algorithm based on adaptive discrete differential evolution. In: IEEE Congress on Evolutionary Computation, CEC 2009, pp. 614–621 (May 2009) Zhang, M., Zhao, S., Wang, X.: Multi-objective evolutionary algorithm based on adaptive discrete differential evolution. In: IEEE Congress on Evolutionary Computation, CEC 2009, pp. 614–621 (May 2009)
23.
Zurück zum Zitat Zitzler, E.: Evolutionary algorithms for multiobjective optimization: methods and applications. Ph.D. thesis, Computer Engineering and Network Laboratory, Swiss Federal Institute of Technology (ETH), Zurich, Switzerland (1999) Zitzler, E.: Evolutionary algorithms for multiobjective optimization: methods and applications. Ph.D. thesis, Computer Engineering and Network Laboratory, Swiss Federal Institute of Technology (ETH), Zurich, Switzerland (1999)
Metadaten
Titel
Comparison of Parameter Control Mechanisms in Multi-objective Differential Evolution
verfasst von
Martin Drozdik
Hernan Aguirre
Youhei Akimoto
Kiyoshi Tanaka
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-19084-6_8