Skip to main content
Top

2017 | OriginalPaper | Chapter

Toward Step-Size Adaptation in Evolutionary Multiobjective Optimization

Authors : Simon Wessing, Rosa Pink, Kai Brandenbusch, Günter Rudolph

Published in: Evolutionary Multi-Criterion Optimization

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We give a definition for step size optimality in multiobjective optimization and visualize the optimal step sizes for a few two-dimensional example constellations. After that, we try to engineer a step size adaptation mechanism that also works in the real world. For this mechanism, we employ the self-adaptation of mutation strength, which is simple and well-known from single-objective optimization. The resulting approach obtains better results than simulated binary crossover and polynomial mutation on the bi-objective BBOB testbed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
We are using step size and mutation strength synonymously in this work.
 
Literature
1.
go back to reference Auger, A., Brockhoff, D., Hansen, N., Tušar, D., Tušar, T., Wagner, T.: The impact of variation operators on the performance of SMS-EMOA on the bi-objective BBOB-2016 test suite. In: Companion Publication of the 2016 Conference on Genetic and Evolutionary Computation, pp. 1225–1232. ACM (2016) Auger, A., Brockhoff, D., Hansen, N., Tušar, D., Tušar, T., Wagner, T.: The impact of variation operators on the performance of SMS-EMOA on the bi-objective BBOB-2016 test suite. In: Companion Publication of the 2016 Conference on Genetic and Evolutionary Computation, pp. 1225–1232. ACM (2016)
2.
go back to reference Beume, N., Laumanns, M., Rudolph, G.: Convergence rates of (1 + 1) evolutionary multiobjective optimization algorithms. In: Schaefer, R., Cotta, C., Kołodziej, J., Rudolph, G. (eds.) PPSN 2010. LNCS, vol. 6238, pp. 597–606. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15844-5_60 Beume, N., Laumanns, M., Rudolph, G.: Convergence rates of (1 + 1) evolutionary multiobjective optimization algorithms. In: Schaefer, R., Cotta, C., Kołodziej, J., Rudolph, G. (eds.) PPSN 2010. LNCS, vol. 6238, pp. 597–606. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-15844-5_​60
3.
go back to reference Beume, N., Laumanns, M., Rudolph, G.: Convergence rates of SMS-EMOA on continuous bi-objective problem classes. In: Proceedings of the 11th Workshop on Foundations of Genetic Algorithms, FOGA 2011, pp. 243–252. ACM (2011) Beume, N., Laumanns, M., Rudolph, G.: Convergence rates of SMS-EMOA on continuous bi-objective problem classes. In: Proceedings of the 11th Workshop on Foundations of Genetic Algorithms, FOGA 2011, pp. 243–252. ACM (2011)
4.
go back to reference Beume, N., Naujoks, B., Emmerich, M.: SMS-EMOA: multiobjective selection based on dominated hypervolume. Eur. J. Oper. Res. 181(3), 1653–1669 (2007)CrossRefMATH Beume, N., Naujoks, B., Emmerich, M.: SMS-EMOA: multiobjective selection based on dominated hypervolume. Eur. J. Oper. Res. 181(3), 1653–1669 (2007)CrossRefMATH
5.
go back to reference Beyer, H.G., Deb, K.: On self-adaptive features in real-parameter evolutionary algorithms. IEEE Trans. Evol. Comput. 5(3), 250–270 (2001)CrossRef Beyer, H.G., Deb, K.: On self-adaptive features in real-parameter evolutionary algorithms. IEEE Trans. Evol. Comput. 5(3), 250–270 (2001)CrossRef
7.
go back to reference Brandenbusch, K.: Experimentelle Analyse selbst-adaptiver Schrittweitenanpassung bei mehrkriteriellen Evolutionären Algorithmen. Bachelor’s thesis. TU Dortmund University, Department of Computer Science, Dortmund, September 2016. (in German) Brandenbusch, K.: Experimentelle Analyse selbst-adaptiver Schrittweitenanpassung bei mehrkriteriellen Evolutionären Algorithmen. Bachelor’s thesis. TU Dortmund University, Department of Computer Science, Dortmund, September 2016. (in German)
8.
go back to reference Bringmann, K., Friedrich, T., Klitzke, P.: Generic postprocessing via subset selection for hypervolume and epsilon-indicator. In: Bartz-Beielstein, T., Branke, J., Filipič, B., Smith, J. (eds.) PPSN 2014. LNCS, vol. 8672, pp. 518–527. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10762-2_51 Bringmann, K., Friedrich, T., Klitzke, P.: Generic postprocessing via subset selection for hypervolume and epsilon-indicator. In: Bartz-Beielstein, T., Branke, J., Filipič, B., Smith, J. (eds.) PPSN 2014. LNCS, vol. 8672, pp. 518–527. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10762-2_​51
9.
go back to reference Brockhoff, D., Tran, T.D., Hansen, N.: Benchmarking numerical multiobjective optimizers revisited. In: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation, GECCO 2015, pp. 639–646. ACM (2015) Brockhoff, D., Tran, T.D., Hansen, N.: Benchmarking numerical multiobjective optimizers revisited. In: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation, GECCO 2015, pp. 639–646. ACM (2015)
11.
go back to reference Conover, W.J., Iman, R.L.: Rank transformations as a bridge between parametric and nonparametric statistics. Am. Stat. 35(3), 124–129 (1981)MATH Conover, W.J., Iman, R.L.: Rank transformations as a bridge between parametric and nonparametric statistics. Am. Stat. 35(3), 124–129 (1981)MATH
12.
go back to reference Deb, K., Agrawal, R.B.: Simulated binary crossover for continuous search space. Complex Syst. 9, 115–148 (1995)MathSciNetMATH Deb, K., Agrawal, R.B.: Simulated binary crossover for continuous search space. Complex Syst. 9, 115–148 (1995)MathSciNetMATH
13.
go back to reference Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)CrossRef Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)CrossRef
14.
go back to reference Eiben, A.E., Hinterding, R., Michalewicz, Z.: Parameter control in evolutionary algorithms. IEEE Trans. Evol. Comput. 3(2), 124–141 (1999)CrossRef Eiben, A.E., Hinterding, R., Michalewicz, Z.: Parameter control in evolutionary algorithms. IEEE Trans. Evol. Comput. 3(2), 124–141 (1999)CrossRef
15.
go back to reference Eiben, A.E., Smith, J.E.: Introduction to Evolutionary Computing. Springer, Heidelberg (2003)CrossRefMATH Eiben, A.E., Smith, J.E.: Introduction to Evolutionary Computing. Springer, Heidelberg (2003)CrossRefMATH
16.
go back to reference Hupkens, I., Deutz, A., Yang, K., Emmerich, M.: Faster exact algorithms for computing expected hypervolume improvement. In: Gaspar-Cunha, A., Henggeler Antunes, C., Coello, C.C. (eds.) EMO 2015. LNCS, vol. 9019, pp. 65–79. Springer, Cham (2015). doi:10.1007/978-3-319-15892-1_5 Hupkens, I., Deutz, A., Yang, K., Emmerich, M.: Faster exact algorithms for computing expected hypervolume improvement. In: Gaspar-Cunha, A., Henggeler Antunes, C., Coello, C.C. (eds.) EMO 2015. LNCS, vol. 9019, pp. 65–79. Springer, Cham (2015). doi:10.​1007/​978-3-319-15892-1_​5
17.
go back to reference Igel, C., Hansen, N., Roth, S.: Covariance matrix adaptation for multi-objective optimization. Evol. Comput. 15(1), 1–28 (2007)CrossRef Igel, C., Hansen, N., Roth, S.: Covariance matrix adaptation for multi-objective optimization. Evol. Comput. 15(1), 1–28 (2007)CrossRef
18.
go back to reference Judt, L., Mersmann, O., Naujoks, B.: Non-monotonicity of observed hypervolume in 1-greedy S-metric selection. J. Multi-Criteria Decis. Anal. 20(5–6), 277–290 (2013)CrossRef Judt, L., Mersmann, O., Naujoks, B.: Non-monotonicity of observed hypervolume in 1-greedy S-metric selection. J. Multi-Criteria Decis. Anal. 20(5–6), 277–290 (2013)CrossRef
19.
go back to reference Klinkenberg, J.W., Emmerich, M.T.M., Deutz, A.H., Shir, O.M., Bäck, T.: A reduced-cost SMS-EMOA using kriging, self-adaptation, and parallelization. In: Ehrgott, M., Naujoks, B., Stewart, J.T., Wallenius, J. (eds.) Multiple Criteria Decision Making for Sustainable Energy and Transportation Systems. LNE, vol. 634, pp. 301–311. Springer, Heidelberg (2010). doi:10.1007/978-3-642-04045-0_26 CrossRef Klinkenberg, J.W., Emmerich, M.T.M., Deutz, A.H., Shir, O.M., Bäck, T.: A reduced-cost SMS-EMOA using kriging, self-adaptation, and parallelization. In: Ehrgott, M., Naujoks, B., Stewart, J.T., Wallenius, J. (eds.) Multiple Criteria Decision Making for Sustainable Energy and Transportation Systems. LNE, vol. 634, pp. 301–311. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-04045-0_​26 CrossRef
20.
go back to reference Kursawe, F.: A variant of evolution strategies for vector optimization. In: Schwefel, H.-P., Männer, R. (eds.) PPSN 1990. LNCS, vol. 496, pp. 193–197. Springer, Heidelberg (1991). doi:10.1007/BFb0029752 CrossRef Kursawe, F.: A variant of evolution strategies for vector optimization. In: Schwefel, H.-P., Männer, R. (eds.) PPSN 1990. LNCS, vol. 496, pp. 193–197. Springer, Heidelberg (1991). doi:10.​1007/​BFb0029752 CrossRef
21.
go back to reference Naujoks, B., Quagliarella, D., Bartz-Beielstein, T.: Sequential parameter optimisation of evolutionary algorithms for airfoil design. In: Winter, G. (ed.) Proceedings of Design and Optimization: Methods and Application (ERCOFTAC 2006), pp. 231–235. University of Las Palmas de Gran Canaria (2006) Naujoks, B., Quagliarella, D., Bartz-Beielstein, T.: Sequential parameter optimisation of evolutionary algorithms for airfoil design. In: Winter, G. (ed.) Proceedings of Design and Optimization: Methods and Application (ERCOFTAC 2006), pp. 231–235. University of Las Palmas de Gran Canaria (2006)
22.
go back to reference Pink, R.: Optimale Schrittweiten für einen bikriteriellen Evolutionären Algorithmus mit S-Metrik Selektion. Bachelor’s thesis. TU Dortmund University, Department of Computer Science, Dortmund, September 2016. (in German) Pink, R.: Optimale Schrittweiten für einen bikriteriellen Evolutionären Algorithmus mit S-Metrik Selektion. Bachelor’s thesis. TU Dortmund University, Department of Computer Science, Dortmund, September 2016. (in German)
23.
go back to reference Rechenberg, I.: Evolutionsstrategie - Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Frommann Holzboog, Stuttgart (1973) Rechenberg, I.: Evolutionsstrategie - Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Frommann Holzboog, Stuttgart (1973)
24.
go back to reference Rudolph, G.: On a multi-objective evolutionary algorithm and its convergence to the Pareto set. In: IEEE International Conference on Evolutionary Computation Proceedings, pp. 511–516 (1998) Rudolph, G.: On a multi-objective evolutionary algorithm and its convergence to the Pareto set. In: IEEE International Conference on Evolutionary Computation Proceedings, pp. 511–516 (1998)
25.
go back to reference Schumer, M., Steiglitz, K.: Adaptive step size random search. IEEE Trans. Autom. Control 13(3), 270–276 (1968)CrossRef Schumer, M., Steiglitz, K.: Adaptive step size random search. IEEE Trans. Autom. Control 13(3), 270–276 (1968)CrossRef
28.
go back to reference Wessing, S., Beume, N., Rudolph, G., Naujoks, B.: Parameter tuning boosts performance of variation operators in multiobjective optimization. In: Schaefer, R., Cotta, C., Kołodziej, J., Rudolph, G. (eds.) PPSN 2010. LNCS, vol. 6238, pp. 728–737. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15844-5_73 Wessing, S., Beume, N., Rudolph, G., Naujoks, B.: Parameter tuning boosts performance of variation operators in multiobjective optimization. In: Schaefer, R., Cotta, C., Kołodziej, J., Rudolph, G. (eds.) PPSN 2010. LNCS, vol. 6238, pp. 728–737. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-15844-5_​73
Metadata
Title
Toward Step-Size Adaptation in Evolutionary Multiobjective Optimization
Authors
Simon Wessing
Rosa Pink
Kai Brandenbusch
Günter Rudolph
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-54157-0_45

Premium Partner