Skip to main content

2016 | OriginalPaper | Buchkapitel

A Multicriteria Generalization of Bayesian Global Optimization

verfasst von : Michael Emmerich, Kaifeng Yang, André Deutz, Hao Wang, Carlos M. Fonseca

Erschienen in: Advances in Stochastic and Deterministic Global Optimization

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter discusses a generalization of the expected improvement used in Bayesian global optimization to the multicriteria optimization domain, where the goal is to find an approximation to the Pareto front. The expected hypervolume improvement (EHVI) measures improvement as the gain in dominated hypervolume relative to a given approximation to the Pareto front. We will review known properties of the EHVI, applications in practice and propose a new exact algorithm for computing EHVI. The new algorithm has asymptotically optimal time complexity O(nlogn). This improves existing computation schemes by a factor of n∕logn. It shows that this measure, at least for a small number of objective functions, is as fast as other simpler measures of multicriteria expected improvement that were considered in recent years.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Auger, A., Bader, J., Brockhoff, D., Zitzler, E.: Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point. In: Proceedings of the Tenth ACM SIGEVO Workshop on Foundations of Genetic Algorithms, pp. 87–102. ACM, Chicago (2009) Auger, A., Bader, J., Brockhoff, D., Zitzler, E.: Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point. In: Proceedings of the Tenth ACM SIGEVO Workshop on Foundations of Genetic Algorithms, pp. 87–102. ACM, Chicago (2009)
2.
Zurück zum Zitat Couckuyt, I., Deschrijver, D., Dhaene, T.: Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization. J. Global Optim. 60 (3), 575–594 (2014)MathSciNetCrossRefMATH Couckuyt, I., Deschrijver, D., Dhaene, T.: Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization. J. Global Optim. 60 (3), 575–594 (2014)MathSciNetCrossRefMATH
3.
Zurück zum Zitat Emmerich, M.: Single-and multi-objective evolutionary design optimization assisted by Gaussian random field metamodels. Ph.D. thesis, Fachbereich Informatik, Chair of Systems Analysis, University of Dortmund (2005) Emmerich, M.: Single-and multi-objective evolutionary design optimization assisted by Gaussian random field metamodels. Ph.D. thesis, Fachbereich Informatik, Chair of Systems Analysis, University of Dortmund (2005)
4.
Zurück zum Zitat Emmerich, M., Giannakoglou, K.C., Naujoks, B.: Single-and multiobjective evolutionary optimization assisted by Gaussian random field metamodels. IEEE Trans. Evol. Comput. 10 (4), 421–439 (2006)CrossRef Emmerich, M., Giannakoglou, K.C., Naujoks, B.: Single-and multiobjective evolutionary optimization assisted by Gaussian random field metamodels. IEEE Trans. Evol. Comput. 10 (4), 421–439 (2006)CrossRef
5.
Zurück zum Zitat Emmerich, M., Deutz, A.H., Klinkenberg, J.W.: Hypervolume-based expected improvement: monotonicity properties and exact computation. In: 2011 IEEE Congress on Evolutionary Computation (CEC), pp. 2147–2154. IEEE, New Jersey (2011) Emmerich, M., Deutz, A.H., Klinkenberg, J.W.: Hypervolume-based expected improvement: monotonicity properties and exact computation. In: 2011 IEEE Congress on Evolutionary Computation (CEC), pp. 2147–2154. IEEE, New Jersey (2011)
6.
Zurück zum Zitat Gaida, D.: Dynamic real-time substrate feed optimization of anaerobic co-digestion plants. Ph.D. thesis, Leiden Institute of Advanced Computer Science (LIACS), Faculty of Science, Leiden University (2014) Gaida, D.: Dynamic real-time substrate feed optimization of anaerobic co-digestion plants. Ph.D. thesis, Leiden Institute of Advanced Computer Science (LIACS), Faculty of Science, Leiden University (2014)
7.
Zurück zum Zitat Hupkens, I., Emmerich, M., Deutz, A.: Faster computation of expected hypervolume improvement. arXiv preprint arXiv:1408.7114 (2014) Hupkens, I., Emmerich, M., Deutz, A.: Faster computation of expected hypervolume improvement. arXiv preprint arXiv:1408.7114 (2014)
8.
Zurück zum Zitat Hupkens, I., Deutz, A., Yang, K., Emmerich, M.: Faster exact algorithms for computing expected hypervolume improvement. In: Evolutionary Multi-Criterion Optimization, pp. 65–79. Springer, Berlin, Heidelberg (2015) Hupkens, I., Deutz, A., Yang, K., Emmerich, M.: Faster exact algorithms for computing expected hypervolume improvement. In: Evolutionary Multi-Criterion Optimization, pp. 65–79. Springer, Berlin, Heidelberg (2015)
9.
Zurück zum Zitat Jones, D.R., Schonlau, M., Welch, W.J.: Efficient global optimization of expensive black-box functions. J. Global Optim. 13 (4), 455–492 (1998)MathSciNetCrossRefMATH Jones, D.R., Schonlau, M., Welch, W.J.: Efficient global optimization of expensive black-box functions. J. Global Optim. 13 (4), 455–492 (1998)MathSciNetCrossRefMATH
10.
Zurück zum Zitat Keane, A.J.: Statistical improvement criteria for use in multiobjective design optimization. AIAA J. 44 (4), 879–891 (2006)CrossRef Keane, A.J.: Statistical improvement criteria for use in multiobjective design optimization. AIAA J. 44 (4), 879–891 (2006)CrossRef
11.
Zurück zum Zitat Knowles, J.: ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Trans. Evol. Comput. 10 (1), 50–66 (2006)CrossRef Knowles, J.: ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Trans. Evol. Comput. 10 (1), 50–66 (2006)CrossRef
12.
Zurück zum Zitat Koch, P., Wagner, T., Emmerich, M.T., Bäck, T., Konen, W.: Efficient multi-criteria optimization on noisy machine learning problems. Appl. Soft Comput. 29, 357–370, New Jersey (2015) Koch, P., Wagner, T., Emmerich, M.T., Bäck, T., Konen, W.: Efficient multi-criteria optimization on noisy machine learning problems. Appl. Soft Comput. 29, 357–370, New Jersey (2015)
13.
Zurück zum Zitat Łaniewski-Wołłk, Ł., Obayashi, S., Jeong, S.: Development of expected improvement for multi-objective problem. In: Proceedings of 42nd Fluid Dynamics Conference/Aerospace Numerical Simulation Symposium (2010) Łaniewski-Wołłk, Ł., Obayashi, S., Jeong, S.: Development of expected improvement for multi-objective problem. In: Proceedings of 42nd Fluid Dynamics Conference/Aerospace Numerical Simulation Symposium (2010)
14.
Zurück zum Zitat Mockus, J.: Bayesian Approach to Global Optimization: Theory and Applications, vol. 37. Springer Science & Business Media, New York (2012)MATH Mockus, J.: Bayesian Approach to Global Optimization: Theory and Applications, vol. 37. Springer Science & Business Media, New York (2012)MATH
15.
Zurück zum Zitat Mockus, J., Tiesis, V., Žilinskas, A.: The application of Bayesian methods for seeking the extremum. In: Towards Global Optimization, vol. 2, pp. 117–129. North-Holland, Amsterdam (1978) Mockus, J., Tiesis, V., Žilinskas, A.: The application of Bayesian methods for seeking the extremum. In: Towards Global Optimization, vol. 2, pp. 117–129. North-Holland, Amsterdam (1978)
16.
Zurück zum Zitat Shimoyama, K., Sato, K., Jeong, S., Obayashi, S.: Comparison of the criteria for updating Kriging response surface models in multi-objective optimization. In: 2012 IEEE Congress on Evolutionary Computation (CEC), pp. 1–8. IEEE, New Jersey (2012) Shimoyama, K., Sato, K., Jeong, S., Obayashi, S.: Comparison of the criteria for updating Kriging response surface models in multi-objective optimization. In: 2012 IEEE Congress on Evolutionary Computation (CEC), pp. 1–8. IEEE, New Jersey (2012)
17.
Zurück zum Zitat Shimoyama, K., Sato, K., Jeong, S., Obayashi, S.: Updating Kriging surrogate models based on the hypervolume indicator in multi-objective optimization. J. Mech. Des. 135 (9), 094503 (2013)CrossRef Shimoyama, K., Sato, K., Jeong, S., Obayashi, S.: Updating Kriging surrogate models based on the hypervolume indicator in multi-objective optimization. J. Mech. Des. 135 (9), 094503 (2013)CrossRef
18.
Zurück zum Zitat Shir, O.M., Emmerich, M., Bäck, T., Vrakking, M.J.: The application of evolutionary multi-criteria optimization to dynamic molecular alignment. In: IEEE Congress on Evolutionary Computation, 2007, CEC 2007, pp. 4108–4115. IEEE, New Jersey (2007) Shir, O.M., Emmerich, M., Bäck, T., Vrakking, M.J.: The application of evolutionary multi-criteria optimization to dynamic molecular alignment. In: IEEE Congress on Evolutionary Computation, 2007, CEC 2007, pp. 4108–4115. IEEE, New Jersey (2007)
19.
Zurück zum Zitat Stein, M.L.: Interpolation of Spatial Data: Some Theory for Kriging. Springer Science & Business Media, New York (2012) Stein, M.L.: Interpolation of Spatial Data: Some Theory for Kriging. Springer Science & Business Media, New York (2012)
20.
Zurück zum Zitat Tesch, M., Schneider, J., Choset, H.: Adapting control policies for expensive systems to changing environments. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 357–364. IEEE, New Jersey (2011) Tesch, M., Schneider, J., Choset, H.: Adapting control policies for expensive systems to changing environments. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 357–364. IEEE, New Jersey (2011)
21.
22.
Zurück zum Zitat Vazquez, E., Bect, J.: Convergence properties of the expected improvement algorithm with fixed mean and covariance functions. J. Stat. Plan. Inference 140 (11), 3088–3095 (2010)MathSciNetCrossRefMATH Vazquez, E., Bect, J.: Convergence properties of the expected improvement algorithm with fixed mean and covariance functions. J. Stat. Plan. Inference 140 (11), 3088–3095 (2010)MathSciNetCrossRefMATH
23.
Zurück zum Zitat Wagner, T., Emmerich, M., Deutz, A., Ponweiser, W.: On expected-improvement criteria for model-based multi-objective optimization. In: Parallel Problem Solving from Nature. PPSN XI, pp. 718–727. Springer, Berlin, Heidelberg (2010) Wagner, T., Emmerich, M., Deutz, A., Ponweiser, W.: On expected-improvement criteria for model-based multi-objective optimization. In: Parallel Problem Solving from Nature. PPSN XI, pp. 718–727. Springer, Berlin, Heidelberg (2010)
24.
Zurück zum Zitat Zaefferer, M., Bartz-Beielstein, T., Naujoks, B., Wagner, T., Emmerich, M.: A case study on multi-criteria optimization of an event detection software under limited budgets. In: Evolutionary Multi-Criterion Optimization, pp. 756–770. Springer, Berlin, Heidelberg (2013) Zaefferer, M., Bartz-Beielstein, T., Naujoks, B., Wagner, T., Emmerich, M.: A case study on multi-criteria optimization of an event detection software under limited budgets. In: Evolutionary Multi-Criterion Optimization, pp. 756–770. Springer, Berlin, Heidelberg (2013)
25.
Zurück zum Zitat Žilinskas, A., Mockus, J.: On one Bayesian method of search of the minimum. Avtomatika i Vychislitel’naya Teknika 4, 42–44 (1972) Žilinskas, A., Mockus, J.: On one Bayesian method of search of the minimum. Avtomatika i Vychislitel’naya Teknika 4, 42–44 (1972)
Metadaten
Titel
A Multicriteria Generalization of Bayesian Global Optimization
verfasst von
Michael Emmerich
Kaifeng Yang
André Deutz
Hao Wang
Carlos M. Fonseca
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-29975-4_12