Skip to main content
Erschienen in: Structural and Multidisciplinary Optimization 5/2018

16.06.2018 | RESEARCH PAPER

A modified hypervolume based expected improvement for multi-objective efficient global optimization method

verfasst von: Zheng Li, Xinyu Wang, Shilun Ruan, Zhaojun Li, Changyu Shen, Yan Zeng

Erschienen in: Structural and Multidisciplinary Optimization | Ausgabe 5/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The hypervolume indicator has been proved as an outstanding metric for the distribution of Pareto points, and the derived hypervolume based expected improvement (HVEI) has received a particular attention in the multi-objective efficient global optimization (EGO) method. However, the high computational cost has become the bottle neck which limits the application of HVEI on many objective optimization. Aiming at this problem, a modified version of HVEI (MHVEI) is proposed in this paper, which is easier to implement, maintains all the desired properties, and has a much lower computational cost. The theoretical study shows that the new criterion can be considered as a weighted integral form of HVEI, and it prefers the new point with a higher uncertainty compared with HVEI. The numerical tests show that the MHVEI performs similar as HVEI on the lower dimensional problem, and the advantage of MHVEI becomes more obvious as the dimension grows.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Beumea N, Emmerich M (2007) SMS-EMOA: Multiobjective selection based on dominated hypervolume. Eur J Oper Res 181(3):1653–1669CrossRef Beumea N, Emmerich M (2007) SMS-EMOA: Multiobjective selection based on dominated hypervolume. Eur J Oper Res 181(3):1653–1669CrossRef
Zurück zum Zitat Couckuyt I, Deschrijver D, Dhaene T (2014) Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization. J Glob Optim 60(3):575–594MathSciNetCrossRef Couckuyt I, Deschrijver D, Dhaene T (2014) Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization. J Glob Optim 60(3):575–594MathSciNetCrossRef
Zurück zum Zitat Das I, Dennis JE (2006) Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems. SIAM J Optim 8(3):631–657MathSciNetCrossRef Das I, Dennis JE (2006) Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems. SIAM J Optim 8(3):631–657MathSciNetCrossRef
Zurück zum Zitat Deb K, Thiele L, Laumanns M, Zitzler E (2001) Scalable test problems for evolutionary multi-objective optimization. Evolutionary Multiobjective Optimization: Theoretical Advances and Applications Chapter 6: 105-145. Deb K, Thiele L, Laumanns M, Zitzler E (2001) Scalable test problems for evolutionary multi-objective optimization. Evolutionary Multiobjective Optimization: Theoretical Advances and Applications Chapter 6: 105-145.
Zurück zum Zitat Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197CrossRef Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197CrossRef
Zurück zum Zitat Emmerich MTM, Beume N, Naujoks B (2005) An EMO Algorithm Using the Hypervolume Measure as Selection Criterion. In: International Conference on Evolutionary Multi-Criterion Optimization, Guanajuato, Mexico. Emmerich MTM, Beume N, Naujoks B (2005) An EMO Algorithm Using the Hypervolume Measure as Selection Criterion. In: International Conference on Evolutionary Multi-Criterion Optimization, Guanajuato, Mexico.
Zurück zum Zitat Emmerich MTM, Giannakoglou KC, Naujoks B (2006) Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels. IEEE Trans Evol Comput 10(4):421–439CrossRef Emmerich MTM, Giannakoglou KC, Naujoks B (2006) Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels. IEEE Trans Evol Comput 10(4):421–439CrossRef
Zurück zum Zitat Emmerich MTM, Deutz AH, Klinkenberg JW (2011) Hypervolume-based expected improvement: Monotonicity properties and exact computation. In: In 2011 IEEE Congress of Evolutionary Computation, New Orleans, LA, USA. Emmerich MTM, Deutz AH, Klinkenberg JW (2011) Hypervolume-based expected improvement: Monotonicity properties and exact computation. In: In 2011 IEEE Congress of Evolutionary Computation, New Orleans, LA, USA.
Zurück zum Zitat Ginsbourger D, Le Riche R, Carraro L (2010) Kriging is well-suited to parallelize optimization. Springer Berlin HeidelbergCrossRef Ginsbourger D, Le Riche R, Carraro L (2010) Kriging is well-suited to parallelize optimization. Springer Berlin HeidelbergCrossRef
Zurück zum Zitat Goel T, Vaidyanathan R, Haftka RT, Wei S, Queipo NV, Tucker K (2007) Response surface approximation of Pareto optimal front in multi-objective optimization. Comput Methods Appl Mech Eng 196(4):879–893CrossRef Goel T, Vaidyanathan R, Haftka RT, Wei S, Queipo NV, Tucker K (2007) Response surface approximation of Pareto optimal front in multi-objective optimization. Comput Methods Appl Mech Eng 196(4):879–893CrossRef
Zurück zum Zitat Haftka RT, Villanueva D, Chaudhuri A (2016) Parallel surrogate-assisted global optimization with expensive functions – a survey. Struct Multidisc Optim 54: 3-13.MathSciNetCrossRef Haftka RT, Villanueva D, Chaudhuri A (2016) Parallel surrogate-assisted global optimization with expensive functions – a survey. Struct Multidisc Optim 54: 3-13.MathSciNetCrossRef
Zurück zum Zitat Hao P, Wang B, Li G (2012) Surrogate-Based Optimum Design for 871 Stiffened Shells with Adaptive Sampling. AIAA J 50(11):2389–2407 Hao P, Wang B, Li G (2012) Surrogate-Based Optimum Design for 871 Stiffened Shells with Adaptive Sampling. AIAA J 50(11):2389–2407
Zurück zum Zitat Hao P, Wang B, Li G, Meng Z, Wang L (2015) Hybrid Framework for Reliability-Based Design Optimization of Imperfect Stiffened Shells. AIAA J 53(10):2878–2889CrossRef Hao P, Wang B, Li G, Meng Z, Wang L (2015) Hybrid Framework for Reliability-Based Design Optimization of Imperfect Stiffened Shells. AIAA J 53(10):2878–2889CrossRef
Zurück zum Zitat Hao, P., Wang, B., Tian, K., Li, G., Sun, Y., & Zhou, C. (2017) Fast procedure for Non-uniform optimum design of stiffened shells under buckling constraint. Structural and Multidisciplinary Optimization 55(4):1503-1516MathSciNetCrossRef Hao, P., Wang, B., Tian, K., Li, G., Sun, Y., & Zhou, C. (2017) Fast procedure for Non-uniform optimum design of stiffened shells under buckling constraint. Structural and Multidisciplinary Optimization 55(4):1503-1516MathSciNetCrossRef
Zurück zum Zitat Jeong S, Obayashi S(2005) Efficient global optimization (EGO) for multi-objective problem and data mining, In: IEEE Congress on Evolutionary Computation, Edinburgh, Scotland. Jeong S, Obayashi S(2005) Efficient global optimization (EGO) for multi-objective problem and data mining, In: IEEE Congress on Evolutionary Computation, Edinburgh, Scotland.
Zurück zum Zitat Jie H, Wu Y, Zhao J, Ding J and Liangliang (2016) An efficient multi-objective PSO algorithm assisted by Kriging metamodel for expensive black-box problems. J Glob Optim 67: 1–25MathSciNetCrossRef Jie H, Wu Y, Zhao J, Ding J and Liangliang (2016) An efficient multi-objective PSO algorithm assisted by Kriging metamodel for expensive black-box problems. J Glob Optim 67: 1–25MathSciNetCrossRef
Zurück zum Zitat Jones DR (2001) A Taxonomy of Global Optimization Methods Based on Response Surfaces. J Glob Optim 21(4):345–383MathSciNetCrossRef Jones DR (2001) A Taxonomy of Global Optimization Methods Based on Response Surfaces. J Glob Optim 21(4):345–383MathSciNetCrossRef
Zurück zum Zitat Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13(4):455–492MathSciNetCrossRef Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13(4):455–492MathSciNetCrossRef
Zurück zum Zitat Keane AJ (2006) Statistical Improvement Criteria for Use in Multiobjective Design Optimization. AIAA J 44(4):879–891CrossRef Keane AJ (2006) Statistical Improvement Criteria for Use in Multiobjective Design Optimization. AIAA J 44(4):879–891CrossRef
Zurück zum Zitat Keshtegar B, Hao P, Wang Y, Li Y (2017) Optimum design of aircraft panels based on adaptive dynamic harmony search. Thin-Walled Structures 118: 37–45.CrossRef Keshtegar B, Hao P, Wang Y, Li Y (2017) Optimum design of aircraft panels based on adaptive dynamic harmony search. Thin-Walled Structures 118: 37–45.CrossRef
Zurück zum Zitat Kim M, Hiroyasu T, Miki M, Watanabe S (2004) SPEA2+: Improving the Performance of the Strength Pareto Evolutionary Algorithm 2. Lect Notes Comput Sci 3242(4):742–751CrossRef Kim M, Hiroyasu T, Miki M, Watanabe S (2004) SPEA2+: Improving the Performance of the Strength Pareto Evolutionary Algorithm 2. Lect Notes Comput Sci 3242(4):742–751CrossRef
Zurück zum Zitat Klamroth K, Lacour R, Vanderpooten D (2015) On the representation of the search region in multi-objective optimization. Eur J Oper Res 245(3):767–778MathSciNetCrossRef Klamroth K, Lacour R, Vanderpooten D (2015) On the representation of the search region in multi-objective optimization. Eur J Oper Res 245(3):767–778MathSciNetCrossRef
Zurück zum Zitat Knowles J (2006) ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Trans Evol Comput 10(1):50–66CrossRef Knowles J (2006) ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Trans Evol Comput 10(1):50–66CrossRef
Zurück zum Zitat Knowles JD, Corne DW, Fleischer M(2003) Bounded archiving using the lebesgue measure, In: IEEE Congress on Evolutionary Computation, Canberra, Australia. Knowles JD, Corne DW, Fleischer M(2003) Bounded archiving using the lebesgue measure, In: IEEE Congress on Evolutionary Computation, Canberra, Australia.
Zurück zum Zitat Krige DG (1951) A statistical approach to some mine valuations and allied problems at the Witwatersrand. Master’s thesis University of the Witwatersrand Krige DG (1951) A statistical approach to some mine valuations and allied problems at the Witwatersrand. Master’s thesis University of the Witwatersrand
Zurück zum Zitat Li M, Li G, Azarm S (2006) A Kriging Metamodel Assisted Multi-Objective Genetic Algorithm for Design Optimization. J Mech Des 130(3):405–414 Li M, Li G, Azarm S (2006) A Kriging Metamodel Assisted Multi-Objective Genetic Algorithm for Design Optimization. J Mech Des 130(3):405–414
Zurück zum Zitat Liu W, Zhang Q, Tsang E, Liu C and Virginas B (2007) On the Performance of Metamodel Assisted MOEA/D, In: Advances in Computation and Intelligence, Second International Symposium, ISICA 2007, Wuhan, Proceedings, pp 547–557 Liu W, Zhang Q, Tsang E, Liu C and Virginas B (2007) On the Performance of Metamodel Assisted MOEA/D, In: Advances in Computation and Intelligence, Second International Symposium, ISICA 2007, Wuhan, Proceedings, pp 547–557
Zurück zum Zitat Mckay MD, Beckman RJ, Conover WJ (1979) A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21(2):239–245MathSciNetMATH Mckay MD, Beckman RJ, Conover WJ (1979) A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21(2):239–245MathSciNetMATH
Zurück zum Zitat Messac A (2003) The normalized normal constraint method for generating the Pareto frontier. Struct Multidiscip Optim 25(2):86–98MathSciNetCrossRef Messac A (2003) The normalized normal constraint method for generating the Pareto frontier. Struct Multidiscip Optim 25(2):86–98MathSciNetCrossRef
Zurück zum Zitat Messac A, Puemi-Sukam C, Melachrinoudis E (2000) Aggregate Objective Functions and Pareto Frontiers: Required Relationships and Practical Implications. Optim Eng 1(2):171–188MathSciNetCrossRef Messac A, Puemi-Sukam C, Melachrinoudis E (2000) Aggregate Objective Functions and Pareto Frontiers: Required Relationships and Practical Implications. Optim Eng 1(2):171–188MathSciNetCrossRef
Zurück zum Zitat Messac A, Dessel SV, Mullur AA, Maria A (2004) Optimization of large-scale rigidified inflatable structures for housing using physical programming. Struct Multidiscip Optim 26(1–2):139–151CrossRef Messac A, Dessel SV, Mullur AA, Maria A (2004) Optimization of large-scale rigidified inflatable structures for housing using physical programming. Struct Multidiscip Optim 26(1–2):139–151CrossRef
Zurück zum Zitat Lophaven, SN, Søndergaard J, Nielsen HB (2002). DACE A Matlab Kriging Toolbox. IMM Informatiocs and Mathematical Modelling. Retrieved from http://imedea.uib-csic.es/master/cambioglobal/Modulo_V_cod101615/Lab/lab_maps/krigging/DACE-krigingsoft/dace/dace.pd Lophaven, SN, Søndergaard J, Nielsen HB (2002). DACE A Matlab Kriging Toolbox. IMM Informatiocs and Mathematical Modelling. Retrieved from http://​imedea.​uib-csic.​es/​master/​cambioglobal/​Modulo_​V_​cod101615/​Lab/​lab_​maps/​krigging/​DACE-krigingsoft/​dace/​dace.​pd
Zurück zum Zitat Przybylski A, Gandibleux X, Ehrgott M (2010) A two phase method for multi-objective integer programming and its application to the assignment problem with three objectives. Discret Optim 7(3):149–165MathSciNetCrossRef Przybylski A, Gandibleux X, Ehrgott M (2010) A two phase method for multi-objective integer programming and its application to the assignment problem with three objectives. Discret Optim 7(3):149–165MathSciNetCrossRef
Zurück zum Zitat Sasena MJ, Papalambros P, Goovaerts P (2002) Exploration of Metamodeling Sampling Criteria for Constrained Global Optimization. Eng Optim 34(3):263–278CrossRef Sasena MJ, Papalambros P, Goovaerts P (2002) Exploration of Metamodeling Sampling Criteria for Constrained Global Optimization. Eng Optim 34(3):263–278CrossRef
Zurück zum Zitat Schonlau M (1998) Computer experiments and global optimization. University of Waterloo, Waterloo, Canada Schonlau M (1998) Computer experiments and global optimization. University of Waterloo, Waterloo, Canada
Zurück zum Zitat Sóbester A, Leary SJ, Keane AJ (2005) On the Design of Optimization Strategies Based on Global Response Surface Approximation Models. J Glob Optim 33(1):31–59MathSciNetCrossRef Sóbester A, Leary SJ, Keane AJ (2005) On the Design of Optimization Strategies Based on Global Response Surface Approximation Models. J Glob Optim 33(1):31–59MathSciNetCrossRef
Zurück zum Zitat Wagner T, EmmerichM, PonweiserW(2010) On expected-improvement criteria for model-based multi-objective optimization. In: International Conference on Parallel Problem Solving From Nature, Krakow, Poland. Wagner T, EmmerichM, PonweiserW(2010) On expected-improvement criteria for model-based multi-objective optimization. In: International Conference on Parallel Problem Solving From Nature, Krakow, Poland.
Zurück zum Zitat While R, Bradstreet L, Barone L and Hingston P (2005) Heuristics for Optimising the Calculation of Hypervolume for Multi-objective Optimisation Problems 3(2): 2225–2232 While R, Bradstreet L, Barone L and Hingston P (2005) Heuristics for Optimising the Calculation of Hypervolume for Multi-objective Optimisation Problems 3(2): 2225–2232
Zurück zum Zitat Yang K, EmmerichM, Deutz A and Fonseca CM(2017) Computing 3-D expected hypervolume improvement and related integrals in asymptotically optimal time. In: International Conference on Evolutionary Multi-Criterion Optimization, Munster, Germany. Yang K, EmmerichM, Deutz A and Fonseca CM(2017) Computing 3-D expected hypervolume improvement and related integrals in asymptotically optimal time. In: International Conference on Evolutionary Multi-Criterion Optimization, Munster, Germany.
Zurück zum Zitat Zhan D, Cheng Y, Liu J (2017) Expected Improvement Matrix-based Infill Criteria for Expensive Multiobjective Optimization. IEEE Trans Evol Comput PP(99):1 Zhan D, Cheng Y, Liu J (2017) Expected Improvement Matrix-based Infill Criteria for Expensive Multiobjective Optimization. IEEE Trans Evol Comput PP(99):1
Zurück zum Zitat Zhang Q, Liu W, Tsang E, Virginas B (2010) Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model. IEEE Trans Evol Comput 14(3):456–474CrossRef Zhang Q, Liu W, Tsang E, Virginas B (2010) Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model. IEEE Trans Evol Comput 14(3):456–474CrossRef
Zurück zum Zitat Zitzler E, Thiele L (1998) Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study. In: 5th International Conference on Parallel Problem Solving from Nature, Amsterdam, Netherlands.CrossRef Zitzler E, Thiele L (1998) Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study. In: 5th International Conference on Parallel Problem Solving from Nature, Amsterdam, Netherlands.CrossRef
Metadaten
Titel
A modified hypervolume based expected improvement for multi-objective efficient global optimization method
verfasst von
Zheng Li
Xinyu Wang
Shilun Ruan
Zhaojun Li
Changyu Shen
Yan Zeng
Publikationsdatum
16.06.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
Structural and Multidisciplinary Optimization / Ausgabe 5/2018
Print ISSN: 1615-147X
Elektronische ISSN: 1615-1488
DOI
https://doi.org/10.1007/s00158-018-2006-3

Weitere Artikel der Ausgabe 5/2018

Structural and Multidisciplinary Optimization 5/2018 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.