Skip to main content

2024 | OriginalPaper | Buchkapitel

Integrating Bayesian and Evolutionary Approaches for Multi-objective Optimisation

verfasst von : Tinkle Chugh, Alex Evans

Erschienen in: Applications of Evolutionary Computation

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Both Multi-Objective Evolutionary Algorithms (MOEAs) and Multi-Objective Bayesian Optimisation (MOBO) are designed to address challenges posed by multi-objective optimisation problems. MOBO offers the distinct advantage of managing computationally or financially expensive evaluations by constructing Bayesian models based on the dataset. MOBO employs an acquisition function to strike a balance between convergence and diversity, facilitating the selection of an appropriate decision vector. MOEAs, similarly focused on achieving convergence and diversity, employ a selection criterion. This paper contributes to the field of multi-objective optimisation by constructing Bayesian models on the selection criterion of decomposition-based MOEAs within the framework of MOBO. The modelling process incorporates both mono and multi-surrogate approaches. The findings underscore the efficacy of MOEA selection criteria in the MOBO context, particularly when adopting the multi-surrogate approach. Evaluation results on both real-world and benchmark problems demonstrate the superiority of the multi-surrogate approach over its mono-surrogate counterpart for a given selection criterion. This study emphasises the significance of bridging the gap between these two optimisation fields and leveraging their respective strengths.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bowman, V.J., et al.: On the relationship of the Tchebycheff norm and the efficient frontier of multiple-criteria objectives. In: Thiriez, H., Zionts, S. (eds.) Multiple Criteria Decision Making: Proceedings of a Conference Jouy-en-Josas, France May 21–23, 1975, pp. 76–86. Springer Berlin Heidelberg, Berlin, Heidelberg (1976). https://doi.org/10.1007/978-3-642-87563-2_5CrossRef Bowman, V.J., et al.: On the relationship of the Tchebycheff norm and the efficient frontier of multiple-criteria objectives. In: Thiriez, H., Zionts, S. (eds.) Multiple Criteria Decision Making: Proceedings of a Conference Jouy-en-Josas, France May 21–23, 1975, pp. 76–86. Springer Berlin Heidelberg, Berlin, Heidelberg (1976). https://​doi.​org/​10.​1007/​978-3-642-87563-2_​5CrossRef
2.
Zurück zum Zitat Cheng, R., Jin, Y., Olhofer, M., Sendhoff, B.: A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans. Evol. Comput. 20, 773–791 (2016)CrossRef Cheng, R., Jin, Y., Olhofer, M., Sendhoff, B.: A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans. Evol. Comput. 20, 773–791 (2016)CrossRef
3.
Zurück zum Zitat Chugh, T.: Mono-surrogate vs multi-surrogate in multi-objective Bayesian optimisation. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 2143–2151. ACM (2022) Chugh, T.: Mono-surrogate vs multi-surrogate in multi-objective Bayesian optimisation. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 2143–2151. ACM (2022)
4.
Zurück zum Zitat Chugh, T.: R-MBO: A multi-surrogate approach for preference incorporation in multi-objective Bayesian optimisation. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 1817–182. ACM (2022) Chugh, T.: R-MBO: A multi-surrogate approach for preference incorporation in multi-objective Bayesian optimisation. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 1817–182. ACM (2022)
5.
Zurück zum Zitat Das, I., Dennis, J.E.: Normal-boundary intersection: a new method for generating the pareto surface in nonlinear multicriteria optimization problems. SIAM J. Optim. 8(3), 631–657 (1998)MathSciNetCrossRef Das, I., Dennis, J.E.: Normal-boundary intersection: a new method for generating the pareto surface in nonlinear multicriteria optimization problems. SIAM J. Optim. 8(3), 631–657 (1998)MathSciNetCrossRef
6.
Zurück zum Zitat Daulton, S., Balandat, M., Bakshy, E.: Differentiable expected hypervolume improvement for parallel multi-objective bayesian optimization. In: Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M.F., Lin, H. (eds.) Advances in Neural Information Processing Systems. vol. 33, pp. 9851–9864. Curran Associates, Inc. (2020) Daulton, S., Balandat, M., Bakshy, E.: Differentiable expected hypervolume improvement for parallel multi-objective bayesian optimization. In: Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M.F., Lin, H. (eds.) Advances in Neural Information Processing Systems. vol. 33, pp. 9851–9864. Curran Associates, Inc. (2020)
7.
Zurück zum Zitat Deb, K., Jain, H.: An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints. IEEE Trans. Evol. Comput. 18, 577–601 (2014)CrossRef Deb, K., Jain, H.: An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints. IEEE Trans. Evol. Comput. 18, 577–601 (2014)CrossRef
8.
Zurück zum Zitat Deb, K., Prarap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6, 182–197 (2002)CrossRef Deb, K., Prarap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6, 182–197 (2002)CrossRef
9.
10.
Zurück zum Zitat Emmerich, M., Beume, N., Naujoks, B.: An EMO algorithm using the hypervolume measure as selection criterion. In: Coello Coello, C.A., Hernández Aguirre, A., Zitzler, E. (eds.) Evolutionary Multi-Criterion Optimization, pp. 62–76. Springer Berlin Heidelberg, Berlin, Heidelberg (2005). https://doi.org/10.1007/978-3-540-31880-4_5CrossRef Emmerich, M., Beume, N., Naujoks, B.: An EMO algorithm using the hypervolume measure as selection criterion. In: Coello Coello, C.A., Hernández Aguirre, A., Zitzler, E. (eds.) Evolutionary Multi-Criterion Optimization, pp. 62–76. Springer Berlin Heidelberg, Berlin, Heidelberg (2005). https://​doi.​org/​10.​1007/​978-3-540-31880-4_​5CrossRef
11.
Zurück zum Zitat Emmerich, M., Deutz, A., Klinkenberg, J.: Hypervolume-based expected improvement: Monotonicity properties and exact computation. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp. 2147–2154. IEEE (2011) Emmerich, M., Deutz, A., Klinkenberg, J.: Hypervolume-based expected improvement: Monotonicity properties and exact computation. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp. 2147–2154. IEEE (2011)
12.
Zurück zum Zitat Emmerich, M., Giannakoglou, K., Naujoks, B.: Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels. IEEE Trans. Evol. Comput. 10, 421–439 (2006)CrossRef Emmerich, M., Giannakoglou, K., Naujoks, B.: Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels. IEEE Trans. Evol. Comput. 10, 421–439 (2006)CrossRef
13.
Zurück zum Zitat Gass, S., Saaty, T.: The computational algorithm for the parametric objective function. Naval Res. Logist. Quart. 2(1–2), 39–45 (1955)MathSciNetCrossRef Gass, S., Saaty, T.: The computational algorithm for the parametric objective function. Naval Res. Logist. Quart. 2(1–2), 39–45 (1955)MathSciNetCrossRef
14.
Zurück zum Zitat Ishibuchi, H., Setoguchi, Y., Masuda, H., Nojima, Y.: Performance of decomposition-based many-objective algorithms strongly depends on pareto front shapes. IEEE Trans. Evol. Comput. 21(2), 169–190 (2017)CrossRef Ishibuchi, H., Setoguchi, Y., Masuda, H., Nojima, Y.: Performance of decomposition-based many-objective algorithms strongly depends on pareto front shapes. IEEE Trans. Evol. Comput. 21(2), 169–190 (2017)CrossRef
15.
Zurück zum Zitat Knowles, J.: ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Trans. Evol. Comput. 10, 50–66 (2006)CrossRef Knowles, J.: ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Trans. Evol. Comput. 10, 50–66 (2006)CrossRef
16.
Zurück zum Zitat Knowles, J. D., Thiele, L., Zitzler, E.: A tutorial on the performance assessment of stochastic multiobjective optimizers. Tech. rep. (2006) Knowles, J. D., Thiele, L., Zitzler, E.: A tutorial on the performance assessment of stochastic multiobjective optimizers. Tech. rep. (2006)
17.
Zurück zum Zitat Majumdar, A., Chugh, T., Hakanen, J., Miettinen, K.: Probabilistic selection approaches in decomposition-based evolutionary algorithms for offline data-driven multiobjective optimization. IEEE Trans. Evol. Comput. 26, 1182–1191 (2022)CrossRef Majumdar, A., Chugh, T., Hakanen, J., Miettinen, K.: Probabilistic selection approaches in decomposition-based evolutionary algorithms for offline data-driven multiobjective optimization. IEEE Trans. Evol. Comput. 26, 1182–1191 (2022)CrossRef
18.
Zurück zum Zitat Mckay, M., Beckman, R., Conover, W.: A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 42, 55–61 (2000)CrossRef Mckay, M., Beckman, R., Conover, W.: A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 42, 55–61 (2000)CrossRef
19.
Zurück zum Zitat Miettinen, K.: Nonlinear multiobjective optimization. Kluwer, Boston, MA (1999) Miettinen, K.: Nonlinear multiobjective optimization. Kluwer, Boston, MA (1999)
20.
Zurück zum Zitat Mogilicharla, A., Chugh, T., Majumder, S., Mitra, K.: Multi-objective optimization of bulk vinyl acetate polymerization with branching. Mater. Manuf. Processes 29, 210–217 (2014)CrossRef Mogilicharla, A., Chugh, T., Majumder, S., Mitra, K.: Multi-objective optimization of bulk vinyl acetate polymerization with branching. Mater. Manuf. Processes 29, 210–217 (2014)CrossRef
21.
Zurück zum Zitat Rahat, A.A.M., Everson, R.M., Fieldsend, J.E.: Alternative infill strategies for expensive multi-objective optimisation. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 873–880. GECCO ’17, ACM, New York, NY, USA (2017) Rahat, A.A.M., Everson, R.M., Fieldsend, J.E.: Alternative infill strategies for expensive multi-objective optimisation. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 873–880. GECCO ’17, ACM, New York, NY, USA (2017)
22.
Zurück zum Zitat Rasmussen, C.E., Williams, C.K.I.: Gaussian processes for machine learning. The MIT Press (2006) Rasmussen, C.E., Williams, C.K.I.: Gaussian processes for machine learning. The MIT Press (2006)
23.
Zurück zum Zitat Shahriari, B., Swersky, K., Wang, Z., Adams, R.P., de Freitas, N.: Taking the human out of the loop: A review of Bayesian optimization. Proc. IEEE 104(1), 148–175 (2016)CrossRef Shahriari, B., Swersky, K., Wang, Z., Adams, R.P., de Freitas, N.: Taking the human out of the loop: A review of Bayesian optimization. Proc. IEEE 104(1), 148–175 (2016)CrossRef
24.
Zurück zum Zitat Tanabe, R., Ishibuchi, H.: An easy-to-use real-world multi-objective optimization problem suite. Appl. Soft Comput. 89, 106078 (2020)CrossRef Tanabe, R., Ishibuchi, H.: An easy-to-use real-world multi-objective optimization problem suite. Appl. Soft Comput. 89, 106078 (2020)CrossRef
25.
Zurück zum Zitat Trivedi, A., Srinivasan, D., Sanyal, K., Ghosh, A.: A survey of multiobjective evolutionary algorithms based on decomposition. IEEE Trans. Evol. Comput. 21(3), 440–462 (2017) Trivedi, A., Srinivasan, D., Sanyal, K., Ghosh, A.: A survey of multiobjective evolutionary algorithms based on decomposition. IEEE Trans. Evol. Comput. 21(3), 440–462 (2017)
26.
Zurück zum Zitat Wagner, T., Emmerich, M., Deutz, A., Ponweiser, W.: On expected-improvement criteria for model-based multi-objective optimization. In: Schaefer, R., Cotta, C., Kołodziej, J., Rudolph, G. (eds.) Parallel Problem Solving from Nature, PPSN XI, pp. 718–727. Springer Berlin Heidelberg, Berlin, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15844-5_72CrossRef Wagner, T., Emmerich, M., Deutz, A., Ponweiser, W.: On expected-improvement criteria for model-based multi-objective optimization. In: Schaefer, R., Cotta, C., Kołodziej, J., Rudolph, G. (eds.) Parallel Problem Solving from Nature, PPSN XI, pp. 718–727. Springer Berlin Heidelberg, Berlin, Heidelberg (2010). https://​doi.​org/​10.​1007/​978-3-642-15844-5_​72CrossRef
28.
Zurück zum Zitat Yang, K., Emmerich, M., Deutz, A., Bäck, T.: Multi-objective Bayesian global optimization using expected hypervolume improvement gradient. Swarm Evol. Comput. 44, 945–956 (Feb 2019) Yang, K., Emmerich, M., Deutz, A., Bäck, T.: Multi-objective Bayesian global optimization using expected hypervolume improvement gradient. Swarm Evol. Comput. 44, 945–956 (Feb 2019)
29.
Zurück zum Zitat Zhang, Q., Li, H.: MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans. Evol. Comput. 11, 712–731 (2007)CrossRef Zhang, Q., Li, H.: MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans. Evol. Comput. 11, 712–731 (2007)CrossRef
Metadaten
Titel
Integrating Bayesian and Evolutionary Approaches for Multi-objective Optimisation
verfasst von
Tinkle Chugh
Alex Evans
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-56855-8_24

Premium Partner