Skip to main content
Top

2020 | OriginalPaper | Chapter

Optimizing Partially Defined Black-Box Functions Under Unknown Constraints via Sequential Model Based Optimization: An Application to Pump Scheduling Optimization in Water Distribution Networks

Authors : Antonio Candelieri, Bruno Galuzzi, Ilaria Giordani, Riccardo Perego, Francesco Archetti

Published in: Learning and Intelligent Optimization

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper proposes a Sequential Model Based Optimization framework for solving optimization problems characterized by a black-box, multi-extremal, expensive and partially defined objective function, under unknown constraints. This is a typical setting for simulation-optimization problems, where the objective function cannot be computed for some configurations of the decision/control variables due to the violation of some (unknown) constraint. The framework is organized in two consecutive phases, the first uses a Support Vector Machine classifier to approximate the boundary of the unknown feasible region within the search space, the second uses Bayesian Optimization to find a globally optimal (feasible) solution. A relevant difference with traditional Bayesian Optimization is that the optimization process is performed on the estimated feasibility region, only, instead of the entire search space. Some results on three 2D test functions and a real case study for the Pump Scheduling Optimization in Water Distribution Networks are reported. The proposed framework proved to be more effective and efficient than Bayesian Optimization approaches using a penalty for function evaluations outside the feasible region.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Frazier, P.I.: Bayesian Optimization. In: Recent Advances in Optimization and Modeling of Contemporary Problems - INFORMS, pp. 255–278 (2018)CrossRef Frazier, P.I.: Bayesian Optimization. In: Recent Advances in Optimization and Modeling of Contemporary Problems - INFORMS, pp. 255–278 (2018)CrossRef
2.
go back to reference Jones, D.R., Schonlau, M., Welch, W.J.: Efficient global optimization of expensive black-box functions. J. Global Optim. 13(4), 455–492 (1998)MathSciNetCrossRef Jones, D.R., Schonlau, M., Welch, W.J.: Efficient global optimization of expensive black-box functions. J. Global Optim. 13(4), 455–492 (1998)MathSciNetCrossRef
3.
go back to reference Shahriari, B., Swersky, K., Wang, Z., Adams, R.P., De Freitas, N.: Taking the human out of the loop: A review of Bayesian Optimization. Proc. IEEE 104(1), 148–175 (2016)CrossRef Shahriari, B., Swersky, K., Wang, Z., Adams, R.P., De Freitas, N.: Taking the human out of the loop: A review of Bayesian Optimization. Proc. IEEE 104(1), 148–175 (2016)CrossRef
4.
go back to reference Žilinskas, A., Žilinskas, J.: Global optimization based on a statistical model and simplicial partitioning. Comput. Math Appl. 44(7), 957–967 (2002)MathSciNetCrossRef Žilinskas, A., Žilinskas, J.: Global optimization based on a statistical model and simplicial partitioning. Comput. Math Appl. 44(7), 957–967 (2002)MathSciNetCrossRef
5.
go back to reference Sergeyev, Y.D., Kvasov, D.E., Mukhametzhanov, M.S.: On the efficiency of nature-inspired metaheuristics in expensive global optimization with limited budget. Sci. Rep.-UK 8(1), 453 (2018)CrossRef Sergeyev, Y.D., Kvasov, D.E., Mukhametzhanov, M.S.: On the efficiency of nature-inspired metaheuristics in expensive global optimization with limited budget. Sci. Rep.-UK 8(1), 453 (2018)CrossRef
9.
go back to reference Archetti, F., Betrò, B.: A priori analysis of deterministic strategies. In: Towards Global Optimization 2 (1978) Archetti, F., Betrò, B.: A priori analysis of deterministic strategies. In: Towards Global Optimization 2 (1978)
10.
go back to reference Archetti, F., Betrò, B.: Stochastic models and optimization. Bollettinodell’Unione Matematica Italiana 5(17-A), 295–301 (1980)MathSciNetMATH Archetti, F., Betrò, B.: Stochastic models and optimization. Bollettinodell’Unione Matematica Italiana 5(17-A), 295–301 (1980)MathSciNetMATH
11.
12.
go back to reference Thornton, C., Hutter, F., Hoos, H.H., Leyton-Brown, K.: Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms. In: Proceedings of ACM-SIGKDD, pp. 847–855 (2013) Thornton, C., Hutter, F., Hoos, H.H., Leyton-Brown, K.: Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms. In: Proceedings of ACM-SIGKDD, pp. 847–855 (2013)
13.
go back to reference Feurer, M., Klein, A., Eggensperger, K., Springenberg, J., Blum, M., Hutter, F.: Efficient and robust automated machine learning. In: Advances in Neural Information, pp. 2962–2970 (2015) Feurer, M., Klein, A., Eggensperger, K., Springenberg, J., Blum, M., Hutter, F.: Efficient and robust automated machine learning. In: Advances in Neural Information, pp. 2962–2970 (2015)
14.
go back to reference Candelieri, A., Archetti, F.: Global optimization in machine learning: the design of a predictive analytics application. Soft Comput. 1–9 (2018) Candelieri, A., Archetti, F.: Global optimization in machine learning: the design of a predictive analytics application. Soft Comput. 1–9 (2018)
16.
go back to reference Sergeyev, Y.D., Pugliese, P., Famularo, D.: Index information algorithm with local tuning for solving multidimensional global optimization problems with multiextremal constraints. Math. Program. 96(3), 489–512 (2003)MathSciNetCrossRef Sergeyev, Y.D., Pugliese, P., Famularo, D.: Index information algorithm with local tuning for solving multidimensional global optimization problems with multiextremal constraints. Math. Program. 96(3), 489–512 (2003)MathSciNetCrossRef
17.
go back to reference Paulavičius, R., Žilinskas, J.: Advantages of simplicial partitioning for Lipschitz optimization problems with linear constraints. Optim. Lett. 10(2), 237–246 (2016)MathSciNetCrossRef Paulavičius, R., Žilinskas, J.: Advantages of simplicial partitioning for Lipschitz optimization problems with linear constraints. Optim. Lett. 10(2), 237–246 (2016)MathSciNetCrossRef
19.
go back to reference Donskoi, V.I.: Partially defined optimization problems: an approach to a solution that is based on pattern recognition theory. J. Sov. Mathematics 65(3), 1664–1668 (1993)CrossRef Donskoi, V.I.: Partially defined optimization problems: an approach to a solution that is based on pattern recognition theory. J. Sov. Mathematics 65(3), 1664–1668 (1993)CrossRef
20.
go back to reference Rudenko, L.I.: Objective functional approximation in a partially defined optimization problem. J. Math. Sci. 72(5), 3359–3363 (1994)MathSciNetCrossRef Rudenko, L.I.: Objective functional approximation in a partially defined optimization problem. J. Math. Sci. 72(5), 3359–3363 (1994)MathSciNetCrossRef
21.
go back to reference Sergeyev, Y.D., Kvasov, D.E., Khalaf, F.M.: A one-dimensional local tuning algorithm for solving GO problems with partially defined constraints. Optim. Lett. 1(1), 85–99 (2007)MathSciNetCrossRef Sergeyev, Y.D., Kvasov, D.E., Khalaf, F.M.: A one-dimensional local tuning algorithm for solving GO problems with partially defined constraints. Optim. Lett. 1(1), 85–99 (2007)MathSciNetCrossRef
22.
go back to reference Hernández-Lobato, J.M., Gelbart, M.A., Adams, R.P., Hoffman, M.W., Ghahramani, Z.: A general framework for constrained Bayesian optimization using information-based search. J. Mach. Learn. Res. 17(1), 5549–5601 (2016)MathSciNetMATH Hernández-Lobato, J.M., Gelbart, M.A., Adams, R.P., Hoffman, M.W., Ghahramani, Z.: A general framework for constrained Bayesian optimization using information-based search. J. Mach. Learn. Res. 17(1), 5549–5601 (2016)MathSciNetMATH
24.
go back to reference Picheny, V., Gramacy, R.B., Wild, S., Le Digabel, S.: Bayesian optimization under mixed constraints with a slack-variable augmented Lagrangian. In Advances in Neural Information Processing Systems, pp. 1435–1443 (2016) Picheny, V., Gramacy, R.B., Wild, S., Le Digabel, S.: Bayesian optimization under mixed constraints with a slack-variable augmented Lagrangian. In Advances in Neural Information Processing Systems, pp. 1435–1443 (2016)
25.
go back to reference Feliot, P., Bect, J., Vazquez, E.: A bayesian approach to constrained single-and multi-objective optimization. J. Global Optim. 67(1–2), 97–133 (2017)MathSciNetCrossRef Feliot, P., Bect, J., Vazquez, E.: A bayesian approach to constrained single-and multi-objective optimization. J. Global Optim. 67(1–2), 97–133 (2017)MathSciNetCrossRef
26.
go back to reference Gramacy, R.B., Lee, H.K.M., Holmes, C., Osborne, M.: Optimization Under Unknown Constraints. In: Bayesian Statistics 9 (2012) Gramacy, R.B., Lee, H.K.M., Holmes, C., Osborne, M.: Optimization Under Unknown Constraints. In: Bayesian Statistics 9 (2012)
27.
go back to reference Bernardo, J., et al.: Optimization under unknown constraints. Bayesian Stat. 9(9), 229 (2011)MathSciNet Bernardo, J., et al.: Optimization under unknown constraints. Bayesian Stat. 9(9), 229 (2011)MathSciNet
28.
go back to reference Hernández-Lobato, J.M., Gelbart, M.A., Hoffman, M.W., Adams, R.P., Ghahramani, Z.: Predictive entropy search for bayesian optimization with unknown constraints. In: Proceedings of the 32nd International Conference on Machine Learning, vol. 37 (2015) Hernández-Lobato, J.M., Gelbart, M.A., Hoffman, M.W., Adams, R.P., Ghahramani, Z.: Predictive entropy search for bayesian optimization with unknown constraints. In: Proceedings of the 32nd International Conference on Machine Learning, vol. 37 (2015)
29.
go back to reference Scholkopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge (2001) Scholkopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge (2001)
31.
go back to reference Basudhar, A., Dribusch, C., Lacaze, S., Missoum, S.: Constrained efficient global optimization with support vector machines. Struct. Multidiscip. Optim. 46(2), 201–221 (2012)CrossRef Basudhar, A., Dribusch, C., Lacaze, S., Missoum, S.: Constrained efficient global optimization with support vector machines. Struct. Multidiscip. Optim. 46(2), 201–221 (2012)CrossRef
32.
go back to reference Tsai, Y.A., et al.: Stochastic optimization for feasibility determination: an application to water pump operation in water distribution network. In: Winter Simulation Conference 2018 (WSC 2018) December 9–12, Gothenburg, Sweden (2018) Tsai, Y.A., et al.: Stochastic optimization for feasibility determination: an application to water pump operation in water distribution network. In: Winter Simulation Conference 2018 (WSC 2018) December 9–12, Gothenburg, Sweden (2018)
33.
go back to reference Candelieri, A., Perego, R., Archetti, F.: Bayesian optimization of pump operations in water distribution systems. J. Global Optim. 71(1), 213–235 (2018)MathSciNetCrossRef Candelieri, A., Perego, R., Archetti, F.: Bayesian optimization of pump operations in water distribution systems. J. Global Optim. 71(1), 213–235 (2018)MathSciNetCrossRef
34.
go back to reference Letham, B., Karrer, B., Ottoni, G., Bakshy, E.: Constrained Bayesian optimization with noisy experiments. Bayesian Anal. 14, 495–519 (2018)MathSciNetCrossRef Letham, B., Karrer, B., Ottoni, G., Bakshy, E.: Constrained Bayesian optimization with noisy experiments. Bayesian Anal. 14, 495–519 (2018)MathSciNetCrossRef
35.
go back to reference Hartfiel, D.J., Curry, G.L.: On optimizing certain nonlinear convex functions which are partially defined by a simulation process. Math. Program. 13(1), 88–93 (1977)MathSciNetCrossRef Hartfiel, D.J., Curry, G.L.: On optimizing certain nonlinear convex functions which are partially defined by a simulation process. Math. Program. 13(1), 88–93 (1977)MathSciNetCrossRef
36.
go back to reference Srinivas, N., Krause, A., Kakade, S.M., Seeger, M.: Gaussian process optimization in the bandit setting: No regret and experimental design. In: Proceedings of International Conference on Machine Learning, pp. 1015–1022 (2010) Srinivas, N., Krause, A., Kakade, S.M., Seeger, M.: Gaussian process optimization in the bandit setting: No regret and experimental design. In: Proceedings of International Conference on Machine Learning, pp. 1015–1022 (2010)
37.
go back to reference Neve, A.G., Kakandikar, G.M., Kulkarni, O.: Application of grasshopper optimization algorithm for constrained and unconstrained test functions. Int. J. Swarm Intel. EvolComput. 6(165), 2 (2017) Neve, A.G., Kakandikar, G.M., Kulkarni, O.: Application of grasshopper optimization algorithm for constrained and unconstrained test functions. Int. J. Swarm Intel. EvolComput. 6(165), 2 (2017)
38.
go back to reference Simionescu, P.A., Beale, D.G.: New concepts in graphic visualization of objective functions. In ASME 2002 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, pp. 891–897 (2002) Simionescu, P.A., Beale, D.G.: New concepts in graphic visualization of objective functions. In ASME 2002 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, pp. 891–897 (2002)
39.
go back to reference Mishra, S.K.: Some new test functions for global optimization and performance of repulsive particle swarm method. MPRA Paper No. 2718 (2008) Mishra, S.K.: Some new test functions for global optimization and performance of repulsive particle swarm method. MPRA Paper No. 2718 (2008)
40.
go back to reference Castro Gama, M.E., Pan, Q., Salman, M.A.: Jonoski, Multivariate optimization to decrease total energy consumption in the water supply system of Abbiategrasso (Milan, Italy). Environ. Eng. Manag. J. 14(9), 2019–2029 (2015)CrossRef Castro Gama, M.E., Pan, Q., Salman, M.A.: Jonoski, Multivariate optimization to decrease total energy consumption in the water supply system of Abbiategrasso (Milan, Italy). Environ. Eng. Manag. J. 14(9), 2019–2029 (2015)CrossRef
41.
go back to reference Rossman, L.A.: EPANET2 User’s Manual. U.S. Environmental Protection Agency, Washington, DC (2000) Rossman, L.A.: EPANET2 User’s Manual. U.S. Environmental Protection Agency, Washington, DC (2000)
42.
go back to reference Castro-Gama, M., Pan, Q., Lanfranchi, E.A., Jomoski, A., Solomatine, D.P.: Pump scheduling for a large water distribution network. Milan, Italy. Procedia Eng. 186, 436–443 (2017)CrossRef Castro-Gama, M., Pan, Q., Lanfranchi, E.A., Jomoski, A., Solomatine, D.P.: Pump scheduling for a large water distribution network. Milan, Italy. Procedia Eng. 186, 436–443 (2017)CrossRef
43.
go back to reference Huang, D., Allen, T.T., Notz, W.I., Zheng, N.: Global optimization of stochastic black-box systems via sequential Kriging meta-models. J. Global Optim. 3(34), 441–466 (2006)MathSciNetCrossRef Huang, D., Allen, T.T., Notz, W.I., Zheng, N.: Global optimization of stochastic black-box systems via sequential Kriging meta-models. J. Global Optim. 3(34), 441–466 (2006)MathSciNetCrossRef
44.
go back to reference Hoffman, M.D., Brochu, E., De Freitas, N.: Portfolio Allocation for Bayesian Optimization. In: UAI, pp. 327–336 (2011) Hoffman, M.D., Brochu, E., De Freitas, N.: Portfolio Allocation for Bayesian Optimization. In: UAI, pp. 327–336 (2011)
Metadata
Title
Optimizing Partially Defined Black-Box Functions Under Unknown Constraints via Sequential Model Based Optimization: An Application to Pump Scheduling Optimization in Water Distribution Networks
Authors
Antonio Candelieri
Bruno Galuzzi
Ilaria Giordani
Riccardo Perego
Francesco Archetti
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-38629-0_7

Premium Partner