Skip to main content
Top

2018 | OriginalPaper | Chapter

Surrogate-Assisted Particle Swarm with Local Search for Expensive Constrained Optimization

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper develops a surrogate-assisted particle swarm optimization framework for expensive constrained optimization called CONOPUS (CONstrained Optimization by Particle swarm Using Surrogates). In each iteration, CONOPUS considers multiple trial positions for each particle in the swarm and uses surrogate models for the objective and constraint functions to identify the most promising trial position where the expensive functions are evaluated. Moreover, the current overall best position is refined by finding the minimum of the surrogate of the objective function within a neighborhood of that position and subject to surrogate inequality constraints with a small margin and with a distance requirement from all previously evaluated positions. CONOPUS is implemented using radial basis function (RBF) surrogates and the resulting algorithm compares favorably to alternative methods on 12 benchmark problems and on a large-scale application from the auto industry with 124 decision variables and 68 inequality constraints.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of the 1995 IEEE International Conference on Neural Networks, pp. 1942–1948. IEEE Service Center, Piscataway (1995) Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of the 1995 IEEE International Conference on Neural Networks, pp. 1942–1948. IEEE Service Center, Piscataway (1995)
3.
go back to reference Qu, B.Y., Liang, J.J., Suganthan, P.N.: Niching particle swarm optimization with local search for multi-modal optimization. Inf. Sci. 197, 131–143 (2012)CrossRef Qu, B.Y., Liang, J.J., Suganthan, P.N.: Niching particle swarm optimization with local search for multi-modal optimization. Inf. Sci. 197, 131–143 (2012)CrossRef
4.
go back to reference Poli, R., Kennedy, J., Blackwell, T.: Particle swarm optimization: an overview. Swarm Intell. 1(1), 33–57 (2007)CrossRef Poli, R., Kennedy, J., Blackwell, T.: Particle swarm optimization: an overview. Swarm Intell. 1(1), 33–57 (2007)CrossRef
5.
go back to reference Banks, A., Vincent, J., Anyakoha, C.: A review of particle swarm optimization, part I: background and development. Nat. Comput. 6(4), 467–484 (2007)MathSciNetCrossRef Banks, A., Vincent, J., Anyakoha, C.: A review of particle swarm optimization, part I: background and development. Nat. Comput. 6(4), 467–484 (2007)MathSciNetCrossRef
6.
go back to reference He, Q., Wang, L.: A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization. Appl. Math. Comput. 186(2), 1407–1422 (2007)MathSciNetMATH He, Q., Wang, L.: A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization. Appl. Math. Comput. 186(2), 1407–1422 (2007)MathSciNetMATH
7.
go back to reference Hu, X., Eberhart, R.C.: Solving constrained nonlinear optimization problems with particle swarm optimization. In: Callaos, N. (ed.) Proceedings of the Sixth World Multiconference on Systemics, Cybernetics and Informatics, pp. 203–206 (2002) Hu, X., Eberhart, R.C.: Solving constrained nonlinear optimization problems with particle swarm optimization. In: Callaos, N. (ed.) Proceedings of the Sixth World Multiconference on Systemics, Cybernetics and Informatics, pp. 203–206 (2002)
8.
go back to reference Munoz-Zavala, A.E., Aguirre, A.H., Diharce, E.R.V.: Constrained optimization via particle evolutionary swarm optimization algorithm (PESO). In: Beyer, H.G. (ed.) Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2005), vol. 1, pp. 209–216. ACM Press, New York (2005) Munoz-Zavala, A.E., Aguirre, A.H., Diharce, E.R.V.: Constrained optimization via particle evolutionary swarm optimization algorithm (PESO). In: Beyer, H.G. (ed.) Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2005), vol. 1, pp. 209–216. ACM Press, New York (2005)
9.
go back to reference Toscano-Pulido, G., Coello, C.A.C.: A constraint-handling mechanism for particle swarm optimization. In: Proceedings of the Congress on Evolutionary Computation 2004 (CEC 2004), vol. 2, pp. 1396–1403. IEEE Service Center, Piscataway (2004) Toscano-Pulido, G., Coello, C.A.C.: A constraint-handling mechanism for particle swarm optimization. In: Proceedings of the Congress on Evolutionary Computation 2004 (CEC 2004), vol. 2, pp. 1396–1403. IEEE Service Center, Piscataway (2004)
10.
go back to reference Parno, M.D., Hemker, T., Fowler, K.R.: Applicability of surrogates to improve efficiency of particle swarm optimization for simulation-based problems. Eng. Optim. 44(5), 521–535 (2012)CrossRef Parno, M.D., Hemker, T., Fowler, K.R.: Applicability of surrogates to improve efficiency of particle swarm optimization for simulation-based problems. Eng. Optim. 44(5), 521–535 (2012)CrossRef
11.
go back to reference Jiang, P., Cao, L., Zhou, Q., Gao, Z., Rong, Y., Shao, X.: Optimization of welding process parameters by combining Kriging surrogate with particle swarm optimization algorithm. Int. J. Adv. Manuf. Technol. 86(9), 2473–2483 (2016)CrossRef Jiang, P., Cao, L., Zhou, Q., Gao, Z., Rong, Y., Shao, X.: Optimization of welding process parameters by combining Kriging surrogate with particle swarm optimization algorithm. Int. J. Adv. Manuf. Technol. 86(9), 2473–2483 (2016)CrossRef
12.
go back to reference Tang, Y., Chen, J., Wei, J.: A surrogate-based particle swarm optimization algorithm for solving optimization problems with expensive black box functions. Eng. Optim. 45(5), 557–576 (2013)MathSciNetCrossRef Tang, Y., Chen, J., Wei, J.: A surrogate-based particle swarm optimization algorithm for solving optimization problems with expensive black box functions. Eng. Optim. 45(5), 557–576 (2013)MathSciNetCrossRef
13.
go back to reference Sun, C., Jin, Y., Cheng, R., Ding, J., Zeng, J.: Surrogate-assisted cooperative swarm optimization of high-dimensional expensive problems. IEEE Trans. Evol. Comput. 21, 644–660 (2017)CrossRef Sun, C., Jin, Y., Cheng, R., Ding, J., Zeng, J.: Surrogate-assisted cooperative swarm optimization of high-dimensional expensive problems. IEEE Trans. Evol. Comput. 21, 644–660 (2017)CrossRef
14.
go back to reference Regis, R.G.: Evolutionary programming for high-dimensional constrained expensive black-box optimization using radial basis functions. IEEE Trans. Evol. Comput. 18(3), 326–347 (2014)CrossRef Regis, R.G.: Evolutionary programming for high-dimensional constrained expensive black-box optimization using radial basis functions. IEEE Trans. Evol. Comput. 18(3), 326–347 (2014)CrossRef
15.
go back to reference Basudhar, A., Dribusch, C., Lacaze, S., Missoum, S.: Constrained efficient global optimization with support vector machines. Struct. Multidiscip. Optim. 46(2), 201–221 (2012)CrossRef Basudhar, A., Dribusch, C., Lacaze, S., Missoum, S.: Constrained efficient global optimization with support vector machines. Struct. Multidiscip. Optim. 46(2), 201–221 (2012)CrossRef
16.
go back to reference Regis, R.G.: Constrained optimization by radial basis function interpolation for high-dimensional expensive black-box problems with infeasible initial points. Eng. Optim. 46(2), 218–243 (2014)MathSciNetCrossRef Regis, R.G.: Constrained optimization by radial basis function interpolation for high-dimensional expensive black-box problems with infeasible initial points. Eng. Optim. 46(2), 218–243 (2014)MathSciNetCrossRef
17.
go back to reference Bagheri, S., Konen, W., Emmerich, M., Bäck, T.: Self-adjusting parameter control for surrogate-assisted constrained optimization under limited budgets. Appl. Soft Comput. 61, 377–393 (2017)CrossRef Bagheri, S., Konen, W., Emmerich, M., Bäck, T.: Self-adjusting parameter control for surrogate-assisted constrained optimization under limited budgets. Appl. Soft Comput. 61, 377–393 (2017)CrossRef
18.
go back to reference Yang, X.S.: Nature-Inspired Metaheuristic Algorithms, 2nd edn. Luniver Press, Bristol (2010) Yang, X.S.: Nature-Inspired Metaheuristic Algorithms, 2nd edn. Luniver Press, Bristol (2010)
19.
go back to reference Jones, D.R.: Large-scale multi-disciplinary mass optimization in the auto industry. In: Modeling and Optimization: Theory and Applications Conference, Ontario, Canada, MOPTA 2008, August 2008 Jones, D.R.: Large-scale multi-disciplinary mass optimization in the auto industry. In: Modeling and Optimization: Theory and Applications Conference, Ontario, Canada, MOPTA 2008, August 2008
20.
go back to reference Regis, R.G.: Particle swarm with radial basis function surrogates for expensive black-box optimization. J. Comput. Sci. 5(1), 12–23 (2014)MathSciNetCrossRef Regis, R.G.: Particle swarm with radial basis function surrogates for expensive black-box optimization. J. Comput. Sci. 5(1), 12–23 (2014)MathSciNetCrossRef
22.
go back to reference Powell, M.J.D.: The theory of radial basis function approximation in 1990. In: Light, W. (ed.) Advances in Numerical Analysis, Volume 2: Wavelets, Subdivision Algorithms and Radial Basis Functions, pp. 105–210. Oxford University Press, Oxford (1992) Powell, M.J.D.: The theory of radial basis function approximation in 1990. In: Light, W. (ed.) Advances in Numerical Analysis, Volume 2: Wavelets, Subdivision Algorithms and Radial Basis Functions, pp. 105–210. Oxford University Press, Oxford (1992)
23.
go back to reference Mallipeddi, R., Suganthan, P.N.: Problem definitions and evaluation criteria for the CEC 2010 competition on constrained real-parameter optimization. Technical report, Nanyang Technological University, Singapore (2010) Mallipeddi, R., Suganthan, P.N.: Problem definitions and evaluation criteria for the CEC 2010 competition on constrained real-parameter optimization. Technical report, Nanyang Technological University, Singapore (2010)
24.
go back to reference Bratton, D., Kennedy, J.: Defining a standard for particle swarm optimization. In: 2007 IEEE Swarm Intelligence Symposium, pp. 120–127, April 2007 Bratton, D., Kennedy, J.: Defining a standard for particle swarm optimization. In: 2007 IEEE Swarm Intelligence Symposium, pp. 120–127, April 2007
25.
go back to reference Cáceres, L.P., López-Ibáñez, M., Stützle, T.: Ant colony optimization on a limited budget of evaluations. Swarm Intell. 9, 103–124 (2015)CrossRef Cáceres, L.P., López-Ibáñez, M., Stützle, T.: Ant colony optimization on a limited budget of evaluations. Swarm Intell. 9, 103–124 (2015)CrossRef
26.
go back to reference Moré, J.J., Wild, S.M.: Benchmarking derivative-free optimization algorithms. SIAM J. Optim. 20(1), 172–191 (2009)MathSciNetCrossRef Moré, J.J., Wild, S.M.: Benchmarking derivative-free optimization algorithms. SIAM J. Optim. 20(1), 172–191 (2009)MathSciNetCrossRef
Metadata
Title
Surrogate-Assisted Particle Swarm with Local Search for Expensive Constrained Optimization
Author
Rommel G. Regis
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-91641-5_21

Premium Partner