Skip to main content
Erschienen in: Memetic Computing 2/2018

07.07.2016 | Regular Research Paper

A fitness approximation assisted competitive swarm optimizer for large scale expensive optimization problems

verfasst von: Chaoli Sun, Jinliang Ding, Jianchao Zeng, Yaochu Jin

Erschienen in: Memetic Computing | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Surrogate assisted meta-heuristic algorithms have received increasing attention over the past years due to the fact that many real-world optimization problems are computationally expensive. However, most existing surrogate assisted meta-heuristic algorithms are designed for small or medium scale problems. In this paper, a fitness approximation assisted competitive swarm optimizer is proposed for optimization of large scale expensive problems. Different from most surrogate assisted evolutionary algorithms that use a computational model for approximating the fitness, we estimate the fitness based on the positional relationship between individuals in the competitive swarm optimizer. Empirical study on seven widely used benchmark problems with 100 and 500 decision variables show that the proposed fitness approximation assisted competitive swarm optimizer is able to achieve competitive performance on a limited computational budget.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Asafuddoula Md, Ray T, Sarker R (2015) A decomposition-based evolutionary algorithm for many objective optimization. IEEE Trans. Evol. Comput. 19(3):445–460CrossRef Asafuddoula Md, Ray T, Sarker R (2015) A decomposition-based evolutionary algorithm for many objective optimization. IEEE Trans. Evol. Comput. 19(3):445–460CrossRef
2.
Zurück zum Zitat Azzouz N, Bechikh S, Ben Said L (2014) Steady state ibea assisted by mlp neural networks for expensive multi-objective optimization problems. In: Proceedings of the 2014 conference on Genetic and evolutionary computation, ACM, pp 581–588 Azzouz N, Bechikh S, Ben Said L (2014) Steady state ibea assisted by mlp neural networks for expensive multi-objective optimization problems. In: Proceedings of the 2014 conference on Genetic and evolutionary computation, ACM, pp 581–588
3.
Zurück zum Zitat Bajer L, Holeňa M (2010) Surrogate model for continuous and discrete genetic optimization based on rbf networks. In: Intelligent data engineering and automated learning-IDEAL 2010. Springer, Berlin, pp 251–258 Bajer L, Holeňa M (2010) Surrogate model for continuous and discrete genetic optimization based on rbf networks. In: Intelligent data engineering and automated learning-IDEAL 2010. Springer, Berlin, pp 251–258
4.
Zurück zum Zitat Dirk B, Schraudolph NN, Koumoutsakos P (2005) Accelerating evolutionary algorithms with gaussian process fitness function models. IEEE Trans Syst Man Cybern Part C Appl Rev 35(2):183–194CrossRef Dirk B, Schraudolph NN, Koumoutsakos P (2005) Accelerating evolutionary algorithms with gaussian process fitness function models. IEEE Trans Syst Man Cybern Part C Appl Rev 35(2):183–194CrossRef
5.
Zurück zum Zitat Cheng R, Jin Y (2015) A competitive swarm optimizer for large scale optimization. IEEE Trans Cybern 45(2):191–204CrossRef Cheng R, Jin Y (2015) A competitive swarm optimizer for large scale optimization. IEEE Trans Cybern 45(2):191–204CrossRef
6.
7.
Zurück zum Zitat El Ela AAA, Abido MA, Spea SR (2011) Differential evolution algorithm for optimal reactive power dispatch. Electr Power Syst Res 81(2):458–464CrossRef El Ela AAA, Abido MA, Spea SR (2011) Differential evolution algorithm for optimal reactive power dispatch. Electr Power Syst Res 81(2):458–464CrossRef
8.
Zurück zum Zitat Saber Elsayed, Ruhul Sarker (2016) Differential evolution framework for big data optimization. Memet Comput 8(1):17–33CrossRef Saber Elsayed, Ruhul Sarker (2016) Differential evolution framework for big data optimization. Memet Comput 8(1):17–33CrossRef
9.
Zurück zum Zitat Freitas AA (2013) Data mining and knowledge discovery with evolutionary algorithms. Springer, Berlin Freitas AA (2013) Data mining and knowledge discovery with evolutionary algorithms. Springer, Berlin
10.
Zurück zum Zitat Jansson T, Nilsson L, Redhe M (2003) Using surrogate models and response surfaces in structural optimization-with application to crashworthiness design and sheet metal forming. Struct Multidiscip Optim 25(2):129–140CrossRef Jansson T, Nilsson L, Redhe M (2003) Using surrogate models and response surfaces in structural optimization-with application to crashworthiness design and sheet metal forming. Struct Multidiscip Optim 25(2):129–140CrossRef
11.
Zurück zum Zitat Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft comput 9(1):3–12CrossRef Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft comput 9(1):3–12CrossRef
12.
Zurück zum Zitat Jin Y (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evol Comput 1(2):61–70CrossRef Jin Y (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evol Comput 1(2):61–70CrossRef
13.
Zurück zum Zitat Jin Y, Olhofer M, Sendhoff B (2002) A framework for evolutionary optimization with approximate fitness functions. IEEE Trans Evol Comput 6(5):481–494CrossRef Jin Y, Olhofer M, Sendhoff B (2002) A framework for evolutionary optimization with approximate fitness functions. IEEE Trans Evol Comput 6(5):481–494CrossRef
14.
Zurück zum Zitat Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Global Optim 13(4):455–492MathSciNetMATHCrossRef Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Global Optim 13(4):455–492MathSciNetMATHCrossRef
15.
Zurück zum Zitat Lalwani S, Kumar R, Gupta N (2015) A novel two-level particle swarm optimization approach for efficient multiple sequence alignment. Memet Comput 7(2):119–133CrossRef Lalwani S, Kumar R, Gupta N (2015) A novel two-level particle swarm optimization approach for efficient multiple sequence alignment. Memet Comput 7(2):119–133CrossRef
16.
Zurück zum Zitat Le MN, Ong YS, Menzel S, Jin Y, Sendhoff B (2013) Evolution by adapting surrogates. Evol Comput 21(2):313–340CrossRef Le MN, Ong YS, Menzel S, Jin Y, Sendhoff B (2013) Evolution by adapting surrogates. Evol Comput 21(2):313–340CrossRef
17.
Zurück zum Zitat Lim D, Jin Y, Ong Y-S, Sendhoff B (2010) Generalizing surrogate-assisted evolutionary computation. IEEE Trans Evol Comput 14(3):329–355CrossRef Lim D, Jin Y, Ong Y-S, Sendhoff B (2010) Generalizing surrogate-assisted evolutionary computation. IEEE Trans Evol Comput 14(3):329–355CrossRef
18.
Zurück zum Zitat Liu B, Zhang Q, Gielen GGE (2014) A gaussian process surrogate model assisted evolutionary algorithm for medium scale expensive optimization problems. IEEE Trans Evol Comput 18(2):180–192CrossRef Liu B, Zhang Q, Gielen GGE (2014) A gaussian process surrogate model assisted evolutionary algorithm for medium scale expensive optimization problems. IEEE Trans Evol Comput 18(2):180–192CrossRef
19.
Zurück zum Zitat Lu X, Tang K, Yao X (2011) Classification-assisted differential evolution for computationally expensive problems. In: 2011 IEEE congress on evolutionary computation (CEC), pp 1986–1993 Lu X, Tang K, Yao X (2011) Classification-assisted differential evolution for computationally expensive problems. In: 2011 IEEE congress on evolutionary computation (CEC), pp 1986–1993
20.
Zurück zum Zitat Ong Y-S, Nair PB, Lum K (2006) Max-min surrogate-assisted evolutionary algorithm for robust design. IEEE Trans Evol Comput 10(4):392–404CrossRef Ong Y-S, Nair PB, Lum K (2006) Max-min surrogate-assisted evolutionary algorithm for robust design. IEEE Trans Evol Comput 10(4):392–404CrossRef
21.
Zurück zum Zitat Patvardhan C, Bansal S, Srivastav A (2015) Quantum-inspired evolutionary algorithm for difficult knapsack problems. Memet Comput 7(2):135–155MATHCrossRef Patvardhan C, Bansal S, Srivastav A (2015) Quantum-inspired evolutionary algorithm for difficult knapsack problems. Memet Comput 7(2):135–155MATHCrossRef
22.
Zurück zum Zitat Ponsich A, Jaimes AL, Coello C et al (2013) A survey on multiobjective evolutionary algorithms for the solution of the portfolio optimization problem and other finance and economics applications. IEEE Trans Evol Comput 17(3):321–344CrossRef Ponsich A, Jaimes AL, Coello C et al (2013) A survey on multiobjective evolutionary algorithms for the solution of the portfolio optimization problem and other finance and economics applications. IEEE Trans Evol Comput 17(3):321–344CrossRef
23.
Zurück zum Zitat Regis RG (2014) Evolutionary programming for high-dimensional constrained expensive black-box optimization using radial basis functions. IEEE Trans Evol Comput 18(3):326–347CrossRef Regis RG (2014) Evolutionary programming for high-dimensional constrained expensive black-box optimization using radial basis functions. IEEE Trans Evol Comput 18(3):326–347CrossRef
24.
Zurück zum Zitat Shi L, Rasheed K (2010) A survey of fitness approximation methods applied in evolutionary algorithms. In: Tenne Y, Goh C-K (eds) Computational intelligence in expensive optimization problems. Springer, Berlin, pp 3–28CrossRef Shi L, Rasheed K (2010) A survey of fitness approximation methods applied in evolutionary algorithms. In: Tenne Y, Goh C-K (eds) Computational intelligence in expensive optimization problems. Springer, Berlin, pp 3–28CrossRef
25.
Zurück zum Zitat Singh HK, Ray T, Smith W (2010) Surrogate assisted simulated annealing (sasa) for constrained multi-objective optimization. In: 2010 IEEE congress on evolutionary computation (CEC), pp 1–8 Singh HK, Ray T, Smith W (2010) Surrogate assisted simulated annealing (sasa) for constrained multi-objective optimization. In: 2010 IEEE congress on evolutionary computation (CEC), pp 1–8
26.
Zurück zum Zitat Smith RE, Dike BA, Stegmann SA (1995) Fitness inheritance in genetic algorithms. In: Proceedings of the 1995 ACM symposium on applied computing, pp 345–350 Smith RE, Dike BA, Stegmann SA (1995) Fitness inheritance in genetic algorithms. In: Proceedings of the 1995 ACM symposium on applied computing, pp 345–350
27.
Zurück zum Zitat Sun C, Jin Y, Zeng J, Yang Y (2014) A two-layer surrogate-assisted particle swarm optimization algorithm. Soft Comput 19(6):1461–1475CrossRef Sun C, Jin Y, Zeng J, Yang Y (2014) A two-layer surrogate-assisted particle swarm optimization algorithm. Soft Comput 19(6):1461–1475CrossRef
28.
Zurück zum Zitat Sun C, Zeng J, Pan J, Jin Y (2013) Similarity-based evolution control for fitness estimation in particle swarm optimization. In: 2013 IEEE symposium on computational intelligence in dynamic and uncertain environments (CIDUE), pp 1–8 Sun C, Zeng J, Pan J, Jin Y (2013) Similarity-based evolution control for fitness estimation in particle swarm optimization. In: 2013 IEEE symposium on computational intelligence in dynamic and uncertain environments (CIDUE), pp 1–8
29.
Zurück zum Zitat Sun C, Zeng J, Pan J, Xue S, Jin Y (2013) A new fitness estimation strategy for particle swarm optimization. Inf Sci 221:355–370MathSciNetMATHCrossRef Sun C, Zeng J, Pan J, Xue S, Jin Y (2013) A new fitness estimation strategy for particle swarm optimization. Inf Sci 221:355–370MathSciNetMATHCrossRef
30.
Zurück zum Zitat Sun X, Gong D, Jin Y, Chen S (2013) A new surrogate-assisted interactive genetic algorithm with weighted semisupervised learning. IEEE Trans Cybern 43(2):685–698CrossRef Sun X, Gong D, Jin Y, Chen S (2013) A new surrogate-assisted interactive genetic algorithm with weighted semisupervised learning. IEEE Trans Cybern 43(2):685–698CrossRef
31.
Zurück zum Zitat Tabatabaei M, Hakanen J, Hartikainen M, Miettinen K, Sindhya K (2015) A survey on handling computationally expensive multiobjective optimization problems using surrogates: non-nature inspired methods. Struct Multidiscip Optim 52(1):1–25MathSciNetCrossRef Tabatabaei M, Hakanen J, Hartikainen M, Miettinen K, Sindhya K (2015) A survey on handling computationally expensive multiobjective optimization problems using surrogates: non-nature inspired methods. Struct Multidiscip Optim 52(1):1–25MathSciNetCrossRef
32.
Zurück zum Zitat Tang K, Yáo X, Suganthan PN, MacNish C, Chen Y-P, Chen C-M, Yang Z (2007) Benchmark functions for the cec2008 special session and competition on large scale global optimization. In: Nature Inspired Computation and Applications Laboratory, USTC, China, pp 153–177 Tang K, Yáo X, Suganthan PN, MacNish C, Chen Y-P, Chen C-M, Yang Z (2007) Benchmark functions for the cec2008 special session and competition on large scale global optimization. In: Nature Inspired Computation and Applications Laboratory, USTC, China, pp 153–177
33.
Zurück zum Zitat Ulmer H, Streichert F, Zell A (2003) Evolution strategies assisted by gaussian processes with improved preselection criterion. In: 2003 congress on evolutionary computation, vol 1, pp 692–699 Ulmer H, Streichert F, Zell A (2003) Evolution strategies assisted by gaussian processes with improved preselection criterion. In: 2003 congress on evolutionary computation, vol 1, pp 692–699
34.
Zurück zum Zitat Voutchkov I, Keane A (2010) Multi-objective optimization using surrogates. In: Tenne Y, Goh C-K (eds) Computational intelligence in optimization. Springer, Berlin, pp 155–175 Voutchkov I, Keane A (2010) Multi-objective optimization using surrogates. In: Tenne Y, Goh C-K (eds) Computational intelligence in optimization. Springer, Berlin, pp 155–175
35.
Zurück zum Zitat Wang D-J, Liu F, Wang Y-Z, Jin Y (2015) A knowledge-based evolutionary proactive scheduling approach in the presence of machine breakdown and deterioration effect. Knowl Based Syst 90:70–80CrossRef Wang D-J, Liu F, Wang Y-Z, Jin Y (2015) A knowledge-based evolutionary proactive scheduling approach in the presence of machine breakdown and deterioration effect. Knowl Based Syst 90:70–80CrossRef
36.
Zurück zum Zitat Wang Y, Feng X-Y, Huang Y-X, Pu D-B, Zhou W-G, Liang Y-C, Zhou C-G (2007) A novel quantum swarm evolutionary algorithm and its applications. Neurocomputing 70(4):633–640CrossRef Wang Y, Feng X-Y, Huang Y-X, Pu D-B, Zhou W-G, Liang Y-C, Zhou C-G (2007) A novel quantum swarm evolutionary algorithm and its applications. Neurocomputing 70(4):633–640CrossRef
37.
Zurück zum Zitat Willmes L, Bäck T, Jin Y, Sendhoff B (2003) Comparing neural networks and Kriging for fitness approximation in evolutionary optimization. In: IEEE congress on evolutionary computation, pp 663–670 Willmes L, Bäck T, Jin Y, Sendhoff B (2003) Comparing neural networks and Kriging for fitness approximation in evolutionary optimization. In: IEEE congress on evolutionary computation, pp 663–670
38.
Zurück zum Zitat Zhang Q, Liu W, Tsang E, Virginas B (2010) Expensive multiobjective optimization by moea/d with gaussian process model. IEEE Trans Evol Comput 14(3):456–474CrossRef Zhang Q, Liu W, Tsang E, Virginas B (2010) Expensive multiobjective optimization by moea/d with gaussian process model. IEEE Trans Evol Comput 14(3):456–474CrossRef
39.
Zurück zum Zitat Zhang X, Tian Y, Jin Y (2015) A knee point-driven evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 19(6):761–776CrossRef Zhang X, Tian Y, Jin Y (2015) A knee point-driven evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 19(6):761–776CrossRef
40.
Zurück zum Zitat Zhang Y, Liu J, Zhou M, Jiang Z (2016) A multi-objective memetic algorithm based on decomposition for big optimization problems. Memet Comput 8(1):45–61CrossRef Zhang Y, Liu J, Zhou M, Jiang Z (2016) A multi-objective memetic algorithm based on decomposition for big optimization problems. Memet Comput 8(1):45–61CrossRef
41.
Zurück zum Zitat Zhou Z, Ong YS, Nair PB, Keane AJ, Lum KY (2007) Combining global and local surrogate models to accelerate evolutionary optimization. IEEE Trans Syst Man Cybern Part C Appl Revi 37(1):66–76CrossRef Zhou Z, Ong YS, Nair PB, Keane AJ, Lum KY (2007) Combining global and local surrogate models to accelerate evolutionary optimization. IEEE Trans Syst Man Cybern Part C Appl Revi 37(1):66–76CrossRef
42.
Zurück zum Zitat Zhou Z, Ong Y-S, Nguyen MH, Lim D (2005) A study on polynomial regression and gaussian process global surrogate model in hierarchical surrogate-assisted evolutionary algorithm. In: Congress on evolutionary computation, IEEE 2005, pp 2832–2839 Zhou Z, Ong Y-S, Nguyen MH, Lim D (2005) A study on polynomial regression and gaussian process global surrogate model in hierarchical surrogate-assisted evolutionary algorithm. In: Congress on evolutionary computation, IEEE 2005, pp 2832–2839
Metadaten
Titel
A fitness approximation assisted competitive swarm optimizer for large scale expensive optimization problems
verfasst von
Chaoli Sun
Jinliang Ding
Jianchao Zeng
Yaochu Jin
Publikationsdatum
07.07.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Memetic Computing / Ausgabe 2/2018
Print ISSN: 1865-9284
Elektronische ISSN: 1865-9292
DOI
https://doi.org/10.1007/s12293-016-0199-9

Weitere Artikel der Ausgabe 2/2018

Memetic Computing 2/2018 Zur Ausgabe

Editorial

Editorial