Top

Memetic Computing

Published in:

07-07-2016 | Regular Research Paper

A fitness approximation assisted competitive swarm optimizer for large scale expensive optimization problems

Authors: Chaoli Sun, Jinliang Ding, Jianchao Zeng, Yaochu Jin

Published in: Memetic Computing | Issue 2/2018

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Surrogate assisted meta-heuristic algorithms have received increasing attention over the past years due to the fact that many real-world optimization problems are computationally expensive. However, most existing surrogate assisted meta-heuristic algorithms are designed for small or medium scale problems. In this paper, a fitness approximation assisted competitive swarm optimizer is proposed for optimization of large scale expensive problems. Different from most surrogate assisted evolutionary algorithms that use a computational model for approximating the fitness, we estimate the fitness based on the positional relationship between individuals in the competitive swarm optimizer. Empirical study on seven widely used benchmark problems with 100 and 500 decision variables show that the proposed fitness approximation assisted competitive swarm optimizer is able to achieve competitive performance on a limited computational budget.

previous article Editorial

next article Solving 0–1 knapsack problems by chaotic monarch butterfly optimization algorithm with Gaussian mutation

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Asafuddoula Md, Ray T, Sarker R (2015) A decomposition-based evolutionary algorithm for many objective optimization. IEEE Trans. Evol. Comput. 19(3):445–460CrossRef

Azzouz N, Bechikh S, Ben Said L (2014) Steady state ibea assisted by mlp neural networks for expensive multi-objective optimization problems. In: Proceedings of the 2014 conference on Genetic and evolutionary computation, ACM, pp 581–588

Bajer L, Holeňa M (2010) Surrogate model for continuous and discrete genetic optimization based on rbf networks. In: Intelligent data engineering and automated learning-IDEAL 2010. Springer, Berlin, pp 251–258

Dirk B, Schraudolph NN, Koumoutsakos P (2005) Accelerating evolutionary algorithms with gaussian process fitness function models. IEEE Trans Syst Man Cybern Part C Appl Rev 35(2):183–194CrossRef

Cheng R, Jin Y (2015) A competitive swarm optimizer for large scale optimization. IEEE Trans Cybern 45(2):191–204CrossRef

Cheng R, Jin Y, Olhofer M, Sendhoff B (2016) A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput. doi:10.1109/TEVC.2016.2519378

El Ela AAA, Abido MA, Spea SR (2011) Differential evolution algorithm for optimal reactive power dispatch. Electr Power Syst Res 81(2):458–464CrossRef

Saber Elsayed, Ruhul Sarker (2016) Differential evolution framework for big data optimization. Memet Comput 8(1):17–33CrossRef

Freitas AA (2013) Data mining and knowledge discovery with evolutionary algorithms. Springer, Berlin

10.

Jansson T, Nilsson L, Redhe M (2003) Using surrogate models and response surfaces in structural optimization-with application to crashworthiness design and sheet metal forming. Struct Multidiscip Optim 25(2):129–140CrossRef

11.

Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft comput 9(1):3–12CrossRef

12.

Jin Y (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evol Comput 1(2):61–70CrossRef

13.

Jin Y, Olhofer M, Sendhoff B (2002) A framework for evolutionary optimization with approximate fitness functions. IEEE Trans Evol Comput 6(5):481–494CrossRef

14.

Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Global Optim 13(4):455–492MathSciNetMATHCrossRef

15.

Lalwani S, Kumar R, Gupta N (2015) A novel two-level particle swarm optimization approach for efficient multiple sequence alignment. Memet Comput 7(2):119–133CrossRef

16.

Le MN, Ong YS, Menzel S, Jin Y, Sendhoff B (2013) Evolution by adapting surrogates. Evol Comput 21(2):313–340CrossRef

17.

Lim D, Jin Y, Ong Y-S, Sendhoff B (2010) Generalizing surrogate-assisted evolutionary computation. IEEE Trans Evol Comput 14(3):329–355CrossRef

18.

Liu B, Zhang Q, Gielen GGE (2014) A gaussian process surrogate model assisted evolutionary algorithm for medium scale expensive optimization problems. IEEE Trans Evol Comput 18(2):180–192CrossRef

19.

Lu X, Tang K, Yao X (2011) Classification-assisted differential evolution for computationally expensive problems. In: 2011 IEEE congress on evolutionary computation (CEC), pp 1986–1993

20.

Ong Y-S, Nair PB, Lum K (2006) Max-min surrogate-assisted evolutionary algorithm for robust design. IEEE Trans Evol Comput 10(4):392–404CrossRef

21.

Patvardhan C, Bansal S, Srivastav A (2015) Quantum-inspired evolutionary algorithm for difficult knapsack problems. Memet Comput 7(2):135–155MATHCrossRef

22.

Ponsich A, Jaimes AL, Coello C et al (2013) A survey on multiobjective evolutionary algorithms for the solution of the portfolio optimization problem and other finance and economics applications. IEEE Trans Evol Comput 17(3):321–344CrossRef

23.

Regis RG (2014) Evolutionary programming for high-dimensional constrained expensive black-box optimization using radial basis functions. IEEE Trans Evol Comput 18(3):326–347CrossRef

24.

Shi L, Rasheed K (2010) A survey of fitness approximation methods applied in evolutionary algorithms. In: Tenne Y, Goh C-K (eds) Computational intelligence in expensive optimization problems. Springer, Berlin, pp 3–28CrossRef

25.

Singh HK, Ray T, Smith W (2010) Surrogate assisted simulated annealing (sasa) for constrained multi-objective optimization. In: 2010 IEEE congress on evolutionary computation (CEC), pp 1–8

26.

Smith RE, Dike BA, Stegmann SA (1995) Fitness inheritance in genetic algorithms. In: Proceedings of the 1995 ACM symposium on applied computing, pp 345–350

27.

Sun C, Jin Y, Zeng J, Yang Y (2014) A two-layer surrogate-assisted particle swarm optimization algorithm. Soft Comput 19(6):1461–1475CrossRef

28.

Sun C, Zeng J, Pan J, Jin Y (2013) Similarity-based evolution control for fitness estimation in particle swarm optimization. In: 2013 IEEE symposium on computational intelligence in dynamic and uncertain environments (CIDUE), pp 1–8

29.

Sun C, Zeng J, Pan J, Xue S, Jin Y (2013) A new fitness estimation strategy for particle swarm optimization. Inf Sci 221:355–370MathSciNetMATHCrossRef

30.

Sun X, Gong D, Jin Y, Chen S (2013) A new surrogate-assisted interactive genetic algorithm with weighted semisupervised learning. IEEE Trans Cybern 43(2):685–698CrossRef

31.

Tabatabaei M, Hakanen J, Hartikainen M, Miettinen K, Sindhya K (2015) A survey on handling computationally expensive multiobjective optimization problems using surrogates: non-nature inspired methods. Struct Multidiscip Optim 52(1):1–25MathSciNetCrossRef

32.

Tang K, Yáo X, Suganthan PN, MacNish C, Chen Y-P, Chen C-M, Yang Z (2007) Benchmark functions for the cec2008 special session and competition on large scale global optimization. In: Nature Inspired Computation and Applications Laboratory, USTC, China, pp 153–177

33.

Ulmer H, Streichert F, Zell A (2003) Evolution strategies assisted by gaussian processes with improved preselection criterion. In: 2003 congress on evolutionary computation, vol 1, pp 692–699

34.

Voutchkov I, Keane A (2010) Multi-objective optimization using surrogates. In: Tenne Y, Goh C-K (eds) Computational intelligence in optimization. Springer, Berlin, pp 155–175

35.

Wang D-J, Liu F, Wang Y-Z, Jin Y (2015) A knowledge-based evolutionary proactive scheduling approach in the presence of machine breakdown and deterioration effect. Knowl Based Syst 90:70–80CrossRef

36.

Wang Y, Feng X-Y, Huang Y-X, Pu D-B, Zhou W-G, Liang Y-C, Zhou C-G (2007) A novel quantum swarm evolutionary algorithm and its applications. Neurocomputing 70(4):633–640CrossRef

37.

Willmes L, Bäck T, Jin Y, Sendhoff B (2003) Comparing neural networks and Kriging for fitness approximation in evolutionary optimization. In: IEEE congress on evolutionary computation, pp 663–670

38.

Zhang Q, Liu W, Tsang E, Virginas B (2010) Expensive multiobjective optimization by moea/d with gaussian process model. IEEE Trans Evol Comput 14(3):456–474CrossRef

39.

Zhang X, Tian Y, Jin Y (2015) A knee point-driven evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 19(6):761–776CrossRef

40.

Zhang Y, Liu J, Zhou M, Jiang Z (2016) A multi-objective memetic algorithm based on decomposition for big optimization problems. Memet Comput 8(1):45–61CrossRef

41.

Zhou Z, Ong YS, Nair PB, Keane AJ, Lum KY (2007) Combining global and local surrogate models to accelerate evolutionary optimization. IEEE Trans Syst Man Cybern Part C Appl Revi 37(1):66–76CrossRef

42.

Zhou Z, Ong Y-S, Nguyen MH, Lim D (2005) A study on polynomial regression and gaussian process global surrogate model in hierarchical surrogate-assisted evolutionary algorithm. In: Congress on evolutionary computation, IEEE 2005, pp 2832–2839

Title: A fitness approximation assisted competitive swarm optimizer for large scale expensive optimization problems
Authors: Chaoli Sun
Jinliang Ding
Jianchao Zeng
Yaochu Jin
Publication date: 07-07-2016
Publisher: Springer Berlin Heidelberg
Published in: Memetic Computing / Issue 2/2018
Print ISSN: 1865-9284
Electronic ISSN: 1865-9292
DOI: https://doi.org/10.1007/s12293-016-0199-9

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 2/2018

A hybrid metaheuristic algorithm for generalized vertex cover problem

Solving 0–1 knapsack problems by chaotic monarch butterfly optimization algorithm with Gaussian mutation

Fabrication of a resonant PEMC sensor using hybrid -constraint lexicographical ranking DE-MSBA with Jacobean approximation

Editorial

An improved optimization method based on krill herd and artificial bee colony with information exchange

Moth search algorithm: a bio-inspired metaheuristic algorithm for global optimization problems

Premium Partner