Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Engineering with Computers
Published in: Engineering with Computers 4/2018

06-12-2017 | Original Article

Multi-level cross entropy optimizer (MCEO): an evolutionary optimization algorithm for engineering problems

Authors: Farid MiarNaeimi, Gholamreza Azizyan, Mohsen Rashki

Published in: Engineering with Computers | Issue 4/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This work proposes a new meta-heuristic optimization algorithm called multi-level cross entropy Optimizer (MCEO). This algorithm is conducted by combination of a group of cross entropy operators. Situations, with a low probability for optimal point are searched with high speed, and also, locations with a high probability for existence of optimal point are investigated with a low speed and high accuracy. The algorithm is then benchmarked on 13 well-known test functions in high dimension spaces (100 dimensions), and the answers are verified by a comparative study with thermal exchange optimization, selfish herds optimization, water evaporation optimization, Moth-Flame optimization, Flower Pollination Algorithm, states of matter search, and gray wolf optimizer. The results indicate that the MCEO algorithm can provide very competitive results in comparison to these well-known meta-heuristics in a similar condition (in term of NFEs). The paper also considers solving three classical engineering design problems (tension/compression spring, welded beam, and pressure vessel designs) and presents a genuine application of the proposed method to the field of dam engineering. The results of the classical engineering design problems and the real application validate that the proposed algorithm is applicable to challenging difficulties with unknown search spaces.
previous article Developing a least squares support vector machine for estimating the blast-induced flyrock
next article A numerical procedure based on Hermite wavelets for two-dimensional hyperbolic telegraph equation

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Literature
1.
Kaveh A (2014) Advances in Metaheuristic algorithms for optimal design of structures. Springer International Publishing, BaselCrossRefMATH
2.
Goldberg DE, Holland JH (1968) Genetic algorithms and machine learning. Mach Learn 3(2):95–99
3.
Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359MathSciNetCrossRefMATH
4.
Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection, vol 1. MIT press, CambridgeMATH
5.
Rechenberg I (1994) Evolution strategy. Comput Intell 1:147–159
6.
Fogel LJ, Owens AJ, Walsh MJ (1966) Artificial intelligence through simulated evolution. Wiley, New York
7.
Simon D (2008) Biogeography-based optimization. IEEE Trans Evol Comput 12(6):702–713CrossRef
8.
Yang XS (2012) Flower pollination algorithm for global optimization. Confrence paper. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol 7445. LNCS, pp 240–249. https://​doi.​org/​10.​1007/​978-3-642-32894-7_​27
9.
Cuevas E, Echavarría A, Ramírez-Ortegón MA (2014) An optimization algorithm inspired by the States of Matter that improves the balance between exploration and exploitation. Appl Intell 40(2):256–272CrossRef
10.
Banichuk NV, Neittaanmäki PJ (2010) Structural optimization with uncertainties. Solid Mechanics its Applications, vol 162, Springer, Netherlands
11.
Webster B, Bernhard PJ (2003) A local search optimization algorithm based on natural principles of gravitation. Technical report. Florida Institute of Technology. #CS-2003-10
12.
Kaveh A, Talatahari S (2010) A novel heuristic optimization method: charged system search. Acta Mech 213(3–4):267–289CrossRefMATH
13.
Formato RA (2007) Central force optimization: A new metaheuristic with applications in applied electromagnetics. Progr Electromagn Res PIER 77:425–491CrossRef
14.
Lam AYS, Li VOK (2010) Chemical-reaction-inspired metaheuristic for optimization. IEEE Trans Evol Comput 14(3):381–399CrossRef
15.
16.
Du H, Wu X, Zhuang J (2006) Small-world optimization algorithm for function optimization. Adv Nat Comput Pt 2 4222:264–273
17.
Moghaddam FF, Moghaddam RF, Cheriet M (2012) Curved space optimization: a random search based on general relativity theory. arXiv:1208.2214
18.
Varaee H, Reza M (2016) Engineering optimization based on ideal gas molecular movement algorithm. Eng Comput 33:71–93CrossRef
19.
Kaveh A, Bakhshpoori T (2016) Water Evaporation Optimization: A novel physically inspired optimization algorithm. Comput Struct 167:69–85CrossRef
20.
Kaveh A, Dadras A (2017) A novel meta-heuristic optimization algorithm: Thermal exchange optimization. Adv Eng Softw 110:69–84CrossRef
21.
22.
Dorigo M, Birattari M, Stutzle T (2006) Ant colony optimization.” IEEE Comput Intell Mag 1(4):28–39CrossRef
23.
Karaboga D (2005) An idea based on honey bee swarm for numerical optimization, Technical report, Erciyes university
24.
Nesahat M, Sepidnam G, Sargolzaei M, Toosi A N (2014) Artificial fish swarm algorithm: a survey of the state-of-the-art, hybridization, combinatorial and indicative applications. Artif Intell Rev. 42(4):965–997
25.
Roth M (2006) Termite: A swarm intelligent routing algorithm for mobile wireless ad-hoc networks. Stigmergic Optimization. Springer, Berlin, Heidelberg, pp 155–184
26.
27.
Gandomi AH, Yang X (2013) Cuckoo search algorithm : a metaheuristic approach to solve structural optimization problems. Eng Comput 29:17–35CrossRef
28.
Shiqin Y, Jianjun J, Guangxing Y (2009) A dolphin partner optimization. In: Intelligent Systems. GCIS’09. WRI Global Congress on, vol 1, IEEE, Washington. pp 124–128
29.
Yang X-S (2010) Firefly Algorithm, Stochastic Test Functions and Design Optimisation. Int J Bio-Inspired Comput. 2(2):78–84
30.
Kaveh A, Khayatazad M (2012) A new meta-heuristic method: Ray Optimization. Comput Struct 112–113:283–294CrossRef
31.
Kaveh A, Farhoudi N (2013) A new optimization method: Dolphin echolocation. Adv Eng Softw 59:53–70CrossRef
32.
Mirjalili S, Mirjalili SM, Lewis A (2014) Grey Wolf Optimizer. Adv Eng Softw 69:46–61CrossRef
33.
Mirjalili S (2015) Moth-flame optimization algorithm: a novel nature-inspired heuristic paradigm. Knowl Based Syst 89:228–249CrossRef
34.
Kaveh A, Ghazaan MI (2017) A new meta-heuristic algorithm : vibrating particles system. Sci Iran 24(2):1–32
35.
Fausto F, Cuevas E, Valdivia A, González A (2017) BioSystems A global optimization algorithm inspired in the behavior of selfish herds. BioSystems 160:39–55CrossRef
36.
Kaveh A, Zolghadr A (2017) Cyclical parthenogenesis algorithm for guided modal strain energy based structural damage detection. Appl Soft Comput J 57:250–264CrossRef
37.
Rubinsten RY, Kroese DP (2004) The cross-entropy method: a unified approach to combinatorial optimization, Monte-Carlo simulation, and machine learning. Springer, New YorkCrossRef
38.
Belmudes F, Ernst D, Wehenkel L (2008) Cross-entropy based rare-event simulation for the identification of dangerous events in power system. in: Probabilistic Methods Applied to Power Systems, 2008. PMAPS’08. Proceedings of the 10th International Conference on IEEE, Puerto Rico. pp 1–7. Print ISBN: 978-1-9343-2521-6
39.
40.
41.
42.
Sani A (2009) Stochastic Modelling and Intervention of the Spread of HIV/AIDS. Ph.D. thesis, The University of Queensland, School of Physical Science, Brisbane
43.
Kroese DP, Porotsky S, Rubinstein RY (2006) The cross-entropy method for continuous multi-extremal optimization. Methodol Comput Appl Prob 8(3):383–407MathSciNetCrossRefMATH
44.
Szabó Z, Póczos B, Lőrincz A (2006) Cross-Entropy Optimization for Independent Process Analysis. IIn: International Conference on Independent Component Analysis and Signal Separation ICA 2006: Independent Component Analysis and Blind Signal Separation. vol 3889, Springer, Berlin. pp 909–916
45.
Busnoniu L, Babuska R, De Schutter B, Ernst D (2010) Reinforcement learning and dynamic programming using function approximators. Taylor & Francis Group, New YorkCrossRef
46.
Kroese DP, Rubinstein RY, Taimre T (2007) Application of the cross-entropy method to clustering and vector quantization. J Global Optim 37(1):137–157CrossRefMATH
47.
48.
Pihur V, Datta S, Datta S (2007) Weighted rank aggregation of cluster validation measures: a monte carlo cross-entropy approach. Bioinformatics 23(13):1607–1615CrossRef
49.
Alon G, Kroese DP, Raviv T, Rubinstein RY (2005) Application of the cross-entropy method to the buffer allocation problem in a simulation-based environment. Ann Oper Res 134(1):137–151MathSciNetCrossRefMATH
50.
Cohen I, Golany B, Shtub A (2007) Resource allocation in stochastic, finite-capacity, multi-project systems through the cross entropy methodology. J Sched 10(3):181–193MathSciNetCrossRefMATH
51.
Kroese DP, Hui KP, Nariai S (2007) Network reliability optimization via the cross-entropy method.” IEEE Trans Reliab 56(2):275–287CrossRef
52.
Fu C, Wang H, Zhu L (2005) Solving the vehicle routing problem with stochastic demands and customers. In: Parallel and distributed computing, applications and technologies, PDCAT Proceedings, vol 2005, pp 736–738
53.
54.
Lőrincz A, Palotai Z, Szirtes G (2008) Spike-based cross-entropy method for reconstruction. Neurocomputing 71(16):3635–3639
55.
Yang X, Press L (2010) Nature-Inspired Metaheuristic Algorithms Second Edition. University of Cambridge, Cambridge
56.
Tung YK, Yen BC, Melching CS (2013) Reliability assessment and risk analysis. McGraw-Hill, New York
57.
Haldar A, Mahdevan S (2010) Probability, reliability, and statistical methods in engineering design. Wiley, New York
58.
Dai H, Wang W (2009) Application of low discrepancy sampling method in structural reliability analysis. Struct Saf 31:55–64CrossRef
59.
Rao SS (2009) Engineering optimization: theory and practice, 4 edn. Wiley, New YorkCrossRef
60.
He Q, Wang L (2007) An effective co-evolutionary particle swarm optimization for constrained engineering design problems. Eng Appl Artif Intell 20(1):89–99CrossRef
61.
Mezura-Montes E, Coello CAC (2008) An empirical study about the usefulness of evolution strategies to solve constrained optimization problems. Int J Gen Syst 37(4):443–473MathSciNetCrossRefMATH
62.
Coello CAC (2000) Use of a self-adaptive penalty approach for engineering optimization problems. Comput Ind 41(2):113–127CrossRef
63.
Lee KS, Geem ZW (2005) A new meta-heuristic algorithm for continuous engineering optimization: Harmony search theory and practice. Comput Methods Appl Mech Eng 194(36–38):3902–3933CrossRefMATH
64.
Huang F, Wang L, He Q (2007) An effective co-evolutionary differential evolution for constrained optimization. Appl Math Comput 186(1):340–356MathSciNetMATH
65.
Coello CAC, Montes EM (2002) Constraint-handling in genetic algorithms through the use of dominance-based tournament selection. Adv Eng Inform 16(3):193–203CrossRef
66.
Coello Coello CA, Becerra RL (2004) Efficient evolutionary optimization through the use of a cultural algorithm. Eng Optim 36(2):219–236CrossRef
67.
He Q, Wang L (2007) A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization. Appl Math Comput 186(2):1407–1422MathSciNetMATH
68.
Zahara E, Kao Y-T (2009) Hybrid Nelder–Mead simplex search and particle swarm optimization for constrained engineering design problems. Expert Syst Appl 36(2):3880–3886CrossRef
69.
L dos Santos Coelho (2010) Gaussian quantum-behaved particle swarm optimization approaches for constrained engineering design problems. Expert Syst Appl 37(2):1676–1683CrossRef
70.
Lampinen J (2002) A constraint handling approach for the differential evolution algorithm. In: Evolutionary Computation, CEC’02. Proceedings of the 2002 Congress, vol 2, pp 1468–1473
71.
Wang L, Li L (2010) An effective differential evolution with level comparison for constrained engineering design. Struct Multidiscip Optim 41(6):947–963CrossRef
72.
Zhang M, Luo W, Wang X (2008) Differential evolution with dynamic stochastic selection for constrained optimization. Inf Sci 178(15):3043–3074CrossRef
73.
Wang Y, Cai Z, Zhou Y, Fan Z (2009) Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique. Struct Multidiscip Optim 37(4):395–413CrossRef
74.
Liu H, Cai Z, Wang Y (2010) Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization. Appl Soft Comput 10(2):629–640CrossRef
75.
Ray T, Liew KM (2003) Society and civilization: An optimization algorithm based on the simulation of social behavior. IEEE Trans Evol Comput 7(4):386–396CrossRef
76.
Mezura-Montes E, Coello CAC (2005) Useful infeasible solutions in engineering optimization with evolutionary algorithms. In: Mexican International Conference on Artificial Intelligence. vol 3789, Springer, Berlin, pp 652–662
77.
Karaboga D, Basturk B (2007) Artificial bee colony (ABC) optimization algorithm for solving constrained optimization. In: International Fuzzy Systems Association World Congress. IFSA 2007: Foundations of fuzzy logic and soft computing, vol 4529. Springer, New York, pp 789–798
78.
Kashan AH (2011) An efficient algorithm for constrained global optimization and application to mechanical engineering design: League championship algorithm (LCA), Comput Aided Design 43(12):1769–1792CrossRef
79.
Eskandar H, Sadollah A, Bahreininejad A, Hamdi M (2012) Water cycle algorithm–a novel metaheuristic optimization method for solving constrained engineering optimization problems. Comput Struct 110:151–166CrossRef
80.
Yang X-S (2010) Engineering optimization: an introduction with metaheuristic applications. Wiley, New YorkCrossRef
81.
Ragsdell KM, Phillips DT (1976) Optimal design of a class of welded structures using geometric programming. J Eng Ind 98(3):1021–1025CrossRef
82.
Kaveh A, Talatahari S (2010) An improved ant colony optimization for constrained engineering design problems. Eng Comput 27(1):155–182CrossRefMATH
83.
Kannan BK, Kramer SN (1994) An augmented Lagrange multiplier based method for mixed integer discrete continuous optimization and its applications to mechanical design. J Mech Design 116(2):405–411CrossRef
84.
Sandgren E (1990) Nonlinear integer and discrete programming in mechanical design optimization. J Mech Des 112(2):223–229CrossRef
85.
Duncan W, Huntley C, Hokenstrom J, Cudworth A, McDaniel T (1987) Design of small dams. A water resources technical publication. Final report. Engineering and Research Center, Bureau of Reclamation, Denver
86.
Kaveh A, Zakian P (2015) “Stability Based Optimum Design of Concrete Gravity Dam Using Css, Cbo and Ecbo Algorithms. Iran Univ Sci Technol 5(4):419–431
87.
Akbari J, Ahmadi MT, Moharrami H (2011) Advances in concrete arch dams shape optimization. Appl Math Model 35(7):3316–3333CrossRefMATH
88.
Mahani AS, Shojaee S, Salajegheh E, Khatibinia M (2015) Hybridizing two-stage meta-heuristic optimization model with weighted least squares support vector machine for optimal shape of double-arch dams. Appl Soft Comput 27:205–218CrossRef
89.
Cai X, Wu Y, Yi J, Ming Y (2011) Research on shape optimization of CSG dams. Water Sci Eng 4(4):445–454
90.
Ahmed GL, Srivastava DK, Rani D (2013) Optimization–simulation models for yield assessment of a single reservoir system. J Indian Water Res Soc 33(4):9–16
91.
Gandomi AH, Yang X-S, Talatahari S, Alavi AH (2013)Metaheuristic applications in structures and infrastructures. Newnes. Book. Elsevier. ISBN: 9780123983640
92.
Gholizadeh S, Seyedpoor SM (2011) Shape optimization of arch dams by metaheuristics and neural networks for frequency constraints.” Sci Iran 18(5):1020–1027CrossRef
Metadata
Title
Multi-level cross entropy optimizer (MCEO): an evolutionary optimization algorithm for engineering problems
Authors
Farid MiarNaeimi
Gholamreza Azizyan
Mohsen Rashki
Publication date
06-12-2017
Publisher
Springer London
Published in
Engineering with Computers / Issue 4/2018
Print ISSN: 0177-0667
Electronic ISSN: 1435-5663
DOI
https://doi.org/10.1007/s00366-017-0569-z

Other articles of this Issue 4/2018

Engineering with Computers 4/2018 Go to the issue

Original Article

Mesh size effect on finite-element modeling of blast-loaded reinforced concrete slab

Original Article

Automatic feature recognition of regular features for symmetrical and non-symmetrical cylinder part using volume decomposition method

Original Article

Proposing of a new soft computing-based model to predict peak particle velocity induced by blasting

Original Article

Comparison of enriched meshless finite volume and element free Galerkin methods for the analysis of heterogeneous media

Original Article

Code verification examples based on the method of manufactured solutions for Kirchhoff–Love and Reissner–Mindlin shell analysis

Original Article

Improved GWO algorithm for optimal design of truss structures