Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 4/2020

02-01-2020 | Research Article - Computer Engineering and Computer Science

Hybrid Particle Swarm Optimization with Sine Cosine Algorithm and Nelder–Mead Simplex for Solving Engineering Design Problems

Authors: Hussam N. Fakhouri, Amjad Hudaib, Azzam Sleit

Published in: Arabian Journal for Science and Engineering | Issue 4/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper introduces a novel hybrid evolutionary algorithm that combines particle swarm optimization (PSO) algorithm with sine–cosine algorithm (SCA) and Nelder–Mead simplex (NMS) optimization technique. However, the algorithm of PSO has some drawbacks like locating local minima rather than global minima, low converge rate and low balance between exploration and exploitation. In this paper, the combination of PSO algorithm with update positions mathematical equation in SCA and NMS technique is presented in order to solve these problems. So a new hybrid strategy called PSOSCANMS is introduced. The SCA algorithm is based on the behavior of sine and cosine functions in the mathematical formula used for solutions. However, the NMS mathematical formulations attempt to replace the worst vertex with a new point, which depends on the worst point and the center of the best vertices. The combined effect of both mathematical formulations of PSO ensures a consistency of exploitation and exploration that makes the search in the search space more effective. Further, it escapes into the local minimum issue and resolves the low converge rate problem. In order to test PSOSCANMS’s performance, a set of 23 well-known unimodal and multimodal functions have been benchmarked. Experimental results showed that PSOSCANMS is more successful than PSO and outperforms the other state-of-the-art compared algorithms over the tested optimization problems. Moreover, an engineering design problem such as spring compression, welded beam is also considered. The result of the problems in engineering design and application problems shows that the algorithm proposed is relevant in difficult cases involving unknown search areas.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Krawiec, K., Simons, C., Swan, J., Woodward, J.: Metaheuristic design patterns: new perspectives for larger-scale search architectures. In: Vasant, P., Alparslan-Gok, S.Z., Weber, G. (eds.) Handbook of Research on Emergent Applications of Optimization Algorithms, pp. 1–36. IGI Global, Pennsylvania (2018) Krawiec, K., Simons, C., Swan, J., Woodward, J.: Metaheuristic design patterns: new perspectives for larger-scale search architectures. In: Vasant, P., Alparslan-Gok, S.Z., Weber, G. (eds.) Handbook of Research on Emergent Applications of Optimization Algorithms, pp. 1–36. IGI Global, Pennsylvania (2018)
2.
go back to reference Ong, P.; Chin, D.D.V.S.; Ho, C.S.; Ng, C.H.: Metaheuristic approaches for extrusion manufacturing process: utilization of flower pollination algorithm and particle swarm optimization. In: Handbook of Research on Applied Optimization Methodologies in Manufacturing Systems, pp. 43–56. IGI Global, Pennsylvania (2018) Ong, P.; Chin, D.D.V.S.; Ho, C.S.; Ng, C.H.: Metaheuristic approaches for extrusion manufacturing process: utilization of flower pollination algorithm and particle swarm optimization. In: Handbook of Research on Applied Optimization Methodologies in Manufacturing Systems, pp. 43–56. IGI Global, Pennsylvania (2018)
3.
go back to reference Hudaib, A.A.; Fakhouri, H.N.: Supernova optimizer: a novel natural inspired meta-heuristic. Mod. Appl. Sci. 12(1), 32 (2017)CrossRef Hudaib, A.A.; Fakhouri, H.N.: Supernova optimizer: a novel natural inspired meta-heuristic. Mod. Appl. Sci. 12(1), 32 (2017)CrossRef
5.
go back to reference Kennedy, J.: Particle swarm optimization. Encyclopedia of machine learning, pp. 760–766. Springer, US (2011) Kennedy, J.: Particle swarm optimization. Encyclopedia of machine learning, pp. 760–766. Springer, US (2011)
6.
go back to reference Al-Sayyed, R.M.; Fakhouri, H.N.; Rodan, A.; Pattinson, C.: Polar particle swarm algorithm for solving cloud data migration optimization problem. Mod. Appl. Sci. 11(8), 98 (2017)CrossRef Al-Sayyed, R.M.; Fakhouri, H.N.; Rodan, A.; Pattinson, C.: Polar particle swarm algorithm for solving cloud data migration optimization problem. Mod. Appl. Sci. 11(8), 98 (2017)CrossRef
7.
go back to reference Altay, E.V.; Alatas, B.: Performance comparisons of socially inspired metaheuristic algorithms on unconstrained global optimization. In Advances in Computer Communication and Computational Sciences, pp. 163–175. Springer, Singapore (2019) Altay, E.V.; Alatas, B.: Performance comparisons of socially inspired metaheuristic algorithms on unconstrained global optimization. In Advances in Computer Communication and Computational Sciences, pp. 163–175. Springer, Singapore (2019)
8.
go back to reference Chegini, S.N.; Bagheri, A.; Najafi, F.: PSOSCALF: a new hybrid PSO based on Sine Cosine Algorithm and Levy flight for solving optimization problems. Appl. Soft Comput. 73, 697–726 (2018)CrossRef Chegini, S.N.; Bagheri, A.; Najafi, F.: PSOSCALF: a new hybrid PSO based on Sine Cosine Algorithm and Levy flight for solving optimization problems. Appl. Soft Comput. 73, 697–726 (2018)CrossRef
9.
go back to reference Mirjalili, S.: SCA: a sine cosine algorithm for solving optimization problems. Knowl. Based Syst. 96, 120–133 (2016)CrossRef Mirjalili, S.: SCA: a sine cosine algorithm for solving optimization problems. Knowl. Based Syst. 96, 120–133 (2016)CrossRef
10.
go back to reference Eberhart, R.; Kennedy, J.: Particle swarm optimization. In: Proceedings of the IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995) Eberhart, R.; Kennedy, J.: Particle swarm optimization. In: Proceedings of the IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995)
11.
go back to reference Benítez-Hidalgo, A.; Nebro, A.J.; Durillo, J.J.; García-Nieto, J.; López-Camacho, E.; Barba-González, C.; Aldana-Montes, J.F.: About designing an observer pattern-based architecture for a multi-objective metaheuristic optimization framework. In: International Symposium on Intelligent and Distributed Computing, pp. 50–60. Springer, Cham (2018) Benítez-Hidalgo, A.; Nebro, A.J.; Durillo, J.J.; García-Nieto, J.; López-Camacho, E.; Barba-González, C.; Aldana-Montes, J.F.: About designing an observer pattern-based architecture for a multi-objective metaheuristic optimization framework. In: International Symposium on Intelligent and Distributed Computing, pp. 50–60. Springer, Cham (2018)
12.
go back to reference Li, Y.G.; Gui, W.H.; Yang, C.H.; Li, J.: Improved PSO algorithm and its application. J. Central South Univ. Technol. 12(1), 222–226 (2005)CrossRef Li, Y.G.; Gui, W.H.; Yang, C.H.; Li, J.: Improved PSO algorithm and its application. J. Central South Univ. Technol. 12(1), 222–226 (2005)CrossRef
13.
go back to reference Pham, D.T.; Ghanbarzadeh, A.; Koç, E.; Otri, S.; Rahim, S.; Zaidi, M.: The bee’s algorithm—a novel tool for complex optimization problems. In: Intelligent Production Machines and Systems, pp. 454–459. Elsevier Science Ltd.‏, Amsterdam (2006) Pham, D.T.; Ghanbarzadeh, A.; Koç, E.; Otri, S.; Rahim, S.; Zaidi, M.: The bee’s algorithm—a novel tool for complex optimization problems. In: Intelligent Production Machines and Systems, pp. 454–459. Elsevier Science Ltd.‏, Amsterdam (2006)
14.
go back to reference Spendley, W. G. R. F. R.; Hext, G. R.; Himsworth, F. R.: Sequential application of simplex designs in optimisation and evolutionary operation. Technometrics, 4(4), 441–461 (1962)MathSciNetCrossRef Spendley, W. G. R. F. R.; Hext, G. R.; Himsworth, F. R.: Sequential application of simplex designs in optimisation and evolutionary operation. Technometrics, 4(4), 441–461 (1962)MathSciNetCrossRef
16.
17.
go back to reference Sörensen, K.; Sevaux, M.; Glover, F.: A history of metaheuristics. In: Handbook of Heuristics, pp. 1–18 (2018) Sörensen, K.; Sevaux, M.; Glover, F.: A history of metaheuristics. In: Handbook of Heuristics, pp. 1–18 (2018)
19.
go back to reference Dorigo, M.; Di Caro, G.: Ant colony optimization: a new meta-heuristic. In: Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406), Vol. 2, pp. 1470–1477. IEEE, Washington (1999)‏ Dorigo, M.; Di Caro, G.: Ant colony optimization: a new meta-heuristic. In: Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406), Vol. 2, pp. 1470–1477. IEEE, Washington (1999)‏
20.
go back to reference Yao, X.; Liu, Y.; Lin, G.: Evolutionary programming made faster. IEEE Trans. Evol. Comput. 3(2), 82–102 (1999)CrossRef Yao, X.; Liu, Y.; Lin, G.: Evolutionary programming made faster. IEEE Trans. Evol. Comput. 3(2), 82–102 (1999)CrossRef
21.
go back to reference Yang, X.S.; Deb, S.: Cuckoo search via Lévy flights. In: 2009 World Congress on Nature and Biologically Inspired Computing (NaBIC), pp. 210–214. IEEE, Washington (2009)‏ Yang, X.S.; Deb, S.: Cuckoo search via Lévy flights. In: 2009 World Congress on Nature and Biologically Inspired Computing (NaBIC), pp. 210–214. IEEE, Washington (2009)‏
22.
go back to reference Karaboga, D.; Basturk, B.: A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J. Global Optim. 39(3), 459–471 (2007)MathSciNetCrossRef Karaboga, D.; Basturk, B.: A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J. Global Optim. 39(3), 459–471 (2007)MathSciNetCrossRef
23.
go back to reference Rashedi, E.; Nezamabadi-Pour, H.; Saryazdi, S.: GSA: a gravitational search algorithm. Inf. Sci. 179(13), 2232–2248 (2009)CrossRef Rashedi, E.; Nezamabadi-Pour, H.; Saryazdi, S.: GSA: a gravitational search algorithm. Inf. Sci. 179(13), 2232–2248 (2009)CrossRef
24.
go back to reference Yang, X.S.: Firefly algorithm. In: Engineering Optimization, pp. 221–223 (2010) Yang, X.S.: Firefly algorithm. In: Engineering Optimization, pp. 221–223 (2010)
25.
go back to reference Mirjalili, S.; Mirjalili, S.M.; Lewis, A.: Grey wolf optimizer. Adv. Eng. Softw. 69, 46–61 (2014)CrossRef Mirjalili, S.; Mirjalili, S.M.; Lewis, A.: Grey wolf optimizer. Adv. Eng. Softw. 69, 46–61 (2014)CrossRef
26.
go back to reference Kaveh, A.; Farhoudi, N.: A new optimization method: Dolphin echolocation. Adv. Eng. Softw. 59, 53–70 (2013)CrossRef Kaveh, A.; Farhoudi, N.: A new optimization method: Dolphin echolocation. Adv. Eng. Softw. 59, 53–70 (2013)CrossRef
27.
go back to reference Pan, W.T.: A new fruit fly optimization algorithm: taking the financial distress model as an example. Knowl. Based Syst. 26, 69–74 (2012)CrossRef Pan, W.T.: A new fruit fly optimization algorithm: taking the financial distress model as an example. Knowl. Based Syst. 26, 69–74 (2012)CrossRef
28.
go back to reference Krishnanand, K.N.; Ghose, D.: Glowworm swarm optimization: a new method for optimising multi-modal functions. Int. J. Comput. Intell. Stud. 1(1), 93–119 (2009)CrossRef Krishnanand, K.N.; Ghose, D.: Glowworm swarm optimization: a new method for optimising multi-modal functions. Int. J. Comput. Intell. Stud. 1(1), 93–119 (2009)CrossRef
29.
go back to reference Kiran, M.S.: TSA: tree-seed algorithm for continuous optimization. Expert Syst. Appl. 42(19), 6686–6698 (2015)CrossRef Kiran, M.S.: TSA: tree-seed algorithm for continuous optimization. Expert Syst. Appl. 42(19), 6686–6698 (2015)CrossRef
30.
go back to reference Rajabioun, R.: Cuckoo optimization algorithm. Appl. Soft Comput. 11(8), 5508–5518 (2011)CrossRef Rajabioun, R.: Cuckoo optimization algorithm. Appl. Soft Comput. 11(8), 5508–5518 (2011)CrossRef
31.
go back to reference Oftadeh, R.; Mahjoob, M.J.; Shariatpanahi, M.: A novel meta-heuristic optimization algorithm inspired by group hunting of animals: hunting search. Comput. Math Appl. 60(7), 2087–2098 (2010)CrossRef Oftadeh, R.; Mahjoob, M.J.; Shariatpanahi, M.: A novel meta-heuristic optimization algorithm inspired by group hunting of animals: hunting search. Comput. Math Appl. 60(7), 2087–2098 (2010)CrossRef
32.
go back to reference Zhao, W.; Wang, L.; Zhang, Z.: Atom search optimization and its application to solve a hydrogeologic parameter estimation problem. Knowl. Based Syst. 163, 283–304 (2019)CrossRef Zhao, W.; Wang, L.; Zhang, Z.: Atom search optimization and its application to solve a hydrogeologic parameter estimation problem. Knowl. Based Syst. 163, 283–304 (2019)CrossRef
33.
go back to reference Joshi, H.; Arora, S.: Enhanced grey wolf optimization algorithm for global optimization. Fundam. Inf. 153(3), 235–264 (2017)MathSciNetCrossRef Joshi, H.; Arora, S.: Enhanced grey wolf optimization algorithm for global optimization. Fundam. Inf. 153(3), 235–264 (2017)MathSciNetCrossRef
34.
go back to reference Qais, M.H.; Hasanien, H.M.; Alghuwainem, S.: Augmented grey wolf optimizer for grid-connected PMSG-based wind energy conversion systems. Appl. Soft Comput. 69, 504–515 (2018)CrossRef Qais, M.H.; Hasanien, H.M.; Alghuwainem, S.: Augmented grey wolf optimizer for grid-connected PMSG-based wind energy conversion systems. Appl. Soft Comput. 69, 504–515 (2018)CrossRef
36.
go back to reference Mohamed, A.A.A.; Mohamed, Y.S.; El-Gaafary, A.A.; Hemeida, A.M.: Optimal power flow using moth swarm algorithm. Electr. Power Syst. Res. 142, 190–206 (2017)CrossRef Mohamed, A.A.A.; Mohamed, Y.S.; El-Gaafary, A.A.; Hemeida, A.M.: Optimal power flow using moth swarm algorithm. Electr. Power Syst. Res. 142, 190–206 (2017)CrossRef
37.
go back to reference Arora, S.; Singh, S.: Butterfly optimization algorithm: a novel approach for global optimization. Soft. Comput. 23, 715–734 (2018)CrossRef Arora, S.; Singh, S.: Butterfly optimization algorithm: a novel approach for global optimization. Soft. Comput. 23, 715–734 (2018)CrossRef
38.
go back to reference Van Den Berg, R. A.; Pogromsky, A. Y.; Leonov, G. A.; Rooda, J. E.: Design of convergent switched systems. In Pettersen K.Y., Gravdahl J.T., Nijmeijer H. (eds.) Group coordination and cooperative control (pp. 291–311). Springer, Berlin, Heidelberg (2006)CrossRef Van Den Berg, R. A.; Pogromsky, A. Y.; Leonov, G. A.; Rooda, J. E.: Design of convergent switched systems. In Pettersen K.Y., Gravdahl J.T., Nijmeijer H. (eds.) Group coordination and cooperative control (pp. 291–311). Springer, Berlin, Heidelberg (2006)CrossRef
39.
go back to reference Semwal, V.B.; Singha, J.; Sharma, P.K.; Chauhan, A.; Behera, B.: An optimized feature selection technique based on incremental feature analysis for bio-metric gait data classification. Multimed. Tools Appl. 76(22), 24457–24475 (2017)CrossRef Semwal, V.B.; Singha, J.; Sharma, P.K.; Chauhan, A.; Behera, B.: An optimized feature selection technique based on incremental feature analysis for bio-metric gait data classification. Multimed. Tools Appl. 76(22), 24457–24475 (2017)CrossRef
40.
go back to reference Semwal, V.B., Gaud, N., Nandi, G.C.: Human gait state prediction using cellular automata and classification using ELM. In: Tanveer, M., Pachori, R. (eds.) Machine Intelligence and Signal Analysis, pp. 135–145. Springer, Singapore (2019)CrossRef Semwal, V.B., Gaud, N., Nandi, G.C.: Human gait state prediction using cellular automata and classification using ELM. In: Tanveer, M., Pachori, R. (eds.) Machine Intelligence and Signal Analysis, pp. 135–145. Springer, Singapore (2019)CrossRef
41.
go back to reference Kumar, S.; Aaron, J.; Sokolov, K.: Directional conjugation of antibodies to nanoparticles for synthesis of multiplexed optical contrast agents with both delivery and targeting moieties. Nat. Protoc. 3(2), 314 (2008)CrossRef Kumar, S.; Aaron, J.; Sokolov, K.: Directional conjugation of antibodies to nanoparticles for synthesis of multiplexed optical contrast agents with both delivery and targeting moieties. Nat. Protoc. 3(2), 314 (2008)CrossRef
42.
go back to reference Valsange, P.S.: Design of helical coil compression spring: a review. Int. J. Eng. Res. Appl. 2(6), 513–522 (2012) Valsange, P.S.: Design of helical coil compression spring: a review. Int. J. Eng. Res. Appl. 2(6), 513–522 (2012)
43.
go back to reference Deb, K.: Optimal design of a welded beam via genetic algorithms. AIAA J. 29(11), 2013–2015 (1991)CrossRef Deb, K.: Optimal design of a welded beam via genetic algorithms. AIAA J. 29(11), 2013–2015 (1991)CrossRef
Metadata
Title
Hybrid Particle Swarm Optimization with Sine Cosine Algorithm and Nelder–Mead Simplex for Solving Engineering Design Problems
Authors
Hussam N. Fakhouri
Amjad Hudaib
Azzam Sleit
Publication date
02-01-2020
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 4/2020
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-019-04285-9

Other articles of this Issue 4/2020

Arabian Journal for Science and Engineering 4/2020 Go to the issue

Research Article - Special Issue - Intelligent Computing and Interdisciplinary Applications

IoT Applications and Services for Connected and Autonomous Electric Vehicles

Research Article - Special Issue - Intelligent Computing And Interdisciplinary Applications

An Adaptive Spiking Neural P System for Solving Vehicle Routing Problems

Premium Partners