Skip to main content
Top
Published in: Neural Computing and Applications 12/2019

22-10-2019 | Original Article

Adaptive differential search algorithm with multi-strategies for global optimization problems

Authors: Xianghua Chu, Da Gao, Jiansheng Chen, Jianshuang Cui, Can Cui, Su Xiu Xu, Quande Qin

Published in: Neural Computing and Applications | Issue 12/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Differential search (DSA) is a recently proposed evolutionary algorithm mimicking the Brownian motion-like random movement existing in living beings. Though it has displayed promise for global optimization, the original DSA suffers from relatively poor search capability, especially for exploitation. In this study, an augmented DSA (ADSA) is proposed by integrating memetic framework with multiple strategies. In ADSA, a sub-gradient strategy is combined to improve local exploitation, and the dynamic Lévy flight technique is developed to strengthen the global exploration. Moreover, a mutation operator based on differential search is used to increase swarm diversity. An intelligent selection method is implemented to adaptively adjust the strategies based on historical performance. To fully benchmark the proposed algorithm, 35 test functions of various properties in 30-D and 100-D are adopted in numerical experiments. Seven canonical optimization algorithms are involved for experimental comparison. In addition, two real-world problems are also tested to verify ADSA’s practical applicability. Numerical results reveal the efficiency and effectiveness of ADSA.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
2.
go back to reference Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the 1995 IEEE international conference on neural networks. Piscataway, New Jersey, USA, pp 1942–1948 Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the 1995 IEEE international conference on neural networks. Piscataway, New Jersey, USA, pp 1942–1948
3.
go back to reference Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: IEEE WCCI, IEEE, pp 69–73 Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: IEEE WCCI, IEEE, pp 69–73
4.
go back to reference Saha S, Das R (2018) Exploring differential evolution and particle swarm optimization to develop some symmetry-based automatic clustering techniques: application to gene clustering. Neural Comput Appl 30(3):735–757CrossRef Saha S, Das R (2018) Exploring differential evolution and particle swarm optimization to develop some symmetry-based automatic clustering techniques: application to gene clustering. Neural Comput Appl 30(3):735–757CrossRef
5.
go back to reference Dorigo M, Birattari M, Stutzle T (2006) Ant colony optimization. IEEE Comput Intell M 1(4):28–39CrossRef Dorigo M, Birattari M, Stutzle T (2006) Ant colony optimization. IEEE Comput Intell M 1(4):28–39CrossRef
6.
go back to reference Dorigo M, Stützle T (2003) The ant colony optimization metaheuristic: Algorithms, applications, and advances. Handbook of metaheuristics. Springer, Boston, pp 250–285CrossRef Dorigo M, Stützle T (2003) The ant colony optimization metaheuristic: Algorithms, applications, and advances. Handbook of metaheuristics. Springer, Boston, pp 250–285CrossRef
7.
go back to reference Karaboga D, Akay B (2009) A comparative study of Artificial Bee Colony algorithm. Appl Math Comput 214(1):108–132MathSciNetMATH Karaboga D, Akay B (2009) A comparative study of Artificial Bee Colony algorithm. Appl Math Comput 214(1):108–132MathSciNetMATH
8.
go back to reference Karaboga D, Gorkemli B, Ozturk C, Karaboga N (2014) A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artif Intell Rev 42(1):21–57CrossRef Karaboga D, Gorkemli B, Ozturk C, Karaboga N (2014) A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artif Intell Rev 42(1):21–57CrossRef
9.
go back to reference Chu X, Cai F, Cui C, Hu M, Li L, Qin Q (2018) Adaptive recommendation model using meta-learning for population-based algorithms. Inf Sci 476:192–210CrossRef Chu X, Cai F, Cui C, Hu M, Li L, Qin Q (2018) Adaptive recommendation model using meta-learning for population-based algorithms. Inf Sci 476:192–210CrossRef
10.
go back to reference Qin Q, Cheng S, Chu X, Lei X, Shi Y (2017) Solving non-convex/non-smooth economic load dispatch problems via an enhanced particle swarm optimization. Appl Soft Comput 59:229–242CrossRef Qin Q, Cheng S, Chu X, Lei X, Shi Y (2017) Solving non-convex/non-smooth economic load dispatch problems via an enhanced particle swarm optimization. Appl Soft Comput 59:229–242CrossRef
11.
go back to reference Chu X, Chen J, Cai F, Li L, Qin Q (2018) Adaptive brainstorm optimisation with multiple strategies. Memet Comput 10(4):383–396CrossRef Chu X, Chen J, Cai F, Li L, Qin Q (2018) Adaptive brainstorm optimisation with multiple strategies. Memet Comput 10(4):383–396CrossRef
13.
go back to reference Milner S, Davis C, Zhang H, Llorca J (2012) Nature-inspired self-organization, control, and optimization in heterogeneous wireless networks. IEEE Trans Mob Comput 11(7):1207–1222CrossRef Milner S, Davis C, Zhang H, Llorca J (2012) Nature-inspired self-organization, control, and optimization in heterogeneous wireless networks. IEEE Trans Mob Comput 11(7):1207–1222CrossRef
14.
go back to reference Zhang H, Cao X, Ho JK, Chow TW (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inform 13(2):520–531CrossRef Zhang H, Cao X, Ho JK, Chow TW (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inform 13(2):520–531CrossRef
15.
go back to reference Marinakis Y, Marinaki M, Migdalas A (2019) A multi-adaptive particle swarm optimization for the vehicle routing problem with time windows. Inf Sci 481:311–329CrossRef Marinakis Y, Marinaki M, Migdalas A (2019) A multi-adaptive particle swarm optimization for the vehicle routing problem with time windows. Inf Sci 481:311–329CrossRef
16.
go back to reference Wu Z, Tazvinga H, Xia XH (2015) Demand side management of photovoltaic-battery hybrid system. Appl Energy 148:294–304CrossRef Wu Z, Tazvinga H, Xia XH (2015) Demand side management of photovoltaic-battery hybrid system. Appl Energy 148:294–304CrossRef
17.
go back to reference Chaudhry R, Tapaswi S, Kumar N (2019) Fz enabled multi-objective pso for multicasting in IoT based wireless sensor networks. Inf Sci 498:1–20MathSciNetCrossRef Chaudhry R, Tapaswi S, Kumar N (2019) Fz enabled multi-objective pso for multicasting in IoT based wireless sensor networks. Inf Sci 498:1–20MathSciNetCrossRef
18.
go back to reference Łapa K (2019) Meta-optimization of multi-objective population-based algorithms using multi-objective performance metrics. Inf Sci 489:193–204MathSciNetCrossRef Łapa K (2019) Meta-optimization of multi-objective population-based algorithms using multi-objective performance metrics. Inf Sci 489:193–204MathSciNetCrossRef
19.
go back to reference Amirsadri S, Mousavirad SJ, Ebrahimpour-Komleh H (2018) A Lévy flights-based grey wolf optimizer combined with back-propagation algorithm for neural network training. Neural Comput Appl 30(12):3707–3720CrossRef Amirsadri S, Mousavirad SJ, Ebrahimpour-Komleh H (2018) A Lévy flights-based grey wolf optimizer combined with back-propagation algorithm for neural network training. Neural Comput Appl 30(12):3707–3720CrossRef
20.
go back to reference Chou JS, Ngo NT (2018) Engineering strength of fiber-reinforced soil estimated by swarm intelligence optimized regression system. Neural Comput Appl 30(7):2129–2144CrossRef Chou JS, Ngo NT (2018) Engineering strength of fiber-reinforced soil estimated by swarm intelligence optimized regression system. Neural Comput Appl 30(7):2129–2144CrossRef
21.
go back to reference Civicioglu P (2012) Transforming geocentric cartesian coordinates to geodetic coordinates by using differential search algorithm. Comput Geosci-UK 46(3):229–247CrossRef Civicioglu P (2012) Transforming geocentric cartesian coordinates to geodetic coordinates by using differential search algorithm. Comput Geosci-UK 46(3):229–247CrossRef
22.
go back to reference Abaci K, Yamacli V (2016) Differential search algorithm for solving multi-objective optimal power flow problem. Int J Electr Power 79:1–10CrossRef Abaci K, Yamacli V (2016) Differential search algorithm for solving multi-objective optimal power flow problem. Int J Electr Power 79:1–10CrossRef
23.
go back to reference Bouchekara EH, Abido MA (2014) Optimal power flow using differential search algorithm. Electr Power Compon Syst 42(15):1683–1699CrossRef Bouchekara EH, Abido MA (2014) Optimal power flow using differential search algorithm. Electr Power Compon Syst 42(15):1683–1699CrossRef
24.
go back to reference Yousoff SNM, Baharin A, Abdullah A (2017) Differential search algorithm in deep neural network for the predictive analysis of xylitol production in escherichia coli. Asian simulation conference. Springer, Singapore, pp 53–67 Yousoff SNM, Baharin A, Abdullah A (2017) Differential search algorithm in deep neural network for the predictive analysis of xylitol production in escherichia coli. Asian simulation conference. Springer, Singapore, pp 53–67
25.
go back to reference Arul R, Velusami S, Ravi G (2015) Solving combined economic emission dispatch problems using self-adaptive differential harmony search algorithm. In: International conference on circuit, power and computing technologies, IEEE, pp 757–762. Arul R, Velusami S, Ravi G (2015) Solving combined economic emission dispatch problems using self-adaptive differential harmony search algorithm. In: International conference on circuit, power and computing technologies, IEEE, pp 757–762.
26.
go back to reference RayapudiSrinivasaRao Satish K, Narasimham SVL (2011) Optimal conductor size selection in distribution systems using the harmony search algorithm with a differential operator. Electr Mach Power Syst 40(1):41–56CrossRef RayapudiSrinivasaRao Satish K, Narasimham SVL (2011) Optimal conductor size selection in distribution systems using the harmony search algorithm with a differential operator. Electr Mach Power Syst 40(1):41–56CrossRef
27.
go back to reference Sandeepdhar GD, Rout S, Badhai H, Swain M, Bhattacharya A (2015) Differential search algorithm for different economic dispatch problem. In: International conference on energy, power and environment: towards sustainable growth, IEEE, pp 1–6. Sandeepdhar GD, Rout S, Badhai H, Swain M, Bhattacharya A (2015) Differential search algorithm for different economic dispatch problem. In: International conference on energy, power and environment: towards sustainable growth, IEEE, pp 1–6.
28.
go back to reference Sulaiman MH (2013) Differential search algorithm for economic dispatch with valve-point effects, In: ICEAS, Tokyo, Toshi Center Hotel, pp 111–117 Sulaiman MH (2013) Differential search algorithm for economic dispatch with valve-point effects, In: ICEAS, Tokyo, Toshi Center Hotel, pp 111–117
29.
go back to reference Kumar V, Chhabra JK, Kumar D (2016) Data clustering using differential search algorithm. Pertan J Sci Technol 24(2):295–306 Kumar V, Chhabra JK, Kumar D (2016) Data clustering using differential search algorithm. Pertan J Sci Technol 24(2):295–306
30.
31.
go back to reference Guha D, Roy PK, Banerjee S (2016) Quasi-oppositional differential search algorithm applied to load frequency control. Eng Sci Technol Int J 19(4):1635–1654CrossRef Guha D, Roy PK, Banerjee S (2016) Quasi-oppositional differential search algorithm applied to load frequency control. Eng Sci Technol Int J 19(4):1635–1654CrossRef
32.
go back to reference Chen G-z, Wang J-q, Li R-z (2015) Parameter identification of the 2-chlorophenol oxidation model using improved differential search algorithm. J Chem-NY 2015:1–10 Chen G-z, Wang J-q, Li R-z (2015) Parameter identification of the 2-chlorophenol oxidation model using improved differential search algorithm. J Chem-NY 2015:1–10
33.
go back to reference Islam NN, Hannan MA, Shareef H, Mohamad A (2015) Bijective differential search algorithm for robust design of damping controller in multimachine power system. Appl Mech Mater 785:424–428CrossRef Islam NN, Hannan MA, Shareef H, Mohamad A (2015) Bijective differential search algorithm for robust design of damping controller in multimachine power system. Appl Mech Mater 785:424–428CrossRef
34.
go back to reference Kumar V, Chhabra JK, Kumar D (2015) Differential search algorithm for multiobjective problems. Procedia Comput Sci 48:22–28CrossRef Kumar V, Chhabra JK, Kumar D (2015) Differential search algorithm for multiobjective problems. Procedia Comput Sci 48:22–28CrossRef
35.
go back to reference Liu J, Wu C, Cao J, Wang X, Teo KL (2016) A binary differential search algorithm for the 0–1 multidimensional knapsack problem. Appl Math Model 40(23–24):9788–9805MathSciNetCrossRefMATH Liu J, Wu C, Cao J, Wang X, Teo KL (2016) A binary differential search algorithm for the 0–1 multidimensional knapsack problem. Appl Math Model 40(23–24):9788–9805MathSciNetCrossRefMATH
36.
go back to reference Faria P, Soares J, Vale Z (2015) Definition of the demand response events duration using differential search algorithm for aggregated consumption shifting and generation scheduling. In: ISAP, IEEE, pp 1–7 Faria P, Soares J, Vale Z (2015) Definition of the demand response events duration using differential search algorithm for aggregated consumption shifting and generation scheduling. In: ISAP, IEEE, pp 1–7
37.
go back to reference Yang XS (2010) Firefly algorithm, Levy flights and global optimization. In: Research and development in intelligent systems XXVI, Springer, pp 209–218 Yang XS (2010) Firefly algorithm, Levy flights and global optimization. In: Research and development in intelligent systems XXVI, Springer, pp 209–218
38.
go back to reference Boyd S, Mutapcic A (2003) Subgradient methods. In: Lecture notes of EE392o, Stanford University, Autumn Quarter, pp 1–21 Boyd S, Mutapcic A (2003) Subgradient methods. In: Lecture notes of EE392o, Stanford University, Autumn Quarter, pp 1–21
39.
go back to reference Trianni V, Tuci E, Passino KM, Marshall JAR (2011) Swarm Cognition: an interdisciplinary approach to the study of self-organising biological collectives. Swarm Intell 5(1):3–18CrossRef Trianni V, Tuci E, Passino KM, Marshall JAR (2011) Swarm Cognition: an interdisciplinary approach to the study of self-organising biological collectives. Swarm Intell 5(1):3–18CrossRef
40.
go back to reference Vagelis P, Manolis P (2011) A hybrid particle swarm - gradient algorithm for global structural optimization. Comput-Aided Civ Inf 26(1):48–68 Vagelis P, Manolis P (2011) A hybrid particle swarm - gradient algorithm for global structural optimization. Comput-Aided Civ Inf 26(1):48–68
41.
go back to reference Spall JC (1992) Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE T Autom Control 37(3):332–341MathSciNetMATHCrossRef Spall JC (1992) Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE T Autom Control 37(3):332–341MathSciNetMATHCrossRef
42.
go back to reference Yang XS (2010) Nature-inspired metaheuristic algorithms. Luniver Press Yang XS (2010) Nature-inspired metaheuristic algorithms. Luniver Press
43.
go back to reference Sharma H, Bansal JC, Arya KV, Yang XS (2016) Lévy flight artificial bee colony algorithm. Int J Syst Sci 47(2016):4750–4756MATH Sharma H, Bansal JC, Arya KV, Yang XS (2016) Lévy flight artificial bee colony algorithm. Int J Syst Sci 47(2016):4750–4756MATH
44.
go back to reference Hu M, Wu T, Weir JD (2012) An intelligent augmentation of particle swarm optimization with multiple adaptive methods. Inf Sci 213:68–83CrossRef Hu M, Wu T, Weir JD (2012) An intelligent augmentation of particle swarm optimization with multiple adaptive methods. Inf Sci 213:68–83CrossRef
45.
go back to reference Chu X, Hu M, Wu T, Weir JD, Lu Q (2014) AHPS2: an optimizer using adaptive heterogeneous particle swarms. Inf Sci 280:26–52CrossRef Chu X, Hu M, Wu T, Weir JD, Lu Q (2014) AHPS2: an optimizer using adaptive heterogeneous particle swarms. Inf Sci 280:26–52CrossRef
46.
go back to reference Liang JJ, Qin AK, Suganthan PN, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE T Evol Comput 10(3):281–295CrossRef Liang JJ, Qin AK, Suganthan PN, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE T Evol Comput 10(3):281–295CrossRef
47.
go back to reference Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39(3):459–471MathSciNetMATHCrossRef Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39(3):459–471MathSciNetMATHCrossRef
48.
go back to reference Yang XS, Deb S (2009) Cuckoo search via Lévy flights. In: NaBIC 2009, IEEE, pp 210–214 Yang XS, Deb S (2009) Cuckoo search via Lévy flights. In: NaBIC 2009, IEEE, pp 210–214
49.
go back to reference Tang R, Fong S, Yang XS, Deb S (2012) Wolf search algorithm with ephemeral memory. In: ICDIM 2012, IEEE, pp 165–172 Tang R, Fong S, Yang XS, Deb S (2012) Wolf search algorithm with ephemeral memory. In: ICDIM 2012, IEEE, pp 165–172
50.
go back to reference Yang XS (2010) Firefly algorithm, stochastic test functions and design optimisation. Int J Bio-Inspir Com 2(2):78–84CrossRef Yang XS (2010) Firefly algorithm, stochastic test functions and design optimisation. Int J Bio-Inspir Com 2(2):78–84CrossRef
51.
go back to reference Das S, Suganthan PN (2011) Problem definitions and evaluation criteria for CEC 2011 competition on testing evolutionary algorithms on real world optimization problems. In: Jadavpur University, Nanyang Technological University, Kolkata, pp 341–359 Das S, Suganthan PN (2011) Problem definitions and evaluation criteria for CEC 2011 competition on testing evolutionary algorithms on real world optimization problems. In: Jadavpur University, Nanyang Technological University, Kolkata, pp 341–359
52.
go back to reference Bai X, Tao R, Wang Z, Wang Y (2013) ISAR imaging of a ship target based on parameter estimation of multicomponent quadratic frequency-modulated signals. IEEE Trans Geosci Remote Sens 52(2):1418–1429CrossRef Bai X, Tao R, Wang Z, Wang Y (2013) ISAR imaging of a ship target based on parameter estimation of multicomponent quadratic frequency-modulated signals. IEEE Trans Geosci Remote Sens 52(2):1418–1429CrossRef
53.
go back to reference Moloi NP, Ali MM (2005) An iterative global optimization algorithm for potential energy minimization. Comput Optim Appl 30(2):119–132MathSciNetMATHCrossRef Moloi NP, Ali MM (2005) An iterative global optimization algorithm for potential energy minimization. Comput Optim Appl 30(2):119–132MathSciNetMATHCrossRef
54.
go back to reference Liang JJ, Qu BY, Suganthan PN (2014) Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. In: Computational intelligence laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore, p 635 Liang JJ, Qu BY, Suganthan PN (2014) Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. In: Computational intelligence laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore, p 635
Metadata
Title
Adaptive differential search algorithm with multi-strategies for global optimization problems
Authors
Xianghua Chu
Da Gao
Jiansheng Chen
Jianshuang Cui
Can Cui
Su Xiu Xu
Quande Qin
Publication date
22-10-2019
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 12/2019
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04538-6

Other articles of this Issue 12/2019

Neural Computing and Applications 12/2019 Go to the issue

Machine Learning - Applications & Techniques in Cyber Intelligence

A non-intrusive load decomposition algorithm for residents

Premium Partner