Skip to main content
Erschienen in: Memetic Computing 4/2012

01.12.2012 | Regular Research Paper

Information sharing impact of stochastic diffusion search on differential evolution algorithm

verfasst von: Mohammad Majid al-Rifaie, John Mark Bishop, Tim Blackwell

Erschienen in: Memetic Computing | Ausgabe 4/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This work details the research aimed at applying the powerful resource allocation mechanism deployed in stochastic diffusion search (SDS) to the differential evolution (DE), effectively merging a nature inspired swarm intelligence algorithm with a biologically inspired evolutionary algorithm. The results reported herein suggest that the hybrid algorithm, exploiting information sharing between the population elements, has the potential to improve the optimisation capability of classical DE algorithms. This claim is verified by running several experiments using state-of-the-art benchmarks. Additionally, the significance of the frequency within which SDS introduces communication and information exchange is also investigated.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The ‘information diffusion’ and ‘randomised partial objective function evaluation’ processes enable SDS to more efficiently optimise problems with costly [discrete] objective functions; see stochastic diffusion search section for an introduction to the SDS metaheuristic.
 
2
Test Phase: decides about the status of each SDEAgent, one after another; Diffusion Phase: shares information according to the algorithm presented.
 
3
Hybrid Composition Functions are not used in this work.
 
4
Some of the artistic applications of merging SDS with PSO (falling into the category of generative art) are reported in [1, 2, 4, 5, 8].
 
Literatur
2.
Zurück zum Zitat al-Rifaie MM, Aber A, Bishop M (2012) Cooperation of nature and physiologically inspired mechanisms in visualisation. In: Ursyn A (ed) Biologically-inspired computing for the arts: scientific data through graphics. IGI Global, United States. ISBN13: 9781466609426, ISBN10: 1466609427 al-Rifaie MM, Aber A, Bishop M (2012) Cooperation of nature and physiologically inspired mechanisms in visualisation. In: Ursyn A (ed) Biologically-inspired computing for the arts: scientific data through graphics. IGI Global, United States. ISBN13: 9781466609426, ISBN10: 1466609427
3.
Zurück zum Zitat al-Rifaie MM, Bishop M (2010) The mining game: a brief introduction to the stochastic diffusion search metaheuristic. The Society for the Study of Artificial Intelligence and the Simulation of Behaviour Quarterly (AISBQ) 130 al-Rifaie MM, Bishop M (2010) The mining game: a brief introduction to the stochastic diffusion search metaheuristic. The Society for the Study of Artificial Intelligence and the Simulation of Behaviour Quarterly (AISBQ) 130
4.
Zurück zum Zitat al-Rifaie MM, Bishop M (2012) Weak vs. strong computational creativity. In: AISB 2012: computing and philosophy. University of Birmingham, Birmingham al-Rifaie MM, Bishop M (2012) Weak vs. strong computational creativity. In: AISB 2012: computing and philosophy. University of Birmingham, Birmingham
5.
Zurück zum Zitat al-Rifaie MM, Bishop M, Aber A (2011) Creative or not? Birds and ants draw with muscles. In: AISB 2011: computing and philosophy. University of York, York, pp 23–30. ISBN: 978-1-908187-03-1 al-Rifaie MM, Bishop M, Aber A (2011) Creative or not? Birds and ants draw with muscles. In: AISB 2011: computing and philosophy. University of York, York, pp 23–30. ISBN: 978-1-908187-03-1
6.
Zurück zum Zitat al-Rifaie MM, Bishop M, Blackwell T (2011) An investigation into the merger of stochastic diffusion search and particle swarm optimisation. In: GECCO ’11: Proceedings of the 2011 GECCO conference companion on Genetic and evolutionary computation. ACM, Dublin, pp 37–44 al-Rifaie MM, Bishop M, Blackwell T (2011) An investigation into the merger of stochastic diffusion search and particle swarm optimisation. In: GECCO ’11: Proceedings of the 2011 GECCO conference companion on Genetic and evolutionary computation. ACM, Dublin, pp 37–44
7.
Zurück zum Zitat al-Rifaie MM, Bishop M, Blackwell T (2011) Resource allocation and dispensation impact of stochastic diffusion search on differential evolution algorithm. In: Nature inspired cooperative strategies for optimisation (NICSO 2011). Springer, Berlin al-Rifaie MM, Bishop M, Blackwell T (2011) Resource allocation and dispensation impact of stochastic diffusion search on differential evolution algorithm. In: Nature inspired cooperative strategies for optimisation (NICSO 2011). Springer, Berlin
8.
Zurück zum Zitat al-Rifaie MM, Bishop M, Caines S (2012) Creativity and autonomy in swarm intelligence systems. In: Bishop M, Erden Y (eds) Cognitive computation: computational creativity, intelligence and autonomy. Springer, Berlin. doi:10.1007/s12559-012-9130-y al-Rifaie MM, Bishop M, Caines S (2012) Creativity and autonomy in swarm intelligence systems. In: Bishop M, Erden Y (eds) Cognitive computation: computational creativity, intelligence and autonomy. Springer, Berlin. doi:10.​1007/​s12559-012-9130-y
9.
Zurück zum Zitat el Beltagy MA, Keane AJ (2001) Evolutionary optimization for computationally expensive problems using gaussian processes. In: Proceedings of international conference on artificial intelligence’01. CSREA Press, pp 708–714 el Beltagy MA, Keane AJ (2001) Evolutionary optimization for computationally expensive problems using gaussian processes. In: Proceedings of international conference on artificial intelligence’01. CSREA Press, pp 708–714
10.
Zurück zum Zitat Bishop J (1989) Stochastic searching networks. In: Proceedings of 1st IEE conference on artificial neural networks, London, pp 329–331 Bishop J (1989) Stochastic searching networks. In: Proceedings of 1st IEE conference on artificial neural networks, London, pp 329–331
11.
Zurück zum Zitat Bonabeau E, Dorigo M, Theraulaz G (2000) Inspiration for optimization from social insect behaviour. Nature 406:3942CrossRef Bonabeau E, Dorigo M, Theraulaz G (2000) Inspiration for optimization from social insect behaviour. Nature 406:3942CrossRef
12.
Zurück zum Zitat Branke J, Schmidt C, Schmeck H (2001) Efficient fitness estimation in noisy environments. In Spector L (ed) Genetic and evolutionary computation conference. Morgan Kaufmann Branke J, Schmidt C, Schmeck H (2001) Efficient fitness estimation in noisy environments. In Spector L (ed) Genetic and evolutionary computation conference. Morgan Kaufmann
13.
Zurück zum Zitat Brest J, Zamuda A, Boskovic B, Maucec M, Zumer V (2009) Dynamic optimization using self-adaptive differential evolution. In: IEEE congress on evolutionary computation, 2009. CEC’09. IEEE, pp 415–422 Brest J, Zamuda A, Boskovic B, Maucec M, Zumer V (2009) Dynamic optimization using self-adaptive differential evolution. In: IEEE congress on evolutionary computation, 2009. CEC’09. IEEE, pp 415–422
14.
Zurück zum Zitat Digalakis J, Margaritis K (2002) An experimental study of benchmarking functions for evolutionary algorithms. Int J Comput Math 79:403–416MathSciNetMATHCrossRef Digalakis J, Margaritis K (2002) An experimental study of benchmarking functions for evolutionary algorithms. Int J Comput Math 79:403–416MathSciNetMATHCrossRef
15.
Zurück zum Zitat Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning. Addison-Wesley, BostonMATH Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning. Addison-Wesley, BostonMATH
16.
Zurück zum Zitat Holldobler B, Wilson EO (1990) The ants. Springer, Berlin Holldobler B, Wilson EO (1990) The ants. Springer, Berlin
17.
Zurück zum Zitat Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft Comput 9:3–12CrossRef Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft Comput 9:3–12CrossRef
18.
Zurück zum Zitat Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, vol IV. IEEE Service Center, Piscataway, pp 1942–1948 Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, vol IV. IEEE Service Center, Piscataway, pp 1942–1948
19.
Zurück zum Zitat Kennedy JF, Eberhart RC, Shi Y (2001) Swarm intelligence. Morgan Kaufmann, San Francisco Kennedy JF, Eberhart RC, Shi Y (2001) Swarm intelligence. Morgan Kaufmann, San Francisco
20.
Zurück zum Zitat Kozlov K, Samsonov A (2006) New migration scheme for parallel differential evolution. In: Proceedings of the international conference on bioinformatics of genome regulation and structure, pp 141–144 Kozlov K, Samsonov A (2006) New migration scheme for parallel differential evolution. In: Proceedings of the international conference on bioinformatics of genome regulation and structure, pp 141–144
21.
Zurück zum Zitat Mendes R, Mohais A (2005) DynDE: a differential evolution for dynamic optimization problems. In: The 2005 IEEE congress on evolutionary computation CEC2005, vol 3. IEEE, pp 2808–2815 Mendes R, Mohais A (2005) DynDE: a differential evolution for dynamic optimization problems. In: The 2005 IEEE congress on evolutionary computation CEC2005, vol 3. IEEE, pp 2808–2815
22.
Zurück zum Zitat de Meyer K (2000) Explorations in stochastic diffusion search: Soft- and hardware implementations of biologically inspired spiking neuron stochastic diffusion networks. Technical report, KDM/JMB/2000/1, University of Reading de Meyer K (2000) Explorations in stochastic diffusion search: Soft- and hardware implementations of biologically inspired spiking neuron stochastic diffusion networks. Technical report, KDM/JMB/2000/1, University of Reading
23.
Zurück zum Zitat de Meyer K, Bishop JM, Nasuto SJ (2003) Stochastic diffusion: using recruitment for search. In: McOwan P, Dautenhahn K, Nehaniv CL (eds) Evolvability and interaction: evolutionary substrates of communication, signalling, and perception in the dynamics of social complexity. Technical report 393, pp 60–65 de Meyer K, Bishop JM, Nasuto SJ (2003) Stochastic diffusion: using recruitment for search. In: McOwan P, Dautenhahn K, Nehaniv CL (eds) Evolvability and interaction: evolutionary substrates of communication, signalling, and perception in the dynamics of social complexity. Technical report 393, pp 60–65
24.
Zurück zum Zitat Miller R (1981) Simultaneous statistical inference. Springer, New York Miller R (1981) Simultaneous statistical inference. Springer, New York
25.
Zurück zum Zitat Moglich M, Maschwitz U, Holldobler B (1974) Tandem calling: a new kind of signal in ant communication. Science 186(4168):1046–1047CrossRef Moglich M, Maschwitz U, Holldobler B (1974) Tandem calling: a new kind of signal in ant communication. Science 186(4168):1046–1047CrossRef
26.
Zurück zum Zitat Myatt DR, Bishop JM, Nasuto SJ (2004) Minimum stable convergence criteria for stochastic diffusion search. Electron Lett 40(2):112–113CrossRef Myatt DR, Bishop JM, Nasuto SJ (2004) Minimum stable convergence criteria for stochastic diffusion search. Electron Lett 40(2):112–113CrossRef
27.
Zurück zum Zitat Nasuto SJ (1999) Resource allocation analysis of the stochastic diffusion search. PhD thesis, University of Reading, Reading Nasuto SJ (1999) Resource allocation analysis of the stochastic diffusion search. PhD thesis, University of Reading, Reading
28.
Zurück zum Zitat Nasuto SJ, Bishop JM (1999) Convergence analysis of stochastic diffusion search. Parallel Algorithms Appl 14(2):89–107 Nasuto SJ, Bishop JM (1999) Convergence analysis of stochastic diffusion search. Parallel Algorithms Appl 14(2):89–107
29.
Zurück zum Zitat Nasuto SJ, Bishop JM, Lauria S (1998) Time complexity of stochastic diffusion search. Neural Computation NC98 Nasuto SJ, Bishop JM, Lauria S (1998) Time complexity of stochastic diffusion search. Neural Computation NC98
30.
Zurück zum Zitat Nasuto SJ, Bishop MJ (2002) Steady state resource allocation analysis of the stochastic diffusion search. Arxiv, preprint cs/0202007 Nasuto SJ, Bishop MJ (2002) Steady state resource allocation analysis of the stochastic diffusion search. Arxiv, preprint cs/0202007
31.
Zurück zum Zitat Smuc T (2002) Improving convergence properties of the differential evolution algorithm. In: Proceedings of the MENDEL 2002—8th international conference on soft computing, pp 80–86 Smuc T (2002) Improving convergence properties of the differential evolution algorithm. In: Proceedings of the MENDEL 2002—8th international conference on soft computing, pp 80–86
32.
Zurück zum Zitat Stoean C, Preuss M, Stoean R, Dumitrescu D (2010) Multimodal optimization by means of a topological species conservation algorithm. IEEE Trans Evol Comput 14(6):842–864CrossRef Stoean C, Preuss M, Stoean R, Dumitrescu D (2010) Multimodal optimization by means of a topological species conservation algorithm. IEEE Trans Evol Comput 14(6):842–864CrossRef
34.
Zurück zum Zitat Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11:341–359 Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11:341–359
35.
Zurück zum Zitat Suganthan PN, Hansen N, Liang JJ, Deb K, Chen YP, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. Technical report, Nanyang Technological University, Singapore and Kanpur Genetic Algorithms Laboratory, IIT Kanpur Suganthan PN, Hansen N, Liang JJ, Deb K, Chen YP, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. Technical report, Nanyang Technological University, Singapore and Kanpur Genetic Algorithms Laboratory, IIT Kanpur
36.
Zurück zum Zitat Tasgetiren M, Suganthan P (2006) A multi-populated differential evolution algorithm for solving constrained optimization problem. In: IEEE congress on evolutionary computation CEC2006. IEEE, pp 33–40 Tasgetiren M, Suganthan P (2006) A multi-populated differential evolution algorithm for solving constrained optimization problem. In: IEEE congress on evolutionary computation CEC2006. IEEE, pp 33–40
37.
Zurück zum Zitat Thomsen R (2004) Multimodal optimization using crowding-based differential evolution. In: Congress on evolutionary computation, 2004 (CEC2004), vol 2. IEEE, pp 1382–1389 Thomsen R (2004) Multimodal optimization using crowding-based differential evolution. In: Congress on evolutionary computation, 2004 (CEC2004), vol 2. IEEE, pp 1382–1389
38.
Zurück zum Zitat Weber M, Neri F, Tirronen V (2010) Parallel random injection differential evolution. Applications of evolutionary computation, pp 471–480 Weber M, Neri F, Tirronen V (2010) Parallel random injection differential evolution. Applications of evolutionary computation, pp 471–480
39.
Zurück zum Zitat Whitaker R, Hurley S (2002) An agent based approach to site selection for wireless networks. In: 1st IEE conference on artificial neural networks. Proceedings of ACM symposium on applied computing, Madrid Spain. ACM Press Whitaker R, Hurley S (2002) An agent based approach to site selection for wireless networks. In: 1st IEE conference on artificial neural networks. Proceedings of ACM symposium on applied computing, Madrid Spain. ACM Press
40.
Zurück zum Zitat Whitley D, Rana S, Dzubera J, Mathias KE (1996) Evaluating evolutionary algorithms. Artif Intell 85(1–2):245–276 Whitley D, Rana S, Dzubera J, Mathias KE (1996) Evaluating evolutionary algorithms. Artif Intell 85(1–2):245–276
41.
Zurück zum Zitat Zaharie D (2003) Control of population diversity and adaptation in differential evolution algorithms. In: Proceedings of the MENDEL 2003—9th international conference on soft computing, pp 41–46 Zaharie D (2003) Control of population diversity and adaptation in differential evolution algorithms. In: Proceedings of the MENDEL 2003—9th international conference on soft computing, pp 41–46
42.
Zurück zum Zitat Zhang J, Sanderson A (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958CrossRef Zhang J, Sanderson A (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958CrossRef
Metadaten
Titel
Information sharing impact of stochastic diffusion search on differential evolution algorithm
verfasst von
Mohammad Majid al-Rifaie
John Mark Bishop
Tim Blackwell
Publikationsdatum
01.12.2012
Verlag
Springer-Verlag
Erschienen in
Memetic Computing / Ausgabe 4/2012
Print ISSN: 1865-9284
Elektronische ISSN: 1865-9292
DOI
https://doi.org/10.1007/s12293-012-0094-y

Weitere Artikel der Ausgabe 4/2012

Memetic Computing 4/2012 Zur Ausgabe

Premium Partner