Skip to main content
Erschienen in: Memetic Computing 1/2016

01.03.2016 | Regular Research Paper

Differential evolution framework for big data optimization

verfasst von: Saber Elsayed, Ruhul Sarker

Erschienen in: Memetic Computing | Ausgabe 1/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

During the last two decades, dealing with big data problems has become a major issue for many industries. Although, in recent years, differential evolution has been successful in solving many complex optimization problems, there has been research gaps on using it to solve big data problems. As a real-time big data problem may not be known in advance, determining the appropriate differential evolution operators and parameters to use is a combinatorial optimization problem. Therefore, in this paper, a general differential evolution framework is proposed, in which the most suitable differential evolution algorithm for a problem on hand is adaptively configured. A local search is also employed to increase the exploitation capability of the proposed algorithm. The algorithm is tested on the 2015 big data optimization competition problems (six single objective problems and six multi-objective problems). The results show the superiority of the proposed algorithm to several state-of-the-art algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The code is available upon request.
 
Literatur
1.
Zurück zum Zitat Brest J, Greiner S, Boskovic B, Mernik M, Zumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evolut Comput 10(6):646–657CrossRef Brest J, Greiner S, Boskovic B, Mernik M, Zumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evolut Comput 10(6):646–657CrossRef
2.
Zurück zum Zitat Caraffini F, Neri F, Cheng J, Zhang G, Picinali L, Iacca G, Mininno E (2013) Super-fit multicriteria adaptive differential evolution. In: 2013 IEEE congress on evolutionary computation (CEC), pp 1678–1685. doi:10.1109/CEC.2013.6557763 Caraffini F, Neri F, Cheng J, Zhang G, Picinali L, Iacca G, Mininno E (2013) Super-fit multicriteria adaptive differential evolution. In: 2013 IEEE congress on evolutionary computation (CEC), pp 1678–1685. doi:10.​1109/​CEC.​2013.​6557763
3.
Zurück zum Zitat Choi TJ, Ahn CW (2015) An adaptive cauchy differential evolution algorithm with population size reduction and modified multiple mutation strategies. In: Proceedings of the 18th Asia Pacific symposium on intelligent and evolutionary systems, vol 2. Springer, pp 13–26 Choi TJ, Ahn CW (2015) An adaptive cauchy differential evolution algorithm with population size reduction and modified multiple mutation strategies. In: Proceedings of the 18th Asia Pacific symposium on intelligent and evolutionary systems, vol 2. Springer, pp 13–26
4.
Zurück zum Zitat Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans Evolut Comput 6(2):182–197CrossRef Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans Evolut Comput 6(2):182–197CrossRef
5.
Zurück zum Zitat Eiben AE, Smith JE (2003) Introduction to evolutionary computing. In: Natural computing series, Springer, Berlin Eiben AE, Smith JE (2003) Introduction to evolutionary computing. In: Natural computing series, Springer, Berlin
6.
Zurück zum Zitat Elsayed SM, Sarker RA, Essam DL (2011) Multi-operator based evolutionary algorithms for solving constrained optimization problems. Comput Oper Res 38(12):1877–1896CrossRefMathSciNetMATH Elsayed SM, Sarker RA, Essam DL (2011) Multi-operator based evolutionary algorithms for solving constrained optimization problems. Comput Oper Res 38(12):1877–1896CrossRefMathSciNetMATH
8.
Zurück zum Zitat Elsayed SM, Sarker RA, Essam DL (2013b) Self-adaptive differential evolution incorporating a heuristic mixing of operators. Comput Optim Appl 54(3):771–790CrossRefMathSciNetMATH Elsayed SM, Sarker RA, Essam DL (2013b) Self-adaptive differential evolution incorporating a heuristic mixing of operators. Comput Optim Appl 54(3):771–790CrossRefMathSciNetMATH
9.
Zurück zum Zitat Elsayed SM, Sarker RA, Essam DL, Hamza NM (2014) Testing united multi-operator evolutionary algorithms on the cec2014 real-parameter numerical optimization. In: IEEE congress on evolutionary computation, pp 1650–1657 Elsayed SM, Sarker RA, Essam DL, Hamza NM (2014) Testing united multi-operator evolutionary algorithms on the cec2014 real-parameter numerical optimization. In: IEEE congress on evolutionary computation, pp 1650–1657
11.
14.
Zurück zum Zitat Madden S (2012) From databases to big data. IEEE Internet Comput 16(3):4–6CrossRef Madden S (2012) From databases to big data. IEEE Internet Comput 16(3):4–6CrossRef
15.
Zurück zum Zitat Mallipeddi R, Suganthan PN, Pan QK, Tasgetiren MF (2011) Differential evolution algorithm with ensemble of parameters and mutation strategies. Appl Soft Comput 11(2):1679–1696CrossRef Mallipeddi R, Suganthan PN, Pan QK, Tasgetiren MF (2011) Differential evolution algorithm with ensemble of parameters and mutation strategies. Appl Soft Comput 11(2):1679–1696CrossRef
19.
Zurück zum Zitat Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evolut Comput 13(2):398–417CrossRef Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evolut Comput 13(2):398–417CrossRef
20.
Zurück zum Zitat Qingfu Z, Hui L (2007) Moea/d: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evolut Comput 11(6):712–731CrossRef Qingfu Z, Hui L (2007) Moea/d: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evolut Comput 11(6):712–731CrossRef
21.
Zurück zum Zitat Qingfu Z, Wudong L, Hui L (2009) The performance of a new version of moea/d on cec09 unconstrained mop test instances. In: IEEE congress on evolutionary computation, pp 203–208 Qingfu Z, Wudong L, Hui L (2009) The performance of a new version of moea/d on cec09 unconstrained mop test instances. In: IEEE congress on evolutionary computation, pp 203–208
22.
Zurück zum Zitat Qiu X, Xu J, Tan K, Abbass H (2015) Adaptive cross-generation differential evolution operators for multi-objective optimization. Evolut Comput IEEE Trans PP(99):1. doi:10.1109/TEVC.2015.2433672 Qiu X, Xu J, Tan K, Abbass H (2015) Adaptive cross-generation differential evolution operators for multi-objective optimization. Evolut Comput IEEE Trans PP(99):1. doi:10.​1109/​TEVC.​2015.​2433672
23.
Zurück zum Zitat Sagiroglu S, Sinanc D (2013) Big data: a review. In: 2013 international conference on collaboration technologies and systems (CTS). IEEE, pp 42–47 Sagiroglu S, Sinanc D (2013) Big data: a review. In: 2013 international conference on collaboration technologies and systems (CTS). IEEE, pp 42–47
24.
Zurück zum Zitat Sarker R, Kamruzzaman J, Newton C (2003) Evolutionary optimization (evopt): a brief review and analysis. Int J Comput Intell Appl 3(4):311–330CrossRef Sarker R, Kamruzzaman J, Newton C (2003) Evolutionary optimization (evopt): a brief review and analysis. Int J Comput Intell Appl 3(4):311–330CrossRef
25.
Zurück zum Zitat Slavakis K, Giannakis G, Mateos G (2014) Modeling and optimization for big data analytics: (statistical) learning tools for our era of data deluge. IEEE Signal Process Mag 31(5):18–31CrossRef Slavakis K, Giannakis G, Mateos G (2014) Modeling and optimization for big data analytics: (statistical) learning tools for our era of data deluge. IEEE Signal Process Mag 31(5):18–31CrossRef
26.
Zurück zum Zitat Storn R (1996) On the usage of differential evolution for function optimization. In: Biennial conference of the North American Fuzzy Information Processing Society (NAFIPS), pp 519–523 Storn R (1996) On the usage of differential evolution for function optimization. In: Biennial conference of the North American Fuzzy Information Processing Society (NAFIPS), pp 519–523
27.
Zurück zum Zitat Storn R, Price K (1995) Differential evolution—a simple and efficient adaptive scheme for global optimization over continuous spaces. Technical report Storn R, Price K (1995) Differential evolution—a simple and efficient adaptive scheme for global optimization over continuous spaces. Technical report
28.
Zurück zum Zitat Tanabe R, Fukunaga A (2013a) Evaluating the performance of shade on cec 2013 benchmark problems. In: IEEE congress on evolutionary computation, pp 1952–1959. doi:10.1109/CEC.2013.6557798 Tanabe R, Fukunaga A (2013a) Evaluating the performance of shade on cec 2013 benchmark problems. In: IEEE congress on evolutionary computation, pp 1952–1959. doi:10.​1109/​CEC.​2013.​6557798
29.
Zurück zum Zitat Tanabe R, Fukunaga A (2013b) Success-history based parameter adaptation for differential evolution. In: IEEE congress on evolutionary computation, pp 71–78. doi:10.1109/CEC.2013.6557555 Tanabe R, Fukunaga A (2013b) Success-history based parameter adaptation for differential evolution. In: IEEE congress on evolutionary computation, pp 71–78. doi:10.​1109/​CEC.​2013.​6557555
31.
Zurück zum Zitat Tvrdík J, Polakova R (2010) Competitive differential evolution for constrained problems. In: IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8 Tvrdík J, Polakova R (2010) Competitive differential evolution for constrained problems. In: IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8
32.
Zurück zum Zitat Tvrdík J, Polakova R (2013) Competitive differential evolution applied to cec 2013 problems. In: IEEE congress on evolutionary computation (CEC). IEEE, pp 1651–1657 Tvrdík J, Polakova R (2013) Competitive differential evolution applied to cec 2013 problems. In: IEEE congress on evolutionary computation (CEC). IEEE, pp 1651–1657
33.
Zurück zum Zitat Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evolut Comput 15(1):55–66CrossRefMathSciNet Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evolut Comput 15(1):55–66CrossRefMathSciNet
34.
Zurück zum Zitat Yang Z, Tang K, Yao X (2011) Scalability of generalized adaptive differential evolution for large-scale continuous optimization. Soft Comput 15(11):2141–2155CrossRef Yang Z, Tang K, Yao X (2011) Scalability of generalized adaptive differential evolution for large-scale continuous optimization. Soft Comput 15(11):2141–2155CrossRef
35.
Zurück zum Zitat Zamuda A, Brest J (2012) Population reduction differential evolution with multiple mutation strategies in real world industry challenges. In: Rutkowski L, Korytkowski M, Scherer R, Tadeusiewicz R, Zadeh L, Zurada J (eds) Swarm and evolutionary computation. Lecture Notes in Computer Science. Springer, Berlin, Heidelberg, pp 154–161 Zamuda A, Brest J (2012) Population reduction differential evolution with multiple mutation strategies in real world industry challenges. In: Rutkowski L, Korytkowski M, Scherer R, Tadeusiewicz R, Zadeh L, Zurada J (eds) Swarm and evolutionary computation. Lecture Notes in Computer Science. Springer, Berlin, Heidelberg, pp 154–161
36.
Zurück zum Zitat Zhang J, Sanderson AC (2009) Jade: adaptive differential evolution with optional external archive. IEEE Trans Evolut Comput 13(5):945–958CrossRef Zhang J, Sanderson AC (2009) Jade: adaptive differential evolution with optional external archive. IEEE Trans Evolut Comput 13(5):945–958CrossRef
37.
Zurück zum Zitat Zhang Y, Zhou M, Jiang Z, Liu J (2015) A multi-agent genetic algorithm for big optimization problems. In: IEEE congress on evolutionary computation, pp 703–707. doi:10.1109/CEC.2015.7256959 Zhang Y, Zhou M, Jiang Z, Liu J (2015) A multi-agent genetic algorithm for big optimization problems. In: IEEE congress on evolutionary computation, pp 703–707. doi:10.​1109/​CEC.​2015.​7256959
38.
Zurück zum Zitat Zhi-Hua Z, Chawla NV, Yaochu J, Williams GJ (2014) Big data opportunities and challenges: discussions from data analytics perspectives [discussion forum]. IEEE Comput Intell Mag 9(4):62–74CrossRef Zhi-Hua Z, Chawla NV, Yaochu J, Williams GJ (2014) Big data opportunities and challenges: discussions from data analytics perspectives [discussion forum]. IEEE Comput Intell Mag 9(4):62–74CrossRef
Metadaten
Titel
Differential evolution framework for big data optimization
verfasst von
Saber Elsayed
Ruhul Sarker
Publikationsdatum
01.03.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Memetic Computing / Ausgabe 1/2016
Print ISSN: 1865-9284
Elektronische ISSN: 1865-9292
DOI
https://doi.org/10.1007/s12293-015-0174-x

Weitere Artikel der Ausgabe 1/2016

Memetic Computing 1/2016 Zur Ausgabe

Editorial

Editorial