Skip to main content
Top
Published in: Memetic Computing 4/2020

26-10-2020 | Regular Research Paper

Evolution of biocoenosis through symbiosis with fitness approximation for many-tasking optimization

Authors: Rung-Tzuo Liaw, Chuan-Kang Ting

Published in: Memetic Computing | Issue 4/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Memetic computing is a blooming research area, which treats memes as the fundamental building blocks of information transfer. Evolutionary multitasking is an emerging topic in memetic computation, which applies evolutionary algorithm to optimize multiple tasks at a time. A famous class of algorithms for evolutionary multitasking is the multi-factorial evolutionary algorithm (MFEA). Nevertheless, current MFEAs only consider problems with small number of tasks, resulting in a lack of effective information transfer strategy. This study proposes a framework for evolutionary multitasking, called the evolution of biocoenosis through symbiosis with fitness approximation (EBSFA). The EBSFA incorporates evolution of biocoenosis through symbiosis (EBS) with fitness approximation to ameliorate the information transfer. The improvement of EBSFA is three-fold, including (1) the adaptive control of information transfer among tasks, (2) the selection of individuals from the universal offspring pool for evaluation based on fitness approximation, and (3) an ensemble method for improving the accuracy of fitness approximation through k nearest neighbors. Experimental analysis verifies the effectiveness and efficiency of the proposed EBSFA, by comparison with an advanced single-tasking method, the covariance matrix adaptation evolution strategy (CMAES), an illustrious multitasking optimization method, the MFEA-II, and an evolutionary many-tasking method, the EBS on a set of many-tasking benchmark problems. The results show that EBSFA can gain nice solution quality and fast convergence speed. Further analysis validates the effectiveness of the proposed components on improving the information transfer.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bali KK, Ong YS, Gupta A, Tan PS (2019) Multifactorial evolutionary algorithm with online transfer parameter estimation: MFEA-II. IEEE Trans Evol Comput 24(1):69–83CrossRef Bali KK, Ong YS, Gupta A, Tan PS (2019) Multifactorial evolutionary algorithm with online transfer parameter estimation: MFEA-II. IEEE Trans Evol Comput 24(1):69–83CrossRef
2.
go back to reference Bali KK, Ong YS, Gupta A, Tan PS (2020) Cognizant multitasking in multiobjective multifactorial evolution: MO-MFEA-II. IEEE Trans Cybern, p 13 Bali KK, Ong YS, Gupta A, Tan PS (2020) Cognizant multitasking in multiobjective multifactorial evolution: MO-MFEA-II. IEEE Trans Cybern, p 13
3.
go back to reference Broomhead D, Lowe D (1988) Radial basis functions, multi-variable functional interpolation and adaptive networks. In: RSRE memorandum/royal signals and radar establishment, vol 4148. Royals Signals and Radar Establishment Broomhead D, Lowe D (1988) Radial basis functions, multi-variable functional interpolation and adaptive networks. In: RSRE memorandum/royal signals and radar establishment, vol 4148. Royals Signals and Radar Establishment
4.
go back to reference Carpenter W, Barthelemy J (1993) A comparison of polynomial approximations and artificial neural nets as response surfaces. Struct Optim 5:166–174CrossRef Carpenter W, Barthelemy J (1993) A comparison of polynomial approximations and artificial neural nets as response surfaces. Struct Optim 5:166–174CrossRef
5.
go back to reference Chandra R, Gupta A, Ong YS, Goh CK (2016) Evolutionary multi-task learning for modular training of feedforward neural networks. In: Proceedings of international conference on neural information processing Chandra R, Gupta A, Ong YS, Goh CK (2016) Evolutionary multi-task learning for modular training of feedforward neural networks. In: Proceedings of international conference on neural information processing
6.
go back to reference Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern Part B Cybern 26(1):29–41CrossRef Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern Part B Cybern 26(1):29–41CrossRef
7.
go back to reference Ebrahimi M, Farmani MR, Roshanian J (2011) Multidisciplinary design of a small satellite launch vehicle using particle swarm optimization. Struct Multidiscip Optim 44(6):773–784CrossRef Ebrahimi M, Farmani MR, Roshanian J (2011) Multidisciplinary design of a small satellite launch vehicle using particle swarm optimization. Struct Multidiscip Optim 44(6):773–784CrossRef
8.
go back to reference Eiben AE, Smith JE (2003) Introduction to evolutionary computing. Natural computing. Springer, BerlinCrossRef Eiben AE, Smith JE (2003) Introduction to evolutionary computing. Natural computing. Springer, BerlinCrossRef
9.
go back to reference Fonseca LG, Lemonge AC, Barbosa HJ (2012) A study on fitness inheritance for enhanced efficiency in real-coded genetic algorithms. In: Proceedings of IEEE congress on evolutionary computation, pp 1–8 Fonseca LG, Lemonge AC, Barbosa HJ (2012) A study on fitness inheritance for enhanced efficiency in real-coded genetic algorithms. In: Proceedings of IEEE congress on evolutionary computation, pp 1–8
10.
go back to reference Goldberg DE (1989) Genetic algorithms in search. Optimization and machine learning. Addison Wesley, ReadingMATH Goldberg DE (1989) Genetic algorithms in search. Optimization and machine learning. Addison Wesley, ReadingMATH
11.
go back to reference Gong W, Zhou A, Cai Z (2015) A multioperator search strategy based on cheap surrogate models for evolutionary optimization. IEEE Trans Evol Comput 19(5):746–758CrossRef Gong W, Zhou A, Cai Z (2015) A multioperator search strategy based on cheap surrogate models for evolutionary optimization. IEEE Trans Evol Comput 19(5):746–758CrossRef
12.
go back to reference Gupta A, Mańdziuk J, Ong YS (2015) Evolutionary multitasking in bi-level optimization. Complex Intell Syst 1(1):83–95CrossRef Gupta A, Mańdziuk J, Ong YS (2015) Evolutionary multitasking in bi-level optimization. Complex Intell Syst 1(1):83–95CrossRef
13.
go back to reference Gupta A, Da B, Yuan Y, Ong YS (2016) On the emerging notion of evolutionary multitasking: a computational analog of cognitive multitasking, Adaptation and learning and optimization, vol 20. Springer, Berlin Gupta A, Da B, Yuan Y, Ong YS (2016) On the emerging notion of evolutionary multitasking: a computational analog of cognitive multitasking, Adaptation and learning and optimization, vol 20. Springer, Berlin
14.
go back to reference Gupta A, Ong YS, Da B, Feng L, Handoko SD (2016) Landscape synergy in evolutionary multitasking. In: Proceedings of IEEE congress on evolutionary computation Gupta A, Ong YS, Da B, Feng L, Handoko SD (2016) Landscape synergy in evolutionary multitasking. In: Proceedings of IEEE congress on evolutionary computation
15.
go back to reference Gupta A, Ong YS, Feng L (2016) Multifactorial evolution: toward evolutionary multitasking. IEEE Trans Evol Comput 20(3):343–357CrossRef Gupta A, Ong YS, Feng L (2016) Multifactorial evolution: toward evolutionary multitasking. IEEE Trans Evol Comput 20(3):343–357CrossRef
16.
go back to reference Hansen N (2006) The CMA evolution strategy: a comparing review. In: Inza I, Bengoetxea E, Lozano JA, Nga PL (eds) Towards a new evolutionary computation, Advances in estimation of distribution algorithms. Springer, Berlin, pp 75–102CrossRef Hansen N (2006) The CMA evolution strategy: a comparing review. In: Inza I, Bengoetxea E, Lozano JA, Nga PL (eds) Towards a new evolutionary computation, Advances in estimation of distribution algorithms. Springer, Berlin, pp 75–102CrossRef
17.
go back to reference Hashimoto R, Ishibuchi H, Masuyama N, Nojima Y (2018) Analysis of evolutionary multi-tasking as an island model. In: Proceedings of the genetic and evolutionary computation conference companion, pp 1894–1897 Hashimoto R, Ishibuchi H, Masuyama N, Nojima Y (2018) Analysis of evolutionary multi-tasking as an island model. In: Proceedings of the genetic and evolutionary computation conference companion, pp 1894–1897
18.
go back to reference Holland J (1975) Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor Holland J (1975) Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor
19.
go back to reference Jin Y (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evol Comput 1:61–70CrossRef Jin Y (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evol Comput 1:61–70CrossRef
20.
go back to reference Lesh FH (1959) Multi-dimensional least-square polynomial curve fitting. Commun ACM 2(9):29–30CrossRef Lesh FH (1959) Multi-dimensional least-square polynomial curve fitting. Commun ACM 2(9):29–30CrossRef
21.
go back to reference Liang JJ, Qu BY, Suganthan PN, Hernández-Díaz AG (2013) Problem definitions and evaluation criteria for the CEC 2013 special session and competition on real-parameter optimization. Nanyang Technological University, Technical report Liang JJ, Qu BY, Suganthan PN, Hernández-Díaz AG (2013) Problem definitions and evaluation criteria for the CEC 2013 special session and competition on real-parameter optimization. Nanyang Technological University, Technical report
22.
go back to reference Liaw RT, Ting CK (2016) Enhancing covariance matrix adaptation evolution strategy through fitness inheritance. In: Proceedings of the IEE congress on evolutionary computation, pp 1956–1963 Liaw RT, Ting CK (2016) Enhancing covariance matrix adaptation evolution strategy through fitness inheritance. In: Proceedings of the IEE congress on evolutionary computation, pp 1956–1963
23.
go back to reference Liaw RT, Ting CK (2017) Evolutionary many-tasking based on biocoenosis through symbiosis: a framework and benchmark problems. In: Proceedings of IEEE congress on evolutionary computation, pp 2266–2273 Liaw RT, Ting CK (2017) Evolutionary many-tasking based on biocoenosis through symbiosis: a framework and benchmark problems. In: Proceedings of IEEE congress on evolutionary computation, pp 2266–2273
24.
go back to reference Liaw RT, Ting CK (2019) Evolutionary manytasking optimization based on symbiosis in biocoenosis. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 4295–4303 Liaw RT, Ting CK (2019) Evolutionary manytasking optimization based on symbiosis in biocoenosis. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 4295–4303
25.
go back to reference Liu B, Chen Q, Zhang Q, Gielen G, Grout V (2014) Behavioral study of the surrogate model-aware evolutionary search framework. In: Proceedings of IEEE congress on evolutionary computation, pp 715–722 Liu B, Chen Q, Zhang Q, Gielen G, Grout V (2014) Behavioral study of the surrogate model-aware evolutionary search framework. In: Proceedings of IEEE congress on evolutionary computation, pp 715–722
26.
go back to reference Luong HN, Nguyen HTT, Ahn CW (2012) Entropy-based efficiency enhancement techniques for evolutionary algorithms. Inf Sci 188:100–120CrossRef Luong HN, Nguyen HTT, Ahn CW (2012) Entropy-based efficiency enhancement techniques for evolutionary algorithms. Inf Sci 188:100–120CrossRef
27.
go back to reference Myers R, Montgomery D (1995) Response surface methodology. Wiley, New YorkMATH Myers R, Montgomery D (1995) Response surface methodology. Wiley, New YorkMATH
28.
go back to reference Ong YS, Zhou Z, Lim D (2006) Curse and blessing of uncertainty in evolutionary algorithm using approximation. In: Proceedings of IEEE congress on evolutionary computation, pp 2928–2935 Ong YS, Zhou Z, Lim D (2006) Curse and blessing of uncertainty in evolutionary algorithm using approximation. In: Proceedings of IEEE congress on evolutionary computation, pp 2928–2935
29.
go back to reference Pelikan M, Sastry K (2004) Fitness inheritance in the Bayesian optimization algorithm. In: Proceedings of genetic and evolutionary computation conference, pp 48–59 Pelikan M, Sastry K (2004) Fitness inheritance in the Bayesian optimization algorithm. In: Proceedings of genetic and evolutionary computation conference, pp 48–59
30.
go back to reference Pilato C, Tumeo A, Palermo G, Ferrandi F, Lanzi PL, Sciuto D (2008) Improving evolutionary exploration to area-time optimization of FPGA designs. J Syst Archit 54(11):1046–1057CrossRef Pilato C, Tumeo A, Palermo G, Ferrandi F, Lanzi PL, Sciuto D (2008) Improving evolutionary exploration to area-time optimization of FPGA designs. J Syst Archit 54(11):1046–1057CrossRef
31.
go back to reference Pilato C, Loiacono D, Tumeo A, Ferrandi F, Lanzi PL, Sciuto D (2010) Speeding-up expensive evaluations in high-level synthesis using solution modeling and fitness inheritance. In: Proceedings of computational intelligence in expensive optimization problems, pp 701–723 Pilato C, Loiacono D, Tumeo A, Ferrandi F, Lanzi PL, Sciuto D (2010) Speeding-up expensive evaluations in high-level synthesis using solution modeling and fitness inheritance. In: Proceedings of computational intelligence in expensive optimization problems, pp 701–723
32.
go back to reference Rechenberg I, Brand F, Hansen N, Herdy M, Ostermeier A (1995) Theorie der evolutionsstrategie–von der zufallssuche zur intelligenten strategie. Tagungsband zum Statusseminar des BMBF Bioinformatik G. Wolf and R. Schmidt and M. van der Meer Rechenberg I, Brand F, Hansen N, Herdy M, Ostermeier A (1995) Theorie der evolutionsstrategie–von der zufallssuche zur intelligenten strategie. Tagungsband zum Statusseminar des BMBF Bioinformatik G. Wolf and R. Schmidt and M. van der Meer
33.
go back to reference Regis RG (2014) Evolutionary programming for high-dimensional constrained expensive black-box optimization using radial basis functions. IEEE Trans Evol Comput 18(3):326–347CrossRef Regis RG (2014) Evolutionary programming for high-dimensional constrained expensive black-box optimization using radial basis functions. IEEE Trans Evol Comput 18(3):326–347CrossRef
34.
35.
go back to reference Sagarna R, Ong YS (2016) Concurrently searching branches in software tests generation through multitask evolution. In: Proceedings of IEEE symposium series on computational intelligence Sagarna R, Ong YS (2016) Concurrently searching branches in software tests generation through multitask evolution. In: Proceedings of IEEE symposium series on computational intelligence
36.
go back to reference Sastry K, Goldberg DE, Pelikan M (2001) Don’t evaluate, inherit. In: Proceedings of the genetic and evolutionary computation conference, pp 551–558 Sastry K, Goldberg DE, Pelikan M (2001) Don’t evaluate, inherit. In: Proceedings of the genetic and evolutionary computation conference, pp 551–558
37.
go back to reference Sastry K, Goldberg DE, Pelikan M (2004) Efficiency enhancement of probabilistic model building genetic algorithms. Report 200420, IlliGAL Sastry K, Goldberg DE, Pelikan M (2004) Efficiency enhancement of probabilistic model building genetic algorithms. Report 200420, IlliGAL
38.
go back to reference Sastry K, Pelikan M, Goldberg DE (2004) Efficiency enhancement of genetic algorithms via building-block-wise fitness estimation. In: Proceedings of IEEE congress on evolutionary computation, vol 1, pp 720–727 Sastry K, Pelikan M, Goldberg DE (2004) Efficiency enhancement of genetic algorithms via building-block-wise fitness estimation. In: Proceedings of IEEE congress on evolutionary computation, vol 1, pp 720–727
39.
go back to reference Sastry K, Lima CF, Goldberg DE (2006) Evaluation relaxation using substructural information and linear estimation. In: Proceedings of the genetic and evolutionary computation conference, pp 419–426 Sastry K, Lima CF, Goldberg DE (2006) Evaluation relaxation using substructural information and linear estimation. In: Proceedings of the genetic and evolutionary computation conference, pp 419–426
40.
go back to reference Shyy W, Tucker PK, Vaidyanathan R (2001) Response surface and neural network techniques for rocket engine injector optimization. J Propul Power 17(2):391–401CrossRef Shyy W, Tucker PK, Vaidyanathan R (2001) Response surface and neural network techniques for rocket engine injector optimization. J Propul Power 17(2):391–401CrossRef
41.
go back to reference Smith RE, Dike BA, Stegmann SA (1995) Fitness inheritance in genetic algorithms. In: Proceedings of the ACM symposium on applied computing, pp 345–350 Smith RE, Dike BA, Stegmann SA (1995) Fitness inheritance in genetic algorithms. In: Proceedings of the ACM symposium on applied computing, pp 345–350
42.
go back to reference Strasser S, Sheppard J, Fortier N, Goodman R (2016) Factored evolutionary algorithms. IEEE Trans Evol Comput 21:281–293CrossRef Strasser S, Sheppard J, Fortier N, Goodman R (2016) Factored evolutionary algorithms. IEEE Trans Evol Comput 21:281–293CrossRef
43.
go back to reference Vapnik V (1998) Statistical learning theory. Wiley, New YorkMATH Vapnik V (1998) Statistical learning theory. Wiley, New YorkMATH
44.
go back to reference Wang TC, Liaw RT (2020) Multifactorial genetic fuzzy data mining for building membership functions. In: Proceedings of IEEE congress on evolutionary computation Wang TC, Liaw RT (2020) Multifactorial genetic fuzzy data mining for building membership functions. In: Proceedings of IEEE congress on evolutionary computation
45.
go back to reference Wen YW, Ting CK (2017) Parting ways and reallocating resources in evolutionary multitasking. In: Proceedings of IEEE congress on evolutionary computation, pp 2404–2411 Wen YW, Ting CK (2017) Parting ways and reallocating resources in evolutionary multitasking. In: Proceedings of IEEE congress on evolutionary computation, pp 2404–2411
46.
go back to reference Williams CKI, Rasmussen CE (1996) Gaussian processes for regression. In: Touretsky DS, Mozer MC, Hasselmo ME (eds) Advances in neural information processing systems, vol 8. MIT Press, Cambridge, pp 514–520 Williams CKI, Rasmussen CE (1996) Gaussian processes for regression. In: Touretsky DS, Mozer MC, Hasselmo ME (eds) Advances in neural information processing systems, vol 8. MIT Press, Cambridge, pp 514–520
47.
go back to reference Zhou L, Feng L, Zhong J, Ong YS, Zhu Z, Sha E (2016) Evolutionary multitasking in combinatorial search spaces: a case study in capacitated vehicle routing problem. In: Proceedings of IEEE symposium series on computational intelligence Zhou L, Feng L, Zhong J, Ong YS, Zhu Z, Sha E (2016) Evolutionary multitasking in combinatorial search spaces: a case study in capacitated vehicle routing problem. In: Proceedings of IEEE symposium series on computational intelligence
Metadata
Title
Evolution of biocoenosis through symbiosis with fitness approximation for many-tasking optimization
Authors
Rung-Tzuo Liaw
Chuan-Kang Ting
Publication date
26-10-2020
Publisher
Springer Berlin Heidelberg
Published in
Memetic Computing / Issue 4/2020
Print ISSN: 1865-9284
Electronic ISSN: 1865-9292
DOI
https://doi.org/10.1007/s12293-020-00317-2

Other articles of this Issue 4/2020

Memetic Computing 4/2020 Go to the issue

Premium Partner