Skip to main content
Top
Published in: Soft Computing 7/2014

01-07-2014 | Methodologies and Application

Improved RM-MEDA with local learning

Authors: Yangyang Li, Xia Xu, Peidao Li, Licheng Jiao

Published in: Soft Computing | Issue 7/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, local learning is proposed to improve the speed and the accuracy of convergence performance of regularity model-based multiobjective estimation of distribution algorithm (RM-MEDA), a typical multi-objective optimization algorithm via estimation of distribution. RM-MEDA employs a model-based method to generate new solutions, however, this method is easy to generate poor solutions when the population has no obvious regularity. To overcome this drawback, our proposed method add a new solution generation strategy, local learning, to the original RM-MEDA. Local learning produces solutions by sampling some solutions from the neighborhood of elitist solutions in the parent population. As it is easy to search some promising solutions in the neighborhood of an elitist solution, local learning can get some useful solutions which help the population attain a fast and accurate convergence. The experimental results on a set of test instances with variable linkages show that the implement of local learning can accelerate convergence speed and add a more accurate convergence to the Pareto optimal.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Baluja S (1994) Population-based incremental learning: a method for integrating genetic search based function optimization and competitive learning. Carnegie Mellon Univ, Pittsburgh, Tech Rep CMU-CS-94-163 Baluja S (1994) Population-based incremental learning: a method for integrating genetic search based function optimization and competitive learning. Carnegie Mellon Univ, Pittsburgh, Tech Rep CMU-CS-94-163
go back to reference Baluja S, Davies S (1998) Fast probabilistic modeling for combinatorial optimization. In Proceedings of the national conference on artificial, pp 469–476 Baluja S, Davies S (1998) Fast probabilistic modeling for combinatorial optimization. In Proceedings of the national conference on artificial, pp 469–476
go back to reference BenSaid L, Bechikh S, Ghedira K (2010) The r-dominance: a new dominance relation for interactive evolutionary multicriteria decision making. IEEE Trans Evol Comput 14(5):801–818CrossRef BenSaid L, Bechikh S, Ghedira K (2010) The r-dominance: a new dominance relation for interactive evolutionary multicriteria decision making. IEEE Trans Evol Comput 14(5):801–818CrossRef
go back to reference Bosman PAN, Thierens D (2005) The naive MIDEA: a base line multi-objective EA. The 3rd international conference on evolutionary multi-criterion optimization (EMO 2005), LNCS, vol 3410. Springer, Berlin, pp 428–442 Bosman PAN, Thierens D (2005) The naive MIDEA: a base line multi-objective EA. The 3rd international conference on evolutionary multi-criterion optimization (EMO 2005), LNCS, vol 3410. Springer, Berlin, pp 428–442
go back to reference Coello CAC, Pulido GT (2001) Multiobjective optimization using a micro-genetic algorithm. In: Proceedings of genetic and evolutionary computation conference (GECCO 2001), pp 274–282 Coello CAC, Pulido GT (2001) Multiobjective optimization using a micro-genetic algorithm. In: Proceedings of genetic and evolutionary computation conference (GECCO 2001), pp 274–282
go back to reference Coello CAC, Van Veldhuizen DA, Lamont GB (2002) Evolutionary algorithms for solving multi-objective problems. Kluwer, DordrechtCrossRefMATH Coello CAC, Van Veldhuizen DA, Lamont GB (2002) Evolutionary algorithms for solving multi-objective problems. Kluwer, DordrechtCrossRefMATH
go back to reference Corne DW, Knowles J, Oates M (2000a) The Pareto-envelope based selection algorithm for multiobjective optimization. In: Parallel problem solving from nature (PPSN-VI). Lecture notes in computer science, vol 1917. Springer, Berlin, pp 869–878 Corne DW, Knowles J, Oates M (2000a) The Pareto-envelope based selection algorithm for multiobjective optimization. In: Parallel problem solving from nature (PPSN-VI). Lecture notes in computer science, vol 1917. Springer, Berlin, pp 869–878
go back to reference Corne DW, Jerram NR, Knowles JD, Oates MJ (2001b) PESA-II: region-based selection in evolutionary multiobjective optimization. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2001), pp 283–290 Corne DW, Jerram NR, Knowles JD, Oates MJ (2001b) PESA-II: region-based selection in evolutionary multiobjective optimization. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2001), pp 283–290
go back to reference Dai G, Wang J, Zhu J (2009) A hybrid multiobjective algorithm using genetic and estimation of distribution based on design of experiments. In: IEEE international conference on intelligent computing and intelligent systems (ICIS 2009), vol 1, pp 284–288 Dai G, Wang J, Zhu J (2009) A hybrid multiobjective algorithm using genetic and estimation of distribution based on design of experiments. In: IEEE international conference on intelligent computing and intelligent systems (ICIS 2009), vol 1, pp 284–288
go back to reference De Bonet JS, Isbell CL, Viola P (1997) MIMIC: finding optima by estimating probability densities. Adv Neural Inf Process Syst 9:424–424 De Bonet JS, Isbell CL, Viola P (1997) MIMIC: finding optima by estimating probability densities. Adv Neural Inf Process Syst 9:424–424
go back to reference Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, Chichester Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, Chichester
go back to reference Deb K, Pratap A, Agarwa S, Meyarivan T (2002) A fast and elitist multi-objective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6:182–197CrossRef Deb K, Pratap A, Agarwa S, Meyarivan T (2002) A fast and elitist multi-objective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6:182–197CrossRef
go back to reference Deb K, Thiele L, Laumanns M, Zitzler E (2005) Scalable test problems for evolutionary multiobjective optimization. In: Evolutionary multiobjective optimization, theoretical advances and applications, pp 105–145 Deb K, Thiele L, Laumanns M, Zitzler E (2005) Scalable test problems for evolutionary multiobjective optimization. In: Evolutionary multiobjective optimization, theoretical advances and applications, pp 105–145
go back to reference Deb K, Sinha A, Kukkonen S (2006) Multi-objective test problems, linkages, and evolutionary methodologies. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2006), pp 1141–1148 Deb K, Sinha A, Kukkonen S (2006) Multi-objective test problems, linkages, and evolutionary methodologies. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2006), pp 1141–1148
go back to reference Ghoseiria K, Nadjari B (2010) An ant colony optimization algorithm for the biobjective shortest path problem. Appl Soft Comput 10(4):1237–1246CrossRef Ghoseiria K, Nadjari B (2010) An ant colony optimization algorithm for the biobjective shortest path problem. Appl Soft Comput 10(4):1237–1246CrossRef
go back to reference Hernández-Díaz AG, Santana-Quintero LV, Coello CAC, Molina J (2007) Pareto-adaptive epsilon-dominance. Evol Comput 15(4):493–517CrossRef Hernández-Díaz AG, Santana-Quintero LV, Coello CAC, Molina J (2007) Pareto-adaptive epsilon-dominance. Evol Comput 15(4):493–517CrossRef
go back to reference Horn J, Nafpliotis N, Goldberg DE (1994) A niched Pareto genetic algorithm for multiobjective optimization. In: Proceeding of the First IEEE conference on evolutionary computation, vol 1, pp 82–87 Horn J, Nafpliotis N, Goldberg DE (1994) A niched Pareto genetic algorithm for multiobjective optimization. In: Proceeding of the First IEEE conference on evolutionary computation, vol 1, pp 82–87
go back to reference Ishibuchi H, Murata T (1998) A multi-objective genetic local search algorithm and its application to flowshop scheduling. IEEE Trans Syst Man Cybern Part C Appl Rev 28(3):392–403CrossRef Ishibuchi H, Murata T (1998) A multi-objective genetic local search algorithm and its application to flowshop scheduling. IEEE Trans Syst Man Cybern Part C Appl Rev 28(3):392–403CrossRef
go back to reference Jamuna K, Swarup KS (2012) Multi-objective biogeography based optimization for optimal PMU placement. Appl Soft Comput 12(5):1457–1620CrossRef Jamuna K, Swarup KS (2012) Multi-objective biogeography based optimization for optimal PMU placement. Appl Soft Comput 12(5):1457–1620CrossRef
go back to reference Jaszkiewicz A (2003) Do multiple-objective metaheuristics deliver on their promises? A computational experiment on the set-covering problem. IEEE Trans Evol Comput 7(2):133–143CrossRefMathSciNet Jaszkiewicz A (2003) Do multiple-objective metaheuristics deliver on their promises? A computational experiment on the set-covering problem. IEEE Trans Evol Comput 7(2):133–143CrossRefMathSciNet
go back to reference Kambhatla N, Leen TK (1997) Dimension reduction by local principal component analysis. Neural Comput 9:1493–1516CrossRef Kambhatla N, Leen TK (1997) Dimension reduction by local principal component analysis. Neural Comput 9:1493–1516CrossRef
go back to reference Khan N (2003) Bayesian optimization algorithm for multi-objective and hierarchically difficult problem. University of Illinois at Urbana-champainge Khan N (2003) Bayesian optimization algorithm for multi-objective and hierarchically difficult problem. University of Illinois at Urbana-champainge
go back to reference Knowles JD, Corne DW (2000) Approximating the non-dominated front using the Pareto archived evolution strategy. Evol Comput 8: 149–172 Knowles JD, Corne DW (2000) Approximating the non-dominated front using the Pareto archived evolution strategy. Evol Comput 8: 149–172
go back to reference Knowles JD, Corne DW (2002) M-PAES: a memetic algorithm for multiobjective optimization. In: Proceedings of the congress on evolutionary computation (CEC 2002), pp 325–332 Knowles JD, Corne DW (2002) M-PAES: a memetic algorithm for multiobjective optimization. In: Proceedings of the congress on evolutionary computation (CEC 2002), pp 325–332
go back to reference Kukkonen S, Lampinen J (2005) GDE3: the third evolution step of generalized differential evolution. In: Proceedings of the congress on evolutionary computation (CEC 2005), vol 1, pp 443–450 Kukkonen S, Lampinen J (2005) GDE3: the third evolution step of generalized differential evolution. In: Proceedings of the congress on evolutionary computation (CEC 2005), vol 1, pp 443–450
go back to reference Larrañaga P, Lozano JA (2001) Estimation of distribution algorithms a new tool for evolutionary computation. Kluwer, Dordrecht Larrañaga P, Lozano JA (2001) Estimation of distribution algorithms a new tool for evolutionary computation. Kluwer, Dordrecht
go back to reference Laumanns M, Ocenasek J (2002) Bayesian optimization algorithm for multi-objective optimization. In: Parallel problem solving from nature (PPSN-VII). Lecture notes in computer science, vol 2439, pp 298–307. Springer, Berlin Laumanns M, Ocenasek J (2002) Bayesian optimization algorithm for multi-objective optimization. In: Parallel problem solving from nature (PPSN-VII). Lecture notes in computer science, vol 2439, pp 298–307. Springer, Berlin
go back to reference Laumanns M, Thiele L, Deb K, Zitzler E (2002) Combining convergence and diversity in evolutionary multi-objective optimization. Evol Comput 10(3):263–282CrossRef Laumanns M, Thiele L, Deb K, Zitzler E (2002) Combining convergence and diversity in evolutionary multi-objective optimization. Evol Comput 10(3):263–282CrossRef
go back to reference Li H, Zhang Q (2009) Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II. IEEE Trans Evol Comput 12(2):284–302CrossRef Li H, Zhang Q (2009) Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II. IEEE Trans Evol Comput 12(2):284–302CrossRef
go back to reference Li M, Dai G, Zhu (2010) The RM-MEDA based on elitist strategy. In: The 5th international conference on advances in computation and intelligence (ISICA 2010), vol 6382, pp 229–239 Li M, Dai G, Zhu (2010) The RM-MEDA based on elitist strategy. In: The 5th international conference on advances in computation and intelligence (ISICA 2010), vol 6382, pp 229–239
go back to reference Liu D, Tan KC, Goh CK, Ho WK (2007) A multiobjective memetic algorithm based on particle swarm optimization. IEEE Trans Syst Man Cybern Part B Cybern 37(1):42–50CrossRef Liu D, Tan KC, Goh CK, Ho WK (2007) A multiobjective memetic algorithm based on particle swarm optimization. IEEE Trans Syst Man Cybern Part B Cybern 37(1):42–50CrossRef
go back to reference Miettinen K (1999) Nonlinear multiobjective optimization. Kluwer, DordrechtMATH Miettinen K (1999) Nonlinear multiobjective optimization. Kluwer, DordrechtMATH
go back to reference Miller BL, Goldberg DE (1995) Genetic algorithms, tournament selection, and the effects of noise. Complex Syst 9(3):193–212MathSciNet Miller BL, Goldberg DE (1995) Genetic algorithms, tournament selection, and the effects of noise. Complex Syst 9(3):193–212MathSciNet
go back to reference Mühlenbein H, Paass G (1996) From recombination of genes to the estimation of distributions I. Binary parameters. In: Parallel problem solving from nature (PPSN-IV). Lecture notes in computer science, vol 1141, pp 178–187. Springer, Berlin Mühlenbein H, Paass G (1996) From recombination of genes to the estimation of distributions I. Binary parameters. In: Parallel problem solving from nature (PPSN-IV). Lecture notes in computer science, vol 1141, pp 178–187. Springer, Berlin
go back to reference Okabe T, Jin Y, Sendhoff B, Olhofer M (2004) Voronoi-based estimation of distribution algorithm for multi-objecbive optimization. In: Proceedings of the congress on evolutionary computation (CEC 2004), vol 2, pp 1594–1601 Okabe T, Jin Y, Sendhoff B, Olhofer M (2004) Voronoi-based estimation of distribution algorithm for multi-objecbive optimization. In: Proceedings of the congress on evolutionary computation (CEC 2004), vol 2, pp 1594–1601
go back to reference Pelikan M, Goldberg D, Lobo F (2000a) A survey of optimization by building and using probabilistic model. Proc Am Control Conf 5:3289–3293 Pelikan M, Goldberg D, Lobo F (2000a) A survey of optimization by building and using probabilistic model. Proc Am Control Conf 5:3289–3293
go back to reference Pelikan M, Goldberg DE, Cantu-Paz E (2000b) Linkage problem, distribution estimation, and Bayesian networks. Evol Comput 8:311–340CrossRef Pelikan M, Goldberg DE, Cantu-Paz E (2000b) Linkage problem, distribution estimation, and Bayesian networks. Evol Comput 8:311–340CrossRef
go back to reference Pelikan M, Sastry K, Goldberg D (2005) Multiobjective HBOA, clustering, and scalability. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2005), pp 663–670 Pelikan M, Sastry K, Goldberg D (2005) Multiobjective HBOA, clustering, and scalability. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2005), pp 663–670
go back to reference Schütze O, Mostaghim S, Dellnitz M, Teich J (2003) Covering paretosets by multilevel evolutionary subdivision techniques. The 2nd international conference on evolutionary multi-criterion optimization (EMO 2003), LNCS, vol 2632. Springer, Berlin, pp 118–132 Schütze O, Mostaghim S, Dellnitz M, Teich J (2003) Covering paretosets by multilevel evolutionary subdivision techniques. The 2nd international conference on evolutionary multi-criterion optimization (EMO 2003), LNCS, vol 2632. Springer, Berlin, pp 118–132
go back to reference Smith J (2007) Co-evolving memetic algorithms: a review and progress report. IEEE Trans Syst Man Cybern Part B Cybern 37(1):6–17CrossRef Smith J (2007) Co-evolving memetic algorithms: a review and progress report. IEEE Trans Syst Man Cybern Part B Cybern 37(1):6–17CrossRef
go back to reference Srinivas N, Deb K (1994) Multiobjective optimization using non-dominated sorting in genetic algorithms. Evol Comput 2:221–248 Srinivas N, Deb K (1994) Multiobjective optimization using non-dominated sorting in genetic algorithms. Evol Comput 2:221–248
go back to reference Van Veldhuizen DA, Lamont GB (1998) Evolutionary computation and convergence to a Pareto front. In: Late breaking papers at the genetic programming 1998 conference, pp 221–228 Van Veldhuizen DA, Lamont GB (1998) Evolutionary computation and convergence to a Pareto front. In: Late breaking papers at the genetic programming 1998 conference, pp 221–228
go back to reference Wang Y, Xiang J, Cai ZX (2012) A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator. Appl Soft Comput 12(11):3526–3538CrossRef Wang Y, Xiang J, Cai ZX (2012) A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator. Appl Soft Comput 12(11):3526–3538CrossRef
go back to reference Zhang Q, Sun J, Tsang E (2005) An Evolutionary algorithm with guided mutation for the maximum clique problem. IEEE Trans Evol Comput 9(2):192–200 Zhang Q, Sun J, Tsang E (2005) An Evolutionary algorithm with guided mutation for the maximum clique problem. IEEE Trans Evol Comput 9(2):192–200
go back to reference Zhang Q, Sun J, Xiao G, Tsang E (2007a) Evolutionary algorithms refining a heuristic: a hybrid method for shared-path protections in WDM networks under SRLG constraints. IEEE Trans Syst Man Cybern Part B Cybern 37:51–61 Zhang Q, Sun J, Xiao G, Tsang E (2007a) Evolutionary algorithms refining a heuristic: a hybrid method for shared-path protections in WDM networks under SRLG constraints. IEEE Trans Syst Man Cybern Part B Cybern 37:51–61
go back to reference Zhang Q, Zhou A, Jin Y (2007b) Global multiobjective optimization via estimation of distribution algorithm with biased initialization and crossover. In Proceedings of the genetic and evolutionary computation conference (GECCO 2007), pp 617–622 Zhang Q, Zhou A, Jin Y (2007b) Global multiobjective optimization via estimation of distribution algorithm with biased initialization and crossover. In Proceedings of the genetic and evolutionary computation conference (GECCO 2007), pp 617–622
go back to reference Zhang Q, Zhou A, Jin Y (2008) RM-MEDA: a regularity model-based multiobjective estimation of distribution algorithm. IEEE Trans Evol Comput 12:41–63CrossRef Zhang Q, Zhou A, Jin Y (2008) RM-MEDA: a regularity model-based multiobjective estimation of distribution algorithm. IEEE Trans Evol Comput 12:41–63CrossRef
go back to reference Zhou A, Zhang Q, Jin Y, Tsang E, Okabe T (2005) A model-based evolutionary algorithm for bi-objective optimization. In: Proceedings of the congress on evolutionary computation (CEC 2005), pp 2568–2575 Zhou A, Zhang Q, Jin Y, Tsang E, Okabe T (2005) A model-based evolutionary algorithm for bi-objective optimization. In: Proceedings of the congress on evolutionary computation (CEC 2005), pp 2568–2575
go back to reference Zhou A, Jin Y, Zhang Q, Sendhoff B, Tsang E (2006) Combining model-based and genetics-based offspring generation for multi-objective optimization using a convergence criterion. In: Proceedings of the congress on evolutionary computation (CEC 2006), pp 3234–3241 Zhou A, Jin Y, Zhang Q, Sendhoff B, Tsang E (2006) Combining model-based and genetics-based offspring generation for multi-objective optimization using a convergence criterion. In: Proceedings of the congress on evolutionary computation (CEC 2006), pp 3234–3241
go back to reference Zitzler E, Thiele L (1999) Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach. IEEE Trans Evol Comput 3:257–271CrossRef Zitzler E, Thiele L (1999) Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach. IEEE Trans Evol Comput 3:257–271CrossRef
go back to reference Zitzler E, Deb K, Thiele L (2000) Comparison of multiobjective evolution algorithms: empirical results. IEEE Trans Evol Comput 8:173–195 Zitzler E, Deb K, Thiele L (2000) Comparison of multiobjective evolution algorithms: empirical results. IEEE Trans Evol Comput 8:173–195
go back to reference Zitzler E, Laumanns M, Thiele L (2002) SPEA2: improving the strength pareto evolutionary algorithm for multi-objective optimization. In Proceedings of the evolutionary methods for design, optimization and control with applications to industrial problems, pp 19–26 Zitzler E, Laumanns M, Thiele L (2002) SPEA2: improving the strength pareto evolutionary algorithm for multi-objective optimization. In Proceedings of the evolutionary methods for design, optimization and control with applications to industrial problems, pp 19–26
Metadata
Title
Improved RM-MEDA with local learning
Authors
Yangyang Li
Xia Xu
Peidao Li
Licheng Jiao
Publication date
01-07-2014
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 7/2014
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-013-1151-2

Other articles of this Issue 7/2014

Soft Computing 7/2014 Go to the issue

Premium Partner