nach oben

Soft Computing

Erschienen in:

Open Access 17.03.2015 | Methodologies and Application

Objective reduction based on nonlinear correlation information entropy

verfasst von: Handing Wang, Xin Yao

Erschienen in: Soft Computing | Ausgabe 6/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

It is hard to obtain the entire solution set of a many-objective optimization problem (MaOP) by multi-objective evolutionary algorithms (MOEAs) because of the difficulties brought by the large number of objectives. However, the redundancy of objectives exists in some problems with correlated objectives (linearly or nonlinearly). Objective reduction can be used to decrease the difficulties of some MaOPs. In this paper, we propose a novel objective reduction approach based on nonlinear correlation information entropy (NCIE). It uses the NCIE matrix to measure the linear and nonlinear correlation between objectives and a simple method to select the most conflicting objectives during the execution of MOEAs. We embed our approach into both Pareto-based and indicator-based MOEAs to analyze the impact of our reduction method on the performance of these algorithms. The results show that our approach significantly improves the performance of Pareto-based MOEAs on both reducible and irreducible MaOPs, but does not much help the performance of indicator-based MOEAs.

Vorheriger Artikel Chance-constrained model for uncertain job shop scheduling problem

Nächster Artikel Stopping criteria for MAPLS-AW, a hybrid multi-objective evolutionary algorithm

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Bader J, Zitzler E (2011) HypE: an algorithm for fast hypervolume-based many-objective optimization. Evol Comput 19(1):45–76CrossRef

Bechikh S, Said LB, Ghédira K (2011) Searching for knee regions of the pareto front using mobile reference points. Soft Comput 15(9):1807–1823CrossRef

Ben Said L, Bechikh S, Ghédira K (2010) The r-dominance: a new dominance relation for interactive evolutionary multicriteria decision making. IEEE Trans Evolut Comput 14(5):801–818CrossRef

Brockhoff D, Zitzler E (2006) Are all objectives necessary? On dimensionality reduction in evolutionary multiobjective optimization. Parallel Probl Solv Nat PPSN IX 4193:533–542

Brockhoff D, Zitzler E (2009) Objective reduction in evolutionary multiobjective optimization: theory and applications. Evolut Comput 17(2):135–166CrossRef

Coello CC (2005) Recent trends in evolutionary multiobjective optimization. In: Abraham A, Jain L, Goldberg R (eds) Evolutionary multiobjective optimization. Advanced information and knowledge processing. Springer, London, pp 7–32CrossRef

Cvetkovic D, Parmee IC (2002) Preferences and their application in evolutionary multiobjective optimization. IEEE Trans Evolut Comput 6(1):42–57CrossRef

Dai C, Wang Y, Hu L (2015) An improved \(\alpha \)-dominance strategy for many-objective optimization problems. Soft Comput. pp 1–7. doi:10.1007/s00500-014-1570-8

Deb K (2001) Multi-objective optimization using evolutionary algorithms, vol 16. Wiley, New YorkMATH

Deb K, Jain H (2014) An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: Solving problems with box constraints. IEEE Trans Evolut Comput 18(4):577–601CrossRef

Deb K, Saxena D (2005) On finding pareto-optimal solutions through dimensionality reduction for certain large-dimensional multi-objective optimization problems. Kangal report 11

Deb K, Tiwari S (2005) Omni-optimizer: a procedure for single and multi-objective optimization. In: Evolutionary multi-criterion optimization. Springer, Berlin, pp 47–61

Deb K, Pratap A, Agarwal S, Meyarivan T (2002a) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evolut Comput 6(2):182–197CrossRef

Deb K, Thiele L, Laumanns M, Zitzler E (2002b) Scalable multi-objective optimization test problems. In: Evolutionary computation, (2002) CEC 2002. IEEE Press, IEEE Congress on, pp 825–830

Farina M, Amato P (2002) On the optimal solution definition for many-criteria optimization problems. In: Fuzzy Information Processing Society, 2002. Proceedings. NAFIPS. 2002 Annual Meeting of the North American, IEEE Press, pp 233–238

Fleming P, Purshouse R, Lygoe R (2005) Many-objective optimization: an engineering design perspective. In: Evolutionary multi-criterion optimization, Springer, Berlin, pp 14–32

Fonseca C, Fleming P (1995) An overview of evolutionary algorithms in multiobjective optimization. Evolut Comput 3(1):1–16CrossRef

Freitas AR, Fleming PJ, Guimaraes FG (2013) A non-parametric harmony-based objective reduction method for many-objective optimization. In: Systems, man, and cybernetics (SMC), IEEE International conference on, IEEE Press, pp 651–656

Gal T, Hanne T (1999) Consequences of dropping nonessential objectives for the application of MCDM methods. Euro J Operat Res 119(2):373–378MathSciNetCrossRefMATH

Giagkiozis I, Fleming PJ (2014) Pareto front estimation for decision making. Evolut Comput 22(4):651–678CrossRef

Gong D, Wang G, Sun X, Han Y (2014) A set-based genetic algorithm for solving the many-objective optimization problem. Soft Comput pp 1–19. doi:10.1007/s00500-014-1284-y

Hadka D, Reed P (2012) Diagnostic assessment of search controls and failure modes in many-objective evolutionary optimization. Evolut Comput 20(3):423–452CrossRef

Hollander M, Wolfe D (1999) Nonparametric statistical methods. Wiley-Interscience, New York

Huband S, Hingston P, Barone L, While L (2006) A review of multiobjective test problems and a scalable test problem toolkit. IEEE Trans Evolut Comput 10(5):477–506CrossRefMATH

Hughes E (2005) Evolutionary many-objective optimisation: many once or one many? In: Evolutionary Computation, 2005. CEC 2005. IEEE Congress on, IEEE Press, vol 1, pp 222–227

Hughes E (2007) Radar waveform optimisation as a many-objective application benchmark. In: Evolutionary multi-criterion optimization, Springer, Berlin, pp 700–714

Ishibuchi H, Tsukamoto N, Nojima Y (2008) Evolutionary many-objective optimization: a short review. In: Evolutionary Computation (2008) CEC 2008. IEEE Press, IEEE Congress on, pp 2419–2426

Ishibuchi H, Sakane Y, Tsukamoto N, Nojima Y (2009) Evolutionary many-objective optimization by NSGA-II and MOEA/D with large populations. In: Systems, man, and cybernetics (SMC), IEEE international conference on, IEEE Press, pp 1758–1763

Ishibuchi H, Akedo N, Ohyanagi H, Nojima Y (2011a) Behavior of EMO algorithms on many-objective optimization problems with correlated objectives. In: Evolutionary computation, (2011) CEC 2011. IEEE Press, IEEE Congress on, pp 1465–1472

Ishibuchi H, Hitotsuyanagi Y, Ohyanagi H, Nojima Y (2011b) Effects of the existence of highly correlated objectives on the behavior of MOEA/D. In: Evolutionary multi-criterion optimization, Springer, Berlin, pp 166–181

Karahan I, Koksalan M (2010) A territory defining multiobjective evolutionary algorithms and preference incorporation. IEEE Trans Evolut Comput 14(4):636–664CrossRef

Khan S, Bandyopadhyay S, Ganguly AR, Saigal S, Erickson DJ III, Protopopescu V, Ostrouchov G (2007) Relative performance of mutual information estimation methods for quantifying the dependence among short and noisy data. Phys Rev E 76(2):026209MathSciNetCrossRef

Khare V, Yao X, Deb K (2003) Performance scaling of multi-objective evolutionary algorithms. In: Fonseca C, Fleming P, Zitzler E, Thiele L, Deb K (eds) Evolutionary multi-criterion optimization, vol 2632., Lecture notes in computer scienceSpringer, Berlin / Heidelberg, pp 376–390CrossRef

Kim JH, Han JH, Kim YH, Choi SH, Kim ES (2012) Preference-based solution selection algorithm for evolutionary multiobjective optimization. IEEE Trans Evolut Comput 16(1):20–34CrossRef

Koksalan M, Karahan I (2010) An interactive territory defining evolutionary algorithm: iTDEA. IEEE Trans Evolut Comput 14(5):702–722CrossRef

Köppen M, Vicente-Garcia R, Nickolay B (2005) Fuzzy-pareto-dominance and its application in evolutionary multi-objective optimization. In: Evolutionary multi-criterion optimization, Springer, Berlin, pp 399–412

Kukkonen S, Lampinen J, (2007) Ranking-dominance and many-objective optimization. In: Evolutionary computation, (2007) CEC 2007. IEEE Press, IEEE Congress on, pp 3983–3990

López Jaimes A, Coello Coello C, Chakraborty D (2008) Objective reduction using a feature selection technique. In: Proceedings of the 10th annual conference on Genetic and evolutionary computation, ACM Press, pp 673–680

López Jaimes A, Coello Coello CA, Aguirre H, Tanaka K (2014) Objective space partitioning using conflict information for solving many-objective problems. Inf Sci 268:305–327MathSciNetCrossRef

Ma X, Qi Y, Li L, Liu F, Jiao L, Wu J (2014) MOEA/D with uniform decomposition measurement for many-objective problems. Soft Comput 18(12):2541–2564CrossRef

Maes F, Collignon A, Vandermeulen D, Marchal G, Suetens P (1997) Multimodality image registration by maximization of mutual information. IEEE Trans Med Imaging 16(2):187–198CrossRef

McClymont K, Keedwell E (2012) Deductive sort and climbing sort: new methods for non-dominated sorting. Evolut Comput 20(1):1–26CrossRef

Pereda E, Quiroga RQ, Bhattacharya J (2005) Nonlinear multivariate analysis of neurophysiological signals. Prog Neurobiol 77(1):1–37CrossRef

Praditwong K, Yao X (2007) How well do multi-objective evolutionary algorithms scale to large problems. In: Evolutionary computation, (2007) CEC 2007. IEEE Press, IEEE Congress on, pp 3959–3966

Purshouse R, Fleming P (2003) Evolutionary many-objective optimisation: an exploratory analysis. In: Evolutionary computation, 2003. CEC 2003. IEEE Congress on, IEEE Press, vol 3, pp 2066–2073

Sato H, Aguirre HE, Tanaka K (2007) Controlling dominance area of solutions and its impact on the performance of MOEAs. In: Evolutionary multi-criterion optimization, Springer, Berlin, pp 5–20

Saxena D, Deb K (2007) Non-linear dimensionality reduction procedures for certain large-dimensional multi-objective optimization problems: employing correntropy and a novel maximum variance unfolding. In: Evolutionary multi-criterion optimization, Springer, Berlin, pp 772–787

Saxena DK, Duro JA, Tiwari A, Deb K, Zhang Q (2013) Objective reduction in many-objective optimization: linear and nonlinear algorithms. IEEE Trans Evolut Comput 17(1):77–99. doi:10.1109/TEVC.2012.2185847 CrossRef

Sindhya K, Ruiz AB, Miettinen K (2011) A preference based interactive evolutionary algorithm for multi-objective optimization: PIE. In: Evolutionary multi-criterion optimization, Springer, Berlin, pp 212–225

Singh H, Isaacs A, Ray T (2011) A pareto corner search evolutionary algorithm and dimensionality reduction in many-objective optimization problems. IEEE Trans Evolut Comput 15(4):539–556CrossRef

Van Veldhuizen DA, Lamont GB (1998) Multiobjective evolutionary algorithm research: a history and analysis. Tech. rep, Citeseer

Wagner T, Beume N, Naujoks B (2007) Pareto-, aggregation-, and indicator-based methods in many-objective optimization. In: Evolutionary multi-criterion optimization, Springer, Berlin, pp 742–756

Wang H, Yao X (2014) Corner sort for pareto-based many-objective optimization. IEEE Trans Cybernet 44(1):92–102MathSciNetCrossRef

Wang Q, Shen Y, Zhang J (2005) A nonlinear correlation measure for multivariable data set. Phys D Nonlinear Phenom 200(3):287–295MathSciNetCrossRefMATH

Wang R, Purshouse R, Fleming P (2013a) Preference-inspired coevolutionary algorithms for many-objective optimization. IEEE Trans Evolut Comput 17(4):474–494CrossRef

Wang R, Purshouse RC, Fleming PJ (2013b) Preference-inspired co-evolutionary algorithm using adaptively generated goal vectors. In: Evolutionary computation, (2013) CEC 2013. IEEE Press, IEEE Congress, pp 916–923

Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evolut Comput 11(6):712–731CrossRef

Zhang Q, Zhou A, Zhao S, Suganthan P, Liu W, Tiwari S (2008) Multiobjective optimization test instances for the CEC 2009 special session and competition. University of Essex, Colchester, UK and Nanyang Technological University, Singapore, special session on performance assessment of multi-objective optimization algorithms, technical report, pp 1–30

Zitzler E, Künzli S (2004) Indicator-based selection in multiobjective search. In: Parallel problem solving from Nature-PPSN VIII, Springer, Berlin, pp 832–842

Titel: Objective reduction based on nonlinear correlation information entropy
verfasst von: Handing Wang
Xin Yao
Publikationsdatum: 17.03.2015
Verlag: Springer Berlin Heidelberg
Erschienen in: Soft Computing / Ausgabe 6/2016
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI: https://doi.org/10.1007/s00500-015-1648-y

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 6/2016

Automatic constraints generation for semisupervised clustering: experiences with documents classification

Immune clonal selection algorithm for capacitated arc routing problem

An improved fruit fly optimization algorithm to solve the homogeneous fuzzy series–parallel redundancy allocation problem under discount strategies

WebGIS based on spatio-temporal hot spots: an application to oto-laryngo-pharyngeal diseases

Bolstering efficient SSGAs based on an ensemble of probabilistic variable-wise crossover strategies

A maximum spanning tree-based dynamic fuzzy supervised neural network architecture for classification of murder cases