Skip to main content
Erschienen in: Evolutionary Intelligence 3/2020

25.09.2019 | Research Paper

Improving many objective optimisation algorithms using objective dimensionality reduction

verfasst von: Xuan Hung Nguyen, Lam Thu Bui, Cao Truong Tran

Erschienen in: Evolutionary Intelligence | Ausgabe 3/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Many-objective optimisation problems (MaOPs) have recently received a considerable attention from researchers. Due to the large number of objectives, MaOPs bring serious difficulties to existing multi-objective evolutionary algorithms (MOEAs). The major difficulties includes the poor scalability, the high computational cost and the difficulty in visualisation. A number of many-objective evolutionary algorithms (MaOEAs) has been proposed to tackle MaOPs, but existing MaOEAs have still faced with the difficulties when the number of objectives increases. Real-world MaOPs often have redundant objectives that are not only inessential to describe the Pareto-optimal front, but also deteriorate MaOEAs. A common approach to the problem is to use objective dimensionality reduction algorithms to eliminate redundant objectives. By removing redundant objectives, objective reduction algorithms can improve the search efficiency, reduce computational cost, and support for decision making. The performance of an objective dimensionality reduction strongly depends on nondominated solutions generated by MOEAs/MaOEAs. The impact of objective reduction algorithms on MOEAs and vice versa have been widely investigated. However, the impact of objective reduction algorithms on MaOEAs and vice versa have been rarely investigated. This paper studies the interdependence of objective reduction algorithms on MaOEAs. Experimental results show that combining an objective reduction algorithm with an MOEA can only successfully remove redundant objectives when the total number of objectives is small. In contrast, combining the objective reduction algorithm with an MaOEA can successfully remove redundant objectives even when the total number of objectives is large. Experimental results also show that objective reduction algorithms can significantly improve the performance of MaOEAs.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
The final set of solutions returned by MOEA at termination.
 
2
Is implicitly defined by the functions composing an MOP.
 
3
Objectives in evolutionary many-objective optimisation are considered features in dimensionality reduction.
 
4
Computation of of an objective subset of minimum size, yielding a (change) dominance structure with given error.
 
5
Computation of an objective subset of given size with the minimum error.
 
6
Eigenvalues are normalised, eigenvalues and eigenvectors are sorted descending together based on eigenvalues.
 
7
\(T_{cor}=1.0 - e_1 (1.0- M_{2\alpha }/M)\) in which \(e_1=0.39416, M_{2\alpha }=5, M=8\).
 
8
Selection score for each objective is calculated \(sc_i=\sum _{j=1}^{N_v} {e_j |f_{ij} |}\).
 
Literatur
1.
Zurück zum Zitat Antonelli M, Ducange P, Lazzerini B, Marcelloni F (2009) Multi-objective evolutionary learning of granularity, membership function parameters and rules of mamdani fuzzy systems. Evol Intel 2(1–2):21 Antonelli M, Ducange P, Lazzerini B, Marcelloni F (2009) Multi-objective evolutionary learning of granularity, membership function parameters and rules of mamdani fuzzy systems. Evol Intel 2(1–2):21
2.
Zurück zum Zitat Bader J, Zitzler E (2011) Hype: an algorithm for fast hypervolume-based many-objective optimization. Evol Comput 19(1):45–76 Bader J, Zitzler E (2011) Hype: an algorithm for fast hypervolume-based many-objective optimization. Evol Comput 19(1):45–76
3.
Zurück zum Zitat Bechikh S, Elarbi M, Said LB (2017) Many-objective optimization using evolutionary algorithms: a survey. In: Recent advances in evolutionary multi-objective optimization, Springer, Berlin, pp 105–137 Bechikh S, Elarbi M, Said LB (2017) Many-objective optimization using evolutionary algorithms: a survey. In: Recent advances in evolutionary multi-objective optimization, Springer, Berlin, pp 105–137
4.
Zurück zum Zitat Brockhoff D, Zitzler E (2006) Are all objectives necessary? on dimensionality reduction in evolutionary multiobjective optimization. In: Parallel Problem Solving from Nature-PPSN IX, pages 533–542. Springer Brockhoff D, Zitzler E (2006) Are all objectives necessary? on dimensionality reduction in evolutionary multiobjective optimization. In: Parallel Problem Solving from Nature-PPSN IX, pages 533–542. Springer
5.
Zurück zum Zitat Brockhoff D, Zitzler E (2006) Dimensionality reduction in multiobjective optimization with (partial) dominance structure preservation: generalized minimum objective subset problems. TIK Report, 247 Brockhoff D, Zitzler E (2006) Dimensionality reduction in multiobjective optimization with (partial) dominance structure preservation: generalized minimum objective subset problems. TIK Report, 247
6.
Zurück zum Zitat Brockhoff D, Zitzler E (2006) On objective conflicts and objective reduction in multiple criteria optimization. TIK Report, 243 Brockhoff D, Zitzler E (2006) On objective conflicts and objective reduction in multiple criteria optimization. TIK Report, 243
7.
Zurück zum Zitat Brockhoff D, Zitzler E (2007) Offline and online objective reduction in evolutionary multiobjective optimization based on objective conflicts. TIK Report, 269 Brockhoff D, Zitzler E (2007) Offline and online objective reduction in evolutionary multiobjective optimization based on objective conflicts. TIK Report, 269
8.
Zurück zum Zitat Brockhoff D, Zitzler E (2009) Objective reduction in evolutionary multiobjective optimization: theory and applications. Evol Comput 17(2):135–166 Brockhoff D, Zitzler E (2009) Objective reduction in evolutionary multiobjective optimization: theory and applications. Evol Comput 17(2):135–166
9.
Zurück zum Zitat Coello CAC, Lamont GB, Van Veldhuizen DA (2002) Evolutionary algorithms for solving multi-objective problems. Springer, Berlin, p 800MATH Coello CAC, Lamont GB, Van Veldhuizen DA (2002) Evolutionary algorithms for solving multi-objective problems. Springer, Berlin, p 800MATH
10.
Zurück zum Zitat Cheng R, Jin Y, Olhofer M, Sendhoff B (2016) A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans Evolut Comput 20(5):773–791 Cheng R, Jin Y, Olhofer M, Sendhoff B (2016) A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans Evolut Comput 20(5):773–791
11.
Zurück zum Zitat Cheung YM, Gu F (2014) Online objective reduction for many-objective optimization problems. In: 2014 IEEE congress on evolutionary computation (CEC), pp 1165–1171. IEEE Cheung YM, Gu F (2014) Online objective reduction for many-objective optimization problems. In: 2014 IEEE congress on evolutionary computation (CEC), pp 1165–1171. IEEE
12.
Zurück zum Zitat Cheung Y-M, Gu F, Liu H-L (2016) Objective extraction for many-objective optimization problems: algorithm and test problems. IEEE Trans Evol Comput 20(5):755–772 Cheung Y-M, Gu F, Liu H-L (2016) Objective extraction for many-objective optimization problems: algorithm and test problems. IEEE Trans Evol Comput 20(5):755–772
13.
Zurück zum Zitat Cunningham JP, Ghahramani Z (2015) Linear dimensionality reduction: survey, insights, and generalizations. J Mach Learn Res 16:2859–2900MathSciNetMATH Cunningham JP, Ghahramani Z (2015) Linear dimensionality reduction: survey, insights, and generalizations. J Mach Learn Res 16:2859–2900MathSciNetMATH
14.
Zurück zum Zitat Deb K, Jain H (2014) An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part i: solving problems with box constraints. IEEE Trans Evolut Comput 18(4):577–601 Deb K, Jain H (2014) An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part i: solving problems with box constraints. IEEE Trans Evolut Comput 18(4):577–601
15.
Zurück zum Zitat Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans Evol Comput 6(2):182–197 Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans Evol Comput 6(2):182–197
16.
Zurück zum Zitat Deb K, Saxena D (2006) Searching for pareto-optimal solutions through dimensionality reduction for certain large-dimensional multi-objective optimization problems. In: Proceedings of the world congress on computational intelligence (WCCI-2006), pp 3352–3360 Deb K, Saxena D (2006) Searching for pareto-optimal solutions through dimensionality reduction for certain large-dimensional multi-objective optimization problems. In: Proceedings of the world congress on computational intelligence (WCCI-2006), pp 3352–3360
17.
Zurück zum Zitat DeRonne KW, Karypis G (2013) Pareto optimal pairwise sequence alignment. IEEE/ACM Trans Comput Biol Bioinform (TCBB) 10:481–493 DeRonne KW, Karypis G (2013) Pareto optimal pairwise sequence alignment. IEEE/ACM Trans Comput Biol Bioinform (TCBB) 10:481–493
18.
Zurück zum Zitat Erceg-Hurn DM, Mirosevich VM (2008) Modern robust statistical methods: an easy way to maximize the accuracy and power of your research. Am Psychol 63:591 Erceg-Hurn DM, Mirosevich VM (2008) Modern robust statistical methods: an easy way to maximize the accuracy and power of your research. Am Psychol 63:591
19.
Zurück zum Zitat Farina M, Amato P (2002) On the optimal solution definition for many-criteria optimization problems. In: Proceedings of the NAFIPS-FLINT international conference, pp 233–238 Farina M, Amato P (2002) On the optimal solution definition for many-criteria optimization problems. In: Proceedings of the NAFIPS-FLINT international conference, pp 233–238
20.
Zurück zum Zitat Fleming PJ, Purshouse RC, Lygoe RJ (2005) Many-objective optimization: an engineering design perspective. In: International conference on evolutionary multi-criterion optimization, pp 14–32 Fleming PJ, Purshouse RC, Lygoe RJ (2005) Many-objective optimization: an engineering design perspective. In: International conference on evolutionary multi-criterion optimization, pp 14–32
21.
Zurück zum Zitat Fu G, Kapelan Z, Kasprzyk JR, Reed P (2012) Optimal design of water distribution systems using many-objective visual analytics. J Water Resour Plan Manag 139:624–633 Fu G, Kapelan Z, Kasprzyk JR, Reed P (2012) Optimal design of water distribution systems using many-objective visual analytics. J Water Resour Plan Manag 139:624–633
22.
Zurück zum Zitat Gu F, Liu H-L, Cheung Y-m (2017) A fast objective reduction algorithm based on dominance structure for many objective optimization. In: Asia-Pacific conference on simulated evolution and learning, Springer, pp 260–271 Gu F, Liu H-L, Cheung Y-m (2017) A fast objective reduction algorithm based on dominance structure for many objective optimization. In: Asia-Pacific conference on simulated evolution and learning, Springer, pp 260–271
23.
Zurück zum Zitat Guo X, Wang X, Wang M, Wang Y (2012) A new objective reduction algorithm for many-objective problems: employing mutual information and clustering algorithm. In: 2012 eighth international conference on computational intelligence and security (CIS), IEEE, pp 11–16 Guo X, Wang X, Wang M, Wang Y (2012) A new objective reduction algorithm for many-objective problems: employing mutual information and clustering algorithm. In: 2012 eighth international conference on computational intelligence and security (CIS), IEEE, pp 11–16
24.
Zurück zum Zitat Guo X, Wang Y, Wang X (2013) Using objective clustering for solving many-objective optimization problems. Mathematical Problems in Engineering 2013 Guo X, Wang Y, Wang X (2013) Using objective clustering for solving many-objective optimization problems. Mathematical Problems in Engineering 2013
25.
Zurück zum Zitat Hughes EJ (2003) Multiple single objective pareto sampling. Congr Evolut Comput 2003:2678–2684 Hughes EJ (2003) Multiple single objective pareto sampling. Congr Evolut Comput 2003:2678–2684
26.
Zurück zum Zitat Ishibuchi H, Masuda H, Nojima Y (2016) Pareto fronts of many-objective degenerate test problems. IEEE Trans Evolut Comput 20:807–813 Ishibuchi H, Masuda H, Nojima Y (2016) Pareto fronts of many-objective degenerate test problems. IEEE Trans Evolut Comput 20:807–813
27.
Zurück zum Zitat Ishibuchi H, Tsukamoto N, Nojima Y (2008) Evolutionary many-objective optimization. In: 3rd international workshop on genetic and evolving systems, 2008. GEFS 2008, IEEE, pp 47–52 Ishibuchi H, Tsukamoto N, Nojima Y (2008) Evolutionary many-objective optimization. In: 3rd international workshop on genetic and evolving systems, 2008. GEFS 2008, IEEE, pp 47–52
28.
Zurück zum Zitat Jaimes AL, Coello CAC, Barrientos JEU (2009) Online objective reduction to deal with many-objective problems. In: International conference on evolutionary multi-criterion optimization, Springer, Berlin, pp 423–437 Jaimes AL, Coello CAC, Barrientos JEU (2009) Online objective reduction to deal with many-objective problems. In: International conference on evolutionary multi-criterion optimization, Springer, Berlin, pp 423–437
29.
Zurück zum Zitat Kaufman L, Rousseeuw P (1987) Clustering by means of medoids. North-Holland, Amsterdam Kaufman L, Rousseeuw P (1987) Clustering by means of medoids. North-Holland, Amsterdam
30.
Zurück zum Zitat Knowles JD, Corne DW (2000) Approximating the nondominated front using the pareto archived evolution strategy. Evol Comput 8(2):149–172 Knowles JD, Corne DW (2000) Approximating the nondominated front using the pareto archived evolution strategy. Evol Comput 8(2):149–172
31.
Zurück zum Zitat Li B, Li J, Tang K, Yao X (2015) Many-objective evolutionary algorithms: a survey. ACM Comput Surv (CSUR) 48(1):13 Li B, Li J, Tang K, Yao X (2015) Many-objective evolutionary algorithms: a survey. ACM Comput Surv (CSUR) 48(1):13
32.
Zurück zum Zitat Li M, Yang S, Liu X (2014) Shift-based density estimation for pareto-based algorithms in many-objective optimization. IEEE Trans Evol Comput 18(3):348–365 Li M, Yang S, Liu X (2014) Shift-based density estimation for pareto-based algorithms in many-objective optimization. IEEE Trans Evol Comput 18(3):348–365
33.
Zurück zum Zitat López Jaimes A, Coello CCA, Chakraborty D (2008) Objective reduction using a feature selection technique. In: Proceedings of the 10th annual conference on genetic and evolutionary computation, ACM, New York, pp 673–680 López Jaimes A, Coello CCA, Chakraborty D (2008) Objective reduction using a feature selection technique. In: Proceedings of the 10th annual conference on genetic and evolutionary computation, ACM, New York, pp 673–680
34.
Zurück zum Zitat Miettinen K (1999) Nonlinear multiobjective optimization, volume 12 of international series in operations research and management science Miettinen K (1999) Nonlinear multiobjective optimization, volume 12 of international series in operations research and management science
35.
Zurück zum Zitat Pei Y, Takagi H (2013) Accelerating iec and ec searches with elite obtained by dimensionality reduction in regression spaces. Evol Intel 6(1):27–40 Pei Y, Takagi H (2013) Accelerating iec and ec searches with elite obtained by dimensionality reduction in regression spaces. Evol Intel 6(1):27–40
36.
Zurück zum Zitat Riquelme N, Von Lücken C, Baran B (2015) Performance metrics in multi-objective optimization. In: Computing conference (CLEI), 2015 Latin American, IEEE, pp 1–11 Riquelme N, Von Lücken C, Baran B (2015) Performance metrics in multi-objective optimization. In: Computing conference (CLEI), 2015 Latin American, IEEE, pp 1–11
37.
Zurück zum Zitat Saxena DK, Deb K (2007) Non-linear dimensionality reduction procedures for certain large-dimensional multi-objective optimization problems: employing correntropy and a novel maximum variance unfolding. In: International conference on evolutionary multi-criterion optimization, Springer, Berlin, pp 772–787 Saxena DK, Deb K (2007) Non-linear dimensionality reduction procedures for certain large-dimensional multi-objective optimization problems: employing correntropy and a novel maximum variance unfolding. In: International conference on evolutionary multi-criterion optimization, Springer, Berlin, pp 772–787
38.
Zurück zum Zitat Saxena DK, Duro JA, Tiwari A, Deb K, Zhang Q (2013) Objective reduction in many-objective optimization: linear and nonlinear algorithms. IEEE Trans Evol Comput 17(1):77–99 Saxena DK, Duro JA, Tiwari A, Deb K, Zhang Q (2013) Objective reduction in many-objective optimization: linear and nonlinear algorithms. IEEE Trans Evol Comput 17(1):77–99
39.
Zurück zum Zitat Singh HK, Isaacs A, Ray T (2011) A pareto corner search evolutionary algorithm and dimensionality reduction in many-objective optimization problems. IEEE Trans Evol Comput 15(4):539–556 Singh HK, Isaacs A, Ray T (2011) A pareto corner search evolutionary algorithm and dimensionality reduction in many-objective optimization problems. IEEE Trans Evol Comput 15(4):539–556
40.
Zurück zum Zitat Tang J, Alam S, Lokan C, Abbass HA (2012) A multi-objective evolutionary method for dynamic airspace re-sectorization using sectors clipping and similarities. In: 2012 IEEE congress on evolutionary computation (CEC), pp 1–8 Tang J, Alam S, Lokan C, Abbass HA (2012) A multi-objective evolutionary method for dynamic airspace re-sectorization using sectors clipping and similarities. In: 2012 IEEE congress on evolutionary computation (CEC), pp 1–8
41.
Zurück zum Zitat Tate J, Woolford-Lim B, Bate I, Yao X (2012) Evolutionary and principled search strategies for sensornet protocol optimization. IEEE Trans Syst Man Cybernet Part B (Cybernet) 42:163–180 Tate J, Woolford-Lim B, Bate I, Yao X (2012) Evolutionary and principled search strategies for sensornet protocol optimization. IEEE Trans Syst Man Cybernet Part B (Cybernet) 42:163–180
42.
Zurück zum Zitat Tian Y, Cheng R, Zhang X, Jin Y (2017) Platemo: a matlab platform for evolutionary multi-objective optimization [educational forum]. IEEE Comput Intell Mag 12(4):73–87 Tian Y, Cheng R, Zhang X, Jin Y (2017) Platemo: a matlab platform for evolutionary multi-objective optimization [educational forum]. IEEE Comput Intell Mag 12(4):73–87
43.
Zurück zum Zitat Tran CT, Zhang M, Andreae P, Xue B (2016) Improving performance for classification with incomplete data using wrapper-based feature selection. Evol Intel 9(3):81–94 Tran CT, Zhang M, Andreae P, Xue B (2016) Improving performance for classification with incomplete data using wrapper-based feature selection. Evol Intel 9(3):81–94
44.
Zurück zum Zitat Wang H, Jiao L, Yao X (2015) Two\_arch2: an improved two-archive algorithm for many-objective optimization. IEEE Trans Evol Comput 19(4):524–541 Wang H, Jiao L, Yao X (2015) Two\_arch2: an improved two-archive algorithm for many-objective optimization. IEEE Trans Evol Comput 19(4):524–541
45.
Zurück zum Zitat Yang S, Li M, Liu X, Zheng J (2013) A grid-based evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 17(5):721–736 Yang S, Li M, Liu X, Zheng J (2013) A grid-based evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 17(5):721–736
46.
Zurück zum Zitat Yuan Y, Xu H, Wang B, Yao X (2016) A new dominance relation-based evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 20(1):16–37 Yuan Y, Xu H, Wang B, Yao X (2016) A new dominance relation-based evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 20(1):16–37
47.
Zurück zum Zitat Zhang Q, Li H (2007) Moea/d: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731 Zhang Q, Li H (2007) Moea/d: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731
48.
Zurück zum Zitat Zhang X, Tian Y, Jin Y (2015) A knee point-driven evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 19(6):761–776 Zhang X, Tian Y, Jin Y (2015) A knee point-driven evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 19(6):761–776
49.
Zurück zum Zitat Zhang Z (2011) Artificial immune optimization system solving constrained omni-optimization. Evol Intel 4(4):203–218 Zhang Z (2011) Artificial immune optimization system solving constrained omni-optimization. Evol Intel 4(4):203–218
50.
Zurück zum Zitat Zhou A, Qu B-Y, Li H, Zhao S-Z, Suganthan PN, Zhang Q (2011) Multiobjective evolutionary algorithms: a survey of the state of the art. Swarm Evolut Comput 1(1):32–49 Zhou A, Qu B-Y, Li H, Zhao S-Z, Suganthan PN, Zhang Q (2011) Multiobjective evolutionary algorithms: a survey of the state of the art. Swarm Evolut Comput 1(1):32–49
51.
Zurück zum Zitat Zitzler E, Laumanns M, Thiele L (2001) Spea2: improving the strength pareto evolutionary algorithm. TIK-report, 103 Zitzler E, Laumanns M, Thiele L (2001) Spea2: improving the strength pareto evolutionary algorithm. TIK-report, 103
52.
Zurück zum Zitat Zitzler E, Thiele L (1999) Multiobjective evolutionary algorithms: a comparative case study and the strength pareto approach. IEEE Trans Evol Comput 3(4):257–271 Zitzler E, Thiele L (1999) Multiobjective evolutionary algorithms: a comparative case study and the strength pareto approach. IEEE Trans Evol Comput 3(4):257–271
Metadaten
Titel
Improving many objective optimisation algorithms using objective dimensionality reduction
verfasst von
Xuan Hung Nguyen
Lam Thu Bui
Cao Truong Tran
Publikationsdatum
25.09.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Evolutionary Intelligence / Ausgabe 3/2020
Print ISSN: 1864-5909
Elektronische ISSN: 1864-5917
DOI
https://doi.org/10.1007/s12065-019-00297-4

Weitere Artikel der Ausgabe 3/2020

Evolutionary Intelligence 3/2020 Zur Ausgabe

Premium Partner