Skip to main content
Top
Published in: Soft Computing 21/2018

06-09-2018 | Focus

MOEA/D with chain-based random local search for sparse optimization

Authors: Hui Li, Jianyong Sun, Mingyang Wang, Qingfu Zhang

Published in: Soft Computing | Issue 21/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The goal in sparse approximation is to find a sparse representation of a system. This can be done by minimizing a data-fitting term and a sparsity term at the same time. This sparse term imposes penalty for sparsity. In classical iterative thresholding methods, these two terms are often combined into a single function, where a relaxed parameter is used to balance the error and the sparsity. It is acknowledged that the setting of relaxed parameter is sensitive to the performance of iterative thresholding methods. In this paper, we proposed to address this difficulty by finding a set of nondominated solutions with different sparsity levels via multiobjective evolutionary algorithms (MOEAs). A new MOEA/D is developed specifically for sparse optimization, in which a chain-based random local search (CRLS) is employed for optimizing subproblems with various sparsity levels. The performance of the proposed algorithm, denoted by MOEA/D-CRLS, is tested on a set of sixteen noise-free or noisy test problems. Our experimental results suggest that MOEA/D-CRLS is competitive regarding the solution precision on the noise-free test problems, and clearly superior on the noisy test problems against three existing representative sparse optimization methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Beck A, Teboulle M (2009) A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J Imaging Sci 2(1):183–202MathSciNetCrossRef Beck A, Teboulle M (2009) A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J Imaging Sci 2(1):183–202MathSciNetCrossRef
go back to reference Blumensath T, Davies ME (2009) Iterative hard thresholding for compressed sensing. Appl Comput Harmon Anal 27(3):265–274MathSciNetCrossRef Blumensath T, Davies ME (2009) Iterative hard thresholding for compressed sensing. Appl Comput Harmon Anal 27(3):265–274MathSciNetCrossRef
go back to reference Cai Z, Wang Y (2006) A multiobjective optimization-based evolutionary algorithm for constrained optimization. IEEE Trans Evol Comput 10(6):658–675CrossRef Cai Z, Wang Y (2006) A multiobjective optimization-based evolutionary algorithm for constrained optimization. IEEE Trans Evol Comput 10(6):658–675CrossRef
go back to reference Cai X, Yang Z, Fan Z, Zhang Q (2017) Decomposition-based-sorting and angle-based-selection for evolutionary multiobjective and many-objective optimization. IEEE Trans Cybern 47(9):2824–2837CrossRef Cai X, Yang Z, Fan Z, Zhang Q (2017) Decomposition-based-sorting and angle-based-selection for evolutionary multiobjective and many-objective optimization. IEEE Trans Cybern 47(9):2824–2837CrossRef
go back to reference Carvalho R, Saldanha R, Gomes B, Lisboa A, Martins A (2012) A multi-objective evolutionary algorithm based on decomposition for optimal design of Yagi-Uda antennas. IEEE Trans Magn 48(2):803–806CrossRef Carvalho R, Saldanha R, Gomes B, Lisboa A, Martins A (2012) A multi-objective evolutionary algorithm based on decomposition for optimal design of Yagi-Uda antennas. IEEE Trans Magn 48(2):803–806CrossRef
go back to reference Coello Coello CA (2000) Constraint handling using an evolutionary multiobjective optimization technique. Civ Eng Environ Syst 17(4):319–346CrossRef Coello Coello CA (2000) Constraint handling using an evolutionary multiobjective optimization technique. Civ Eng Environ Syst 17(4):319–346CrossRef
go back to reference Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evolut Comput 6(2):182–197CrossRef Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evolut Comput 6(2):182–197CrossRef
go back to reference Kingsbury N (2001) Complex wavelets for shift invariant analysis and filtering of signals. Appl Comput Harmon Anal 10(3):234–253MathSciNetCrossRef Kingsbury N (2001) Complex wavelets for shift invariant analysis and filtering of signals. Appl Comput Harmon Anal 10(3):234–253MathSciNetCrossRef
go back to reference Konstantinidis A, Yang K (2011) Multi-objective energy-ecient dense deployment in wireless sensor networks using a hybrid problem-specic MOEA/D. Appl Soft Comput 11(6):4117–4134CrossRef Konstantinidis A, Yang K (2011) Multi-objective energy-ecient dense deployment in wireless sensor networks using a hybrid problem-specic MOEA/D. Appl Soft Comput 11(6):4117–4134CrossRef
go back to reference Li H, Landa-Silva D (2011) An adaptive evolutionary multi-objective approach based on simulated annealing. Evol Comput 19(4):561–595CrossRef Li H, Landa-Silva D (2011) An adaptive evolutionary multi-objective approach based on simulated annealing. Evol Comput 19(4):561–595CrossRef
go back to reference Li H, Zhang Q (2009) Multiobjective optimization problems with complicated pareto sets, MOEA/D and NSGA-II. IEEE Trans Evol Comput 13(2):284–302CrossRef Li H, Zhang Q (2009) Multiobjective optimization problems with complicated pareto sets, MOEA/D and NSGA-II. IEEE Trans Evol Comput 13(2):284–302CrossRef
go back to reference Li H, Su XL, Xu ZB, Zhang Q (2012) MOEA/D with iterative thresholding algorithm for sparse optimization problems. In: Proceedings of 12th international conference parallel problem solving nature (PPSN), pp 93–101 Li H, Su XL, Xu ZB, Zhang Q (2012) MOEA/D with iterative thresholding algorithm for sparse optimization problems. In: Proceedings of 12th international conference parallel problem solving nature (PPSN), pp 93–101
go back to reference Li L, Yao X, Stolkin R, Gong MG, He S (2014) An evolutionary multiobjective approach to sparse reconstruction. IEEE Trans Evol Comput 18(6):827–845CrossRef Li L, Yao X, Stolkin R, Gong MG, He S (2014) An evolutionary multiobjective approach to sparse reconstruction. IEEE Trans Evol Comput 18(6):827–845CrossRef
go back to reference Li H, Fan Y, Zhang Q, Xu Z, Deng J (2016) A multi-phase multiobjective approach based on decomposition for sparse reconstruction. In: 2016 IEEE congress on evolutionary computation (CEC), pp 601–608 Li H, Fan Y, Zhang Q, Xu Z, Deng J (2016) A multi-phase multiobjective approach based on decomposition for sparse reconstruction. In: 2016 IEEE congress on evolutionary computation (CEC), pp 601–608
go back to reference Li H, Zhang Q, Deng J (2017a) Biased multiobjective optimization and decomposition algorithm. IEEE Trans Cybern 47(1):52–66CrossRef Li H, Zhang Q, Deng J (2017a) Biased multiobjective optimization and decomposition algorithm. IEEE Trans Cybern 47(1):52–66CrossRef
go back to reference Li H, Zhang Q, Deng J, Xu Z (2017b) A preference-based multiobjective evolutionary approach for sparse optimization. IEEE Trans Neural Netw Learn Syst 29:1716–1731MathSciNetCrossRef Li H, Zhang Q, Deng J, Xu Z (2017b) A preference-based multiobjective evolutionary approach for sparse optimization. IEEE Trans Neural Netw Learn Syst 29:1716–1731MathSciNetCrossRef
go back to reference Liu HL, Gu F, Zhang Q (2014) Decomposition of a multiobjective optimization problem into a number of simple multiobjective subproblems. IEEE Trans Evolut Comput 18(3):450–455CrossRef Liu HL, Gu F, Zhang Q (2014) Decomposition of a multiobjective optimization problem into a number of simple multiobjective subproblems. IEEE Trans Evolut Comput 18(3):450–455CrossRef
go back to reference Mallat SG, Zhang Z (1993) Matching pursuits with time–frequency dictionaries. IEEE Trans Signal Process 44(12):3397–3415CrossRef Mallat SG, Zhang Z (1993) Matching pursuits with time–frequency dictionaries. IEEE Trans Signal Process 44(12):3397–3415CrossRef
go back to reference Medina M, Coello Coello C, Ramirez J (2013) Reactive power handling by a multi-objective teaching learning optimizer based on decomposition. IEEE Trans Power Syst 28(4):3629–3637CrossRef Medina M, Coello Coello C, Ramirez J (2013) Reactive power handling by a multi-objective teaching learning optimizer based on decomposition. IEEE Trans Power Syst 28(4):3629–3637CrossRef
go back to reference Mei Y, Tang K, Yao X (2011) Decomposition-based memetic algorithm for multiobjective capacitated arc routing problem. IEEE Trans Evolut Comput 15(2):151–165CrossRef Mei Y, Tang K, Yao X (2011) Decomposition-based memetic algorithm for multiobjective capacitated arc routing problem. IEEE Trans Evolut Comput 15(2):151–165CrossRef
go back to reference Rubio-Largo l, Zhang Q, Vega-Rodrguez MA (2014) A multiobjective evolutionary algorithm based on decomposition with normal boundary intersection for traffic grooming in optical networks. Inf Sci 289:91–116MathSciNetCrossRef Rubio-Largo l, Zhang Q, Vega-Rodrguez MA (2014) A multiobjective evolutionary algorithm based on decomposition with normal boundary intersection for traffic grooming in optical networks. Inf Sci 289:91–116MathSciNetCrossRef
go back to reference Tropp J, Gilbert AC (2007) Signal recovery from partial information via orthogonal matching pursuit. IEEE Trans Inf Theory 53(12):4655–4666CrossRef Tropp J, Gilbert AC (2007) Signal recovery from partial information via orthogonal matching pursuit. IEEE Trans Inf Theory 53(12):4655–4666CrossRef
go back to reference Xu Z, Chang X, Xu F, Zhang H (2012) L1/2 regularization: a thresholding representation theory and a fast solver. IEEE Trans Neural Netw Learn Syst 23(7):1013–1027CrossRef Xu Z, Chang X, Xu F, Zhang H (2012) L1/2 regularization: a thresholding representation theory and a fast solver. IEEE Trans Neural Netw Learn Syst 23(7):1013–1027CrossRef
go back to reference Zeng JS, Xu ZB, Zhang BC, Hong W, Wu YR (2013) Accelerated L1/2 regularization based SAR imaging via BCR and reduced Newton skills. Signal Process 93(7):1831–1844CrossRef Zeng JS, Xu ZB, Zhang BC, Hong W, Wu YR (2013) Accelerated L1/2 regularization based SAR imaging via BCR and reduced Newton skills. Signal Process 93(7):1831–1844CrossRef
go back to reference Zeng J, Lin S, Wang Y, Xu Z (2014) L1/2 regularization: convergence of iterative half thresholding algorithm. IEEE Trans Signal Process 62(9):2317–2329MathSciNetCrossRef Zeng J, Lin S, Wang Y, Xu Z (2014) L1/2 regularization: convergence of iterative half thresholding algorithm. IEEE Trans Signal Process 62(9):2317–2329MathSciNetCrossRef
go back to reference Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731CrossRef Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731CrossRef
go back to reference Zhang Q, Li H, Maringer D, Tsang EPK (2010) MOEA/D with NBI-style Tchebycheff approach for portfolio management. In: Proceedings of the IEEE congress on evolutionary computation, CEC 2010, Barcelona, Spain, 18–23 July 2010, pp 1–8 Zhang Q, Li H, Maringer D, Tsang EPK (2010) MOEA/D with NBI-style Tchebycheff approach for portfolio management. In: Proceedings of the IEEE congress on evolutionary computation, CEC 2010, Barcelona, Spain, 18–23 July 2010, pp 1–8
go back to reference Zhou Y, Kwong S, Guo H, Zhang X, Zhang Q (2017) A two-phase evolutionary approach for compressive sensing reconstruction. IEEE Trans Cybern 47(9):2651–2663CrossRef Zhou Y, Kwong S, Guo H, Zhang X, Zhang Q (2017) A two-phase evolutionary approach for compressive sensing reconstruction. IEEE Trans Cybern 47(9):2651–2663CrossRef
Metadata
Title
MOEA/D with chain-based random local search for sparse optimization
Authors
Hui Li
Jianyong Sun
Mingyang Wang
Qingfu Zhang
Publication date
06-09-2018
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 21/2018
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-018-3460-y

Other articles of this Issue 21/2018

Soft Computing 21/2018 Go to the issue

Premium Partner