Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 1/2019

18-05-2017 | Original Article

Reconstruction of sparse signals via neurodynamic optimization

Authors: Guocheng Li, Zheng Yan

Published in: International Journal of Machine Learning and Cybernetics | Issue 1/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

It is significant to solve \(l_1\) minimization problems efficiently and reliably in compressed sensing (CS) since the \(l_1\) minimization is essential for the recovery of sparse signals. In view of this, a neurodynamic optimization approach is proposed for solving the \(l_1\)-minimization problems for reconstruction of sparse signals based on a projection neural network (PNN). The proposed neurodynamic optimization approach differs from most \(l_1\)-solvers in that it operates in continuous time rather than being specified by discrete iterations; i.e., it evolves according to deterministic neurodynamics. The proposed PNN is designed based on subgradient projection methods. The neural network has a simple structure, giving it a potential to be implemented as a large-scale analog circuit. It is proved that under appropriate conditions on the measurement matrix, every neuronal state of the proposed neural network is convergent to the optimal solution of the \(l_1\)-minimization problem under study. Simulation results are provided to substantiate the effectiveness of the proposed approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
3.
go back to reference Candes EJ, Romberg J, Tao T (2006) Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. Trans IEEE Inf Theory 52(2):489–509MathSciNetCrossRefMATH Candes EJ, Romberg J, Tao T (2006) Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. Trans IEEE Inf Theory 52(2):489–509MathSciNetCrossRefMATH
4.
go back to reference Lustig M, Donoho D, Pauly J (2007) The application of compressed sensing for rapid MR imaging. Magn Reson Med 58(6):1182CrossRef Lustig M, Donoho D, Pauly J (2007) The application of compressed sensing for rapid MR imaging. Magn Reson Med 58(6):1182CrossRef
5.
go back to reference Trzasko J, Manduca A, Trans IEEE (2009) Highly undersampled magnetic resonance image reconstruction via homotopic minimization. Med Imag 28(1):106–121CrossRef Trzasko J, Manduca A, Trans IEEE (2009) Highly undersampled magnetic resonance image reconstruction via homotopic minimization. Med Imag 28(1):106–121CrossRef
6.
go back to reference Duarte M, Davenport M, Tahkar D, Laska J, Ting S, Kelly K, Baraniuk R (2008) Single-pixel imaging via compressive sampling. IEEE Signal Process Mag 25(2):83–91CrossRef Duarte M, Davenport M, Tahkar D, Laska J, Ting S, Kelly K, Baraniuk R (2008) Single-pixel imaging via compressive sampling. IEEE Signal Process Mag 25(2):83–91CrossRef
8.
go back to reference Candes EJ, Acad CR (2008) The restricted isometry property and its applications for compressed sensing. C R Acad Sci Paris Ser I 346(9–10):589–592 Candes EJ, Acad CR (2008) The restricted isometry property and its applications for compressed sensing. C R Acad Sci Paris Ser I 346(9–10):589–592
10.
go back to reference Kim SJ, Koh K, Lustig M, Boyd S, Corinevsky D (2007) An interior-point method for large-scale l1 regularized least squares. IEEE J Select Topics Signal Process 1(4):606–617CrossRef Kim SJ, Koh K, Lustig M, Boyd S, Corinevsky D (2007) An interior-point method for large-scale l1 regularized least squares. IEEE J Select Topics Signal Process 1(4):606–617CrossRef
11.
go back to reference Donoho DL, Tsaig Y (2006) Fast solution of l1-norm minimization problems when the solution may be sparse. Department of Statistics, Stanford University, USA, Tech. rep Donoho DL, Tsaig Y (2006) Fast solution of l1-norm minimization problems when the solution may be sparse. Department of Statistics, Stanford University, USA, Tech. rep
12.
go back to reference Figueiredo M, Nowak R, Wright S, Sel IEEEJ (2007) Gradient projection for sparse reconstruction: application to compressed sensing and other inverse problems. Topics Signal Process 1(4):586–598CrossRef Figueiredo M, Nowak R, Wright S, Sel IEEEJ (2007) Gradient projection for sparse reconstruction: application to compressed sensing and other inverse problems. Topics Signal Process 1(4):586–598CrossRef
13.
go back to reference Candes EJ (2008) The restricted isometry property and its implications for compressed sensing. Comptes Rendus Acad Sci Ser I 346(9–10):589–592 Candes EJ (2008) The restricted isometry property and its implications for compressed sensing. Comptes Rendus Acad Sci Ser I 346(9–10):589–592
14.
go back to reference Becker S, Bobin J, Candes EJ (2011) Nesta: a fast and accurate first-order method for sparse recovery. SIAM J Imaging Sci 4(1):1–39MathSciNetCrossRefMATH Becker S, Bobin J, Candes EJ (2011) Nesta: a fast and accurate first-order method for sparse recovery. SIAM J Imaging Sci 4(1):1–39MathSciNetCrossRefMATH
15.
go back to reference Yin W, Osher S, Goldfarb D, Darbon J (2008) Bregman iterative algorithms for l1-minimization with applications to compressed sensing. SIAM J Imaging Sci 1(1):143–168MathSciNetCrossRefMATH Yin W, Osher S, Goldfarb D, Darbon J (2008) Bregman iterative algorithms for l1-minimization with applications to compressed sensing. SIAM J Imaging Sci 1(1):143–168MathSciNetCrossRefMATH
16.
17.
go back to reference Daubechies I, Defrise M, Mol CD (2004) An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Commun Pure Appl Math 57(11):1413–1457MathSciNetCrossRefMATH Daubechies I, Defrise M, Mol CD (2004) An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Commun Pure Appl Math 57(11):1413–1457MathSciNetCrossRefMATH
18.
19.
go back to reference Donoho D, Tsaig Y (2008) Fast solution for l1-norm minimization problems when the solution may be sparse. Trans IEEE Inf Theory 54(11):4789–4812CrossRefMATH Donoho D, Tsaig Y (2008) Fast solution for l1-norm minimization problems when the solution may be sparse. Trans IEEE Inf Theory 54(11):4789–4812CrossRefMATH
20.
go back to reference Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. In: Proc Nat Acad Sci Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. In: Proc Nat Acad Sci
21.
go back to reference Cichocki A, Unbehauen R (1993) Neural networks for optimization and signal processing. Wiley, New YorkMATH Cichocki A, Unbehauen R (1993) Neural networks for optimization and signal processing. Wiley, New YorkMATH
22.
go back to reference Twigg C, Hasler P (2009) Configurable analog signal processing. Digital Signal Process 19(6):904–922CrossRef Twigg C, Hasler P (2009) Configurable analog signal processing. Digital Signal Process 19(6):904–922CrossRef
23.
go back to reference Rozell CJ, Johnson DH, Baraniuk RG, Olshausen BA (2008) Sparse coding via thresholding and local competition in neural circuits. Neural Comput 20(10):2526–2563MathSciNetCrossRef Rozell CJ, Johnson DH, Baraniuk RG, Olshausen BA (2008) Sparse coding via thresholding and local competition in neural circuits. Neural Comput 20(10):2526–2563MathSciNetCrossRef
24.
go back to reference Guo ZS, Wang J (2010) A neurodynamical optimization approach to constrained sparsity maximization based on alternative objective functions. In: Proceedings of International Joint Conference on Neural Networks Guo ZS, Wang J (2010) A neurodynamical optimization approach to constrained sparsity maximization based on alternative objective functions. In: Proceedings of International Joint Conference on Neural Networks
25.
go back to reference Liu Q, Wang J (2009) A one-layer recurrent neural network for nonsmooth convex optimization subject to linear equality constraints. In: Proc Int Conf Neural Inf, Process Liu Q, Wang J (2009) A one-layer recurrent neural network for nonsmooth convex optimization subject to linear equality constraints. In: Proc Int Conf Neural Inf, Process
26.
go back to reference Guo Z, Liu Q, Wang J (2011) A one-layer recurrent neural network for pseudoconvex optimization with linear equality constraints. IEEE Trans Neural Netw 22(12):1892–1900CrossRef Guo Z, Liu Q, Wang J (2011) A one-layer recurrent neural network for pseudoconvex optimization with linear equality constraints. IEEE Trans Neural Netw 22(12):1892–1900CrossRef
27.
go back to reference Filippov A (1988) Differential equations with discontinuous right-hand side. Kluwer Academic, DordrechtCrossRefMATH Filippov A (1988) Differential equations with discontinuous right-hand side. Kluwer Academic, DordrechtCrossRefMATH
29.
go back to reference Clarke F (1969) Optimization and non-smooth analysis. Wiley, New York Clarke F (1969) Optimization and non-smooth analysis. Wiley, New York
30.
go back to reference Pardalos P (2008) Nonconvex optimization and its application. Berlin Heidelberg Pardalos P (2008) Nonconvex optimization and its application. Berlin Heidelberg
31.
go back to reference Cambini A, Martein L (2009) Generalized convexity and optimization: theory and applications. Springer-Verlag, Berlin HeidelbergMATH Cambini A, Martein L (2009) Generalized convexity and optimization: theory and applications. Springer-Verlag, Berlin HeidelbergMATH
Metadata
Title
Reconstruction of sparse signals via neurodynamic optimization
Authors
Guocheng Li
Zheng Yan
Publication date
18-05-2017
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 1/2019
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-017-0694-4

Other articles of this Issue 1/2019

International Journal of Machine Learning and Cybernetics 1/2019 Go to the issue