Skip to main content
Erschienen in: Journal of Scientific Computing 1/2021

01.04.2021

Smoothing Strategy Along with Conjugate Gradient Algorithm for Signal Reconstruction

verfasst von: Caiying Wu, Jing Wang, Jan Harold Alcantara, Jein-Shan Chen

Erschienen in: Journal of Scientific Computing | Ausgabe 1/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a new smoothing strategy along with conjugate gradient algorithm for the signal reconstruction problem. Theoretically, the proposed conjugate gradient algorithm along with the smoothing functions for the absolute value function is shown to possess some nice properties which guarantee global convergence. Numerical experiments and comparisons suggest that the proposed algorithm is an efficient approach for sparse recovery. Moreover, we demonstrate that the approach has some advantages over some existing solvers for the signal reconstruction problem.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Baraniuk, R.: Compressive sensing. IEEE Signal Process. Mag. 24, 118–121 (2007)CrossRef Baraniuk, R.: Compressive sensing. IEEE Signal Process. Mag. 24, 118–121 (2007)CrossRef
2.
Zurück zum Zitat Beck, A., Teboulle, M.: A fast iterative shrinkage thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2(1), 183–202 (2009)MathSciNetCrossRef Beck, A., Teboulle, M.: A fast iterative shrinkage thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2(1), 183–202 (2009)MathSciNetCrossRef
3.
Zurück zum Zitat Becker, S., Bobin, J., Candès, E.: NESTA: a fast and accurate first-order method for sparse recovery. SIAM J. Imaging Sci. 4(1), 1–39 (2011)MathSciNetCrossRef Becker, S., Bobin, J., Candès, E.: NESTA: a fast and accurate first-order method for sparse recovery. SIAM J. Imaging Sci. 4(1), 1–39 (2011)MathSciNetCrossRef
4.
Zurück zum Zitat Bruckstein, A.M., Donoho, D.L., Elad, M.: From sparse solutions of systems of equations to sparse modeling of signals and images. SIAM Rev. 51, 34–81 (2009)MathSciNetCrossRef Bruckstein, A.M., Donoho, D.L., Elad, M.: From sparse solutions of systems of equations to sparse modeling of signals and images. SIAM Rev. 51, 34–81 (2009)MathSciNetCrossRef
5.
Zurück zum Zitat Candès, E.J.: The restricted isometry property and its implications for compressed sensing. Comptes Rendus Mathematique 346(9–10), 589–592 (2008)MathSciNetCrossRef Candès, E.J.: The restricted isometry property and its implications for compressed sensing. Comptes Rendus Mathematique 346(9–10), 589–592 (2008)MathSciNetCrossRef
6.
Zurück zum Zitat Candès, E.J., Randall, P.A.: Highly robust error correction by convex programming. IEEE Trans. Inf. Theory 54, 2829–2840 (2008)MathSciNetCrossRef Candès, E.J., Randall, P.A.: Highly robust error correction by convex programming. IEEE Trans. Inf. Theory 54, 2829–2840 (2008)MathSciNetCrossRef
7.
Zurück zum Zitat Candès, E.J., Romberg, J., Tao, T.: Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inf. Theory 52, 489–509 (2006)MathSciNetCrossRef Candès, E.J., Romberg, J., Tao, T.: Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inf. Theory 52, 489–509 (2006)MathSciNetCrossRef
8.
Zurück zum Zitat Candès, E.J., Romberg, J.K., Tao, T.: Stable signal recovery from incomplete and inaccurate measurements. Commun. Pure Appl. Math. 59(8), 1207–1223 (2006)MathSciNetCrossRef Candès, E.J., Romberg, J.K., Tao, T.: Stable signal recovery from incomplete and inaccurate measurements. Commun. Pure Appl. Math. 59(8), 1207–1223 (2006)MathSciNetCrossRef
9.
Zurück zum Zitat Candès, E.J., Tao, T.: Near optimal signal recovery from random projections: universal encoding strategies. IEEE Trans. Inf. Theory 52, 5406–5425 (2004)MathSciNetCrossRef Candès, E.J., Tao, T.: Near optimal signal recovery from random projections: universal encoding strategies. IEEE Trans. Inf. Theory 52, 5406–5425 (2004)MathSciNetCrossRef
10.
11.
Zurück zum Zitat Candès, E.J., Tao, T.: Near optimal signal recovery from random projections: Universal encoding strategies? IEEE Trans. Inf. Theory 52(12), 5406–5425 (2006)MathSciNetCrossRef Candès, E.J., Tao, T.: Near optimal signal recovery from random projections: Universal encoding strategies? IEEE Trans. Inf. Theory 52(12), 5406–5425 (2006)MathSciNetCrossRef
12.
Zurück zum Zitat Chen, X., Ye, Y., Wang, Z., Ge, D.: Complexity of unconstrained \(L_2-L_p\) minimization. Math. Program. 143, 371–383 (2014)MathSciNetCrossRef Chen, X., Ye, Y., Wang, Z., Ge, D.: Complexity of unconstrained \(L_2-L_p\) minimization. Math. Program. 143, 371–383 (2014)MathSciNetCrossRef
13.
Zurück zum Zitat Chen, X., Zhou, W.: Smoothing nonlinear conjugate gradient method for image restoration using nonsmooth nonconvex minimization. SIAM J. Imaging Sci. 3(4), 765–790 (2010)MathSciNetCrossRef Chen, X., Zhou, W.: Smoothing nonlinear conjugate gradient method for image restoration using nonsmooth nonconvex minimization. SIAM J. Imaging Sci. 3(4), 765–790 (2010)MathSciNetCrossRef
14.
Zurück zum Zitat Chen, X., Zhou, W.: Convergence of the reweighted \(l_1\) minimization algorithm for \(l_2-l_p\) minimization. Comput. Optim. Appl. 59, 47–61 (2014)MathSciNetCrossRef Chen, X., Zhou, W.: Convergence of the reweighted \(l_1\) minimization algorithm for \(l_2-l_p\) minimization. Comput. Optim. Appl. 59, 47–61 (2014)MathSciNetCrossRef
15.
Zurück zum Zitat Daubechies, I., DeVore, R., Fornasier, M., Güntük, S.: Iteratively reweighted least squares minimization for sparse recovery. Commun. Pure Appl. Math. 63, 1–38 (2010)MathSciNetCrossRef Daubechies, I., DeVore, R., Fornasier, M., Güntük, S.: Iteratively reweighted least squares minimization for sparse recovery. Commun. Pure Appl. Math. 63, 1–38 (2010)MathSciNetCrossRef
17.
Zurück zum Zitat Friedman, J., Hastie, T., Tibshirani, R.: A note on the group lasso and a sparse group lasso. Stat. Theory (math.ST). Submitted on 5 Jan (2010) Friedman, J., Hastie, T., Tibshirani, R.: A note on the group lasso and a sparse group lasso. Stat. Theory (math.ST). Submitted on 5 Jan (2010)
18.
Zurück zum Zitat Ge, D., Jiang, X., Ye, Y.: A note on the complexity of \(L_p\) minimization. Math. Program. 129, 285–299 (2011)MathSciNetCrossRef Ge, D., Jiang, X., Ye, Y.: A note on the complexity of \(L_p\) minimization. Math. Program. 129, 285–299 (2011)MathSciNetCrossRef
19.
Zurück zum Zitat Gribnoval, R., Nielsen, M.: Sparse decompositions in unions of bases. IEEE Trans. Inf. Theory 49, 3320–3325 (2003)CrossRef Gribnoval, R., Nielsen, M.: Sparse decompositions in unions of bases. IEEE Trans. Inf. Theory 49, 3320–3325 (2003)CrossRef
20.
Zurück zum Zitat Hale, E.T., Yin, W., Zhang, Y.: Fixed-point continuation for \(\ell _1\)-minimization: methodology and convergence. SIAM J. Optim. 19, 1107–1130 (2008)MathSciNetCrossRef Hale, E.T., Yin, W., Zhang, Y.: Fixed-point continuation for \(\ell _1\)-minimization: methodology and convergence. SIAM J. Optim. 19, 1107–1130 (2008)MathSciNetCrossRef
21.
Zurück zum Zitat Koh, K., Kim, S., Boyd, S.: An interior-point method for large scale \(l_1\) regularized logistic regression. J. Mach. Learn. Res. 8, 1519–1555 (2007)MathSciNetMATH Koh, K., Kim, S., Boyd, S.: An interior-point method for large scale \(l_1\) regularized logistic regression. J. Mach. Learn. Res. 8, 1519–1555 (2007)MathSciNetMATH
22.
Zurück zum Zitat Lai, M.-J., Wang, J.: An unconstrained \(l_q\) minimization with 0 \( < q \le 1\) for sparse solutions of underdetermined linear system. SIAM J. Optim. 21(1), 82–101 (2011)MathSciNetCrossRef Lai, M.-J., Wang, J.: An unconstrained \(l_q\) minimization with 0 \( < q \le 1\) for sparse solutions of underdetermined linear system. SIAM J. Optim. 21(1), 82–101 (2011)MathSciNetCrossRef
23.
Zurück zum Zitat Lai, M.-J., Xu, Y., Yin, W.: Improved iteratively reweighted least squares for unconstrained smoothed \(l_q\) minimization. SIAM J. Numer. Anal. 51(2), 927–957 (2013)MathSciNetCrossRef Lai, M.-J., Xu, Y., Yin, W.: Improved iteratively reweighted least squares for unconstrained smoothed \(l_q\) minimization. SIAM J. Numer. Anal. 51(2), 927–957 (2013)MathSciNetCrossRef
24.
25.
Zurück zum Zitat Nguyen, C.T., Saheya, B., Chang, Y.-L., Chen, J.-S.: Unified smoothing functions for absolute value equation associated with second-order cone. Appl. Numer. Math. 135, 206–227 (2019)MathSciNetCrossRef Nguyen, C.T., Saheya, B., Chang, Y.-L., Chen, J.-S.: Unified smoothing functions for absolute value equation associated with second-order cone. Appl. Numer. Math. 135, 206–227 (2019)MathSciNetCrossRef
26.
Zurück zum Zitat Simonn, N., Friedman, J., Hastieand, T., Tibshirani, R.: A sparse-group lasso. J. Comput. Graph. Stat. 22, 231–245 (2013)MathSciNetCrossRef Simonn, N., Friedman, J., Hastieand, T., Tibshirani, R.: A sparse-group lasso. J. Comput. Graph. Stat. 22, 231–245 (2013)MathSciNetCrossRef
27.
Zurück zum Zitat Wang, X., Liu, F., Jiao, L.C., Wu, J., Chen, J.: Incomplete variables truncated conjugate gradient method for signal reconstruction in compressed sensing. Inf. Sci. 288, 387–411 (2014)CrossRef Wang, X., Liu, F., Jiao, L.C., Wu, J., Chen, J.: Incomplete variables truncated conjugate gradient method for signal reconstruction in compressed sensing. Inf. Sci. 288, 387–411 (2014)CrossRef
28.
Zurück zum Zitat Wang, Y., Yin, W., Zheng, J.: Global convergence of ADMM in nonconvex nonsmooth optimization. J. Sci. Comput. 78, 29–63 (2019)MathSciNetCrossRef Wang, Y., Yin, W., Zheng, J.: Global convergence of ADMM in nonconvex nonsmooth optimization. J. Sci. Comput. 78, 29–63 (2019)MathSciNetCrossRef
29.
Zurück zum Zitat Wu, C., Zhan, J., Lu, Y., Chen, J.-S.: Signal reconstruction by conjugate gradient algorithm based on smoothing \(l_1-\)norm. Calcolo 56(4), 1–26 (2019)CrossRef Wu, C., Zhan, J., Lu, Y., Chen, J.-S.: Signal reconstruction by conjugate gradient algorithm based on smoothing \(l_1-\)norm. Calcolo 56(4), 1–26 (2019)CrossRef
30.
Zurück zum Zitat Wu, C., Zhang, J., Chen, J.-S.: An elastic unconstrained \(l_q-l_1\) minimization for finding sparse solution, submitted manuscript (2019) Wu, C., Zhang, J., Chen, J.-S.: An elastic unconstrained \(l_q-l_1\) minimization for finding sparse solution, submitted manuscript (2019)
31.
Zurück zum Zitat Xu, Z., Chang, X., Xu, F., Zhang, H.: \(L_{1/2}\) regularization: a thresholding representation theory and a fast solver. IEEE Trans. Neural Netw. Learn. Syst. 23, 1013–1027 (2012)CrossRef Xu, Z., Chang, X., Xu, F., Zhang, H.: \(L_{1/2}\) regularization: a thresholding representation theory and a fast solver. IEEE Trans. Neural Netw. Learn. Syst. 23, 1013–1027 (2012)CrossRef
32.
Zurück zum Zitat Yin, K., Xiao, Y.H., Zhang, M.L.: Nonlinear conjugate gradient method for \(l_1\)-norm regularization problems in compressive sensing. J. Comput. Inf. Syst. 7, 880–885 (2011) Yin, K., Xiao, Y.H., Zhang, M.L.: Nonlinear conjugate gradient method for \(l_1\)-norm regularization problems in compressive sensing. J. Comput. Inf. Syst. 7, 880–885 (2011)
33.
34.
Zurück zum Zitat Zhang, Y., Ye, W.: Sparse recovery by the iteratively reweighted \(l_1\) algorithm for elastic \(l_2-l_q\) minimization. Optimization 66(10), 1677–1687 (2017)MathSciNetCrossRef Zhang, Y., Ye, W.: Sparse recovery by the iteratively reweighted \(l_1\) algorithm for elastic \(l_2-l_q\) minimization. Optimization 66(10), 1677–1687 (2017)MathSciNetCrossRef
35.
Zurück zum Zitat Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B-Stat. Methodol. 67, 301–320 (2005)MathSciNetCrossRef Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B-Stat. Methodol. 67, 301–320 (2005)MathSciNetCrossRef
36.
Zurück zum Zitat Zhu, H., Xiao, Y.H., Wu, S.Y.: Large sparse signal recovery by conjugate gradient algorithm based on smoothing technique. Comput. Math. Appl. 66, 24–32 (2013)MathSciNetCrossRef Zhu, H., Xiao, Y.H., Wu, S.Y.: Large sparse signal recovery by conjugate gradient algorithm based on smoothing technique. Comput. Math. Appl. 66, 24–32 (2013)MathSciNetCrossRef
Metadaten
Titel
Smoothing Strategy Along with Conjugate Gradient Algorithm for Signal Reconstruction
verfasst von
Caiying Wu
Jing Wang
Jan Harold Alcantara
Jein-Shan Chen
Publikationsdatum
01.04.2021
Verlag
Springer US
Erschienen in
Journal of Scientific Computing / Ausgabe 1/2021
Print ISSN: 0885-7474
Elektronische ISSN: 1573-7691
DOI
https://doi.org/10.1007/s10915-021-01440-z

Weitere Artikel der Ausgabe 1/2021

Journal of Scientific Computing 1/2021 Zur Ausgabe

Premium Partner