Skip to main content

2013 | OriginalPaper | Buchkapitel

Fast Implementation of 1-Greedy Algorithm

verfasst von : Alexander Petukhov, Inna Kozlov

Erschienen in: Recent Advances in Harmonic Analysis and Applications

Verlag: Springer New York

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present an algorithm for finding sparse solutions of the system of linear equations A x = b with the rectangular matrix A of size n ×N, where n < N. The algorithm basic constructive block is one iteration of the standard interior-point linear programming algorithm. To find the sparse representation we modify (reweight) each iteration in the spirit of Petukhov (Fast implementation of orthogonal greedy algorithm for tight wavelet frames. Signal Process. 86, 471–479 (2006)). However, the weights are selected according to the 1-greedy strategy developed in Kozlov and Petukhov (Sparse solutions for underdetermined systems of linear equations. In: Freeden, W., Nashed, M.Z., Sonar, T. (eds.) Handbook of Geomathematics, pp. 1243–1259. Springer, Berlin (2010)). Our algorithm combines computational complexity close to plain 1-minimization with the significantly higher efficiency of the sparse representations recovery than the reweighted 1-minimization (Candes et al.: Enhancing sparsity by reweighted 1 minimization. J. Fourier Anal. Appl. 14, 877–905 (2008) (special issue on sparsity)), approaching the capacity of the 1-greedy algorithm.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press, Cambridge (2004)MATH Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press, Cambridge (2004)MATH
2.
Zurück zum Zitat Candès, E.J., Tao, T.: Decoding by linear programming. IEEE Trans. Inform. Theor. 51, 4203–4215 (2005)CrossRef Candès, E.J., Tao, T.: Decoding by linear programming. IEEE Trans. Inform. Theor. 51, 4203–4215 (2005)CrossRef
3.
Zurück zum Zitat Candes, E.J., Wakin, M.B., Boyd, S.: Enhancing sparsity by reweighted ℓ 1 minimization. J. Fourier Anal. Appl. 14, 877–905 (2008) (special issue on sparsity) Candes, E.J., Wakin, M.B., Boyd, S.: Enhancing sparsity by reweighted 1 minimization. J. Fourier Anal. Appl. 14, 877–905 (2008) (special issue on sparsity)
4.
Zurück zum Zitat Chartrand, R., Yin, W.: Iteratively reweighted algorithms for compressive sensing. In: Proceedings of International Conference on Acoustics, Speech, Signal Processing (ICASSP), pp. 3869–3872 (2008) Chartrand, R., Yin, W.: Iteratively reweighted algorithms for compressive sensing. In: Proceedings of International Conference on Acoustics, Speech, Signal Processing (ICASSP), pp. 3869–3872 (2008)
5.
Zurück zum Zitat Daubechies, I., DeVore, R., Fornasier, M., Güntürk, C.S.: Iteratively re-weighted least squares minimization for sparse recovery. Commun. Pure Appl. Math. 63, 1–38 (2010)MATHCrossRef Daubechies, I., DeVore, R., Fornasier, M., Güntürk, C.S.: Iteratively re-weighted least squares minimization for sparse recovery. Commun. Pure Appl. Math. 63, 1–38 (2010)MATHCrossRef
7.
Zurück zum Zitat Donoho, D., Tsaig, Y., Drori, I., Starck, J.: Sparse solutions of underdetermined linear equations by stagewise orthogonal matching pursuit. Report, Stanford University (2006) Donoho, D., Tsaig, Y., Drori, I., Starck, J.: Sparse solutions of underdetermined linear equations by stagewise orthogonal matching pursuit. Report, Stanford University (2006)
8.
Zurück zum Zitat Foucart, S., Lai, M.J.: Sparsest solutions of underdetermined linear systems via ℓ q -minimization for 0 ≤ q ≤ 1. Appl. Comp. Harmonic Anal. 26, 395–407 (2009)MathSciNetMATHCrossRef Foucart, S., Lai, M.J.: Sparsest solutions of underdetermined linear systems via q -minimization for 0 ≤ q ≤ 1. Appl. Comp. Harmonic Anal. 26, 395–407 (2009)MathSciNetMATHCrossRef
9.
Zurück zum Zitat Kozlov, I., Petukhov, A.: Sparse solutions for underdetermined systems of linear equations. In: Freeden, W., Nashed, M.Z., Sonar, T. (eds.) Handbook of Geomathematics, pp. 1243–1259. Springer, Berlin (2010)CrossRef Kozlov, I., Petukhov, A.: Sparse solutions for underdetermined systems of linear equations. In: Freeden, W., Nashed, M.Z., Sonar, T. (eds.) Handbook of Geomathematics, pp. 1243–1259. Springer, Berlin (2010)CrossRef
10.
Zurück zum Zitat Lai, M.-J., Wang, J.: An unconstrained l q minimization with 0 < q ≤ 1 for sparse solution of under-determined linear systems. SIAM J. Optim. 21, 82–101 (2010)MathSciNetCrossRef Lai, M.-J., Wang, J.: An unconstrained l q minimization with 0 < q ≤ 1 for sparse solution of under-determined linear systems. SIAM J. Optim. 21, 82–101 (2010)MathSciNetCrossRef
12.
Zurück zum Zitat Petukhov, A.: Fast implementation of orthogonal greedy algorithm for tight wavelet frames. Signal Process. 86, 471–479 (2006)MATHCrossRef Petukhov, A.: Fast implementation of orthogonal greedy algorithm for tight wavelet frames. Signal Process. 86, 471–479 (2006)MATHCrossRef
13.
Zurück zum Zitat Rudelson, M., Vershynin, R.: Geometric approach to error correcting codes and reconstruction of signals. Int. Math. Res. Not. 64, 4019–4041 (2005)MathSciNetCrossRef Rudelson, M., Vershynin, R.: Geometric approach to error correcting codes and reconstruction of signals. Int. Math. Res. Not. 64, 4019–4041 (2005)MathSciNetCrossRef
Metadaten
Titel
Fast Implementation of ℓ 1-Greedy Algorithm
verfasst von
Alexander Petukhov
Inna Kozlov
Copyright-Jahr
2013
Verlag
Springer New York
DOI
https://doi.org/10.1007/978-1-4614-4565-4_25