Skip to main content
Erschienen in: Journal of Scientific Computing 3/2016

28.01.2016

Point Source Super-resolution Via Non-convex \(L_1\) Based Methods

verfasst von: Yifei Lou, Penghang Yin, Jack Xin

Erschienen in: Journal of Scientific Computing | Ausgabe 3/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We study the super-resolution (SR) problem of recovering point sources consisting of a collection of isolated and suitably separated spikes from only the low frequency measurements. If the peak separation is above a factor in (1, 2) of the Rayleigh length (physical resolution limit), \(L_1\) minimization is guaranteed to recover such sparse signals. However, below such critical length scale, especially the Rayleigh length, the \(L_1\) certificate no longer exists. We show several local properties (local minimum, directional stationarity, and sparsity) of the limit points of minimizing two \(L_1\) based nonconvex penalties, the difference of \(L_1\) and \(L_2\) norms (\(L_{1-2}\)) and capped \(L_1\) (C\(L_1\)), subject to the measurement constraints. In one and two dimensional numerical SR examples, the local optimal solutions from difference of convex function algorithms outperform the global \(L_1\) solutions near or below Rayleigh length scales either in the accuracy of ground truth recovery or in finding a sparse solution satisfying the constraints more accurately.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
Denote \(.*\) be entry-wise multiplication, and \(|\cdot |\) be entry-wise absolute value (Note \(\Vert \cdot \Vert _1\) is the standard \(L_1\) norm).
 
Literatur
1.
Zurück zum Zitat Aubel, C., Stotz, D., Bölcskei, H.: A theory of super-resolution from short-time fourier transform measurements. Tech. rep., arXiv preprint arXiv:1509.01047 (2015) Aubel, C., Stotz, D., Bölcskei, H.: A theory of super-resolution from short-time fourier transform measurements. Tech. rep., arXiv preprint arXiv:​1509.​01047 (2015)
2.
Zurück zum Zitat Azais, J.M., De-Castro, Y., Gamboa, F.: Spike detection from inaccurate samplings. Appl. Comput. Harmon. Anal. 38(2), 177–195 (2015)MathSciNetCrossRefMATH Azais, J.M., De-Castro, Y., Gamboa, F.: Spike detection from inaccurate samplings. Appl. Comput. Harmon. Anal. 38(2), 177–195 (2015)MathSciNetCrossRefMATH
3.
Zurück zum Zitat Borman, S., Stevenson, R.L.: Super-resolution from image sequences—a review. In: Midwest Symposium on Circuits and Systems, pp. 374–378 (1998) Borman, S., Stevenson, R.L.: Super-resolution from image sequences—a review. In: Midwest Symposium on Circuits and Systems, pp. 374–378 (1998)
4.
Zurück zum Zitat Candes, E., Romberg, J., Tao, T.: Stable signal recovery from incomplete and inaccurate measurements. Commun. Pure Appl. Math. 59, 1207–1223 (2006)MathSciNetCrossRefMATH Candes, E., Romberg, J., Tao, T.: Stable signal recovery from incomplete and inaccurate measurements. Commun. Pure Appl. Math. 59, 1207–1223 (2006)MathSciNetCrossRefMATH
5.
6.
Zurück zum Zitat Candès, E.J., Fernandez-Granda, C.: Towards a mathematical theory of super-resolution. Commun. Pure Appl. Math. 67(6), 906–956 (2014)MathSciNetCrossRefMATH Candès, E.J., Fernandez-Granda, C.: Towards a mathematical theory of super-resolution. Commun. Pure Appl. Math. 67(6), 906–956 (2014)MathSciNetCrossRefMATH
7.
Zurück zum Zitat Chartrand, R.: Exact reconstruction of sparse signals via nonconvex minimization. IEEE Signal Process. Lett. 10(14), 707–710 (2007)CrossRef Chartrand, R.: Exact reconstruction of sparse signals via nonconvex minimization. IEEE Signal Process. Lett. 10(14), 707–710 (2007)CrossRef
8.
Zurück zum Zitat Chartrand, R., Yin, W.: Iteratively reweighted algorithms for compressive sensing. In: International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 3869–3872 (2008) Chartrand, R., Yin, W.: Iteratively reweighted algorithms for compressive sensing. In: International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 3869–3872 (2008)
9.
Zurück zum Zitat Chen, X., Xu, F., Ye, Y.: Lower bound theory of nonzero entries in solutions of \(L_{2}{-}L_{p}\) minimization. SIAM J. Sci. Comput. 32(5), 2832–2852 (2010)MathSciNetCrossRefMATH Chen, X., Xu, F., Ye, Y.: Lower bound theory of nonzero entries in solutions of \(L_{2}{-}L_{p}\) minimization. SIAM J. Sci. Comput. 32(5), 2832–2852 (2010)MathSciNetCrossRefMATH
10.
Zurück zum Zitat De-Castro, Y., Gamboa, F.: Exact reconstruction using Beurling minimal extrapolation. J. Math. Anal. Appl. 395(1), 336–354 (2012)MathSciNetCrossRefMATH De-Castro, Y., Gamboa, F.: Exact reconstruction using Beurling minimal extrapolation. J. Math. Anal. Appl. 395(1), 336–354 (2012)MathSciNetCrossRefMATH
11.
Zurück zum Zitat Demanet, L., Nguyen, N.: The recoverability limit for superresolution via sparsity. Tech. rep., arXiv preprint arXiv:1502.01385 (2015) Demanet, L., Nguyen, N.: The recoverability limit for superresolution via sparsity. Tech. rep., arXiv preprint arXiv:​1502.​01385 (2015)
14.
Zurück zum Zitat Donoho, D.L., Johnstone, I.M., Hoch, J.C., Stern, A.S.: Maximum entropy and the nearly black object. J. R. Sat. Soc. Series B (Methodological), 41–81 (1992) Donoho, D.L., Johnstone, I.M., Hoch, J.C., Stern, A.S.: Maximum entropy and the nearly black object. J. R. Sat. Soc. Series B (Methodological), 41–81 (1992)
15.
16.
Zurück zum Zitat Facchinei, F., Pang, J.S.: Finite-dimensional variational inequalities and complementarity problems. Springer, Berlin (2007)MATH Facchinei, F., Pang, J.S.: Finite-dimensional variational inequalities and complementarity problems. Springer, Berlin (2007)MATH
17.
Zurück zum Zitat Fannjiang, A., Liao, W.: Coherence pattern-guided compressive sensing with unresolved grids. SIAM J. Imaging Sci. 5(1), 179–202 (2012)MathSciNetCrossRefMATH Fannjiang, A., Liao, W.: Coherence pattern-guided compressive sensing with unresolved grids. SIAM J. Imaging Sci. 5(1), 179–202 (2012)MathSciNetCrossRefMATH
18.
Zurück zum Zitat Fernandez-Granda, C.: Super-resolution of point sources via convex programming. Tech. rep., arXiv preprint arXiv:1507.07034 (2015) Fernandez-Granda, C.: Super-resolution of point sources via convex programming. Tech. rep., arXiv preprint arXiv:​1507.​07034 (2015)
19.
Zurück zum Zitat Goodman, J.W.: Introduction to Fourier Optics. Roberts and Company Publishers, Englewood (2005) Goodman, J.W.: Introduction to Fourier Optics. Roberts and Company Publishers, Englewood (2005)
20.
Zurück zum Zitat Lai, M.J., Xu, Y., Yin, W.: Improved iteratively reweighted least squares for unconstrained smoothed lq minimization. SIAM J. Numer. Anal. 5(2), 927–957 (2013)MathSciNetCrossRefMATH Lai, M.J., Xu, Y., Yin, W.: Improved iteratively reweighted least squares for unconstrained smoothed lq minimization. SIAM J. Numer. Anal. 5(2), 927–957 (2013)MathSciNetCrossRefMATH
21.
Zurück zum Zitat Lou, Y., Osher, S., Xin, J.: Computational aspects of constrained L1–L2 minimization for compressive sensing. In: Modelling, Computation and Optimization in Information Systems and Management Sciences, pp. 169–180. Springer (2015) Lou, Y., Osher, S., Xin, J.: Computational aspects of constrained L1–L2 minimization for compressive sensing. In: Modelling, Computation and Optimization in Information Systems and Management Sciences, pp. 169–180. Springer (2015)
23.
Zurück zum Zitat Mallat, S., Yu, G.: Super-resolution with sparse mixing estimators. IEEE Trans. Image Process. 19(11), 2889–2900 (2010)MathSciNetCrossRef Mallat, S., Yu, G.: Super-resolution with sparse mixing estimators. IEEE Trans. Image Process. 19(11), 2889–2900 (2010)MathSciNetCrossRef
24.
Zurück zum Zitat Marquina, A., Osher, S.: Image super-resolution by TV-regularization and Bregman iteration. J. Sci. Comput. 37(3), 367–382 (2008)MathSciNetCrossRefMATH Marquina, A., Osher, S.: Image super-resolution by TV-regularization and Bregman iteration. J. Sci. Comput. 37(3), 367–382 (2008)MathSciNetCrossRefMATH
25.
Zurück zum Zitat Morgenshtern, V.I., Candès, E.J.: Super-resolution of positive sources: the discrete setup. Tech. rep., arXiv preprint arXiv:1504.00717 (2015) Morgenshtern, V.I., Candès, E.J.: Super-resolution of positive sources: the discrete setup. Tech. rep., arXiv preprint arXiv:​1504.​00717 (2015)
26.
Zurück zum Zitat Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: a technical overview. IEEE Signal Process. Mag. 20(3), 21–36 (2003)CrossRef Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: a technical overview. IEEE Signal Process. Mag. 20(3), 21–36 (2003)CrossRef
27.
Zurück zum Zitat Peleg, D., Meir, R.: A bilinear formulation for vector sparsity optimization. Signal Process. 88(2), 375–389 (2008)CrossRefMATH Peleg, D., Meir, R.: A bilinear formulation for vector sparsity optimization. Signal Process. 88(2), 375–389 (2008)CrossRefMATH
28.
Zurück zum Zitat Pham-Dinh, T., Le-Thi, H.A.: Convex analysis approach to dc programming: Theory, algorithms and applications. Acta Math. Vietnam. 22(1), 289–355 (1997)MathSciNetMATH Pham-Dinh, T., Le-Thi, H.A.: Convex analysis approach to dc programming: Theory, algorithms and applications. Acta Math. Vietnam. 22(1), 289–355 (1997)MathSciNetMATH
29.
Zurück zum Zitat Pham-Dinh, T., Le-Thi, H.A.: A DC optimization algorithm for solving the trust-region subproblem. SIAM J. Optim. 8(2), 476–505 (1998)MathSciNetCrossRefMATH Pham-Dinh, T., Le-Thi, H.A.: A DC optimization algorithm for solving the trust-region subproblem. SIAM J. Optim. 8(2), 476–505 (1998)MathSciNetCrossRefMATH
30.
Zurück zum Zitat Pham-Dinh, T., Le-Thi, H.A.: The dc (difference of convex functions) programming and dca revisited with dc models of real world nonconvex optimization problems. Ann. Oper. Res. 133(1–4), 23–46 (2005)MathSciNetMATH Pham-Dinh, T., Le-Thi, H.A.: The dc (difference of convex functions) programming and dca revisited with dc models of real world nonconvex optimization problems. Ann. Oper. Res. 133(1–4), 23–46 (2005)MathSciNetMATH
31.
Zurück zum Zitat Protter, M., Elad, M., Takeda, H., Milanfar, P.: Generalizing the non-local-means to super-resolution reconstruction. IEEE Trans. Image Process. 18(1), 36–51 (2009)MathSciNetCrossRef Protter, M., Elad, M., Takeda, H., Milanfar, P.: Generalizing the non-local-means to super-resolution reconstruction. IEEE Trans. Image Process. 18(1), 36–51 (2009)MathSciNetCrossRef
32.
Zurück zum Zitat Shahram, M., Milanfar, P.: Statistical and information-theoretic analysis of resolution in imaging. IEEE Trans. Inf. Theory 8(52), 3411–3437 (2006)MathSciNetCrossRefMATH Shahram, M., Milanfar, P.: Statistical and information-theoretic analysis of resolution in imaging. IEEE Trans. Inf. Theory 8(52), 3411–3437 (2006)MathSciNetCrossRefMATH
33.
Zurück zum Zitat Shen, X., Pan, W., Zhu, Y.: Likelihood-based selection and sharp parameter estimation. J. Am. Stat. Assoc. 107(497), 223–232 (2012)MathSciNetCrossRefMATH Shen, X., Pan, W., Zhu, Y.: Likelihood-based selection and sharp parameter estimation. J. Am. Stat. Assoc. 107(497), 223–232 (2012)MathSciNetCrossRefMATH
34.
Zurück zum Zitat Tang, G., Bhaskar, B.N., Recht, B.: Near minimax line spectral estimation. IEEE Trans. Inf. Theory 61(1), 499–512 (2015)MathSciNetCrossRef Tang, G., Bhaskar, B.N., Recht, B.: Near minimax line spectral estimation. IEEE Trans. Inf. Theory 61(1), 499–512 (2015)MathSciNetCrossRef
35.
36.
Zurück zum Zitat Tropp, J., Gilbert, A.: Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans. Inf. Theory 53(12), 4655–4666 (2007)MathSciNetCrossRefMATH Tropp, J., Gilbert, A.: Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans. Inf. Theory 53(12), 4655–4666 (2007)MathSciNetCrossRefMATH
37.
Zurück zum Zitat Wang, Z., Liu, H., Zhang, T.: Optimal computational and statistical rates of convergence for sparse nonconvex learning problems. Ann. Stat. 42(6), 2164 (2014)MathSciNetCrossRefMATH Wang, Z., Liu, H., Zhang, T.: Optimal computational and statistical rates of convergence for sparse nonconvex learning problems. Ann. Stat. 42(6), 2164 (2014)MathSciNetCrossRefMATH
38.
Zurück zum Zitat Xu, Z., Chang, X., Xu, F., Zhang, H.: \(L_{1/2}\) regularization: a thresholding representation theory and a fast solver. IEEE Trans. Neural Netw. 23, 1013–1027 (2012)CrossRef Xu, Z., Chang, X., Xu, F., Zhang, H.: \(L_{1/2}\) regularization: a thresholding representation theory and a fast solver. IEEE Trans. Neural Netw. 23, 1013–1027 (2012)CrossRef
39.
Zurück zum Zitat Yang, J., Wright, J., Huang, T., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRef Yang, J., Wright, J., Huang, T., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRef
40.
Zurück zum Zitat Yin, P., Lou, Y., He, Q., Xin, J.: Minimization of \(l_1{-}l_2\) for compressed sensing. SIAM J. Sci. Comput. 37, A536–A563 (2015)MathSciNetCrossRefMATH Yin, P., Lou, Y., He, Q., Xin, J.: Minimization of \(l_1{-}l_2\) for compressed sensing. SIAM J. Sci. Comput. 37, A536–A563 (2015)MathSciNetCrossRefMATH
41.
Zurück zum Zitat Zhang, T.: Multi-stage convex relaxation for learning with sparse regularization. In: Advances in Neural Information Processing Systems, pp. 1929–1936 (2009) Zhang, T.: Multi-stage convex relaxation for learning with sparse regularization. In: Advances in Neural Information Processing Systems, pp. 1929–1936 (2009)
Metadaten
Titel
Point Source Super-resolution Via Non-convex Based Methods
verfasst von
Yifei Lou
Penghang Yin
Jack Xin
Publikationsdatum
28.01.2016
Verlag
Springer US
Erschienen in
Journal of Scientific Computing / Ausgabe 3/2016
Print ISSN: 0885-7474
Elektronische ISSN: 1573-7691
DOI
https://doi.org/10.1007/s10915-016-0169-x

Weitere Artikel der Ausgabe 3/2016

Journal of Scientific Computing 3/2016 Zur Ausgabe

Premium Partner