Skip to main content

2018 | OriginalPaper | Buchkapitel

Content Adaptive Constraint Based Image Upsampling

verfasst von : Fan Yang, Huizhu Jia, Don Xie, Rui Chen, Wen Gao

Erschienen in: Advances in Multimedia Information Processing – PCM 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we present a novel image upsampling method within a two-stage framework to reconstruct different image content (large-scale edges and small-scale structures). First, we utilize a total variation (TV) filter for image decomposition which decomposes an image content into structure component and texture component. In the first stage, the structure component is enhanced by a shock filter and an improved non-local means filter, then combines with the texture component to generate initial high-resolution (HR) image. In the second stage, the gradient of initial HR image is regarded as an edge preserving constraint to reconstruct the texture component. Experimental results demonstrate that the new approach can reconstruct faithfully the HR images with sharp edges and texture structures, and annoying artifacts (blurring, jaggies, ringing, etc.) are greatly suppressed. It outperforms the state-of-the-art approaches, based on subjective and objective evaluations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Keys, R.: Cubic convolution interpolation for digital image processing. IEEE Trans. Acoust. Speech Signal Process. (2003) Keys, R.: Cubic convolution interpolation for digital image processing. IEEE Trans. Acoust. Speech Signal Process. (2003)
2.
Zurück zum Zitat Zhang, L., Wu, X.: An edge-guided image interpolation algorithm via directional filtering and data fusion. IEEE Trans. Image Process. 15, 2226–2238 (2006)CrossRef Zhang, L., Wu, X.: An edge-guided image interpolation algorithm via directional filtering and data fusion. IEEE Trans. Image Process. 15, 2226–2238 (2006)CrossRef
3.
Zurück zum Zitat Li, X., Orchard, M.T.: New edge-directed interpolation. IEEE Trans. Image Process. 10, 1521–1527 (2001)CrossRef Li, X., Orchard, M.T.: New edge-directed interpolation. IEEE Trans. Image Process. 10, 1521–1527 (2001)CrossRef
4.
Zurück zum Zitat Zhang, X., Wu, X.: Image interpolation by adaptive 2-D autoregressive modeling and soft-decision estimation. IEEE Trans. Image Process. 17, 887–896 (2008)MathSciNetCrossRef Zhang, X., Wu, X.: Image interpolation by adaptive 2-D autoregressive modeling and soft-decision estimation. IEEE Trans. Image Process. 17, 887–896 (2008)MathSciNetCrossRef
5.
Zurück zum Zitat Hung, K.W., Siu, W.C.: Robust soft-decision interpolation using weighted least squares. IEEE Trans. Image Process. 21, 1061–1069 (2012)MathSciNetCrossRef Hung, K.W., Siu, W.C.: Robust soft-decision interpolation using weighted least squares. IEEE Trans. Image Process. 21, 1061–1069 (2012)MathSciNetCrossRef
6.
Zurück zum Zitat Baker, S., Kanade, T.: Limits on super-resolution and how to break them. IEEE Trans. Pattern Anal. Mach. Intell. 24, 1167–1183 (2002)CrossRef Baker, S., Kanade, T.: Limits on super-resolution and how to break them. IEEE Trans. Pattern Anal. Mach. Intell. 24, 1167–1183 (2002)CrossRef
7.
Zurück zum Zitat Aly, H.A., Dubois, E.: Image up-sampling using total-variation regularization with a new observation model. IEEE Trans. Image Process. 14, 1647–1659 (2005)CrossRef Aly, H.A., Dubois, E.: Image up-sampling using total-variation regularization with a new observation model. IEEE Trans. Image Process. 14, 1647–1659 (2005)CrossRef
8.
Zurück zum Zitat Saito, T., Komatsu, T.: Image-processing approach based on nonlinear image-decomposition. IEICE Trans. Fundam. Electron. Commun. Comput. Sci. 92, 696–707 (2009)CrossRef Saito, T., Komatsu, T.: Image-processing approach based on nonlinear image-decomposition. IEICE Trans. Fundam. Electron. Commun. Comput. Sci. 92, 696–707 (2009)CrossRef
9.
Zurück zum Zitat Sakurai, M., Sakuta, Y., Watanabe, M., Goto, T., Hirano, S.: Super-resolution through non-linear enhancement filters. In: IEEE International Conference on Image Processing (2013) Sakurai, M., Sakuta, Y., Watanabe, M., Goto, T., Hirano, S.: Super-resolution through non-linear enhancement filters. In: IEEE International Conference on Image Processing (2013)
10.
Zurück zum Zitat Sun, J., Sun, J., Xu, Z., Shum, H.Y.: Gradient profile prior and its applications in image super-resolution and enhancement. IEEE Trans. Image Process. 20, 1529–1542 (2011)MathSciNetCrossRef Sun, J., Sun, J., Xu, Z., Shum, H.Y.: Gradient profile prior and its applications in image super-resolution and enhancement. IEEE Trans. Image Process. 20, 1529–1542 (2011)MathSciNetCrossRef
11.
Zurück zum Zitat Wang, L., Wu, H., Pan, C.: Fast image upsampling via the displacement field. IEEE Trans. Image Process. 23, 5123–5135 (2014)MathSciNetCrossRef Wang, L., Wu, H., Pan, C.: Fast image upsampling via the displacement field. IEEE Trans. Image Process. 23, 5123–5135 (2014)MathSciNetCrossRef
12.
Zurück zum Zitat Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image Super-Resolution Via Sparse Representation. IEEE Trans. Image Process. 19, 2861–2873 (2010)MathSciNetCrossRef Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image Super-Resolution Via Sparse Representation. IEEE Trans. Image Process. 19, 2861–2873 (2010)MathSciNetCrossRef
13.
Zurück zum Zitat Wada, Y., Ogata, A., Kubota, T.: Total variation based image cartoon-texture decomposition. SIAM J. Multiscale Model. Simul. (2005) Wada, Y., Ogata, A., Kubota, T.: Total variation based image cartoon-texture decomposition. SIAM J. Multiscale Model. Simul. (2005)
14.
Zurück zum Zitat Yin, W., Goldfarb, D., Osher, S.: A comparison of three total variation based texture extraction models. J. Vis. Commun. Image Represent. 18, 240–252 (2007)CrossRef Yin, W., Goldfarb, D., Osher, S.: A comparison of three total variation based texture extraction models. J. Vis. Commun. Image Represent. 18, 240–252 (2007)CrossRef
15.
Zurück zum Zitat Aujol, J.F., Gilboa, G., Chan, T., Osher, S.: Structure-texture image decomposition-modeling, algorithms, and parameter selection. Int. J. Comput. Vis. 67, 111–136 (2006)CrossRef Aujol, J.F., Gilboa, G., Chan, T., Osher, S.: Structure-texture image decomposition-modeling, algorithms, and parameter selection. Int. J. Comput. Vis. 67, 111–136 (2006)CrossRef
16.
Zurück zum Zitat Osher, S., Rudin, L.I.: Feature-oriented image enhancement using shock filters. Soc. Ind. Appl. Math. 27, 919–940 (1990)MATH Osher, S., Rudin, L.I.: Feature-oriented image enhancement using shock filters. Soc. Ind. Appl. Math. 27, 919–940 (1990)MATH
17.
Zurück zum Zitat Alvarez, L., Mazorra, L.: Signal and image restoration using shock filters and anisotropic diffusion. SIAM J. Numer. Anal. 31, 590–605 (1994)MathSciNetCrossRef Alvarez, L., Mazorra, L.: Signal and image restoration using shock filters and anisotropic diffusion. SIAM J. Numer. Anal. 31, 590–605 (1994)MathSciNetCrossRef
18.
Zurück zum Zitat Buades, A., Coll, B., Morel, J.F.M.: A non-local algorithm for image denoising. In: IEEE Conference on Computer Vision and Pattern Recognition (2005) Buades, A., Coll, B., Morel, J.F.M.: A non-local algorithm for image denoising. In: IEEE Conference on Computer Vision and Pattern Recognition (2005)
19.
Zurück zum Zitat Mccarthy, E., Balado, F., Slvestre, G.C.M., Hurley, N.J.: A framework for soft hashing and its application to robust image hashing. In: IEEE International Conference on Image Processing (2004) Mccarthy, E., Balado, F., Slvestre, G.C.M., Hurley, N.J.: A framework for soft hashing and its application to robust image hashing. In: IEEE International Conference on Image Processing (2004)
20.
Zurück zum Zitat Yoshikawa, A., Suzuki, S., Goto, T., Hirano, S.: Super resolution image reconstruction using total variation regularization and learning-based method. In: IEEE International Conference on Image Processing (2010) Yoshikawa, A., Suzuki, S., Goto, T., Hirano, S.: Super resolution image reconstruction using total variation regularization and learning-based method. In: IEEE International Conference on Image Processing (2010)
21.
Zurück zum Zitat Freedman, G., Fattal, R.: Image and video upscaling from local self-examples. ACM Trans. Graph. 30, 12 (2011)CrossRef Freedman, G., Fattal, R.: Image and video upscaling from local self-examples. ACM Trans. Graph. 30, 12 (2011)CrossRef
22.
Zurück zum Zitat Lu, X., Yuan, H., Yan, P., Yuan, Y.: Geometry constrained sparse coding for single image super-resolution. In: IEEE Conference on Computer Vision and Pattern Recognition (2012) Lu, X., Yuan, H., Yan, P., Yuan, Y.: Geometry constrained sparse coding for single image super-resolution. In: IEEE Conference on Computer Vision and Pattern Recognition (2012)
23.
Zurück zum Zitat Dong, C., Chen, C.L., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38, 295–307 (2016)CrossRef Dong, C., Chen, C.L., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38, 295–307 (2016)CrossRef
Metadaten
Titel
Content Adaptive Constraint Based Image Upsampling
verfasst von
Fan Yang
Huizhu Jia
Don Xie
Rui Chen
Wen Gao
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-77383-4_81

Neuer Inhalt