Skip to main content
Erschienen in: International Journal of Computer Vision 6/2018

08.12.2017

Hallucinating Compressed Face Images

verfasst von: Chih-Yuan Yang, Sifei Liu, Ming-Hsuan Yang

Erschienen in: International Journal of Computer Vision | Ausgabe 6/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A face hallucination algorithm is proposed to generate high-resolution images from JPEG compressed low-resolution inputs by decomposing a deblocked face image into structural regions such as facial components and non-structural regions like the background. For structural regions, landmarks are used to retrieve adequate high-resolution component exemplars in a large dataset based on the estimated head pose and illumination condition. For non-structural regions, an efficient generic super resolution algorithm is applied to generate high-resolution counterparts. Two sets of gradient maps extracted from these two regions are combined to guide an optimization process of generating the hallucination image. Numerous experimental results demonstrate that the proposed algorithm performs favorably against the state-of-the-art hallucination methods on JPEG compressed face images with different poses, expressions, and illumination conditions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Baker, S., & Kanade, T. (2002). Limits on super-resolution and how to break them. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(9), 1167–1183.CrossRef Baker, S., & Kanade, T. (2002). Limits on super-resolution and how to break them. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(9), 1167–1183.CrossRef
Zurück zum Zitat Barnes, C., Shechtman, E., Goldman, D. B., & Finkelstein, A. (2010). The generalized PatchMatch correspondence algorithm. In Proceedings of European conference on computer vision. Barnes, C., Shechtman, E., Goldman, D. B., & Finkelstein, A. (2010). The generalized PatchMatch correspondence algorithm. In Proceedings of European conference on computer vision.
Zurück zum Zitat Buades, A., Coll, B., & Morel, J. M. (2005). A non-local algorithm for image denoising. In Proceedings of IEEE conference on computer vision and pattern recognition. Buades, A., Coll, B., & Morel, J. M. (2005). A non-local algorithm for image denoising. In Proceedings of IEEE conference on computer vision and pattern recognition.
Zurück zum Zitat Choi, I., Kim, S., Brown, M., & Tai, Y. W. (2013). A learning-based approach to reduce JPEG artifacts in image matting. In Proceedings of IEEE international conference on computer vision. Choi, I., Kim, S., Brown, M., & Tai, Y. W. (2013). A learning-based approach to reduce JPEG artifacts in image matting. In Proceedings of IEEE international conference on computer vision.
Zurück zum Zitat Figueiredo, M. A. T., Dias, J. B., Oliveira, J. P., & Nowak, R. (2006). On total variation denoising: A new majorization-minimization algorithm and an experimental comparison with wavelet denoising. In Proceedings of IEEE international conference on image processing. Figueiredo, M. A. T., Dias, J. B., Oliveira, J. P., & Nowak, R. (2006). On total variation denoising: A new majorization-minimization algorithm and an experimental comparison with wavelet denoising. In Proceedings of IEEE international conference on image processing.
Zurück zum Zitat Foi, A., Katkovnik, V., & Egiazarian, K. (2007). Pointwise shape-adaptive DCT for high-quality denoising and deblocking of grayscale and color images. IEEE Transactions on Image Processing, 16(5), 1395–1411.MathSciNetCrossRef Foi, A., Katkovnik, V., & Egiazarian, K. (2007). Pointwise shape-adaptive DCT for high-quality denoising and deblocking of grayscale and color images. IEEE Transactions on Image Processing, 16(5), 1395–1411.MathSciNetCrossRef
Zurück zum Zitat Gross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2008). Multi-PIE. In Proceedings of IEEE conference on automatic face and gesture recognition. Gross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2008). Multi-PIE. In Proceedings of IEEE conference on automatic face and gesture recognition.
Zurück zum Zitat Jia, K., & Gong, S. (2005). Multi-modal tensor face for simultaneous super-resolution and recognition. In Proceedings of IEEE international conference on computer vision. Jia, K., & Gong, S. (2005). Multi-modal tensor face for simultaneous super-resolution and recognition. In Proceedings of IEEE international conference on computer vision.
Zurück zum Zitat Jiang, J., Hu, R., Wang, Z., & Han, Z. (2014). Noise robust face hallucination via locality-constrained representation. IEEE Transactions on Multimedia, 16(5), 1268–1281.CrossRef Jiang, J., Hu, R., Wang, Z., & Han, Z. (2014). Noise robust face hallucination via locality-constrained representation. IEEE Transactions on Multimedia, 16(5), 1268–1281.CrossRef
Zurück zum Zitat Kim, K. I., & Kwon, Y. (2008). Example-based learning for single-image super-resolution and JPEG artifact removal. Max-Planck-Institut Technical Report. Kim, K. I., & Kwon, Y. (2008). Example-based learning for single-image super-resolution and JPEG artifact removal. Max-Planck-Institut Technical Report.
Zurück zum Zitat Kumar, N., Berg, A. C., Belhumeur, P. N., & Nayar, S. K. (2009). Attribute and simile classifiers for face verification. In Proceedings of IEEE international conference on computer vision. Kumar, N., Berg, A. C., Belhumeur, P. N., & Nayar, S. K. (2009). Attribute and simile classifiers for face verification. In Proceedings of IEEE international conference on computer vision.
Zurück zum Zitat Li, Y., Guo, F., Tan, R. T., & Brown, M. S. (2014). A contrast enhancement framework with JPEG artifacts suppression. In Proceedings of European conference on computer vision. Li, Y., Guo, F., Tan, R. T., & Brown, M. S. (2014). A contrast enhancement framework with JPEG artifacts suppression. In Proceedings of European conference on computer vision.
Zurück zum Zitat Liang, Y., Lai, J. H., Yuen, P. C., Zou, W. W., & Cai, Z. (2014). Face hallucination with imprecise-alignment using iterative sparse representation. Pattern Recognition, 47(10), 3327–3342.CrossRef Liang, Y., Lai, J. H., Yuen, P. C., Zou, W. W., & Cai, Z. (2014). Face hallucination with imprecise-alignment using iterative sparse representation. Pattern Recognition, 47(10), 3327–3342.CrossRef
Zurück zum Zitat Liu, C., Shum, H. Y., & Freeman, W. T. (2007). Face hallucination: Theory and practice. International Journal of Computer Vision, 75(1), 115–134.CrossRef Liu, C., Shum, H. Y., & Freeman, W. T. (2007). Face hallucination: Theory and practice. International Journal of Computer Vision, 75(1), 115–134.CrossRef
Zurück zum Zitat Liu, S., & Bovik, A. C. (2002). Efficient DCT-domain blind measurement and reduction of blocking artifacts. IEEE Transactions on Circuits and Systems for Video Technology, 12(12), 1139–1149.CrossRef Liu, S., & Bovik, A. C. (2002). Efficient DCT-domain blind measurement and reduction of blocking artifacts. IEEE Transactions on Circuits and Systems for Video Technology, 12(12), 1139–1149.CrossRef
Zurück zum Zitat Liu, S., & Yang, M. H. (2014). Compressed face hallucination. In Proceedings of IEEE international conference on image processing. Liu, S., & Yang, M. H. (2014). Compressed face hallucination. In Proceedings of IEEE international conference on image processing.
Zurück zum Zitat Ma, X., Zhang, J., & Qi, C. (2010). Hallucinating face by position-patch. Pattern Recognition, 43(6), 2224–2236.CrossRef Ma, X., Zhang, J., & Qi, C. (2010). Hallucinating face by position-patch. Pattern Recognition, 43(6), 2224–2236.CrossRef
Zurück zum Zitat Mairal, J., Bach, F., Ponce, J., Sapiro, G., & Zisserman, A. (2009). Non-local sparse models for image restoration. In Proceedings of IEEE international conference on computer vision. Mairal, J., Bach, F., Ponce, J., Sapiro, G., & Zisserman, A. (2009). Non-local sparse models for image restoration. In Proceedings of IEEE international conference on computer vision.
Zurück zum Zitat Park, J. S., & Lee, S. W. (2008). An example-based face hallucination method for single-frame, low-resolution facial images. IEEE Transactions on Image Processing, 17(10), 1806–1816.MathSciNetCrossRefMATH Park, J. S., & Lee, S. W. (2008). An example-based face hallucination method for single-frame, low-resolution facial images. IEEE Transactions on Image Processing, 17(10), 1806–1816.MathSciNetCrossRefMATH
Zurück zum Zitat Singh, S., Kumar, V., & Verma, H. K. (2007). Reduction of blocking artifacts in JPEG compressed images. Digital Signal Processing, 17(1), 225–243.CrossRef Singh, S., Kumar, V., & Verma, H. K. (2007). Reduction of blocking artifacts in JPEG compressed images. Digital Signal Processing, 17(1), 225–243.CrossRef
Zurück zum Zitat Tappen, M. F., & Liu, C. (2012). A Bayesian approach to alignment-based image hallucination. In Proceedings of European conference on computer vision. Tappen, M. F., & Liu, C. (2012). A Bayesian approach to alignment-based image hallucination. In Proceedings of European conference on computer vision.
Zurück zum Zitat Timofte, R., Smet, V. D., & Gool, L. V. (2014). A+: Adjusted anchored neighborhood regression for fast super-resolution. In Proceedings of Asian conference on computer vision. Timofte, R., Smet, V. D., & Gool, L. V. (2014). A+: Adjusted anchored neighborhood regression for fast super-resolution. In Proceedings of Asian conference on computer vision.
Zurück zum Zitat Viola, P., & Jones, M. J. (2004). Robust real-time face detection. International Journal of Computer Vision, 57(2), 137–154.CrossRef Viola, P., & Jones, M. J. (2004). Robust real-time face detection. International Journal of Computer Vision, 57(2), 137–154.CrossRef
Zurück zum Zitat Wang, N., Tao, D., Gao, X., Li, X., & Li, J. (2014). A comprehensive survey to face hallucination. International Journal of Computer Vision, 106(1), 9–30.CrossRef Wang, N., Tao, D., Gao, X., Li, X., & Li, J. (2014). A comprehensive survey to face hallucination. International Journal of Computer Vision, 106(1), 9–30.CrossRef
Zurück zum Zitat Wang, X., & Tang, X. (2005). Hallucinating face by eigentransformation. IEEE Transactions on Systems, Man, and Cybernetics, 35(3), 425–434.CrossRef Wang, X., & Tang, X. (2005). Hallucinating face by eigentransformation. IEEE Transactions on Systems, Man, and Cybernetics, 35(3), 425–434.CrossRef
Zurück zum Zitat Wang, Z., Bovik, A., Sheikh, H., & Simoncelli, E. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4), 600–612.CrossRef Wang, Z., Bovik, A., Sheikh, H., & Simoncelli, E. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4), 600–612.CrossRef
Zurück zum Zitat Xiong, X., & la Torre, F. D. (2013). Supervised descent method and its application to face alignment. In Proceedings of IEEE conference on computer vision and pattern recognition. Xiong, X., & la Torre, F. D. (2013). Supervised descent method and its application to face alignment. In Proceedings of IEEE conference on computer vision and pattern recognition.
Zurück zum Zitat Xiong, Z., Sun, X., & Wu, F. (2010). Robust web image/video super-resolution. IEEE Transactions on Image Processing, 19(8), 2017–2028.MathSciNetCrossRefMATH Xiong, Z., Sun, X., & Wu, F. (2010). Robust web image/video super-resolution. IEEE Transactions on Image Processing, 19(8), 2017–2028.MathSciNetCrossRefMATH
Zurück zum Zitat Yang, CY., Liu, S., & Yang, M. H. (2013). Structured face hallucination. In Proceedings of IEEE conference on computer vision and pattern recognition. Yang, CY., Liu, S., & Yang, M. H. (2013). Structured face hallucination. In Proceedings of IEEE conference on computer vision and pattern recognition.
Zurück zum Zitat Yang, J., Wright, J., Huang, T., & Ma, Y. (2008). Image super-resolution via sparse representation of raw image patches. In Proceedings of IEEE conference on computer vision and pattern recognition. Yang, J., Wright, J., Huang, T., & Ma, Y. (2008). Image super-resolution via sparse representation of raw image patches. In Proceedings of IEEE conference on computer vision and pattern recognition.
Zurück zum Zitat Yang, J., Wright, J., Huang, T., & Ma, Y. (2010). Image super-resolution via sparse representation. IEEE Transactions on Image Processing, 19(11), 2861–2873.MathSciNetCrossRefMATH Yang, J., Wright, J., Huang, T., & Ma, Y. (2010). Image super-resolution via sparse representation. IEEE Transactions on Image Processing, 19(11), 2861–2873.MathSciNetCrossRefMATH
Zurück zum Zitat Zhai, G., Zhang, W., Yang, X., Lin, W., & Xu, Y. (2008). Efficient deblocking with coefficient regularization, shape-adaptive filtering, and quantization constraint. IEEE Transactions on Multimedia, 10(5), 735–745.CrossRef Zhai, G., Zhang, W., Yang, X., Lin, W., & Xu, Y. (2008). Efficient deblocking with coefficient regularization, shape-adaptive filtering, and quantization constraint. IEEE Transactions on Multimedia, 10(5), 735–745.CrossRef
Zurück zum Zitat Zhu, X., & Ramanan, D. (2012). Face detection, pose estimation, and landmark localization in the wild. In Proceedings of IEEE conference on computer vision and pattern recognition. Zhu, X., & Ramanan, D. (2012). Face detection, pose estimation, and landmark localization in the wild. In Proceedings of IEEE conference on computer vision and pattern recognition.
Metadaten
Titel
Hallucinating Compressed Face Images
verfasst von
Chih-Yuan Yang
Sifei Liu
Ming-Hsuan Yang
Publikationsdatum
08.12.2017
Verlag
Springer US
Erschienen in
International Journal of Computer Vision / Ausgabe 6/2018
Print ISSN: 0920-5691
Elektronische ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-017-1044-4

Weitere Artikel der Ausgabe 6/2018

International Journal of Computer Vision 6/2018 Zur Ausgabe

Premium Partner