Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 6/2013

01.12.2013 | Original Article

Face hallucination using example-based regularization

verfasst von: Hong Zhao, Yao Lu

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 6/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Face super-resolution is to synthesize a high resolution facial image from a low resolution input, which can significantly improve the recognition for computer and human. Regularization plays a vital role in ill-posed problems. The use of examples becomes much more effective when handling narrow family of images, such as face images. A properly chosen regularization can direct the solution toward a better quality outcome. An emerging powerful regularization is one that leans on image examples. This paper proposed a face hallucination method using example-based regularization. The work is specially targeted at improving the quality of high magnification. Our work follows the pyramid framework and assigns several high-quality candidate patches for each location in the degraded image. All problematic examples are rejected by defining an error function which embodies the example-based regularization. After repeated pruning, the reconstruction is done when there is only one candidate patch left in each location. The encouraging experimental results provide some hints that our approach is effective.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Park S-C, Park M-K, Kang M-G (2003) Super-resolution image reconstruction: a technical overview (J). IEEE Signal Process Mag 20(3):21–36CrossRef Park S-C, Park M-K, Kang M-G (2003) Super-resolution image reconstruction: a technical overview (J). IEEE Signal Process Mag 20(3):21–36CrossRef
2.
Zurück zum Zitat Hertzmann A, Jacobs C-E, Oliver N et al. (2001) Image analogies. In: Proceedings of the SIGGRAPH. Los Angeles, USA, ACM Press, New York, pp 327–340 Hertzmann A, Jacobs C-E, Oliver N et al. (2001) Image analogies. In: Proceedings of the SIGGRAPH. Los Angeles, USA, ACM Press, New York, pp 327–340
3.
Zurück zum Zitat Elad M, Feuer A (1999) Super-resolution restoration of an image sequence: adaptive filtering approach. IEEE Trans Image Process 8(3):387–395CrossRef Elad M, Feuer A (1999) Super-resolution restoration of an image sequence: adaptive filtering approach. IEEE Trans Image Process 8(3):387–395CrossRef
5.
Zurück zum Zitat Stark H, Oskoui P (1989) High-resolution image recovery from image-plane arrays, using convex projections. J Opt Soc Am A Opt Image Sci Vis 6(11):1715–1726CrossRef Stark H, Oskoui P (1989) High-resolution image recovery from image-plane arrays, using convex projections. J Opt Soc Am A Opt Image Sci Vis 6(11):1715–1726CrossRef
6.
Zurück zum Zitat Nguyen N, Milanfar P (2000) A wavelet-based interpolation-restoration method for super-resolution. Circuits Syst Signal Process 19(4):321–338CrossRefMATH Nguyen N, Milanfar P (2000) A wavelet-based interpolation-restoration method for super-resolution. Circuits Syst Signal Process 19(4):321–338CrossRefMATH
7.
Zurück zum Zitat Jian Sun, Zong-ben Xu, Heung-Yeung Shum (2008) Image super-resolution using gradient profile prior. In: Proceedings of the 10th international conference on computer vision and pattern recognition, anchorage, Alaska, USA, 24–26 June 2008, pp 1–8 Jian Sun, Zong-ben Xu, Heung-Yeung Shum (2008) Image super-resolution using gradient profile prior. In: Proceedings of the 10th international conference on computer vision and pattern recognition, anchorage, Alaska, USA, 24–26 June 2008, pp 1–8
8.
Zurück zum Zitat Glasner D, Bagon S, Irani M (2009) Super-resolution from a single image. In: Proceedings of the 12th international conference on computer vision, Kyoto, Japan, 29 Sept–2 Oct 2009, pp 349–356 Glasner D, Bagon S, Irani M (2009) Super-resolution from a single image. In: Proceedings of the 12th international conference on computer vision, Kyoto, Japan, 29 Sept–2 Oct 2009, pp 349–356
9.
Zurück zum Zitat Lyndsey C-P, David P-C, Stephen J-R, Andrew Z (2009) Bayesian methods for image super-resolution. Comput J 52(1):101–113 Lyndsey C-P, David P-C, Stephen J-R, Andrew Z (2009) Bayesian methods for image super-resolution. Comput J 52(1):101–113
10.
Zurück zum Zitat Yang Jianchao, Wright J, Huang T-S, Ma Yi (2010) Image super-resolution via sparse representation. IEEE Trans Image Process 19(11):2861–2873MathSciNetCrossRef Yang Jianchao, Wright J, Huang T-S, Ma Yi (2010) Image super-resolution via sparse representation. IEEE Trans Image Process 19(11):2861–2873MathSciNetCrossRef
11.
Zurück zum Zitat Farsiu S, Robinson M-D, Elad M et al (2004) Fast and robust multiframe super resolution. IEEE Trans Image Process 13(10):1327–1344CrossRef Farsiu S, Robinson M-D, Elad M et al (2004) Fast and robust multiframe super resolution. IEEE Trans Image Process 13(10):1327–1344CrossRef
12.
Zurück zum Zitat Tsai R-Y, Huang T-S (1984) Multiple frame image restoration and registration. Adv Comput Vis Image Process 1:317–339 Tsai R-Y, Huang T-S (1984) Multiple frame image restoration and registration. Adv Comput Vis Image Process 1:317–339
13.
Zurück zum Zitat Ur H, Gross D (1992) Improved resolution from sub-pixel shifted pictures. IEEE Trans Graph Models Image Process 54(2):181–186CrossRef Ur H, Gross D (1992) Improved resolution from sub-pixel shifted pictures. IEEE Trans Graph Models Image Process 54(2):181–186CrossRef
14.
Zurück zum Zitat Nguyen N, Milanfar P (2000) An efficient wavelet-based algorithm for image super-resolution. In: Proceedings of international conference on image processing, Vancouver, BC, Canada, 10–13 Sept 2000, pp 351–354 Nguyen N, Milanfar P (2000) An efficient wavelet-based algorithm for image super-resolution. In: Proceedings of international conference on image processing, Vancouver, BC, Canada, 10–13 Sept 2000, pp 351–354
15.
Zurück zum Zitat Irani M, Peleg S (1991) Improving resolution by image registration. IEEE Trans Graph Models Image Process 53(3):231–239CrossRef Irani M, Peleg S (1991) Improving resolution by image registration. IEEE Trans Graph Models Image Process 53(3):231–239CrossRef
16.
Zurück zum Zitat Schulz R-R, Stevenson R-L (1996) Extraction of high-resolution frames from video sequences. IEEE Trans Image Process 5:996–1011CrossRef Schulz R-R, Stevenson R-L (1996) Extraction of high-resolution frames from video sequences. IEEE Trans Image Process 5:996–1011CrossRef
17.
Zurück zum Zitat Elad M, Feuer A (1997) Restoration of a single super-resolution image from several blurred, noisy, and under-sampled measured images. IEEE Trans Image Process 6(12):1646–1658CrossRef Elad M, Feuer A (1997) Restoration of a single super-resolution image from several blurred, noisy, and under-sampled measured images. IEEE Trans Image Process 6(12):1646–1658CrossRef
18.
Zurück zum Zitat Hardie R-C, Barnard K-J, Armstrong E–E (1997) Joint MAP registration 245 and high-resolution image estimation using a sequence of under-sampled images. IEEE Trans Image Process 6:1621–1633CrossRef Hardie R-C, Barnard K-J, Armstrong E–E (1997) Joint MAP registration 245 and high-resolution image estimation using a sequence of under-sampled images. IEEE Trans Image Process 6:1621–1633CrossRef
19.
Zurück zum Zitat Baker S, Kanade T (2002) Limits on super-resolution and how to break them. IEEE Trans PAMI 24(9):1167–1183CrossRef Baker S, Kanade T (2002) Limits on super-resolution and how to break them. IEEE Trans PAMI 24(9):1167–1183CrossRef
20.
Zurück zum Zitat Baker S, Kanade T (2000) Hallucinating faces. In: Proceedings of the 4th international conference on automatic face and gesture recognition, Grenoble, France, 28–30 Mar 2000, pp 83–88 Baker S, Kanade T (2000) Hallucinating faces. In: Proceedings of the 4th international conference on automatic face and gesture recognition, Grenoble, France, 28–30 Mar 2000, pp 83–88
21.
Zurück zum Zitat Freeman W-T, Pasztor E-C (1999) Learning low-level vision. In: Proceedings of the 7th international conference on computer vision, Kerkyra, Corfu, 20–25 Sept 1999, pp 1182–1189 Freeman W-T, Pasztor E-C (1999) Learning low-level vision. In: Proceedings of the 7th international conference on computer vision, Kerkyra, Corfu, 20–25 Sept 1999, pp 1182–1189
22.
Zurück zum Zitat Freeman W-T, Rjones T, Pasztor E-C (2002) Example-based super-resolution. In: Proceedings of the 10th international conference on computer graphics and applications, Beijing, China, 9–11 Oct 2002, pp 56–65 Freeman W-T, Rjones T, Pasztor E-C (2002) Example-based super-resolution. In: Proceedings of the 10th international conference on computer graphics and applications, Beijing, China, 9–11 Oct 2002, pp 56–65
23.
Zurück zum Zitat Suresh K-V, Rajagopalan A-N (2007) Robust and computationally efficient super-resolution algorithm. J Opt Soc Am A Opt Image Sci Vis 24(4):984–992CrossRef Suresh K-V, Rajagopalan A-N (2007) Robust and computationally efficient super-resolution algorithm. J Opt Soc Am A Opt Image Sci Vis 24(4):984–992CrossRef
24.
Zurück zum Zitat Li X, Hu Y, Gao X et al (2010) A multi-frame image super-resolution method. IEEE Signal Process Mag 90(2):405–414CrossRefMATH Li X, Hu Y, Gao X et al (2010) A multi-frame image super-resolution method. IEEE Signal Process Mag 90(2):405–414CrossRefMATH
25.
Zurück zum Zitat Shen H, Zhang L, Huang B et al (2007) A MAP approach for joint motion estimation, segmentation, and super resolution. IEEE Trans Image Process 16(2):479–490MathSciNetCrossRef Shen H, Zhang L, Huang B et al (2007) A MAP approach for joint motion estimation, segmentation, and super resolution. IEEE Trans Image Process 16(2):479–490MathSciNetCrossRef
26.
Zurück zum Zitat El-Khamy S-E, Hadhoud M-M, Dessouky M-I et al (2006) Wavelet fusion: a tool to break the limits on LMMSE image super-resolution. Int J Wavelets Multiresolut Inf Process 4(1):105–118MathSciNetCrossRefMATH El-Khamy S-E, Hadhoud M-M, Dessouky M-I et al (2006) Wavelet fusion: a tool to break the limits on LMMSE image super-resolution. Int J Wavelets Multiresolut Inf Process 4(1):105–118MathSciNetCrossRefMATH
27.
Zurück zum Zitat Farsiu S, Robinson D, Elad M et al (2004) Advances and challenges in super-resolution. Int J Imaging Syst Technol 16(2):47–57CrossRef Farsiu S, Robinson D, Elad M et al (2004) Advances and challenges in super-resolution. Int J Imaging Syst Technol 16(2):47–57CrossRef
28.
Zurück zum Zitat Mohammad-Djafari A (2009) Super-resolution: a short review, a new method based on hidden Markov modeling of HR image and future challenges. Comput J 52(1):126–141CrossRef Mohammad-Djafari A (2009) Super-resolution: a short review, a new method based on hidden Markov modeling of HR image and future challenges. Comput J 52(1):126–141CrossRef
29.
Zurück zum Zitat Sun J, Zhang N, Tao H, Shum H (2003) Image hallucination with primal sketch priors. In: Proceedings of international conference on computer vision and pattern recognition, Madison, Wisconsin, 16–22 June 2003, pp 729–736 Sun J, Zhang N, Tao H, Shum H (2003) Image hallucination with primal sketch priors. In: Proceedings of international conference on computer vision and pattern recognition, Madison, Wisconsin, 16–22 June 2003, pp 729–736
30.
Zurück zum Zitat Hong C, Dit-Yan Y, Yimin X (2004) Super-resolution through neighbor embedding. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, Washington DC, USA, 27 June–2 July 2004, pp 275–282 Hong C, Dit-Yan Y, Yimin X (2004) Super-resolution through neighbor embedding. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, Washington DC, USA, 27 June–2 July 2004, pp 275–282
31.
Zurück zum Zitat Yi T, Pingkun Y, Yuan Y, Xue-long L (2011) Single-image super-resolution via local learning. Int J Mach Learn Cybern 2(1):15–23CrossRef Yi T, Pingkun Y, Yuan Y, Xue-long L (2011) Single-image super-resolution via local learning. Int J Mach Learn Cybern 2(1):15–23CrossRef
32.
Zurück zum Zitat Chakrabarti A, Rajagopalan A-N, Chellappa R (2007) Super-resolution of face images using kernel PCA-based prior. IEEE Trans Multimedia 9(4):888–892CrossRef Chakrabarti A, Rajagopalan A-N, Chellappa R (2007) Super-resolution of face images using kernel PCA-based prior. IEEE Trans Multimedia 9(4):888–892CrossRef
33.
Zurück zum Zitat Bruce P, Ashraful A-M, Hong Y (2011) Performance evaluation and comparison of PCA based human face recognition methods for distorted images. Int J Mach Learn Cybern 2(4):245–259CrossRef Bruce P, Ashraful A-M, Hong Y (2011) Performance evaluation and comparison of PCA based human face recognition methods for distorted images. Int J Mach Learn Cybern 2(4):245–259CrossRef
34.
35.
Zurück zum Zitat Chacko Binu P, Vimal Krishnan VR, Raju G, Babu Anto P (2012) Handwritten character recognition using wavelet energy and extreme learning machine. Int J Mach Learn Cybern 3(2):149–161CrossRef Chacko Binu P, Vimal Krishnan VR, Raju G, Babu Anto P (2012) Handwritten character recognition using wavelet energy and extreme learning machine. Int J Mach Learn Cybern 3(2):149–161CrossRef
36.
Zurück zum Zitat Malay KK, Manish Ch, Minakshi B (2011) Interactive image retrieval using M-band wavelet, earth mover’s distance and fuzzy relevance feedback. Int J Mach Learn Cybern. doi: 10.1007/s13042-011-0062-8 Malay KK, Manish Ch, Minakshi B (2011) Interactive image retrieval using M-band wavelet, earth mover’s distance and fuzzy relevance feedback. Int J Mach Learn Cybern. doi: 10.​1007/​s13042-011-0062-8
37.
Zurück zum Zitat Wang J, Zhu S, Gong Y (2010) Resolution enhancement based on learning the sparse association of image patches. Pattern Recogn Lett 31(1):1–10CrossRef Wang J, Zhu S, Gong Y (2010) Resolution enhancement based on learning the sparse association of image patches. Pattern Recogn Lett 31(1):1–10CrossRef
38.
Zurück zum Zitat Kim K, Kwon Y (2010) Single-image super-resolution using sparse regression and natural image prior. IEEE Trans Pattern Anal Mach Intell 32(6):1127–1133MathSciNetCrossRef Kim K, Kwon Y (2010) Single-image super-resolution using sparse regression and natural image prior. IEEE Trans Pattern Anal Mach Intell 32(6):1127–1133MathSciNetCrossRef
39.
Zurück zum Zitat Yang J, Wright J, Huang T-S et al (2010) Image super-resolution via sparse representation. IEEE Trans Image Process 19(11):2861–2873MathSciNetCrossRef Yang J, Wright J, Huang T-S et al (2010) Image super-resolution via sparse representation. IEEE Trans Image Process 19(11):2861–2873MathSciNetCrossRef
40.
Zurück zum Zitat Liu L, YiDing W (2008) Face super-resolution using a hybrid model. In: Proceedings of international conference on signal processing, Beijing, China, 26–29 Oct 2008, pp 1153–1156 Liu L, YiDing W (2008) Face super-resolution using a hybrid model. In: Proceedings of international conference on signal processing, Beijing, China, 26–29 Oct 2008, pp 1153–1156
41.
Zurück zum Zitat Liu C, Shum H, Freeman W (2007) Face hallucination: theory and practice. Int J Comput Vis 75:115–134CrossRef Liu C, Shum H, Freeman W (2007) Face hallucination: theory and practice. Int J Comput Vis 75:115–134CrossRef
42.
Zurück zum Zitat Wang X, Tang X (2005) Hallucinating face by eigen-transformation. IEEE Trans Syst Man Cybern 35(3):425–434CrossRef Wang X, Tang X (2005) Hallucinating face by eigen-transformation. IEEE Trans Syst Man Cybern 35(3):425–434CrossRef
43.
Zurück zum Zitat Cong-yong S, Yue-ting Z, Li H, Fei W (2005) Steerable pyramid-based face hallucination. IEEE Trans Pattern Recogn 38:813–824CrossRef Cong-yong S, Yue-ting Z, Li H, Fei W (2005) Steerable pyramid-based face hallucination. IEEE Trans Pattern Recogn 38:813–824CrossRef
44.
Zurück zum Zitat Dsenko D, Elad M (2007) Example-based single document image super-resolution: a global MAP approach with outlier rejection. Int J Multidimens Syst Signal Process 18(2):103–121CrossRef Dsenko D, Elad M (2007) Example-based single document image super-resolution: a global MAP approach with outlier rejection. Int J Multidimens Syst Signal Process 18(2):103–121CrossRef
45.
Zurück zum Zitat Lagendijk R-L, Biemond J (1991) Iterative identification and restoration of images. Kluwer Academic Publishers, BostonCrossRefMATH Lagendijk R-L, Biemond J (1991) Iterative identification and restoration of images. Kluwer Academic Publishers, BostonCrossRefMATH
46.
Zurück zum Zitat Roth S, Black M-J (2005) Fields of experts: a framework for learning image priors. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition (CVPR), San-Diego, California, 20–25 June 2005, pp 860–867 Roth S, Black M-J (2005) Fields of experts: a framework for learning image priors. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition (CVPR), San-Diego, California, 20–25 June 2005, pp 860–867
47.
Zurück zum Zitat Efros A-A, Leung T-K (1999) Texture synthesis by non-parametric sampling. In: Proceedings of IEEE computer society conference on computer vision (ICCV), Corfu, Greece, 20–25 Sept 1999, pp 1033–1038 Efros A-A, Leung T-K (1999) Texture synthesis by non-parametric sampling. In: Proceedings of IEEE computer society conference on computer vision (ICCV), Corfu, Greece, 20–25 Sept 1999, pp 1033–1038
48.
Zurück zum Zitat Nakagaki R, Katsaggelos A-K (2003) VQ-based blind image restoration algorithm. IEEE Trans Image Process 12(9):1044–1053CrossRef Nakagaki R, Katsaggelos A-K (2003) VQ-based blind image restoration algorithm. IEEE Trans Image Process 12(9):1044–1053CrossRef
49.
Zurück zum Zitat Criminisi A, Perez P, Toyama K (2004) Region filling and object removal by exemplar-based image in painting. IEEE Trans Image Process 13(9):1200–1212CrossRef Criminisi A, Perez P, Toyama K (2004) Region filling and object removal by exemplar-based image in painting. IEEE Trans Image Process 13(9):1200–1212CrossRef
50.
Zurück zum Zitat Philips P-J, Moon H, Rauss P, Rizvi S-A (1997) The FERET evaluation methodology for face-recognition algorithms. In: Proceedings of international conference on computer vision and pattern recognition, San Juan, Puerto Rico, 17–19 June 1997, pp 137–143 Philips P-J, Moon H, Rauss P, Rizvi S-A (1997) The FERET evaluation methodology for face-recognition algorithms. In: Proceedings of international conference on computer vision and pattern recognition, San Juan, Puerto Rico, 17–19 June 1997, pp 137–143
Metadaten
Titel
Face hallucination using example-based regularization
verfasst von
Hong Zhao
Yao Lu
Publikationsdatum
01.12.2013
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 6/2013
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-012-0149-x

Weitere Artikel der Ausgabe 6/2013

International Journal of Machine Learning and Cybernetics 6/2013 Zur Ausgabe

Neuer Inhalt