Skip to main content
Top

2018 | OriginalPaper | Chapter

Scene Relighting Using a Single Reference Image Through Material Constrained Layer Decomposition

Authors : Xin Jin, Yannan Li, Ningning Liu, Xiaodong Li, Quan Zhou, Yulu Tian, Shiming Ge

Published in: Artificial Intelligence and Robotics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Image relighting is to change the illumination of an image to a target illumination effect without known the original scene geometry, material information and illumination condition. We propose a novel outdoor scene relighting method, which needs only a single reference image and is based on material constrained layer decomposition. Firstly, the material map is extracted from the input image. Then, the reference image is warped to the input image through patch match based image warping. Lastly, the input image is relighted using material constrained layer decomposition. The experimental results reveal that our method can produce similar illumination effect as that of the reference image on the input image using only a single reference image.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Shih, Y., Paris, S., Durand, F., Freeman, W.T.: Data-driven hallucination of different times of day from a single outdoor photo. ACM Trans. Graph. 32(6), 11, Article 200 (2013) Shih, Y., Paris, S., Durand, F., Freeman, W.T.: Data-driven hallucination of different times of day from a single outdoor photo. ACM Trans. Graph. 32(6), 11, Article 200 (2013)
2.
go back to reference Haber, T., Fuchs, C., Bekaer, P., et al.: Relighting objects from image collections. In: IEEE Conference on Computer Vision and Pattern Recognition, 2009 (CVPR 2009), pp. 627–634. IEEE (2009) Haber, T., Fuchs, C., Bekaer, P., et al.: Relighting objects from image collections. In: IEEE Conference on Computer Vision and Pattern Recognition, 2009 (CVPR 2009), pp. 627–634. IEEE (2009)
3.
go back to reference Chen, X., Wu, H., Jin, X., Zhao, Q.: Face illumination manipulation using a single reference image by adaptive layer decomposition. IEEE Trans. Image Process. (TIP) 22(11), 4249–4259 (2013) Chen, X., Wu, H., Jin, X., Zhao, Q.: Face illumination manipulation using a single reference image by adaptive layer decomposition. IEEE Trans. Image Process. (TIP) 22(11), 4249–4259 (2013)
4.
go back to reference Peers, P., Tamura, N., Matusik, W., Debevec, P.: Post-production facial performance relighting using reflectance transfer. ACM Trans. Graph. 26(3), Article 52 (2007) Peers, P., Tamura, N., Matusik, W., Debevec, P.: Post-production facial performance relighting using reflectance transfer. ACM Trans. Graph. 26(3), Article 52 (2007)
5.
go back to reference Chen, J., Su, G., He, J., Ben, S.: Face image relighting using locally constrained global optimization. Computer Vision—ECCV 2010 Volume 6314 of the series. Lecture Notes in Computer Science, pp. 44–57 (2010) Chen, J., Su, G., He, J., Ben, S.: Face image relighting using locally constrained global optimization. Computer Vision—ECCV 2010 Volume 6314 of the series. Lecture Notes in Computer Science, pp. 44–57 (2010)
6.
go back to reference Jin, X., Tian, Y., Ye, C., Chi, J., Li, X., Zhao, G.: Object image relighting through patch match warping and color transfer. In: The 16th International Conference on Virtual Reality and Visualization (ICVRV), Hangzhou, China, pp. 235–241, 23–25 Sept 2016 Jin, X., Tian, Y., Ye, C., Chi, J., Li, X., Zhao, G.: Object image relighting through patch match warping and color transfer. In: The 16th International Conference on Virtual Reality and Visualization (ICVRV), Hangzhou, China, pp. 235–241, 23–25 Sept 2016
7.
go back to reference Lu, H., Guna, J., Dansereau, D.G.: Introduction to the special section on artificial intelligence and computer vision. Comput. Electr. Eng. 58, 444–446 (2017)CrossRef Lu, H., Guna, J., Dansereau, D.G.: Introduction to the special section on artificial intelligence and computer vision. Comput. Electr. Eng. 58, 444–446 (2017)CrossRef
8.
go back to reference Lu, H., Li, Y., Nakashima, S., Kim, H., Serikawa, S.: Underwater image super-resolution by descattering and fusion. IEEE Access 5, 670–679 (2017)CrossRef Lu, H., Li, Y., Nakashima, S., Kim, H., Serikawa, S.: Underwater image super-resolution by descattering and fusion. IEEE Access 5, 670–679 (2017)CrossRef
9.
go back to reference Lu, H., Li, Y., Zhang, L., Serikawa, S.: Contrast enhancement for images in turbid water. J. Opt. Soc. Am. A. 32(5), 886–893 (2015)CrossRef Lu, H., Li, Y., Zhang, L., Serikawa, S.: Contrast enhancement for images in turbid water. J. Opt. Soc. Am. A. 32(5), 886–893 (2015)CrossRef
10.
go back to reference Lu, H., Li, Y., Nakashima, S., Serikawa, S.: Turbidity underwater image restoration using spectral properties and light compensation. IEICE Trans. Inf. Syst. 99(1), 219–227 (2016)CrossRef Lu, H., Li, Y., Nakashima, S., Serikawa, S.: Turbidity underwater image restoration using spectral properties and light compensation. IEICE Trans. Inf. Syst. 99(1), 219–227 (2016)CrossRef
11.
go back to reference Zhou, Q., Zheng, B., Zhu, W., Latecki, L.J.: Multi-scale context for scene labeling via flexible segmentation graph. Pattern Recogn. 2016(59), 312–324 (2016)CrossRef Zhou, Q., Zheng, B., Zhu, W., Latecki, L.J.: Multi-scale context for scene labeling via flexible segmentation graph. Pattern Recogn. 2016(59), 312–324 (2016)CrossRef
12.
go back to reference Bell, S., Upchurch, P., Snavely, N., Bala, K.: Material recognition in the wild with the materials in context database. In: IEEE Conference on Computer Vision and Pattern Recognition, (CVPR) 2015, Boston, MA, USA, 7–12 June 2015 Bell, S., Upchurch, P., Snavely, N., Bala, K.: Material recognition in the wild with the materials in context database. In: IEEE Conference on Computer Vision and Pattern Recognition, (CVPR) 2015, Boston, MA, USA, 7–12 June 2015
13.
go back to reference Barnes, C., Shechtman, E., Goldman, D., Finkelstein, A.: The generalized patchmatch correspondence algorithm. Computer Vision–ECCV 2010, 29–43 (2010) Barnes, C., Shechtman, E., Goldman, D., Finkelstein, A.: The generalized patchmatch correspondence algorithm. Computer Vision–ECCV 2010, 29–43 (2010)
14.
go back to reference Farbman, Z., Fattal, R., Lischinski, D., Szeliski, R.: Edgepreserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. (Proceedings of ACM SIGGRAPH 2008), 27(3) (2008) Farbman, Z., Fattal, R., Lischinski, D., Szeliski, R.: Edgepreserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. (Proceedings of ACM SIGGRAPH 2008), 27(3) (2008)
15.
go back to reference Lischinski, D., Farbman, Z., Uyttendaele, M., Szeliski, R.: Interactive local adjustment of tonal values. ACM Trans. Graph. 25(3): 646–653 (2006) Lischinski, D., Farbman, Z., Uyttendaele, M., Szeliski, R.: Interactive local adjustment of tonal values. ACM Trans. Graph. 25(3): 646–653 (2006)
16.
go back to reference Wang, Y., Liu, Z., Hua, G., Wen, Z., Zhang, Z., Samaras, D.: Face re-lighting from a single image under harsh lighting conditions. In: Proc. CVPR (2007) Wang, Y., Liu, Z., Hua, G., Wen, Z., Zhang, Z., Samaras, D.: Face re-lighting from a single image under harsh lighting conditions. In: Proc. CVPR (2007)
17.
go back to reference Eisemann, E., Durand, F.: Flash photography enhancement via intrinsic relighting. ACM Trans. Graph. 23(3), 673-678 (2004) Eisemann, E., Durand, F.: Flash photography enhancement via intrinsic relighting. ACM Trans. Graph. 23(3), 673-678 (2004)
18.
go back to reference Agrawal, A., Raskar, R.: Gradient domain manipulation techniques in vision and graphics. In: ICCV 2007 Courses (2007) Agrawal, A., Raskar, R.: Gradient domain manipulation techniques in vision and graphics. In: ICCV 2007 Courses (2007)
Metadata
Title
Scene Relighting Using a Single Reference Image Through Material Constrained Layer Decomposition
Authors
Xin Jin
Yannan Li
Ningning Liu
Xiaodong Li
Quan Zhou
Yulu Tian
Shiming Ge
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-69877-9_5

Premium Partner