Skip to main content
Top

2015 | OriginalPaper | Chapter

Automatic Estimation of Illumination Features for Indoor Photorealistic Rendering in Augmented Reality

Authors : Hasan Alhajhamad, Mohd Shahrizal Sunar, Hoshang Kolivand

Published in: Intelligent Software Methodologies, Tools and Techniques

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, a fast and practical algorithm is presented to estimate the multiple number of lights from every single indoor scene image in Augmented Reality environmet. This algorithm provides a way to accurately estimate the position, directions, and intensities properties of the light sources in a scene. Unlike other state-of-the-art algorithms, it is able to give accurate results without any essential analysis on the objects in the scene. It uses the analysis of the saturation channel HSV data. The evaluation is done by testing a ground truth dataset of synthetic and real images with known properties of lights and then comparing the results with other studies in the field.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
2.
go back to reference Frahm, J.-M., Koeser, K., Grest, D.: Markerless augmented reality with light source estimation for direct illumination. In: Conference on Visual Media Production CVMP, London, pp. 211–220. IET (2005) Frahm, J.-M., Koeser, K., Grest, D.: Markerless augmented reality with light source estimation for direct illumination. In: Conference on Visual Media Production CVMP, London, pp. 211–220. IET (2005)
3.
go back to reference Al-Najdawi, N., Bez, H.: A survey of cast shadow detection algorithms. Pattern Recogn. Lett. 33(6), 752–764 (2012)MATHCrossRef Al-Najdawi, N., Bez, H.: A survey of cast shadow detection algorithms. Pattern Recogn. Lett. 33(6), 752–764 (2012)MATHCrossRef
4.
go back to reference Jacobs, K., Loscos, C.: Classification of illumination methods for mixed reality. Comput. Graph. Forum 25(1), 29–51 (2004)CrossRef Jacobs, K., Loscos, C.: Classification of illumination methods for mixed reality. Comput. Graph. Forum 25(1), 29–51 (2004)CrossRef
5.
go back to reference Neverova, N., Muselet, D., Trémeau, A.: Lighting estimation in indoor environments from low-quality images. In: ECCV 2012 Proceedings of the 12th International Conference on Computer Vision, pp. 380–389 (2012) Neverova, N., Muselet, D., Trémeau, A.: Lighting estimation in indoor environments from low-quality images. In: ECCV 2012 Proceedings of the 12th International Conference on Computer Vision, pp. 380–389 (2012)
6.
go back to reference Pentland, A.P.: Finding the illuminant direction. J. Opt. Soc. Am. 72(4), 448–455 (1982)CrossRef Pentland, A.P.: Finding the illuminant direction. J. Opt. Soc. Am. 72(4), 448–455 (1982)CrossRef
7.
go back to reference Yeoh, R.C., Zhou, S.Z.: Consistent real-time lighting for virtual objects in augmented reality. In: 8th IEEE International Symposium on Mixed and Augmented Reality, pp. 223–224. IEEE (2009) Yeoh, R.C., Zhou, S.Z.: Consistent real-time lighting for virtual objects in augmented reality. In: 8th IEEE International Symposium on Mixed and Augmented Reality, pp. 223–224. IEEE (2009)
8.
go back to reference Bingham, M.: An Interest Point Based Illumination Condition Matching Approach to Photometric Registration Within Augmented Reality Worlds (2011) Bingham, M.: An Interest Point Based Illumination Condition Matching Approach to Photometric Registration Within Augmented Reality Worlds (2011)
9.
10.
go back to reference Lopez-moreno, J., Hadap, S., Reinhard, E., Gutierrez, D.: Light source detection in photographs. In: Andujar, C., Lluch, J. (eds.) Congreso Espanol de Informatica Grafica, vol. 11, pp. 161–168. Eurographics S.E. (2009) Lopez-moreno, J., Hadap, S., Reinhard, E., Gutierrez, D.: Light source detection in photographs. In: Andujar, C., Lluch, J. (eds.) Congreso Espanol de Informatica Grafica, vol. 11, pp. 161–168. Eurographics S.E. (2009)
11.
go back to reference Wei, J.: Robust recovery of multiple light source based on local light source constant constraint. Pattern Recogn. Lett. 24(1–3), 159–172 (2003)MATHCrossRef Wei, J.: Robust recovery of multiple light source based on local light source constant constraint. Pattern Recogn. Lett. 24(1–3), 159–172 (2003)MATHCrossRef
12.
go back to reference Agusanto, K., Li, L., Chuangui, Z., Sing, N.W.: Photorealistic rendering for augmented reality using environment illumination. In: The Second IEEE and ACM International Symposium on Mixed and Augmented Reality 2003 Proceedings, vol. 3, pp. 208–216. IEEE Computer Society (2003) Agusanto, K., Li, L., Chuangui, Z., Sing, N.W.: Photorealistic rendering for augmented reality using environment illumination. In: The Second IEEE and ACM International Symposium on Mixed and Augmented Reality 2003 Proceedings, vol. 3, pp. 208–216. IEEE Computer Society (2003)
13.
go back to reference Zheng, Q., Chellappa, R.: Estimation of illuminant direction, albedo, and shape from shading. IEEE Trans. Pattern Anal. Mach. Intell. 13(7), 680–702 (1991)CrossRef Zheng, Q., Chellappa, R.: Estimation of illuminant direction, albedo, and shape from shading. IEEE Trans. Pattern Anal. Mach. Intell. 13(7), 680–702 (1991)CrossRef
14.
go back to reference Zhang, Y., Yang, Y.-H.: Multiple illuminant direction detection with application to image synthesis. IEEE Trans. Pattern Anal. Mach. Intell. 23(8), 915–920 (2001)CrossRef Zhang, Y., Yang, Y.-H.: Multiple illuminant direction detection with application to image synthesis. IEEE Trans. Pattern Anal. Mach. Intell. 23(8), 915–920 (2001)CrossRef
15.
go back to reference Lopez-Moreno, J., Hadap, S., Reinhard, E., Gutierrez, D.: Compositing images through light source detection. Comput. Graph. 34(6), 698–707 (2010)CrossRef Lopez-Moreno, J., Hadap, S., Reinhard, E., Gutierrez, D.: Compositing images through light source detection. Comput. Graph. 34(6), 698–707 (2010)CrossRef
16.
go back to reference Lopez-Moreno, J., Garces, E., Hadap, S., Reinhard, E., Gutierrez, D.: Multiple light source estimation in a single image. Comput. Graph. Forum 32(8), 170–182 (2013)CrossRef Lopez-Moreno, J., Garces, E., Hadap, S., Reinhard, E., Gutierrez, D.: Multiple light source estimation in a single image. Comput. Graph. Forum 32(8), 170–182 (2013)CrossRef
17.
go back to reference Wang, Y., Samaras, D.: Estimation of multiple illuminants from a single image of arbitrary known geometry. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part III. LNCS, vol. 2352, pp. 272–288. Springer, Heidelberg (2002) CrossRef Wang, Y., Samaras, D.: Estimation of multiple illuminants from a single image of arbitrary known geometry. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part III. LNCS, vol. 2352, pp. 272–288. Springer, Heidelberg (2002) CrossRef
18.
go back to reference Noh, Z., Sunar, M.S.: Soft shadow rendering based on real light source estimation in augmented reality. Adv. Multimedia - Int. J. 1(2), 26–36 (2010) Noh, Z., Sunar, M.S.: Soft shadow rendering based on real light source estimation in augmented reality. Adv. Multimedia - Int. J. 1(2), 26–36 (2010)
19.
go back to reference Noh, Z., Sunar, M.S.: A review of shadow techniques in augmented reality. In: Second International Conference on Machine Vision, pp. 320–324. IEEE (2009) Noh, Z., Sunar, M.S.: A review of shadow techniques in augmented reality. In: Second International Conference on Machine Vision, pp. 320–324. IEEE (2009)
20.
go back to reference Wang, Y., Samaras, D.: Estimation of multiple directional light sources for synthesis of augmented reality images. Graph. Models 65(4), 185–205 (2003)CrossRef Wang, Y., Samaras, D.: Estimation of multiple directional light sources for synthesis of augmented reality images. Graph. Models 65(4), 185–205 (2003)CrossRef
21.
go back to reference Panagopoulos, A., Wang, C., Samaras, D., Paragios, N.: Illumination estimation and cast shadow detection through a higher-order graphical model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 673–680. Image Analysis Lab, Computer Science Dept., Stony Brook University, IEEE, NY, USA (2011) Panagopoulos, A., Wang, C., Samaras, D., Paragios, N.: Illumination estimation and cast shadow detection through a higher-order graphical model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 673–680. Image Analysis Lab, Computer Science Dept., Stony Brook University, IEEE, NY, USA (2011)
22.
go back to reference Mei, X., Ling, H., Jacobs, D.W.: Illumination recovery from image with cast shadows via sparse representation. IEEE Trans. Image Process. : Publ. IEEE Signal Process. Soci. 20(8), 2366–2377 (2011)MathSciNetCrossRef Mei, X., Ling, H., Jacobs, D.W.: Illumination recovery from image with cast shadows via sparse representation. IEEE Trans. Image Process. : Publ. IEEE Signal Process. Soci. 20(8), 2366–2377 (2011)MathSciNetCrossRef
23.
go back to reference Sato, I., Sato, Y., Ikeuchi, K.: Illumination from shadows. IEEE Trans. Pattern Anal. Mach. Intell. 25(3), 290–300 (2003)MATHCrossRef Sato, I., Sato, Y., Ikeuchi, K.: Illumination from shadows. IEEE Trans. Pattern Anal. Mach. Intell. 25(3), 290–300 (2003)MATHCrossRef
24.
go back to reference Panagopoulos, A., Wang, C., Samaras, D., Paragios, N.: Estimating shadows with the bright channel cue. In: Kutulakos, K.N. (ed.) ECCV 2010 Workshops, Part II. LNCS, vol. 6554, pp. 1–12. Springer, Heidelberg (2012) CrossRef Panagopoulos, A., Wang, C., Samaras, D., Paragios, N.: Estimating shadows with the bright channel cue. In: Kutulakos, K.N. (ed.) ECCV 2010 Workshops, Part II. LNCS, vol. 6554, pp. 1–12. Springer, Heidelberg (2012) CrossRef
25.
go back to reference Kanbara, M., Yokoya, N.: Real-time estimation of light source environment for photorealistic augmented reality. In: Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, vol. 2, pp. 911–914. IEEE (2004) Kanbara, M., Yokoya, N.: Real-time estimation of light source environment for photorealistic augmented reality. In: Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, vol. 2, pp. 911–914. IEEE (2004)
26.
go back to reference Sato, I., Sato, Y., Ikeuchi, K.: Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Trans. Visual Comput. Graphics 5(1), 1–12 (1999)CrossRef Sato, I., Sato, Y., Ikeuchi, K.: Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Trans. Visual Comput. Graphics 5(1), 1–12 (1999)CrossRef
27.
go back to reference Stumpfel, J., Jones, A., Wenger, A., Tchou, C., Hawkins, T., Debevec, P.: Direct HDR capture of the sun and sky. In: ACM SIGGRAPH 2006 Courses on - SIGGRAPH 2006. AFRIGRAPH 2004, vol. 1, p. 5. ACM Press (2006) Stumpfel, J., Jones, A., Wenger, A., Tchou, C., Hawkins, T., Debevec, P.: Direct HDR capture of the sun and sky. In: ACM SIGGRAPH 2006 Courses on - SIGGRAPH 2006. AFRIGRAPH 2004, vol. 1, p. 5. ACM Press (2006)
28.
go back to reference Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst., Man, Cybern. 9(1), 62–66 (1979)MathSciNetCrossRef Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst., Man, Cybern. 9(1), 62–66 (1979)MathSciNetCrossRef
29.
go back to reference Suzuki, S., Be, K.: Topological structural analysis of digitized binary images by border following. Comput. Vis., Graph., Image Process. 30(1), 32–46 (1985)CrossRef Suzuki, S., Be, K.: Topological structural analysis of digitized binary images by border following. Comput. Vis., Graph., Image Process. 30(1), 32–46 (1985)CrossRef
30.
go back to reference Wu, C., Liu, Y., Dai, Q., Wilburn, B.: Fusing multiview and photometric stereo for 3D reconstruction under uncalibrated illumination. IEEE Trans. Vis. Comput. Graph. 17(8), 1082–1095 (2011)CrossRef Wu, C., Liu, Y., Dai, Q., Wilburn, B.: Fusing multiview and photometric stereo for 3D reconstruction under uncalibrated illumination. IEEE Trans. Vis. Comput. Graph. 17(8), 1082–1095 (2011)CrossRef
Metadata
Title
Automatic Estimation of Illumination Features for Indoor Photorealistic Rendering in Augmented Reality
Authors
Hasan Alhajhamad
Mohd Shahrizal Sunar
Hoshang Kolivand
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-22689-7_42

Premium Partner