Skip to main content
Top

2020 | OriginalPaper | Chapter

8. Photometric Estimation

Authors : Katsushi Ikeuchi, Yasuyuki Matsushita, Ryusuke Sagawa, Hiroshi Kawasaki, Yasuhiro Mukaigawa, Ryo Furukawa, Daisuke Miyazaki

Published in: Active Lighting and Its Application for Computer Vision

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Previous chapters considered methods of estimating geometric shape information by using active-lighting methods, which provide photometric characteristics of the target scene and light sources. Because BRDF depends on materials, adequate lighting and analysis provides rich information about those materials. Moreover, multispectral light gives us more robust identification capability. Furthermore, polarization and fluorescence are useful for material classification. Analyzing captured images enables us to separate an image into several photometric components. Additionally, a scene illuminated by multiple lights can be decomposed into an image illuminated by a single light. As such, active lighting is useful, not only for geometrical analysis, but also for photometrical analysis.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Morimoto T, Chiba M, Katayama Y, Ikeuchi K (2009) Multispectral image analysis for bas-relief at the inner gallery of Bayon temple. In: 22nd CIPA symposium, Kyoto, Japan Morimoto T, Chiba M, Katayama Y, Ikeuchi K (2009) Multispectral image analysis for bas-relief at the inner gallery of Bayon temple. In: 22nd CIPA symposium, Kyoto, Japan
2.
go back to reference Blasinski H, Farrell J, Wandell B (2017) Designing illuminant spectral power distributions for surface classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2164–2173 Blasinski H, Farrell J, Wandell B (2017) Designing illuminant spectral power distributions for surface classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2164–2173
3.
go back to reference Skaff S, Tin SK, Martinello M (2015) Learning optimal incident illumination using spectral bidirectional reflectance distribution function images for material classification. J Imaging Sci Technol 59(6):1–60405CrossRef Skaff S, Tin SK, Martinello M (2015) Learning optimal incident illumination using spectral bidirectional reflectance distribution function images for material classification. J Imaging Sci Technol 59(6):1–60405CrossRef
4.
go back to reference Sato M, Yoshida S, Olwal A, Shi B, Hiyama A, Tanikawa T, Hirose M, Raskar R (2015) Spectrans: versatile material classification for interaction with textureless, specular and transparent surfaces. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, pp 2191–2200 Sato M, Yoshida S, Olwal A, Shi B, Hiyama A, Tanikawa T, Hirose M, Raskar R (2015) Spectrans: versatile material classification for interaction with textureless, specular and transparent surfaces. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, pp 2191–2200
5.
go back to reference Liu C, Gu J (2013) Discriminative illumination: per-pixel classification of raw materials based on optimal projections of spectral brdf. IEEE Trans Pattern Anal Mach Intell (PAMI) 36(1):86–98 Liu C, Gu J (2013) Discriminative illumination: per-pixel classification of raw materials based on optimal projections of spectral brdf. IEEE Trans Pattern Anal Mach Intell (PAMI) 36(1):86–98
6.
go back to reference Wang C, Okabe T (2017) Joint optimization of coded illumination and grayscale conversion for one-shot raw material classification. In: Proceedings of the British machine vision conference (BMVC) Wang C, Okabe T (2017) Joint optimization of coded illumination and grayscale conversion for one-shot raw material classification. In: Proceedings of the British machine vision conference (BMVC)
7.
go back to reference Wolff LB, Boult TE (1991) Constraining object features using a polarization reflectance model. IEEE Trans Pattern Anal Mach Intell (PAMI) 7:635–657CrossRef Wolff LB, Boult TE (1991) Constraining object features using a polarization reflectance model. IEEE Trans Pattern Anal Mach Intell (PAMI) 7:635–657CrossRef
8.
go back to reference Martínez-Domingo MÁ, Valero EM, Hernández-Andrés J, Tominaga S, Horiuchi T, Hirai K (2017) Image processing pipeline for segmentation and material classification based on multispectral high dynamic range polarimetric images. Opt Express 25(24):30073–30090CrossRef Martínez-Domingo MÁ, Valero EM, Hernández-Andrés J, Tominaga S, Horiuchi T, Hirai K (2017) Image processing pipeline for segmentation and material classification based on multispectral high dynamic range polarimetric images. Opt Express 25(24):30073–30090CrossRef
9.
go back to reference Chen H, Wolff LB (1998) Polarization phase-based method for material classification in computer vision. Int J Comput Vis (IJCV) 28(1):73–83CrossRef Chen H, Wolff LB (1998) Polarization phase-based method for material classification in computer vision. Int J Comput Vis (IJCV) 28(1):73–83CrossRef
10.
go back to reference Howell JR, Menguc MP, Siegel R (2015) Thermal radiation heat transfer. CRC Press Howell JR, Menguc MP, Siegel R (2015) Thermal radiation heat transfer. CRC Press
11.
go back to reference Zhang C, Sato I (2012) Image-based separation of reflective and fluorescent components using illumination variant and invariant color. IEEE Trans Pattern Anal Mach Intell (PAMI) 35(12):2866–2877CrossRef Zhang C, Sato I (2012) Image-based separation of reflective and fluorescent components using illumination variant and invariant color. IEEE Trans Pattern Anal Mach Intell (PAMI) 35(12):2866–2877CrossRef
12.
go back to reference Fu Y, Lam A, Sato I, Okabe T, Sato Y (2015) Reflectance and fluorescence spectral recovery via actively lit RGB images. IEEE Trans Pattern Anal Mach Intell (PAMI) 38(7):1313–1326CrossRef Fu Y, Lam A, Sato I, Okabe T, Sato Y (2015) Reflectance and fluorescence spectral recovery via actively lit RGB images. IEEE Trans Pattern Anal Mach Intell (PAMI) 38(7):1313–1326CrossRef
13.
go back to reference Fu Y, Lam A, Sato I, Okabe T, Sato Y (2013) Separating reflective and fluorescent components using high frequency illumination in the spectral domain. In: Proceedings of the international conference on computer vision (ICCV), pp 457–464 Fu Y, Lam A, Sato I, Okabe T, Sato Y (2013) Separating reflective and fluorescent components using high frequency illumination in the spectral domain. In: Proceedings of the international conference on computer vision (ICCV), pp 457–464
14.
go back to reference Tominaga S, Hirai K, Horiuchi T (2018) Estimation of fluorescent donaldson matrices using a spectral imaging system. Opt Express 26(2):2132–2148CrossRef Tominaga S, Hirai K, Horiuchi T (2018) Estimation of fluorescent donaldson matrices using a spectral imaging system. Opt Express 26(2):2132–2148CrossRef
15.
go back to reference Schechner Y, Nayar S, Belhumeur P (2003) A theory of multiplexed illumination. Proc Int Conf Comput Vis (ICCV) 2:808–815CrossRef Schechner Y, Nayar S, Belhumeur P (2003) A theory of multiplexed illumination. Proc Int Conf Comput Vis (ICCV) 2:808–815CrossRef
16.
go back to reference Harwit M, Sloane NJ (1979) Hadamard transform optics. Academic Press Harwit M, Sloane NJ (1979) Hadamard transform optics. Academic Press
17.
go back to reference Mukaigawa Y, Sumino K, Yagi Y (2007) Multiplexed illumination for measuring brdf using an ellipsoidal mirror and a projector. In: Proceedings of the Asian conference on computer vision (ACCV). Springer, pp 246–257 Mukaigawa Y, Sumino K, Yagi Y (2007) Multiplexed illumination for measuring brdf using an ellipsoidal mirror and a projector. In: Proceedings of the Asian conference on computer vision (ACCV). Springer, pp 246–257
18.
go back to reference Sagawa R, Satoh Y (2017) Illuminant-camera communication to observe moving objects under strong external light by spread spectrum modulation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 5097–5105 Sagawa R, Satoh Y (2017) Illuminant-camera communication to observe moving objects under strong external light by spread spectrum modulation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 5097–5105
19.
go back to reference Wenger A, Gardner A, Tchou C, Unger J, Hawkins T, Debevec P (2005) Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans Graph (TOG) 24(3):756–764CrossRef Wenger A, Gardner A, Tchou C, Unger J, Hawkins T, Debevec P (2005) Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans Graph (TOG) 24(3):756–764CrossRef
20.
go back to reference Sagawa R, Sakashita K, Kasuya N, Kawasaki H, Furukawa R, Yagi Y (2012) Grid-based active stereo with single-colored wave pattern for dense one-shot 3D scan. In: 2012 second international conference on 3d imaging, modeling, processing, visualization & transmission. IEEE, pp 363–370 Sagawa R, Sakashita K, Kasuya N, Kawasaki H, Furukawa R, Yagi Y (2012) Grid-based active stereo with single-colored wave pattern for dense one-shot 3D scan. In: 2012 second international conference on 3d imaging, modeling, processing, visualization & transmission. IEEE, pp 363–370
21.
go back to reference Nishino K, Sato Y, Ikeuchi K (1999) Eigen-texture method: appearance compression based on 3D model. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 1. IEEE, pp 618–624 Nishino K, Sato Y, Ikeuchi K (1999) Eigen-texture method: appearance compression based on 3D model. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 1. IEEE, pp 618–624
22.
go back to reference Chen WC, Bouguet JY, Chu MH, Grzeszczuk R (2002) Light field mapping: efficient representation and hardware rendering of surface light fields. ACM Trans Graph (TOG) 21(3):447–456CrossRef Chen WC, Bouguet JY, Chu MH, Grzeszczuk R (2002) Light field mapping: efficient representation and hardware rendering of surface light fields. ACM Trans Graph (TOG) 21(3):447–456CrossRef
23.
go back to reference Arun KS, Huang TS, Blostein SD (1987) Least-squares fitting of two 3-D point sets. IEEE Trans Pattern Anal Mach Intell (PAMI) 5:698–700CrossRef Arun KS, Huang TS, Blostein SD (1987) Least-squares fitting of two 3-D point sets. IEEE Trans Pattern Anal Mach Intell (PAMI) 5:698–700CrossRef
Metadata
Title
Photometric Estimation
Authors
Katsushi Ikeuchi
Yasuyuki Matsushita
Ryusuke Sagawa
Hiroshi Kawasaki
Yasuhiro Mukaigawa
Ryo Furukawa
Daisuke Miyazaki
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-56577-0_8

Premium Partner