Skip to main content
Top

2020 | OriginalPaper | Chapter

7. Other Shape Reconstruction Techniques

Authors : Katsushi Ikeuchi, Yasuyuki Matsushita, Ryusuke Sagawa, Hiroshi Kawasaki, Yasuhiro Mukaigawa, Ryo Furukawa, Daisuke Miyazaki

Published in: Active Lighting and Its Application for Computer Vision

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In the previous chapters, the photometric stereo and structured light methods were introduced. Although these two methods have been well studied in the computer vision field, other optical phenomena are used to provide clues for shape reconstruction. In this chapter, shape reconstruction techniques that utilize special optical phenomena (e.g., polarization, fluorescence, cast shadow, and projector defocus) are introduced.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Born M, Wolf E (2013) Principles of optics: electromagnetic theory of propagation, interference and diffraction of light. Elsevier Born M, Wolf E (2013) Principles of optics: electromagnetic theory of propagation, interference and diffraction of light. Elsevier
2.
go back to reference Hecht E (1998) Hecht optics vol 997. Addison Wesley, pp 213–214 Hecht E (1998) Hecht optics vol 997. Addison Wesley, pp 213–214
3.
go back to reference Shurcliff WA (1966) Polarized light. Production and use. Harvard University Press, Cambridge, MA| c1966 Shurcliff WA (1966) Polarized light. Production and use. Harvard University Press, Cambridge, MA| c1966
4.
go back to reference Wolff LB, Boult TE (1991) Constraining object features using a polarization reflectance model. IEEE Trans Pattern Anal Mach Intell (PAMI) 7:635–657CrossRef Wolff LB, Boult TE (1991) Constraining object features using a polarization reflectance model. IEEE Trans Pattern Anal Mach Intell (PAMI) 7:635–657CrossRef
5.
go back to reference Rahmann S (1999) Inferring 3d scene structure from a single polarization image. In: Polarization and color techniques in industrial inspection, vol 3826. International Society for Optics and Photonics, pp 22–34 Rahmann S (1999) Inferring 3d scene structure from a single polarization image. In: Polarization and color techniques in industrial inspection, vol 3826. International Society for Optics and Photonics, pp 22–34
6.
go back to reference Rahmann S (2000) Polarization images: a geometric interpretation for shape analysis. In: Proceedings of the international conference on pattern recognition (ICPR), vol 3. IEEE, pp 538–542 Rahmann S (2000) Polarization images: a geometric interpretation for shape analysis. In: Proceedings of the international conference on pattern recognition (ICPR), vol 3. IEEE, pp 538–542
7.
go back to reference Rahmann S, Canterakis N (2001) Reconstruction of specular surfaces using polarization imaging. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 1. IEEE, pp I–I Rahmann S, Canterakis N (2001) Reconstruction of specular surfaces using polarization imaging. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 1. IEEE, pp I–I
8.
go back to reference Rahmann S (2003) Reconstruction of quadrics from two polarization views. In: Iberian conference on pattern recognition and image analysis. Springer, pp 810–820 Rahmann S (2003) Reconstruction of quadrics from two polarization views. In: Iberian conference on pattern recognition and image analysis. Springer, pp 810–820
9.
go back to reference Atkinson GA, Hancock ER (2007) Shape estimation using polarization and shading from two views. IEEE Trans Pattern Anal Mach Intell (PAMI) 29(11):2001–2017CrossRef Atkinson GA, Hancock ER (2007) Shape estimation using polarization and shading from two views. IEEE Trans Pattern Anal Mach Intell (PAMI) 29(11):2001–2017CrossRef
10.
go back to reference Miyazaki D, Shigetomi T, Baba M, Furukawa R, Hiura S, Asada N (2016) Surface normal estimation of black specular objects from multiview polarization images. Opt Eng 56(4):041303CrossRef Miyazaki D, Shigetomi T, Baba M, Furukawa R, Hiura S, Asada N (2016) Surface normal estimation of black specular objects from multiview polarization images. Opt Eng 56(4):041303CrossRef
11.
go back to reference Miyazaki D, Furuhashi R, Hiura S (2020) Shape estimation of concave specular object from multiview polarization. J Electron Imaging 29(4):041006CrossRef Miyazaki D, Furuhashi R, Hiura S (2020) Shape estimation of concave specular object from multiview polarization. J Electron Imaging 29(4):041006CrossRef
12.
go back to reference Cui Z, Gu J, Shi B, Tan P, Kautz J (2017) Polarimetric multi-view stereo. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 1558–1567 Cui Z, Gu J, Shi B, Tan P, Kautz J (2017) Polarimetric multi-view stereo. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 1558–1567
13.
go back to reference Yang L, Tan F, Li A, Cui Z, Furukawa Y, Tan P (2018) Polarimetric dense monocular slam. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3857–3866 Yang L, Tan F, Li A, Cui Z, Furukawa Y, Tan P (2018) Polarimetric dense monocular slam. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3857–3866
14.
go back to reference Mecca R, Logothetis F, Cipolla R (2018) A differential approach to shape from polarization Mecca R, Logothetis F, Cipolla R (2018) A differential approach to shape from polarization
15.
go back to reference Miyazaki D, Tan RT, Hara K, Ikeuchi K (2003) Polarization-based inverse rendering from a single view. In: Proceedings of the international conference on computer vision (ICCV). IEEE Computer Society, p 982 Miyazaki D, Tan RT, Hara K, Ikeuchi K (2003) Polarization-based inverse rendering from a single view. In: Proceedings of the international conference on computer vision (ICCV). IEEE Computer Society, p 982
16.
go back to reference Atkinson GA, Hancock ER (2006) Recovery of surface orientation from diffuse polarization. IEEE Trans Image Process (TIP) 15(6):1653–1664CrossRef Atkinson GA, Hancock ER (2006) Recovery of surface orientation from diffuse polarization. IEEE Trans Image Process (TIP) 15(6):1653–1664CrossRef
17.
go back to reference Miyazaki D, Saito M, Sato Y, Ikeuchi K (2002) Determining surface orientations of transparent objects based on polarization degrees in visible and infrared wavelengths. J Opt Soc Am A 19(4):687–694CrossRef Miyazaki D, Saito M, Sato Y, Ikeuchi K (2002) Determining surface orientations of transparent objects based on polarization degrees in visible and infrared wavelengths. J Opt Soc Am A 19(4):687–694CrossRef
18.
go back to reference Saito M, Sato Y, Ikeuchi K, Kashiwagi H (1999) Measurement of surface orientations of transparent objects by use of polarization in highlight. J Opt Soc Am A 16(9):2286–2293CrossRef Saito M, Sato Y, Ikeuchi K, Kashiwagi H (1999) Measurement of surface orientations of transparent objects by use of polarization in highlight. J Opt Soc Am A 16(9):2286–2293CrossRef
19.
go back to reference Barbour BA (2012) Apparatus and method for extracting information from electromagnetic energy including target 3d structure and materials. US Patent 8,320,661 Barbour BA (2012) Apparatus and method for extracting information from electromagnetic energy including target 3d structure and materials. US Patent 8,320,661
20.
go back to reference Miyazaki D, Kagesawa M, Ikeuchi K (2004) Transparent surface modeling from a pair of polarization images. IEEE Trans Pattern Anal Mach Intell (PAMI) 1:73–82CrossRef Miyazaki D, Kagesawa M, Ikeuchi K (2004) Transparent surface modeling from a pair of polarization images. IEEE Trans Pattern Anal Mach Intell (PAMI) 1:73–82CrossRef
21.
go back to reference Huynh CP, Robles-Kelly A, Hancock ER (2013) Shape and refractive index from single-view spectro-polarimetric images. Int J Compu Vis (IJCV) 101(1):64–94MathSciNetCrossRef Huynh CP, Robles-Kelly A, Hancock ER (2013) Shape and refractive index from single-view spectro-polarimetric images. Int J Compu Vis (IJCV) 101(1):64–94MathSciNetCrossRef
22.
go back to reference Kobayashi Y, Morimoto T, Sato I, Mukaigawa Y, Tomono T, Ikeuchi K (2016) Reconstructing shapes and appearances of thin film objects using RGB images. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3774–3782 Kobayashi Y, Morimoto T, Sato I, Mukaigawa Y, Tomono T, Ikeuchi K (2016) Reconstructing shapes and appearances of thin film objects using RGB images. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3774–3782
23.
go back to reference Koshikawa K, Shirai Y (1987) A model-based recognition of glossy objects using their polarimetrical properties. Adv Robot 2(2):137–147CrossRef Koshikawa K, Shirai Y (1987) A model-based recognition of glossy objects using their polarimetrical properties. Adv Robot 2(2):137–147CrossRef
24.
go back to reference Guarnera GC, Peers P, Debevec P, Ghosh A (2012) Estimating surface normals from spherical stokes reflectance fields. In: Proceedings of the European conference on computer vision (ECCV). Springer, pp 340–349 Guarnera GC, Peers P, Debevec P, Ghosh A (2012) Estimating surface normals from spherical stokes reflectance fields. In: Proceedings of the European conference on computer vision (ECCV). Springer, pp 340–349
25.
go back to reference Morel O, Stolz C, Meriaudeau F, Gorria P (2006) Active lighting applied to three-dimensional reconstruction of specular metallic surfaces by polarization imaging. Appl Opt 45(17):4062–4068CrossRef Morel O, Stolz C, Meriaudeau F, Gorria P (2006) Active lighting applied to three-dimensional reconstruction of specular metallic surfaces by polarization imaging. Appl Opt 45(17):4062–4068CrossRef
26.
go back to reference Drbohlav O, Sara R (2001) Unambiguous determination of shape from photometric stereo with unknown light sources. In: Proceedings of the international conference on computer vision (ICCV), vol 1. IEEE, pp 581–586 Drbohlav O, Sara R (2001) Unambiguous determination of shape from photometric stereo with unknown light sources. In: Proceedings of the international conference on computer vision (ICCV), vol 1. IEEE, pp 581–586
27.
go back to reference Ngo Thanh T, Nagahara H, Taniguchi RI (2015) Shape and light directions from shading and polarization. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2310–2318 Ngo Thanh T, Nagahara H, Taniguchi RI (2015) Shape and light directions from shading and polarization. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2310–2318
28.
go back to reference Smith W, Ramamoorthi R, Tozza S (2018) Height-from-polarisation with unknown lighting or albedo. In: IEEE transactions on pattern analysis and machine intelligence (PAMI) Smith W, Ramamoorthi R, Tozza S (2018) Height-from-polarisation with unknown lighting or albedo. In: IEEE transactions on pattern analysis and machine intelligence (PAMI)
29.
go back to reference Kadambi A, Taamazyan V, Shi B, Raskar R (2017) Depth sensing using geometrically constrained polarization normals. Int J Comput Vis (IJCV) 125(1–3):34–51MathSciNetCrossRef Kadambi A, Taamazyan V, Shi B, Raskar R (2017) Depth sensing using geometrically constrained polarization normals. Int J Comput Vis (IJCV) 125(1–3):34–51MathSciNetCrossRef
30.
go back to reference Yu Y, Zhu D, Smith WA (2017) Shape-from-polarisation: a nonlinear least squares approach. In: Proceedings of the international conference on computer vision (ICCV), pp 2969–2976 Yu Y, Zhu D, Smith WA (2017) Shape-from-polarisation: a nonlinear least squares approach. In: Proceedings of the international conference on computer vision (ICCV), pp 2969–2976
31.
go back to reference Miyazaki D, Ikeuchi K (2007) Shape estimation of transparent objects by using inverse polarization ray tracing. IEEE Trans Pattern Anal Mach Intell (PAMI) 29(11):2018–2030CrossRef Miyazaki D, Ikeuchi K (2007) Shape estimation of transparent objects by using inverse polarization ray tracing. IEEE Trans Pattern Anal Mach Intell (PAMI) 29(11):2018–2030CrossRef
32.
go back to reference Sato I, Okabe T, Sato Y (2012) Bispectral photometric stereo based on fluorescence. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 270–277 Sato I, Okabe T, Sato Y (2012) Bispectral photometric stereo based on fluorescence. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 270–277
33.
go back to reference Treibitz T, Murez Z, Mitchell BG, Kriegman D (2012) Shape from fluorescence. In: Proceedings of the European conference on computer vision (ECCV). Springer, pp 292–306 Treibitz T, Murez Z, Mitchell BG, Kriegman D (2012) Shape from fluorescence. In: Proceedings of the European conference on computer vision (ECCV). Springer, pp 292–306
34.
go back to reference Murez Z, Treibitz T, Ramamoorthi R, Kriegman D (2015) Photometric stereo in a scattering medium. In: Proceedings of the international conference on computer vision (ICCV), pp 3415–3423 Murez Z, Treibitz T, Ramamoorthi R, Kriegman D (2015) Photometric stereo in a scattering medium. In: Proceedings of the international conference on computer vision (ICCV), pp 3415–3423
35.
go back to reference Hullin MB, Fuchs M, Ihrke I, Seidel HP, Lensch HP (2008) Fluorescent immersion range scanning. ACM Trans Graph (TOG) 27(3):87CrossRef Hullin MB, Fuchs M, Ihrke I, Seidel HP, Lensch HP (2008) Fluorescent immersion range scanning. ACM Trans Graph (TOG) 27(3):87CrossRef
36.
go back to reference Okabe T, Sato I, Sato Y (2009) Attached shadow coding: estimating surface normals from shadows under unknown reflectance and lighting conditions. In: Proceedings of the international conference on computer vision (ICCV). IEEE, pp 1693–1700 Okabe T, Sato I, Sato Y (2009) Attached shadow coding: estimating surface normals from shadows under unknown reflectance and lighting conditions. In: Proceedings of the international conference on computer vision (ICCV). IEEE, pp 1693–1700
37.
go back to reference Kawasaki H, Furukawa R (2007) Shape reconstruction from cast shadows using coplanarities and metric constraints. In: Proceedings of the Asian conference on computer vision (ACCV) LNCS 4843, vol II, pp 847–857 Kawasaki H, Furukawa R (2007) Shape reconstruction from cast shadows using coplanarities and metric constraints. In: Proceedings of the Asian conference on computer vision (ACCV) LNCS 4843, vol II, pp 847–857
38.
go back to reference Shafer SA, Kanade T (1983) Using shadows in finding surface orientations. Comput Vis Graph Image Process 22(1):145–176CrossRef Shafer SA, Kanade T (1983) Using shadows in finding surface orientations. Comput Vis Graph Image Process 22(1):145–176CrossRef
39.
go back to reference Hambrick LN, Loew MH, Carroll RLJ (1987) The entry exit method of shadow boundary segmentation. IEEE Trans Pattern Anal Mach Intell (PAMI) 9(5):597–607 Hambrick LN, Loew MH, Carroll RLJ (1987) The entry exit method of shadow boundary segmentation. IEEE Trans Pattern Anal Mach Intell (PAMI) 9(5):597–607
40.
go back to reference Hatzitheodorou M, Kender J (1988) An optimal algorithm for the derivation of shape from shadows. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 486–491 Hatzitheodorou M, Kender J (1988) An optimal algorithm for the derivation of shape from shadows. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 486–491
41.
go back to reference Raviv D, Pao Y, Loparo KA (1989) Reconstruction of three-dimensional surfaces from two-dimensional binary images. IEEE Trans Robot Autom 5(5):701–710CrossRef Raviv D, Pao Y, Loparo KA (1989) Reconstruction of three-dimensional surfaces from two-dimensional binary images. IEEE Trans Robot Autom 5(5):701–710CrossRef
45.
go back to reference Yamazaki S, Narasimhan SG, Baker S, Kanade T (2007) Coplanar shadowgrams for acquiring visual hulls of intricate objects. In: Proceedings of the international conference on computer vision (ICCV) Yamazaki S, Narasimhan SG, Baker S, Kanade T (2007) Coplanar shadowgrams for acquiring visual hulls of intricate objects. In: Proceedings of the international conference on computer vision (ICCV)
46.
go back to reference Kriegman DJ, Belhumeur PN (2001) What shadows reveal about object structure. J Opt Soc Am 18(8):1804–1813CrossRef Kriegman DJ, Belhumeur PN (2001) What shadows reveal about object structure. J Opt Soc Am 18(8):1804–1813CrossRef
47.
go back to reference Caspi Y, Werman M (2003) Vertical parallax from moving shadows. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 2. IEEE, pp 2309–2315 Caspi Y, Werman M (2003) Vertical parallax from moving shadows. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 2. IEEE, pp 2309–2315
48.
go back to reference Nayar S, Watanabe M, Noguchi M (1996) Real-Time focus range sensor. IEEE Trans Pattern Anal Mach Intell (PAMI) 18(12):1186–1198CrossRef Nayar S, Watanabe M, Noguchi M (1996) Real-Time focus range sensor. IEEE Trans Pattern Anal Mach Intell (PAMI) 18(12):1186–1198CrossRef
49.
go back to reference Kawasaki H, Horita Y, Masuyama H, Ono S, Kimura M, Takane Y (2013) Optimized aperture for estimating depth from projector’s defocus. In: 2013 International conference on 3d vision-3DV 2013. IEEE, pp 135–142 Kawasaki H, Horita Y, Masuyama H, Ono S, Kimura M, Takane Y (2013) Optimized aperture for estimating depth from projector’s defocus. In: 2013 International conference on 3d vision-3DV 2013. IEEE, pp 135–142
50.
go back to reference Kawasaki H, Horita Y, Morinaga H, Matugano Y, Ono S, Kimura M, Takane Y (2012) Structured light with coded aperture for wide range 3d measurement. In: 2012 19th IEEE international conference on image processing. IEEE, pp 2777–2780 Kawasaki H, Horita Y, Morinaga H, Matugano Y, Ono S, Kimura M, Takane Y (2012) Structured light with coded aperture for wide range 3d measurement. In: 2012 19th IEEE international conference on image processing. IEEE, pp 2777–2780
51.
go back to reference Kawasaki H, Ono S, Horita Y, Shiba Y, Furukawa R, Hiura S (2015) Active one-shot scan for wide depth range using a light field projector based on coded aperture. In: Proceedings of the international conference on computer vision (ICCV), pp 3568–3576 Kawasaki H, Ono S, Horita Y, Shiba Y, Furukawa R, Hiura S (2015) Active one-shot scan for wide depth range using a light field projector based on coded aperture. In: Proceedings of the international conference on computer vision (ICCV), pp 3568–3576
Metadata
Title
Other Shape Reconstruction Techniques
Authors
Katsushi Ikeuchi
Yasuyuki Matsushita
Ryusuke Sagawa
Hiroshi Kawasaki
Yasuhiro Mukaigawa
Ryo Furukawa
Daisuke Miyazaki
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-56577-0_7

Premium Partner