Skip to main content

2020 | OriginalPaper | Buchkapitel

7. Other Shape Reconstruction Techniques

verfasst von : Katsushi Ikeuchi, Yasuyuki Matsushita, Ryusuke Sagawa, Hiroshi Kawasaki, Yasuhiro Mukaigawa, Ryo Furukawa, Daisuke Miyazaki

Erschienen in: Active Lighting and Its Application for Computer Vision

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the previous chapters, the photometric stereo and structured light methods were introduced. Although these two methods have been well studied in the computer vision field, other optical phenomena are used to provide clues for shape reconstruction. In this chapter, shape reconstruction techniques that utilize special optical phenomena (e.g., polarization, fluorescence, cast shadow, and projector defocus) are introduced.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Born M, Wolf E (2013) Principles of optics: electromagnetic theory of propagation, interference and diffraction of light. Elsevier Born M, Wolf E (2013) Principles of optics: electromagnetic theory of propagation, interference and diffraction of light. Elsevier
2.
Zurück zum Zitat Hecht E (1998) Hecht optics vol 997. Addison Wesley, pp 213–214 Hecht E (1998) Hecht optics vol 997. Addison Wesley, pp 213–214
3.
Zurück zum Zitat Shurcliff WA (1966) Polarized light. Production and use. Harvard University Press, Cambridge, MA| c1966 Shurcliff WA (1966) Polarized light. Production and use. Harvard University Press, Cambridge, MA| c1966
4.
Zurück zum Zitat Wolff LB, Boult TE (1991) Constraining object features using a polarization reflectance model. IEEE Trans Pattern Anal Mach Intell (PAMI) 7:635–657CrossRef Wolff LB, Boult TE (1991) Constraining object features using a polarization reflectance model. IEEE Trans Pattern Anal Mach Intell (PAMI) 7:635–657CrossRef
5.
Zurück zum Zitat Rahmann S (1999) Inferring 3d scene structure from a single polarization image. In: Polarization and color techniques in industrial inspection, vol 3826. International Society for Optics and Photonics, pp 22–34 Rahmann S (1999) Inferring 3d scene structure from a single polarization image. In: Polarization and color techniques in industrial inspection, vol 3826. International Society for Optics and Photonics, pp 22–34
6.
Zurück zum Zitat Rahmann S (2000) Polarization images: a geometric interpretation for shape analysis. In: Proceedings of the international conference on pattern recognition (ICPR), vol 3. IEEE, pp 538–542 Rahmann S (2000) Polarization images: a geometric interpretation for shape analysis. In: Proceedings of the international conference on pattern recognition (ICPR), vol 3. IEEE, pp 538–542
7.
Zurück zum Zitat Rahmann S, Canterakis N (2001) Reconstruction of specular surfaces using polarization imaging. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 1. IEEE, pp I–I Rahmann S, Canterakis N (2001) Reconstruction of specular surfaces using polarization imaging. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 1. IEEE, pp I–I
8.
Zurück zum Zitat Rahmann S (2003) Reconstruction of quadrics from two polarization views. In: Iberian conference on pattern recognition and image analysis. Springer, pp 810–820 Rahmann S (2003) Reconstruction of quadrics from two polarization views. In: Iberian conference on pattern recognition and image analysis. Springer, pp 810–820
9.
Zurück zum Zitat Atkinson GA, Hancock ER (2007) Shape estimation using polarization and shading from two views. IEEE Trans Pattern Anal Mach Intell (PAMI) 29(11):2001–2017CrossRef Atkinson GA, Hancock ER (2007) Shape estimation using polarization and shading from two views. IEEE Trans Pattern Anal Mach Intell (PAMI) 29(11):2001–2017CrossRef
10.
Zurück zum Zitat Miyazaki D, Shigetomi T, Baba M, Furukawa R, Hiura S, Asada N (2016) Surface normal estimation of black specular objects from multiview polarization images. Opt Eng 56(4):041303CrossRef Miyazaki D, Shigetomi T, Baba M, Furukawa R, Hiura S, Asada N (2016) Surface normal estimation of black specular objects from multiview polarization images. Opt Eng 56(4):041303CrossRef
11.
Zurück zum Zitat Miyazaki D, Furuhashi R, Hiura S (2020) Shape estimation of concave specular object from multiview polarization. J Electron Imaging 29(4):041006CrossRef Miyazaki D, Furuhashi R, Hiura S (2020) Shape estimation of concave specular object from multiview polarization. J Electron Imaging 29(4):041006CrossRef
12.
Zurück zum Zitat Cui Z, Gu J, Shi B, Tan P, Kautz J (2017) Polarimetric multi-view stereo. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 1558–1567 Cui Z, Gu J, Shi B, Tan P, Kautz J (2017) Polarimetric multi-view stereo. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 1558–1567
13.
Zurück zum Zitat Yang L, Tan F, Li A, Cui Z, Furukawa Y, Tan P (2018) Polarimetric dense monocular slam. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3857–3866 Yang L, Tan F, Li A, Cui Z, Furukawa Y, Tan P (2018) Polarimetric dense monocular slam. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3857–3866
14.
Zurück zum Zitat Mecca R, Logothetis F, Cipolla R (2018) A differential approach to shape from polarization Mecca R, Logothetis F, Cipolla R (2018) A differential approach to shape from polarization
15.
Zurück zum Zitat Miyazaki D, Tan RT, Hara K, Ikeuchi K (2003) Polarization-based inverse rendering from a single view. In: Proceedings of the international conference on computer vision (ICCV). IEEE Computer Society, p 982 Miyazaki D, Tan RT, Hara K, Ikeuchi K (2003) Polarization-based inverse rendering from a single view. In: Proceedings of the international conference on computer vision (ICCV). IEEE Computer Society, p 982
16.
Zurück zum Zitat Atkinson GA, Hancock ER (2006) Recovery of surface orientation from diffuse polarization. IEEE Trans Image Process (TIP) 15(6):1653–1664CrossRef Atkinson GA, Hancock ER (2006) Recovery of surface orientation from diffuse polarization. IEEE Trans Image Process (TIP) 15(6):1653–1664CrossRef
17.
Zurück zum Zitat Miyazaki D, Saito M, Sato Y, Ikeuchi K (2002) Determining surface orientations of transparent objects based on polarization degrees in visible and infrared wavelengths. J Opt Soc Am A 19(4):687–694CrossRef Miyazaki D, Saito M, Sato Y, Ikeuchi K (2002) Determining surface orientations of transparent objects based on polarization degrees in visible and infrared wavelengths. J Opt Soc Am A 19(4):687–694CrossRef
18.
Zurück zum Zitat Saito M, Sato Y, Ikeuchi K, Kashiwagi H (1999) Measurement of surface orientations of transparent objects by use of polarization in highlight. J Opt Soc Am A 16(9):2286–2293CrossRef Saito M, Sato Y, Ikeuchi K, Kashiwagi H (1999) Measurement of surface orientations of transparent objects by use of polarization in highlight. J Opt Soc Am A 16(9):2286–2293CrossRef
19.
Zurück zum Zitat Barbour BA (2012) Apparatus and method for extracting information from electromagnetic energy including target 3d structure and materials. US Patent 8,320,661 Barbour BA (2012) Apparatus and method for extracting information from electromagnetic energy including target 3d structure and materials. US Patent 8,320,661
20.
Zurück zum Zitat Miyazaki D, Kagesawa M, Ikeuchi K (2004) Transparent surface modeling from a pair of polarization images. IEEE Trans Pattern Anal Mach Intell (PAMI) 1:73–82CrossRef Miyazaki D, Kagesawa M, Ikeuchi K (2004) Transparent surface modeling from a pair of polarization images. IEEE Trans Pattern Anal Mach Intell (PAMI) 1:73–82CrossRef
21.
Zurück zum Zitat Huynh CP, Robles-Kelly A, Hancock ER (2013) Shape and refractive index from single-view spectro-polarimetric images. Int J Compu Vis (IJCV) 101(1):64–94MathSciNetCrossRef Huynh CP, Robles-Kelly A, Hancock ER (2013) Shape and refractive index from single-view spectro-polarimetric images. Int J Compu Vis (IJCV) 101(1):64–94MathSciNetCrossRef
22.
Zurück zum Zitat Kobayashi Y, Morimoto T, Sato I, Mukaigawa Y, Tomono T, Ikeuchi K (2016) Reconstructing shapes and appearances of thin film objects using RGB images. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3774–3782 Kobayashi Y, Morimoto T, Sato I, Mukaigawa Y, Tomono T, Ikeuchi K (2016) Reconstructing shapes and appearances of thin film objects using RGB images. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3774–3782
23.
Zurück zum Zitat Koshikawa K, Shirai Y (1987) A model-based recognition of glossy objects using their polarimetrical properties. Adv Robot 2(2):137–147CrossRef Koshikawa K, Shirai Y (1987) A model-based recognition of glossy objects using their polarimetrical properties. Adv Robot 2(2):137–147CrossRef
24.
Zurück zum Zitat Guarnera GC, Peers P, Debevec P, Ghosh A (2012) Estimating surface normals from spherical stokes reflectance fields. In: Proceedings of the European conference on computer vision (ECCV). Springer, pp 340–349 Guarnera GC, Peers P, Debevec P, Ghosh A (2012) Estimating surface normals from spherical stokes reflectance fields. In: Proceedings of the European conference on computer vision (ECCV). Springer, pp 340–349
25.
Zurück zum Zitat Morel O, Stolz C, Meriaudeau F, Gorria P (2006) Active lighting applied to three-dimensional reconstruction of specular metallic surfaces by polarization imaging. Appl Opt 45(17):4062–4068CrossRef Morel O, Stolz C, Meriaudeau F, Gorria P (2006) Active lighting applied to three-dimensional reconstruction of specular metallic surfaces by polarization imaging. Appl Opt 45(17):4062–4068CrossRef
26.
Zurück zum Zitat Drbohlav O, Sara R (2001) Unambiguous determination of shape from photometric stereo with unknown light sources. In: Proceedings of the international conference on computer vision (ICCV), vol 1. IEEE, pp 581–586 Drbohlav O, Sara R (2001) Unambiguous determination of shape from photometric stereo with unknown light sources. In: Proceedings of the international conference on computer vision (ICCV), vol 1. IEEE, pp 581–586
27.
Zurück zum Zitat Ngo Thanh T, Nagahara H, Taniguchi RI (2015) Shape and light directions from shading and polarization. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2310–2318 Ngo Thanh T, Nagahara H, Taniguchi RI (2015) Shape and light directions from shading and polarization. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2310–2318
28.
Zurück zum Zitat Smith W, Ramamoorthi R, Tozza S (2018) Height-from-polarisation with unknown lighting or albedo. In: IEEE transactions on pattern analysis and machine intelligence (PAMI) Smith W, Ramamoorthi R, Tozza S (2018) Height-from-polarisation with unknown lighting or albedo. In: IEEE transactions on pattern analysis and machine intelligence (PAMI)
29.
Zurück zum Zitat Kadambi A, Taamazyan V, Shi B, Raskar R (2017) Depth sensing using geometrically constrained polarization normals. Int J Comput Vis (IJCV) 125(1–3):34–51MathSciNetCrossRef Kadambi A, Taamazyan V, Shi B, Raskar R (2017) Depth sensing using geometrically constrained polarization normals. Int J Comput Vis (IJCV) 125(1–3):34–51MathSciNetCrossRef
30.
Zurück zum Zitat Yu Y, Zhu D, Smith WA (2017) Shape-from-polarisation: a nonlinear least squares approach. In: Proceedings of the international conference on computer vision (ICCV), pp 2969–2976 Yu Y, Zhu D, Smith WA (2017) Shape-from-polarisation: a nonlinear least squares approach. In: Proceedings of the international conference on computer vision (ICCV), pp 2969–2976
31.
Zurück zum Zitat Miyazaki D, Ikeuchi K (2007) Shape estimation of transparent objects by using inverse polarization ray tracing. IEEE Trans Pattern Anal Mach Intell (PAMI) 29(11):2018–2030CrossRef Miyazaki D, Ikeuchi K (2007) Shape estimation of transparent objects by using inverse polarization ray tracing. IEEE Trans Pattern Anal Mach Intell (PAMI) 29(11):2018–2030CrossRef
32.
Zurück zum Zitat Sato I, Okabe T, Sato Y (2012) Bispectral photometric stereo based on fluorescence. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 270–277 Sato I, Okabe T, Sato Y (2012) Bispectral photometric stereo based on fluorescence. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 270–277
33.
Zurück zum Zitat Treibitz T, Murez Z, Mitchell BG, Kriegman D (2012) Shape from fluorescence. In: Proceedings of the European conference on computer vision (ECCV). Springer, pp 292–306 Treibitz T, Murez Z, Mitchell BG, Kriegman D (2012) Shape from fluorescence. In: Proceedings of the European conference on computer vision (ECCV). Springer, pp 292–306
34.
Zurück zum Zitat Murez Z, Treibitz T, Ramamoorthi R, Kriegman D (2015) Photometric stereo in a scattering medium. In: Proceedings of the international conference on computer vision (ICCV), pp 3415–3423 Murez Z, Treibitz T, Ramamoorthi R, Kriegman D (2015) Photometric stereo in a scattering medium. In: Proceedings of the international conference on computer vision (ICCV), pp 3415–3423
35.
Zurück zum Zitat Hullin MB, Fuchs M, Ihrke I, Seidel HP, Lensch HP (2008) Fluorescent immersion range scanning. ACM Trans Graph (TOG) 27(3):87CrossRef Hullin MB, Fuchs M, Ihrke I, Seidel HP, Lensch HP (2008) Fluorescent immersion range scanning. ACM Trans Graph (TOG) 27(3):87CrossRef
36.
Zurück zum Zitat Okabe T, Sato I, Sato Y (2009) Attached shadow coding: estimating surface normals from shadows under unknown reflectance and lighting conditions. In: Proceedings of the international conference on computer vision (ICCV). IEEE, pp 1693–1700 Okabe T, Sato I, Sato Y (2009) Attached shadow coding: estimating surface normals from shadows under unknown reflectance and lighting conditions. In: Proceedings of the international conference on computer vision (ICCV). IEEE, pp 1693–1700
37.
Zurück zum Zitat Kawasaki H, Furukawa R (2007) Shape reconstruction from cast shadows using coplanarities and metric constraints. In: Proceedings of the Asian conference on computer vision (ACCV) LNCS 4843, vol II, pp 847–857 Kawasaki H, Furukawa R (2007) Shape reconstruction from cast shadows using coplanarities and metric constraints. In: Proceedings of the Asian conference on computer vision (ACCV) LNCS 4843, vol II, pp 847–857
38.
Zurück zum Zitat Shafer SA, Kanade T (1983) Using shadows in finding surface orientations. Comput Vis Graph Image Process 22(1):145–176CrossRef Shafer SA, Kanade T (1983) Using shadows in finding surface orientations. Comput Vis Graph Image Process 22(1):145–176CrossRef
39.
Zurück zum Zitat Hambrick LN, Loew MH, Carroll RLJ (1987) The entry exit method of shadow boundary segmentation. IEEE Trans Pattern Anal Mach Intell (PAMI) 9(5):597–607 Hambrick LN, Loew MH, Carroll RLJ (1987) The entry exit method of shadow boundary segmentation. IEEE Trans Pattern Anal Mach Intell (PAMI) 9(5):597–607
40.
Zurück zum Zitat Hatzitheodorou M, Kender J (1988) An optimal algorithm for the derivation of shape from shadows. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 486–491 Hatzitheodorou M, Kender J (1988) An optimal algorithm for the derivation of shape from shadows. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 486–491
41.
Zurück zum Zitat Raviv D, Pao Y, Loparo KA (1989) Reconstruction of three-dimensional surfaces from two-dimensional binary images. IEEE Trans Robot Autom 5(5):701–710CrossRef Raviv D, Pao Y, Loparo KA (1989) Reconstruction of three-dimensional surfaces from two-dimensional binary images. IEEE Trans Robot Autom 5(5):701–710CrossRef
45.
Zurück zum Zitat Yamazaki S, Narasimhan SG, Baker S, Kanade T (2007) Coplanar shadowgrams for acquiring visual hulls of intricate objects. In: Proceedings of the international conference on computer vision (ICCV) Yamazaki S, Narasimhan SG, Baker S, Kanade T (2007) Coplanar shadowgrams for acquiring visual hulls of intricate objects. In: Proceedings of the international conference on computer vision (ICCV)
46.
Zurück zum Zitat Kriegman DJ, Belhumeur PN (2001) What shadows reveal about object structure. J Opt Soc Am 18(8):1804–1813CrossRef Kriegman DJ, Belhumeur PN (2001) What shadows reveal about object structure. J Opt Soc Am 18(8):1804–1813CrossRef
47.
Zurück zum Zitat Caspi Y, Werman M (2003) Vertical parallax from moving shadows. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 2. IEEE, pp 2309–2315 Caspi Y, Werman M (2003) Vertical parallax from moving shadows. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 2. IEEE, pp 2309–2315
48.
Zurück zum Zitat Nayar S, Watanabe M, Noguchi M (1996) Real-Time focus range sensor. IEEE Trans Pattern Anal Mach Intell (PAMI) 18(12):1186–1198CrossRef Nayar S, Watanabe M, Noguchi M (1996) Real-Time focus range sensor. IEEE Trans Pattern Anal Mach Intell (PAMI) 18(12):1186–1198CrossRef
49.
Zurück zum Zitat Kawasaki H, Horita Y, Masuyama H, Ono S, Kimura M, Takane Y (2013) Optimized aperture for estimating depth from projector’s defocus. In: 2013 International conference on 3d vision-3DV 2013. IEEE, pp 135–142 Kawasaki H, Horita Y, Masuyama H, Ono S, Kimura M, Takane Y (2013) Optimized aperture for estimating depth from projector’s defocus. In: 2013 International conference on 3d vision-3DV 2013. IEEE, pp 135–142
50.
Zurück zum Zitat Kawasaki H, Horita Y, Morinaga H, Matugano Y, Ono S, Kimura M, Takane Y (2012) Structured light with coded aperture for wide range 3d measurement. In: 2012 19th IEEE international conference on image processing. IEEE, pp 2777–2780 Kawasaki H, Horita Y, Morinaga H, Matugano Y, Ono S, Kimura M, Takane Y (2012) Structured light with coded aperture for wide range 3d measurement. In: 2012 19th IEEE international conference on image processing. IEEE, pp 2777–2780
51.
Zurück zum Zitat Kawasaki H, Ono S, Horita Y, Shiba Y, Furukawa R, Hiura S (2015) Active one-shot scan for wide depth range using a light field projector based on coded aperture. In: Proceedings of the international conference on computer vision (ICCV), pp 3568–3576 Kawasaki H, Ono S, Horita Y, Shiba Y, Furukawa R, Hiura S (2015) Active one-shot scan for wide depth range using a light field projector based on coded aperture. In: Proceedings of the international conference on computer vision (ICCV), pp 3568–3576
Metadaten
Titel
Other Shape Reconstruction Techniques
verfasst von
Katsushi Ikeuchi
Yasuyuki Matsushita
Ryusuke Sagawa
Hiroshi Kawasaki
Yasuhiro Mukaigawa
Ryo Furukawa
Daisuke Miyazaki
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-56577-0_7