Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
Erschienen in:
A Comprehensive Introduction to Photometric 3D-Reconstruction Kapitel lesen Erstes Kapitel lesen

2020 | OriginalPaper | Buchkapitel

6. Recent Progress in Shape from Polarization

verfasst von : Boxin Shi, Jinfa Yang, Jinwei Chen, Ruihua Zhang, Rui Chen

Erschienen in: Advances in Photometric 3D-Reconstruction

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Photometric cues play an important role in recovering per-pixel 3D information from images. Shape from shading and photometric stereo are popular photometric 3D reconstruction approaches, which rely on inversely analyzing an image formation model of the surface normal, reflectance, and lighting. Similarly, shape from polarization explores radiance variation under different polarizer angles to estimate the surface normal, which does not require an active light source and has less restricted assumptions on reflectance and lighting. This chapter reviews basic principles of shape from polarization and its image formation model for surfaces of different reflection properties. We then survey recent progress in shape from polarization combined with different auxiliary information such as geometric cues, spectral cues, photometric cues, and deep learning, and further introduce how polarization imaging benefits other vision tasks in addition to shape recovery.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Vorheriges Kapitel On the Well-Posedness of Uncalibrated Photometric Stereo Under General Lighting
Nächstes Kapitel Estimating Facial Aging Using Light Scattering Photometry
Literatur
1.
2.
Agrawal A, Chellappa R, Raskar R (2005) An algebraic approach to surface reconstruction from gradient fields. In: Proceedings of international conference on computer vision, vol 1. IEEE, pp 174–181
3.
Agrawal A, Raskar R, Chellappa R (2006) What is the range of surface reconstructions from a gradient field? In: Proceedings of European conference on computer vision, pp 578–591
4.
Atkinson GA (2017) Two-source surface reconstruction using polarisation. In: Scandinavian conference on image analysis, pp 123–135
5.
Atkinson GA, Hancock ER (2005) Multi-view surface reconstruction using polarization. In: Proceedings of international conference on computer vision, vol 1. IEEE, pp 309–316
6.
Atkinson GA, Hancock ER (2006) Recovery of surface orientation from diffuse polarization. IEEE Trans Image Process 15(6):1653–1664
7.
Atkinson GA, Hancock ER (2007) Shape estimation using polarization and shading from two views. IEEE Trans Pattern Anal Mach Intell 29(11):2001–2017
8.
Atkinson GA, Hancock ER (2007) Surface reconstruction using polarization and photometric stereo. In: International conference on computer analysis of images and patterns, pp 466–473
9.
Ba Y, Chen R, Wang Y, Yan L, Shi B, Kadambi A (2019) Physics-based neural networks for shape from polarization. arXiv preprint arXiv:​1903.​10210
10.
Berger K, Voorhies R, Matthies L (2016) Incorporating polarization in stereo vision-based 3D perception of non-Lambertian scenes. In: Unmanned systems technology, vol 9837. International Society for Optics and Photonics
11.
Berger K, Voorhies R, Matthies LH (2017) Depth from stereo polarization in specular scenes for urban robotics. In: IEEE international conference on robotics and automation. IEEE, pp 1966–1973
12.
Born M, Wolf E (1997) Principles of optics. Sixth (corrected) edition
13.
Born M, Wolf E, Bhatia AB, Clemmow PC, Gabor D, Stokes AR, Taylor AM, Wayman PA, Wilcock WL (1999) Principles of optics: electromagnetic theory of propagation, interference and diffraction of light, 7th edn. Cambridge University Press, Cambridge
14.
Burger W, Burge MJ (2009) Principles of digital image processing: fundamental techniques. Springer Publishing Company, IncorporatedMATH
15.
Chen G, Han K, Shi B, Matsushita Y, Wong KYK (2019) SDPS-net: self-calibrating deep photometric stereo networks. In: Proceedings of computer vision and pattern recognition
16.
Chen L, Zheng Y, Subpa-Asa A, Sato I (2018) Polarimetric three-view geometry. In: Proceedings of European conference on computer vision, pp 20–36
17.
Cui Z, Gu J, Shi B, Tan P, Kautz J (2017) Polarimetric multi-view stereo. In: Proceedings of computer vision and pattern recognition, pp 1558–1567
18.
Cui Z, Larsson V, Pollefeys M (2019) Polarimetric relative pose estimation. In: Proceedings of international conference on computer vision, pp 2671–2680
19.
20.
Frankot RT, Chellappa R (1988) A method for enforcing integrability in shape from shading algorithms. IEEE Trans Pattern Anal Mach Intell 10(4):439–451MATH
21.
Fuhrmann S, Langguth F, Goesele M (2014) MVE-A multi-view reconstruction environment. In: Eurographics workshops on graphics and cultural heritage, pp 11–18
22.
Furukawa Y, Ponce J (2009) Accurate, dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell 32(8):1362–1376
23.
Ghosh A, Chen T, Peers P, Wilson CA, Debevec P (2009) Estimating specular roughness and anisotropy from second order spherical gradient illumination. Comput Graph Forum 28:1161–1170
24.
Ghosh A, Chen T, Peers P, Wilson CA, Debevec P (2010) Circularly polarized spherical illumination reflectometry. ACM Trans Graph (TOG) 29(6):162
25.
Herrera SEM, Malti A, Morel O, Bartoli A (2013) Shape-from-polarization in laparoscopy. In: IEEE international symposium on biomedical imaging, pp 1412–1415
26.
Horn BK (1970) Shape from shading: a method for obtaining the shape of a smooth opaque object from one view
27.
Huynh CP, Robles-Kelly A, Hancock E (2010) Shape and refractive index recovery from single-view polarisation images. In: Proceedings of computer vision and pattern recognition, pp 1229–1236
28.
Huynh CP, Robles-Kelly A, Hancock ER (2013) Shape and refractive index from single-view spectro-polarimetric images. Int J Comput Vis 101(1):64–94MathSciNet
29.
Ihrke I, Kutulakos KN, Lensch HP, Magnor M, Heidrich W (2010) Transparent and specular object reconstruction. Comput Graph Forum 29:2400–2426
30.
Kadambi A, Taamazyan V, Shi B, Raskar R (2015) Polarized 3D: high-quality depth sensing with polarization cues. In: Proceedings of international conference on computer vision, pp 3370–3378
31.
Kadambi A, Taamazyan V, Shi B, Raskar R (2017) Depth sensing using geometrically constrained polarization normals. Int J Comput Vis 125(1–3):34–51MathSciNet
32.
Kar A, Häne C, Malik J (2017) Learning a multi-view stereo machine. In: Advances in neural information processing systems, pp 365–376
33.
Kong N, Tai YW, Shin JS (2013) A physically-based approach to reflection separation: from physical modeling to constrained optimization. IEEE Trans Pattern Anal Mach Intell 36(2):209–221
34.
Kovesi P (2005) Shapelets correlated with surface normals produce surfaces. In: Proceedings of international conference on computer vision, vol 2. IEEE, pp 994–1001
35.
Li M, Zhou Z, Wu Z, Shi B, Diao C, Tan P (2020) Multi-view photometric stereo: a robust solution and benchmark dataset for spatially varying isotropic materials. IEEE Trans Image Process
36.
Liao Y (2003) Polarization optics. China Science Press
37.
Logothetis F, Mecca R, Sgallari F, Cipolla R (2019) A differential approach to shape from polarisation: a level-set characterisation. Int J Comput Vis 127(11–12):1680–1693
38.
Lu J, Ji Y, Yu J, Ye J (2019) Mirror surface reconstruction using polarization field. In: Proceedings of international conference on computational photography. IEEE, pp 1–9
39.
40.
Lyu Y, Cui Z, Li S, Pollefeys M, Shi B (2019) Reflection separation using a pair of unpolarized and polarized images. In: Annual conference on neural information processing systems
41.
Mecca R, Logothetis F, Cipolla R (2018) A differential approach to shape from polarization. British machine vision conference
42.
Miyazaki D, Furuhashi R, Hiura S (2020) Shape estimation of concave specular object from multiview polarization. J Electron Imag 29(4):041006
43.
Miyazaki D, Kagesawa M, Ikeuchi K (2003) Polarization-based transparent surface modeling from two views. In: Proceedings of international conference on computer vision, vol 3, p 1381
44.
Miyazaki D, Kagesawa M, Ikeuchi K (2004) Transparent surface modeling from a pair of polarization images. IEEE Trans Pattern Anal Mach Intell 26(1):73–82
45.
Miyazaki D, Saito M, Sato Y, Ikeuchi K (2002) Determining surface orientations of transparent objects based on polarization degrees in visible and infrared wavelengths. JOSA A 19(4):687–694
46.
Miyazaki D, Shigetomi T, Baba M, Furukawa R, Hiura S, Asada N (2016) Surface normal estimation of black specular objects from multiview polarization images. Opt Eng 56(4):041303
47.
Morel O, Meriaudeau F, Stolz C, Gorria P (2005) Polarization imaging applied to 3D reconstruction of specular metallic surfaces. Mach Vis Appl Ind Inspect XIII 5679:178–186
48.
Nehab D, Rusinkiewicz S, Davis J, Ramamoorthi R (2005) Efficiently combining positions and normals for precise 3D geometry. ACM Trans Graph (TOG) 24(3):536–543
49.
Ngo TT, Nagahara H, Taniguchi RI (2015) Shape and light directions from shading and polarization. In: Proceedings of computer vision and pattern recognition, pp 2310–2318
50.
51.
52.
Riviere J, Reshetouski I, Filipi L, Ghosh A (2017) Polarization imaging reflectometry in the wild. ACM Trans Graph (TOG) 36(6):206
53.
Saito M, Sato Y, Ikeuchi K, Kashiwagi H (2001) Measurement of surface orientations of transparent objects using polarization in highlight. Syst Comput Jpn 32(5):64–71
54.
Schechner YY (2011) Inversion by \(P^4\): polarization-picture post-processing. Philos Trans R Soc B: Biol Sci 366(1565):638–648
55.
Schechner YY (2015) Self-calibrating imaging polarimetry. In: Proceedings of international conference on computational photography. IEEE, pp 1–10
56.
Schechner YY, Shamir J, Kiryati N (2000) Polarization and statistical analysis of scenes containing a semireflector. JOSA A 17(2):276–284
57.
Shabayek AER, Demonceaux C, Morel O, Fofi D (2012) Vision based UAV attitude estimation: progress and insights. J Intell Robot Syst 65(1–4):295–308
58.
Shi B, Mo Z, Wu Z, Duan D, Yeung SK, Tan P (2019) A benchmark dataset and evaluation for non-lambertian and uncalibrated photometric stereo. IEEE Trans Pattern Anal Mach Intell 41(2):271–284
59.
Shurcliff W (1962) Polarized light, production and use. Harvard, Cambridge (1962)
60.
Smith WA, Ramamoorthi R, Tozza S (2016) Linear depth estimation from an uncalibrated, monocular polarisation image. In: Proceedings of European conference on computer vision, pp 109–125
61.
Smith WA, Ramamoorthi R, Tozza S (2019) Height-from-polarisation with unknown lighting or albedo. IEEE Trans Pattern Anal Mach Intell 41(12):2875–2888
62.
Stolz C, Ferraton M, Meriaudeau F (2012) Shape from polarization: a method for solving zenithal angle ambiguity. Opt Lett 37(20):4218–4220
63.
64.
Tan Z, Zhao B, Xu X, Fei Z, Luo M (2019) Object segmentation based on refractive index estimated by polarization of specular reflection. Optik, 163918
65.
Teo GD, Shi B, Zheng Y, Yeung SK (2018) Self-calibrating polarising radiometric calibration. In: Proceedings of computer vision and pattern recognition
66.
Torrance KE, Sparrow EM (1992) Radiometry. Chapter theory for off-specular reflection from roughened surfaces, vol 3. Jones and Bartlett Publishers Inc, USA, pp 32–41
67.
Tozza S, Smith WA, Zhu D, Ramamoorthi R, Hancock ER (2017) Linear differential constraints for photo-polarimetric height estimation. In: Proceedings of international conference on computer vision, pp 2279–2287
68.
Wieschollek P, Gallo O, Gu J, Kautz J (2018) Separating reflection and transmission images in the wild. In: Proceedings of European conference on computer vision, pp 89–104
69.
Wolff LB (1997) Polarization vision: a new sensory approach to image understanding. Image Vis Comput 15(2):81–93
70.
Wolff LB, Boult TE (1991) Constraining object features using a polarization reflectance model. IEEE Trans Pattern Anal Mach Intell 13(7):635–657
71.
Wolff LB, Nayar SK, Oren M (1998) Improved diffuse reflection models for computer vision. Int J Comput Vis 30(1):55–71
72.
Yang L, Tan F, Li A, Cui Z, Furukawa Y, Tan P (2018) Polarimetric dense monocular slam. In: Proceedings of computer vision and pattern recognition, pp 3857–3866
73.
Yu Y, Zhu D, Smith W.A (2017) Shape-from-polarisation: A nonlinear least squares approach. In: Proceedings of international conference on computer vision, pp 2969–2976
74.
Zheng Q, Jia Y, Shi B, Jiang X, Duan LY, Kot AC (2019) Spline-net: sparse photometric stereo through lighting interpolation and normal estimation networks. In: Proceedings of international conference on computer vision, pp 8549–8558
75.
Zhu D, Smith WA (2019) Depth from a polarisation+ RGB stereo pair. In: Proceedings of computer vision and pattern recognition, pp 7586–7595
Metadaten
Titel
Recent Progress in Shape from Polarization
verfasst von
Boxin Shi
Jinfa Yang
Jinwei Chen
Ruihua Zhang
Rui Chen
Copyright-Jahr
2020
Buch
Advances in Photometric 3D-Reconstruction

Print ISBN: 978-3-030-51865-3

Electronic ISBN: 978-3-030-51866-0

Copyright-Jahr: 2020

DOI
https://doi.org/10.1007/978-3-030-51866-0_6

Premium Partner

    Bildnachweise