nach oben

Erschienen in:

2020 | OriginalPaper | Buchkapitel

2. Perspective Shape from Shading

An Exposition on Recent Works with New Experiments

verfasst von : Michael Breuß, Ashkan Mansouri Yarahmadi

Erschienen in: Advances in Photometric 3D-Reconstruction

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Shape from Shading (SFS) is a fundamental task in computer vision. By given information about the reflectance of an object’s surface and the position of the light source, the SFS problem is to reconstruct the 3D depth of the object from a single grayscale 2D input image. A modern class of SFS models relies on the property that the camera performs a perspective projection. The corresponding perspective SFS methods have been the subject of many investigations within the last years. The goal of this chapter is to give an overview of these developments. In our discussion, we focus on important model aspects, and we investigate some prominent algorithms appearing in the literature in more detail than it was done in previous works.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel A Comprehensive Introduction to Photometric 3D-Reconstruction

Nächstes Kapitel RGBD-Fusion: Depth Refinement for Diffuse and Specular Objects

Nur mit Berechtigung zugänglich

Abdelrahim AS, Abdelrahman MA, Abdelmunim H, Farag A, Miller M (2011) Novel image-based 3D reconstruction of the human jaw using shape from shading and feature descriptors. In: Proceedings of the British machine vision conference (BMVC), pp 1–11

Ahmed A, Farag A (2006) A new formulation for shape from shading for non-Lambertian surfaces. In: Proceedings of 2006 IEEE computer society conference on computer vision and pattern recognition, vol 2, June 2006. IEEE Computer Society Press, New York, NY, pp 17–22

Aloimonos JY (1990) Perspective approximations. Image Vis Comput 8(3):179–192

Bakshi S, Yang YH (1994) Shape from shading for non-Lambertian surfaces. In: Proceedings of IEEE international conference on image processing, vol 2, Austin, TX. IEEE Computer Society Press, pp 130–134

Bors AG, Hancock ER, Wilson RC (2003) Terrain analysis using radar shape-from-shading. IEEE Trans Pattern Anal Mach Intell 25(8):974–992

Breuß M, Cristiani E, Durou J-D, Falcone M, Vogel O (2012) Perspective shape from shading: ambiguity analysis and numerical approximations. SIAM J Imaging Sci 5(1):311–342MathSciNetMATH

Cacace S, Cristiani E, Falcone M (2014) Can local single-pass methods solve any stationary Hamilton-Jacobi-Bellman equation? SIAM J Sci Comput 36(2):570–587MathSciNetMATH

Camilli F, Tozza S (2017) A unified approach to the well-posedness of some non-Lambertian models in shape-from-shading theory. SIAM J Imaging Sci 10(1):26–46MathSciNetMATH

Cho SI, Saito H, Ozawa S (1997) A divide-and-conquer strategy in shape from shading. In: Proceedings of the 1997 IEEE computer society conference on computer vision and pattern recognition (CVPR), June 17–19, San Juan, Puerto Rico, pp 413–419

10.

Courteille F, Crouzil A, Durou J-D, Gurdjos P (2007) Shape from shading for the digitization of curved documents. Mach Vis Appl 18:301–316MATH

11.

Courteille F, Crouzil A, Durou J-D, Gurdjos P (2004) Shape from shading en conditions ralistes d’acquisition photographique. In: 14ème Congr\(\grave{\text{s}}\) Francophone de Reconnaissance des Formes et Intelligence Artificielle - RFIA 2004, Toulouse, 28 January 2004–30 January 2004, vol 2, AFRIF-AFIA, pp 925–934

12.

Courteille F, Crouzil A, Durou J-D, Gurdjos P (2004) Towards shape from shading under realistic photographic conditions. In: Proceedings of 17th international conference on pattern recognition, vol II, August 2004. Cambridge, UK, pp 277–280

13.

Durou J-D, Falcone M, Sagona M (2008) Numerical methods for shape-from-shading: a new survey with benchmarks. Comput Vis Image Underst 109(1):22–43

14.

Forsyth D (2011) Variable-source shading analysis. Int J Comput Vis 91(3):280–302MathSciNetMATH

15.

Galliani S, Ju YC, Breuß M, Bruhn A (2013) Generalised perspective shape from shading in spherical coordinates. In: Kuiijper A, Pock T, Bredies K, Bischof H (eds) Proceedings of 4th international conference on scale space and variational methods in computer vision (SSVM 2013), Graz, Austria, June 2013. Lecture notes in computer science, vol 7893. Springer, Berlin, pp 222–233

16.

Gårding J (1992) Shape from texture for smooth curved surfaces in perspective projection. J Math Imaging Vis 2:327–350MATH

17.

Gårding J (1993) Shape from texture and contour by weak isotropy. Artif Intell 64:243–297MathSciNetMATH

18.

Georgoulis S, Rematas K, Ritschel T, Gavves E, Fritz M, Van Gool L, Tuytelaars T (2018) Reflectance and natural illumination from single-material specular objects using deep learning. IEEE Trans Pattern Anal Mach Intell

19.

Gibson JJ (1950) The perception of the visual world. Houghton Mifflin, Boston

20.

Hartley R, Zisserman A (2000) Multiple view geometry in computer vision. Cambridge University Press, CambridgeMATH

21.

Hasegawa JK, Tozzi CL (1996) Shape from shading with perspective projection and camera calibration. Comput Graph 20(3):351–364

22.

Helmsen JJ, Puckett EG, Colella P, Dorr M (1996) Two new methods for simulating photolithography development in 3d. In: Optical microlithography IX, Santa Clara, CA, USA, March 1996. SPIE, pp 253–261

23.

Horn BKP, Brooks MJ (1989) Shape from shading. Artificial intelligence series. MIT Press, Cambridge

24.

Horn BKP (1970) Shape from shading: a method for obtaining the shape of a smooth opaque object from one view. PhD thesis, Department of Electrical Engineering, MIT, Cambridge, Massachusetts, USA

25.

Horn BKP (1975) Obtaining shape from shading information. In: Winston PH (ed) The psychology of computer vision. McGraw-Hill, New York, pp 115–155

26.

Horn BKP (1986) Robot vision. MIT Press, Cambridge

27.

Ju YC, Tozza S, Breuß M, Bruhn A, Kleefeld A (2013) Generalised perspective shape from shading with Oren-Nayar reflectance. In: Burghardt T, Damen D, Mayol-Cuevas W, Mirmehdi M (eds) Proceedings of 24th British machine vision conference (BMVC 2013), Bristol, UK, September 2013, Article 42. BMVA Press

28.

Kimmel R, Bruckstein AM (1995) Tracking level sets by level sets: a method for solving the shape from shading problem. Comput Vis Image Underst 62(1):47–58

29.

Lambert JH (1760) Photometria: sive de mensura et gradibus luminis, colorum et umbrae. Augsburg, sumptibus viduae E. Klett

30.

Lee KM, Kuo CCJ (1994) Shape from shading with perspective projection. Comput Vis Graph Image Process: Image Underst 59(2):202–211

31.

Lee K, Kuo CCJ (1997) Shape from shading with a generalized reflectance map model. Comput Vis Image Underst 67(2):143–160

32.

Li Z, Xu Z, Ramamoorthi R, Sunkavalli K, Chandraker M (2018) Learning to reconstruct shape and spatially-varying reflectance from a single image. ACM Trans Graph 37(6):269:1–269:11

33.

Maurer D, Ju YC, Breuß M, Bruhn A (2018) Combining shape from shading and stereo: a joint variational method for estimating depth, illumination and albedo. Int J Comput Vis 126(12):1342–1366

34.

Okatani T, Deguchi K (1997) Shape reconstruction from an endoscope image by shape from shading technique for a point light source at the projection center. Comput Vis Image Underst 66(2):119–131

35.

Oliensis J, Dupuis P (1991) Direct method for reconstructing shape from shading. In: Proceedings of SPIE conference 1570 on geometric methods in computer vision, San Diego, California, July 1991, pp 116–128

36.

Oren M, Nayar SK (1995) Generalization of the Lambertian model and implications for machine vision. Int J Comput Vis 14(3):227–251

37.

Penna MA (1989) Local and semi-local shape from shading for a single perspective image of a smooth object. Comput Vis Graph Image Process 46(3):346–366

38.

Penna MA (1989) A shape from shading analysis for a single perspective image of a polyhedron. IEEE Trans Pattern Anal Mach Intell 11(6):545–554

39.

Prados E, Camilli F, Faugeras O (2006) A unifying and rigorous shape from shading method adapted to realistic data and applications. J Math Imaging Vis 25(3):307–328MathSciNet

40.

Prados E, Camilli F, Faugeras O (2006) A viscosity solution method for shape-from-shading without image boundary data. ESAIM: Math Model Numer Anal 40(2):393–412

41.

Prados E, Faugeras O (2003) “Perspective shape from shading” and viscosity solutions. In: Proceedings of 9th IEEE international conference on computer vision, vol II, Nice, France, October 2003, pp 826–831

42.

Prados E, Faugeras O (2004) Unifying approaches and removing unrealistic assumptions in shape from shading: mathematics can help. In: Proceedings of 8th European conference on computer vision, vol IV, Prague, Czech Republic, May 2004. LNCS, vol 3024, pp 141–154

43.

Prados E, Faugeras O (2005) Shape from shading: a well-posed problem? In: Proceedings of IEEE conference on computer vision and pattern recognition, vol II, San Diego, California, USA, June 2005, pp 870–877

44.

Ragheb H, Hancock E (2005) Surface radiance correction for shape-from-shading. Pattern Recognit 38(10):1574–1595

45.

Rhodin H, Breuß M (2013) A mathematically justified algorithm for shape from texture. In: Kuiijper A, Pock T, Bredies K, Bischof H (eds) Proceedings of 4th international conference on scale space and variational methods in computer vision (SSVM 2013), Graz, Austria, June 2013. Lecture notes in computer science, vol 7893, pp 294–305. Springer, Berlin

46.

Rindfleisch T (1966) Photometric method for lunar topography. Photogramm Eng 32(2):262–277

47.

Samaras D, Metaxas D (2003) Incorporating illumination constraints in deformable models for shape from shading and light direction estimation. IEEE Trans Pattern Anal Mach Intell 25(2):247–264

48.

Sethian JA (1996) Fast marching level set methods for three-dimensional photolithography development. In: Optical microlithography IX, Santa Clara, CA, USA, March 1996. SPIE, pp 262–272

49.

Sethian JA (1999) Level set methods and fast marching methods, 2nd edn. Cambridge University Press, Cambridge. Paperback edition

50.

Sethian JA (1996) A fast marching level set method for monotonically advancing fronts. Proc Natl Acad Sci 93(4):1591–1595MathSciNetMATH

51.

Smith WAP, Hancock ER (2008) Facial shape-from-shading and recognition using principal geodesic analysis and robust statistics. Int J Comput Vis 76(1):71–91

52.

Tankus A, Sochen N, Yeshurun Y (2005) Shape-from-shading under perspective projection. Int J Comput Vis 63(1):21–43

53.

Tankus A, Sochen N, Yeshurun Y (2003) A new perspective [on] shape-from-shading. In: Proceedings of 9th IEEE international conference on computer vision, vol II, Nice, France, October 2003, pp 862–869

54.

Tankus A, Sochen N, Yeshurun Y (2004) Perspective shape-from-shading by fast marching. In: Proceedings of IEEE conference on computer vision and pattern recognition, vol I, Washington, D.C., USA, June 2004, pp 43–49

55.

Tozza S, Falcone M (2016) Analysis and approximation of some shape-from-shading models for non-Lambertian surfaces. J Math Imaging Vis 55(2):153–178MathSciNetMATH

56.

Tsitsiklis JN (1995) Efficient algorithms for globally optimal trajectories. IEEE Trans Autom Control 40(9):1528–1538

57.

Van Diggelen J (1951) A photometric investigation of the slopes and heights of the ranges of hills in the Maria of the moon. Bull Astron Inst Neth XI(423):283–289

58.

Vogel O, Breuß M, Weickert J (2008) Perspective shape from shading with non-Lambertian reflectance. In: Rigoll G (ed) Pattern recognition. Lecture notes in computer science, vol 5096. Springer, Berlin, pp 517–526

59.

Wöhler C, Grumpe A (2013) Integrated DEM reconstruction and calibration of hyperspectral imagery: a remote sensing perspective. In: Breuß M, Bruckstein A, Maragos P (eds) Innovations for shape analysis: models and algorithms. Mathematics and visualization. Springer, Berlin, pp 467–492

60.

Woodham RJ (1980) Photometric method for determining surface orientation from multiple images. Opt Eng 19(1):139–144

61.

Wu C, Narasimhan S, Jaramaz B (2010) A multi-image shape-from-shading framework for near-lighting perspective endoscopes. Int J Comput Vis 86(2):211–228MathSciNet

62.

Wu J, Smith WAP, Hancock ER (2010) Facial gender classification using shape from shading. Image Vis Comput 28(6):1039–1048

63.

Yamany SM, Farag AA, Tasman D, Farman AGP (1999) A robust 3-D reconstruction system for human jaw modeling. In: Taylor C, Colchester A (eds) Proceedings of 2nd international conference on medical image computing and computer-assisted intervention (MICCAI’99), Cambridge, England, September 1999. LNCS, vol 1679, pp 778–787

64.

Yamany SM, Farag AA, Tasman D, Farman AGP (2000) A 3-D reconstruction system for the human jaw using a sequence of optical images. IEEE Trans Med Imaging 11(5):538–547

65.

Yuen SY, Tsui YY, Leung YW, Chen RMM (2002) Fast marching method for shape from shading under perspective projection. In: Proceedings of 2nd international conference visualization, imaging, and image processing (VIIP 2002), Marbella, Spain, September 2002, pp 584–589

66.

Yuen SY, Tsui YY, Chow CK (2007) A fast marching formulation of perspective shape from shading under frontal illumination. Pattern Recognit Lett 28:806–824

67.

Zhang R, Tsai P-S, Cryer JE, Shah M (1999) Shape from shading: a survey. IEEE Trans Pattern Anal Mach Intell 21(8):690–706MATH

Titel: Perspective Shape from Shading
verfasst von: Michael Breuß
Ashkan Mansouri Yarahmadi
Verlag: Springer International Publishing
Buch: Advances in Photometric 3D-Reconstruction
Print ISBN: 978-3-030-51865-3

Electronic ISBN: 978-3-030-51866-0

Copyright-Jahr: 2020
DOI: https://doi.org/10.1007/978-3-030-51866-0_2

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner