Top

Published in:

2013 | OriginalPaper | Chapter

16. A Review of Geometry Recovery from a Single Image Focusing on Curved Object Reconstruction

Authors : Martin R. Oswald, Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers

Published in: Innovations for Shape Analysis

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Single view reconstruction approaches infer the structure of 3D objects or scenes from 2D images. This is an inherently ill-posed problem. An abundance of reconstruction approaches has been proposed in the literature, which can be characterized by the additional assumptions they impose to make the reconstruction feasible. These assumptions are either formulated by restrictions on the reconstructable object domain, by geometric or learned shape priors or by requiring user input. In this chapter, we examine a representative set of state-of-the-art reconstruction approaches, which are applicable to real-world images. We classify the approaches according to their reconstruction objective and compare them based on a variety of important criteria. Finally, we show experimental comparisons for five curved object reconstruction approaches.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Non-rigid Shape Correspondence Using Pointwise Surface Descriptors and Metric Structures

next chapter On Globally Optimal Local Modeling: From Moving Least Squares to Over-parametrization

Bae, S., Durand, F.: Defocus magnification. In: Proceedings of the Eurographics. Blackwell, Oxford (2007)

Barinova, O., Konushin, V., Yakubenko, A., Lee, K., Lim, H., Konushin, A.: Fast automatic single-view 3-d reconstruction of urban scenes. In: Proceedings of the European Conference on Computer Vision, pp. 100–113. Springer, Berlin/Heidelberg (2008)

Botsch, M., Kobbelt, L.: An intuitive framework for real-time freeform modeling. In: ACM Transactions on Graphics (Proc. SIGGRAPH), vol. 23, pp. 630–634. ACM/Addison-Wesley Publishing Co., New York (2004)

Chen, Y., Cipolla, R.: Single and sparse view 3d reconstruction by learning shape priors. Comput. Vis. Image Underst. 115, 586–602 (2011)CrossRef

Cohen, L.D., Cohen, I.: Finite-element methods for active contour models and balloons for 2-d and 3-d images. IEEE Trans. Pattern Anal. Mach. Intell. 15(11), 1131–1147 (1993)CrossRef

Colombo, C., Del Bimbo, A., Pernici, F.: Metric 3d reconstruction and texture acquisition of surfaces of revolution from a single uncalibrated view. IEEE Trans. Pattern Anal. Mach. Intell. 27, 99–114 (2005)CrossRef

Courteille, F., Crouzil, A., Durou, J.-D., Gurdjos, P.: Towards shape from shading under realistic photographic conditions. pp. 277–280 (2004)

Criminisi, A., Reid, I., Zisserman, A.: Single view metrology. Int. J. Comput. Vis. 40(2), 123–148 (2000)MATHCrossRef

Daum, M., Dudek, G.: On 3-d surface reconstruction using shape from shadows. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA, USA, pp. 461–468 (1998)

10.

Delage, E., Lee, H., Ng, A.Y.: Automatic single-image 3d reconstructions of indoor Manhattan world scenes (2005)

11.

Duchon, J.: Splines Minimizing Rotation-Invariant Semi-norms in Sobolev Spaces. In: Schempp, W., Zeller, K. (eds.) Constructive Theory of Functions of Several Variables, vol. 571/1977, pp. 85–100. Springer, Berlin (1977)CrossRef

12.

Durou, J.-D., Falcone, M., Sagona, M.: Numerical methods for shape-from-shading: a new survey with benchmarks. Comput. Vis. Image Underst. 109, 22–43 (2008)CrossRef

13.

Francois, A.R.J., Medioni, G.G.: Interactive 3d model extraction from a single image. Image Vis. Comput. 19(6), 317–328 (2001)CrossRef

14.

Han, F., Zhu, S.-C.: Bayesian reconstruction of 3d shapes and scenes from a single image. In: Proceedings of the Higher-Level Knowledge in 3D Modeling and Motion Analysis, Nice, France, pp. 12–20. (2003)

15.

Hassner, T., Basri, R.: Example based 3d reconstruction from single 2d images. In: Beyond Patches Workshop at IEEE Conference on Computer Vision and Pattern Recognition, New York, NY, USA, p. 15. (2006)

16.

Hatzitheodorou, M.: The derivation of 3-d surface shape from shadows. In: Proceedings of a Workshop on Image Understanding Workshop, pp. 1012–1020. Morgan Kaufmann, San Francisco (1989)

17.

Hoiem, D., Efros, A.A., Hebert, M.: Automatic photo pop-up. ACM Trans. Graph. 24(3), 577–584 (2005)CrossRef

18.

Hong, W., Yang, A.-Y., Huang, K., Ma, Y.: On symmetry and multiple-view geometry: structure, pose, and calibration from a single image. Int. J. Comput. Vis. 60, 241–265 (2004). doi:10.1023/B:VISI.0000036837.76476.10CrossRef

19.

Horaud, R.P., Brady, M.: On the geometric interpretation of image contours. Artif. Intell. 37(1–3), 333–353 (1988). Special Issue on Geometric Reasoning

20.

Horry, Y., Anjyo, K.-I., Arai, K.: Tour into the picture: using a spidery mesh interface to make animation from a single image. In: SIGGRAPH ’97: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, pp. 225–232. ACM/Addison-Wesley, New York (1997)

21.

Igarashi, T.: Adaptive unwrapping for interactive texture painting. In: Proceedings of the ACM Symposium on Interactive 3D Graphics, pp. 209–216. ACM, New York (2001)

22.

Igarashi, T.: Smooth meshes for sketch-based freeform modeling. In: Proceedings of the 2003 Symposium on Interactive 3D Graphics, pp. 139–142. ACM, New York (2003)

23.

Igarashi, T., Matsuoka, S., Tanaka, H.: Teddy: a sketching interface for 3d freeform design. In: ACM Transactions on Graphics (Proceedings of the SIGGRAPH), pp. 409–416. ACM/Addison-Wesley, New York (1999)

24.

Ikeuchi, K., Horn, B.K.P.: Numerical shape from shading and occluding boundaries. Artif. Intell. 17, 141–185 (1981)CrossRef

25.

Joshi, P., Carr, N.: Repoussé: automatic inflation of 2d art. In: Proceedings of the Eurographics Workshop on Sketch-Based Modeling, Annecy, France (2008)

26.

Kanade, T.: Recovery of the three-dimensional shape of an object from a single view. Artif. Intell. 17, 409–460 (1981)CrossRef

27.

Karpenko, O.A., Hughes, J.F.: Smoothsketch: 3d free-form shapes from complex sketches. ACM Trans. Graph. 25(3), 589–598 (2006)CrossRef

28.

Karpenko, O., Hughes, J.F., Raskar, R.: Free-form sketching with variational implicit surfaces. Comput. Graph. Forum 21(3), 585–594 (2002)CrossRef

29.

Kender, J., Smith, E.: Shape from darkness. In: Proceedings of the International Conference on Computer Vision, London, pp. 539–546 (1987)

30.

Koutsourakis, P., Simon, L., Teboul, O., Tziritas, G., Paragios, N.: Single view reconstruction using shape grammars for urban environments. In: Proceedings of the International Conference on Computer Vision, Kyoto. IEEE (2009)

31.

Kushal, A.M., Sanyal, S., Bansal, V., Banerjee, S.: A simple method for interactive 3d reconstruction and camera calibration from a single view. In: Proceedings Indian Conference in Computer Vision, Graphics and Image Processing, Ahmedabad, India (2002)

32.

Levin, A.: Analyzing depth from coded aperture sets. In: Proceedings of the European Conference on Computer Vision, pp. 214–227. Springer, Berlin (2010)

33.

Li, Y., Pizlo, Z., Steinman, R.M.: A computational model that recovers the 3d shape of an object from a single 2d retinal representation. Vis. Res. 49, 979–991 (2009)CrossRef

34.

Li, Z., Liu, J., Tang, X.: A closed-form solution to 3d reconstruction of piecewise planar objects from single images. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA, pp. 1–6 (2007)

35.

Liebowitz, D., Criminisi, A., Zisserman, A.: Creating architectural models from images. In: Proceedings of the EuroGraphics, vol. 18, pp. 39–50 (1999)

36.

Lowe, D.G.: Three-dimensional object recognition from single two-dimensional images. Artif. Intell. 31, 355–395 (1987)CrossRef

37.

Malik, J., Rosenholtz, R.: Computing local surface orientation and shape from texture for curved surfaces. Int. J. Comput. Vis. 23(2), 149–168 (1997)CrossRef

38.

Nagai, T., Naruse, T., Ikehara, M., Kurematsu, A.: Hmm-based surface reconstruction from single images. In: Proceedings of the International Conference on Image Processing, Rochester, NY, USA, vol. 2, pp. II–561–II–564 (2002)

39.

Nayar, S.K., Ikeuchi, K., Kanade, T.: Shape from interreflections. In: Proceedings of the International Conference on Computer Vision, Osaka, Japan, pp. 2–11 (1990)

40.

Nealen, A., Igarashi, T., Sorkine, O., Alexa, M.: Fibermesh: designing freeform surfaces with 3d curves. ACM Trans. Graph. 26(3), 41 (2007)CrossRef

41.

Oswald, M.R., Töppe, E., Kolev, K., Cremers, D.: Non-parametric single view reconstruction of curved objects using convex optimization. In: Pattern Recognition (Proceedings of the DAGM), Jena (2009)

42.

Prados, E., Faugeras, O.: Shape from shading: a well-posed problem? In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 870–877. IEEE, San Diego/Etats-Unis (2005)

43.

Prasad, M.: Class-based single view reconstruction. Ph.D. thesis, University of Oxford (2009)

44.

Prasad, M., Zisserman, A., Fitzgibbon, A.W.: Fast and controllable 3D modelling from silhouettes. In: Eurographics, Short Papers, pp. 9–12 (2005)

45.

Prasad, M., Zisserman, A., Fitzgibbon, A.W.: Single view reconstruction of curved surfaces. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, New York, pp. 1345–1354 (2006)

46.

Rother, D., Sapiro, G.: Seeing 3d objects in a single 2d image. In: Proceedings of the International Conference on Computer Vision, Kyoto, pp. 1819–1826 (2009)

47.

Saxena, A., Chung, S.H., Ng, A.Y.: 3-d depth reconstruction from a single still image. Int. J. Comput. Vis. 76, 53–69 (2007)CrossRef

48.

Saxena, A., Sun, M., Ng, A.Y.: Make3d: learning 3d scene structure from a single still image. IEEE Trans. Pattern Anal. Mach. Intell. 31(5), 824–840 (2009)CrossRef

49.

Sturm, P.F., Maybank, S.J.: A method for interactive 3d reconstruction of piecewise planar objects from single images. In: Proceedings of the BMVC, pp. 265–274. British Machine Vision Association, England (1999)

50.

Super, B.J., Bovik, A.C.: Shape from texture using local spectral moments. IEEE Trans. Pattern Anal. Mach. Intell. 17, 333–343 (1995)CrossRef

51.

Terzopoulos, D., Witkin, A., Kass, M.: Symmetry-seeking models and 3d object reconstruction. Int. J. Comput. Vis. 1, 211–221 (1987)CrossRef

52.

Töppe, E., Oswald, M.R., Cremers, D., Rother, C.: Image-based 3d modeling via cheeger sets. In: Proceedings of the Asian Conference on Computer Vision, Queenstown (2010)

53.

Ulupinar, F., Nevatia, R.: Shape from contour: straight homogeneous generalized cylinders and constant cross section generalized cylinders. IEEE Trans. Pattern Anal. Mach. Intell. 17, 120–135 (1995)CrossRef

54.

Utcke, S., Zisserman, A.: Projective reconstruction of surfaces of revolution. In: Pattern Recognition (Proceedings of the DAGM), pp. 93–102. Springer, Berlin/New York (2003)

55.

Vetter, T.: Synthesis of novel views from a single face image. Int. J. Comput. Vis. 28, 103 (1998)CrossRef

56.

Wang, G., Su, W., Song, Y.: A new shape from shading approach for specular surfaces. In: Proceedings of the Third International Conference on Artificial Intelligence and Computational Intelligence – Volume Part III. Lecture Notes in Computer Science, pp. 71–78. Springer, Berlin/Heidelberg (2011)

57.

Welch, W., Witkin, A.P.: Free-form shape design using triangulated surfaces. In: ACM Transactions on Graphics (Proceedings of the SIGGRAPH), pp. 247–256 (1994)

58.

Williams, L.: 3d paint. In: Proceedings of the 1990 Symposium on Interactive 3D Graphics, Snowbird, pp. 225–233 (1990)

59.

Wong, K.-Y.K., Mendonça, P.R.S., Cipolla, R.: Reconstruction of surfaces of revolution from single uncalibrated views. In: Proceedings of the British Machine Vision Conference, Cardiff, pp. 265–272 (2002)

60.

Yu, Y., Chang, J.: Shadow graphs and surface reconstruction. In: Proceedings of the European Conference on Computer Vision, Copenhagen, pp. 31–45 (2002)

61.

Zeleznik, R.C., Herndon, K.P., Hughes, J.F.: Sketch: an interface for sketching 3d scenes. In: ACM Transactions on Graphics (Proceedings of the SIGGRAPH), pp. 163–170. ACM, New York (1996)

62.

Zhang, R., Tsai, P.-S., Cryer, J.E., Shah, M.: Shape from shading: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 21(8), 690–706 (1999)CrossRef

63.

Zhang, L., Dugas-Phocion, G., Samson, J.-S., Seitz, S.M.: Single view modeling of free-form scenes. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, Kauai, HI USA, pp. 990–997 (2001)

Title: A Review of Geometry Recovery from a Single Image Focusing on Curved Object Reconstruction
Authors: Martin R. Oswald
Eno Töppe
Claudia Nieuwenhuis
Daniel Cremers
Publisher: Springer Berlin Heidelberg
Book: Innovations for Shape Analysis
Print ISBN: 978-3-642-34140-3

Electronic ISBN: 978-3-642-34141-0

Copyright Year: 2013
DOI: https://doi.org/10.1007/978-3-642-34141-0_16

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner