nach oben

Erschienen in:

2017 | OriginalPaper | Buchkapitel

Towards Space Carving with a Hand-Held Camera

verfasst von : Zhirui Wang, Laurent Kneip

Erschienen in: Computer Vision Systems

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

With the rise of VR applications, dense reconstruction of 3D object models becomes an increasingly important subproblem of computer vision. Most existing methods focus on the reconstruction of the actual object and assume that camera poses are known and the observed object is clearly dominant in the image. The goal of this paper is to extend these technologies to less artificial data, and enable dense 3D object modeling from an ordinary hand-held camera observing an object on top of a structured, unknown planar background. The key of our method consists of recovering highly accurate camera poses from structure from motion based on a planar scene assumption, and modeling the structure on the planar background with implicitly smooth Bezier splines. We present a complete end-to-end pipeline able to produce meaningful dense 3D models from a simple space carving approach in near real-time.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Visual Servoing of Wheeled Mobile Robots Under Dynamic Environment

Nächstes Kapitel Monocular Epipolar Constraint for Optical Flow Estimation

Agarwal, S., Mierle, K., et al.: Ceres solver. http://ceres-solver.org

Balzer, J., Soatto, S.: Second-order shape optimization for geometric inverse problems in vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014)

Berthilsson, R., Astrom, K., Heyden, A.: Reconstruction of general curves, using factorization and bundle adjustment. Int. J. Comput. Vis. (IJCV) 41(3), 171–182 (2001)CrossRefMATH

Bylow, E., Sturm, J., Kerl, C., Kahl, F., Cremers, D.: Direct camera pose tracking and mapping with signed distance functions. In: Demo Track of the RGB-D Workshop on Advanced Reasoning with Depth Cameras at Robotics: Science and Systems (RSS) (2013)

Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 8(6), 679–698 (1986)CrossRef

Cashman, T.J., Fitzgibbon, A.W.: What shape are dolphins? Building 3D morphable models from 2D images. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 35(1), 232–244 (2013)CrossRef

Delaunoy, A., Pollefeys, M.: Photometric bundle adjustment for dense multi-view 3D modeling. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014)

Eade, E., Drummond, T.: Edge landmarks in monocular SLAM. Image Vis. Comput. (IVC) 27(5), 588–596 (2009)CrossRef

Engel, J., Schöps, T., Cremers, D.: LSD-SLAM: large-scale direct monocular SLAM. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8690, pp. 834–849. Springer, Cham (2014). doi:10.1007/978-3-319-10605-2_54

10.

Engel, J., Sturm, J., Cremers, D.: Semi-dense visual odometry for a monocular camera. In: Proceedings of the International Conference on Computer Vision (ICCV) (2013)

11.

Fabbri, R., Kimia, B.: 3D curve sketch: flexible curve-based stereo reconstruction and calibration. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2010)

12.

Faugeras, O., Mourrain, B.: On the geometry and algebra of the point and line correspondences between n images. In: Proceedings of the International Conference on Computer Vision (ICCV) (1995)

13.

Feldmar, J., Betting, F., Ayache, N.: 3D-2D projective registration of free-form curves and surfaces. In: Proceedings of the International Conference on Computer Vision (ICCV) (1995)

14.

Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, New York (2004)CrossRefMATH

15.

Kaess, M., Zboinski, R., Dellaert, F.: MCMC-based multiview reconstruction of piecewise smooth subdivision curves with a variable number of control points. In: Pajdla, T., Matas, J. (eds.) ECCV 2004 Part III. LNCS, vol. 3023, pp. 329–341. Springer, Heidelberg (2004). doi:10.1007/978-3-540-24672-5_26 CrossRef

16.

Kahl, F., August, J.: Multiview reconstruction of space curves. In: Proceedings of the International Conference on Computer Vision (ICCV) (2003)

17.

Kahl, F., Heyden, A.: Using conic correspondences in two images to estimate the epipolar geometry. In: Proceedings of the International Conference on Computer Vision (ICCV) (1998)

18.

Kaminski, J.Y., Shashua, A.: Multiple view geometry of general algebraic curves. Int. J. Comput. Vis. (IJCV) 56(3), 195–219 (2004)CrossRef

19.

Kneip, L., Furgale, P.: OpenGV: a unified and generalized approach to real-time calibrated geometric vision. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Hongkong (2014)

20.

Kneip, L., Scaramuzza, D., Siegwart, R.: A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, USA (2011)

21.

Kolev, K., Brox, T., Cremers, D.: Fast joint estimation of silhouettes and dense 3D geometry from multiple images. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 34(3), 493–505 (2012)CrossRef

22.

Kolev, K., Tanskanen, P., Speciale, P., Pollefeys, M.: Turning mobile phones into 3D scanners. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014)

23.

Laurentini, A.: The visual hull concept for silhouette-based image understanding. IEEE Trans. Pattern Anal. Mach. Intell. 16(2), 150–162 (1994)CrossRef

24.

Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., Fulk, D.: The digital michelangelo project: 3D scanning of large statues. In: ACM Transactions on Graphics (SIGGRAPH) (2011)

25.

Malis, E., Vargas, M.: Deeper understanding of the homography decomposition for vision-based control. Ph.D. thesis, INRIA (2007)

26.

Martin, W.N., Aggarwal, J.K.: Volumetric descriptions of objects from multiple views. IEEE Trans. Pattern Anal. Mach. Intell. 5(2), 150 (1983)CrossRef

27.

Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohli, P., Shotton, J., Hodges, S., Fitzgibbon, A.: Kinectfusion: real-time dense surface mapping and tracking. In: Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR) (2011)

28.

Newcombe, R.A., Lovegrove, S.J., Davison, A.J.: DTAM: dense tracking and mapping in real-time. In: Proceedings of the International Conference on Computer Vision (ICCV) (2011)

29.

Nitschke, C.: A Framework for Realtime 3-D Reconstruction by Space Carving Using Graphics Hardware. diplom. de, Hamburg (2007)

30.

Nurutdinova, I., Fitzgibbon, A.: Towards pointless structure from motion: 3D reconstruction and camera parameters from general 3D curves. In: Proceedings of the International Conference on Computer Vision (ICCV) (2015)

31.

Pan, Q., Reitmayr, G., Drummond, T.: ProFORMA: probabilistic feature-based on-line rapid model acquisition. In: Proceedings of the British Machine Vision Conference (BMVC), London, UK (2009)

32.

Porrill, J., Pollard, S.: Curve matching and stereo calibration. Image Vis. Comput. (IVC) 9(1), 45–50 (1991)CrossRef

33.

Rother, C., Kolmogorov, V., Blake, A.: Grabcut: interactive foreground extraction using iterated graph cuts. In: ACM transactions on graphics (TOG), vol. 23, pp. 309–314. ACM (2004)

34.

Teney, D., Piater, J.: Sampling-based multiview reconstruction without correspondences for 3D edges. In: Proceedings of the International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT) (2012)

35.

Xiao, Y.J., Li, Y.: Optimized stereo reconstruction of free-form space curves based on a nonuniform rational B-spline model. J. Opt. Soc. Am. 22(9), 1746–1762 (2005)MathSciNetCrossRef

36.

Zhou, Y., Kneip, L., Li, H.: Semi-dense visual odometry for RGB-D cameras using approximate nearest neighbour fields. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (2017)

Titel: Towards Space Carving with a Hand-Held Camera
verfasst von: Zhirui Wang
Laurent Kneip
Verlag: Springer International Publishing
Buch: Computer Vision Systems
Print ISBN: 978-3-319-68344-7

Electronic ISBN: 978-3-319-68345-4

Copyright-Jahr: 2017
DOI: https://doi.org/10.1007/978-3-319-68345-4_5

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"