Skip to main content

2018 | OriginalPaper | Buchkapitel

CRF-Based Reconstruction from Narrow-Baseline Image Sequences

verfasst von : Yue Xu, Qiuyan Tao, Lianghao Wang, Dongxiao Li, Ming Zhang

Erschienen in: Advances in Multimedia Information Processing – PCM 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Given an image sequence of a scene it is possible to recover a depth map. Though multiview stereo algorithms are well-studied, rarely are those algorithms considered in the context of narrow baseline. In this paper, a practical method is proposed to generate dense depth map using a narrow-baseline image sequence. We introduce a new structure from small motion method tailored for narrow baseline which allows us to recover sparse scene structure and camera poses. In the dense reconstruction, we adopt a space-sweeping method for dense matching and a fully connected conditional random field model for depth refinement. As opposed to prior methods that guide CRF with color information alone, we creatively add depth information guidance which effectively avoids over-smoothing and bad impact from error color information. Our approach produces higher-quality dense depth results than state-of-the-art algorithms under the same baseline configuration.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, pp. 1865–1872. Cambridge University Press, New York (2000) Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, pp. 1865–1872. Cambridge University Press, New York (2000)
2.
Zurück zum Zitat Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3D. ACM Trans. Graph. 25, 835–846 (2006)CrossRef Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3D. ACM Trans. Graph. 25, 835–846 (2006)CrossRef
3.
Zurück zum Zitat Häming, K., et al.: The structure-from-motion reconstruction pipeline - a survey with focus on short image sequences. Kybernetika 46(5), 926–937 (2010). PrahaMathSciNetMATH Häming, K., et al.: The structure-from-motion reconstruction pipeline - a survey with focus on short image sequences. Kybernetika 46(5), 926–937 (2010). PrahaMathSciNetMATH
4.
Zurück zum Zitat Okutomi, M., Kanade, T.: A multiple-baseline stereo. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 15(4), 353–363 (1993)CrossRef Okutomi, M., Kanade, T.: A multiple-baseline stereo. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 15(4), 353–363 (1993)CrossRef
6.
Zurück zum Zitat Yu, F., Gallup, D.: 3D reconstruction from accidental motion. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3986–3993. IEEE (2014) Yu, F., Gallup, D.: 3D reconstruction from accidental motion. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3986–3993. IEEE (2014)
7.
Zurück zum Zitat Im, S., et al.: High quality structure from small motion for rolling shutter cameras. In: IEEE International Conference on Computer Vision IEEE, pp. 837–845 (2015) Im, S., et al.: High quality structure from small motion for rolling shutter cameras. In: IEEE International Conference on Computer Vision IEEE, pp. 837–845 (2015)
8.
Zurück zum Zitat Ha, H., et al.: High-quality depth from uncalibrated small motion clip. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE (2016) Ha, H., et al.: High-quality depth from uncalibrated small motion clip. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE (2016)
9.
Zurück zum Zitat Campbell, N.D.F., et al.: Using multiple hypotheses to improve depth-maps for multi-view stereo. In: European Conference on Computer Vision, Marseille, France, 12–18 October 2008, pp. 766–779 Campbell, N.D.F., et al.: Using multiple hypotheses to improve depth-maps for multi-view stereo. In: European Conference on Computer Vision, Marseille, France, 12–18 October 2008, pp. 766–779
10.
Zurück zum Zitat Woodford, O., et al.: Global stereo reconstruction under second-order smoothness priors. IEEE Trans. Pattern Anal. Mach. Intell. 31(12), 2115–2118 (2009)CrossRef Woodford, O., et al.: Global stereo reconstruction under second-order smoothness priors. IEEE Trans. Pattern Anal. Mach. Intell. 31(12), 2115–2118 (2009)CrossRef
11.
Zurück zum Zitat Komodakis, N., Paragios, N.: Beyond pairwise energies: efficient optimization for higher-order MRFs. In: IEEE Conference on IEEE Xplore Computer Vision and Pattern Recognition, pp. 2985–2992 (2009) Komodakis, N., Paragios, N.: Beyond pairwise energies: efficient optimization for higher-order MRFs. In: IEEE Conference on IEEE Xplore Computer Vision and Pattern Recognition, pp. 2985–2992 (2009)
12.
Zurück zum Zitat Shi, J., Tomasi, C.: Good features to track. In: CVPR, pp. 593–600 (1994) Shi, J., Tomasi, C.: Good features to track. In: CVPR, pp. 593–600 (1994)
13.
Zurück zum Zitat Tomasi, C.: Detection and tracking of point features. Technical report 91.21(1991), pp. 9795–9802 (1991) Tomasi, C.: Detection and tracking of point features. Technical report 91.21(1991), pp. 9795–9802 (1991)
14.
Zurück zum Zitat Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)MathSciNetCrossRef Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)MathSciNetCrossRef
15.
Zurück zum Zitat Hartley, R., et al.: Verifying global minima for L2 minimization problems in multiple view geometry. Int. J. Comput. Vis. 101, 288–304 (2013)MathSciNetCrossRef Hartley, R., et al.: Verifying global minima for L2 minimization problems in multiple view geometry. Int. J. Comput. Vis. 101, 288–304 (2013)MathSciNetCrossRef
16.
Zurück zum Zitat Ma, L., Chen, Y., Moore, K.L.: Rational radial distortion models of camera lenses with analytical solution for distortion correction. Int. J. Inf. Acquis. 1, 135–147 (2012)CrossRef Ma, L., Chen, Y., Moore, K.L.: Rational radial distortion models of camera lenses with analytical solution for distortion correction. Int. J. Inf. Acquis. 1, 135–147 (2012)CrossRef
17.
Zurück zum Zitat Agarwal, S., Mierle, K.: Ceres Solver: Tutorial & Reference. Google Inc. (2012) Agarwal, S., Mierle, K.: Ceres Solver: Tutorial & Reference. Google Inc. (2012)
18.
Zurück zum Zitat Collins, R.T.: A space-sweep approach to true multi-image matching. In: Conference on Computer Vision and Pattern Recognition IEEE Computer Society, pp. 358–363. IEEE (1996) Collins, R.T.: A space-sweep approach to true multi-image matching. In: Conference on Computer Vision and Pattern Recognition IEEE Computer Society, pp. 358–363. IEEE (1996)
19.
Zurück zum Zitat Krähenbühl, P., Koltun, V.: Efficient inference in fully connected CRFs with Gaussian edge potentials. In: Advances in Neural Information Processing Systems, pp. 109–117 (2011) Krähenbühl, P., Koltun, V.: Efficient inference in fully connected CRFs with Gaussian edge potentials. In: Advances in Neural Information Processing Systems, pp. 109–117 (2011)
20.
Zurück zum Zitat Krähenbühl, P., Koltun, V.: Parameter learning and convergent inference for dense random fields. In: International Conference on Machine Learning, Atlanta, USA, vol. 46, pp. 346–350 (2013) Krähenbühl, P., Koltun, V.: Parameter learning and convergent inference for dense random fields. In: International Conference on Machine Learning, Atlanta, USA, vol. 46, pp. 346–350 (2013)
21.
Zurück zum Zitat Wanner, S.: Datasets and Benchmarks for Densely Sampled 4D Light Fields. The Eurographics Association (2013) Wanner, S.: Datasets and Benchmarks for Densely Sampled 4D Light Fields. The Eurographics Association (2013)
Metadaten
Titel
CRF-Based Reconstruction from Narrow-Baseline Image Sequences
verfasst von
Yue Xu
Qiuyan Tao
Lianghao Wang
Dongxiao Li
Ming Zhang
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-77380-3_34

Neuer Inhalt