Skip to main content

2016 | OriginalPaper | Buchkapitel

Robust and Accurate Line- and/or Point-Based Pose Estimation without Manhattan Assumptions

verfasst von : Yohann Salaün , Renaud Marlet, Pascal Monasse

Erschienen in: Computer Vision – ECCV 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Usual Structure from Motion techniques based on feature points have a hard time on scenes with little texture or presenting a single plane, as in indoor environments. Line segments are more robust features in this case. We propose a novel geometrical criterion for two-view pose estimation using lines, that does not assume a Manhattan world. We also define a parameterless (a contrario) RANSAC-like method to discard calibration outliers and provide more robust pose estimations, possibly using points as well when available. Finally, we provide quantitative experimental data that illustrate failure cases of other methods and that show how our approach outperforms them, both in robustness and precision.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Xu, Y., Oh, S., Hoogs, A.: A minimum error vanishing point detection approach for uncalibrated monocular images of man-made environments. In: IEEE Computer Vision and Pattern Recognition (CVPR 2013), pp. 1376–1383, June 2013 Xu, Y., Oh, S., Hoogs, A.: A minimum error vanishing point detection approach for uncalibrated monocular images of man-made environments. In: IEEE Computer Vision and Pattern Recognition (CVPR 2013), pp. 1376–1383, June 2013
2.
Zurück zum Zitat Lezama, J., Grompone von Gioi, R., Randall, G., Morel, J.M.: Finding vanishing points via point alignments in image primal and dual domains. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2014), June 2014 Lezama, J., Grompone von Gioi, R., Randall, G., Morel, J.M.: Finding vanishing points via point alignments in image primal and dual domains. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2014), June 2014
3.
Zurück zum Zitat Elqursh, A., Elgammal, A.: Line-based relative pose estimation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2011), pp. 3049–3056, June 2011 Elqursh, A., Elgammal, A.: Line-based relative pose estimation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2011), pp. 3049–3056, June 2011
4.
Zurück zum Zitat Weng, J., Huang, T.S., Ahuja, N.: Motion and structure from line correspondences; closed-form solution, uniqueness, and optimization. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI 1992) 14(3), 318–336 (1992)CrossRef Weng, J., Huang, T.S., Ahuja, N.: Motion and structure from line correspondences; closed-form solution, uniqueness, and optimization. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI 1992) 14(3), 318–336 (1992)CrossRef
5.
Zurück zum Zitat Zhang, Z.: Estimating motion and structure from correspondences of line segments between two perspective images. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI 1995) 17(12), 1129–1139 (1995)CrossRef Zhang, Z.: Estimating motion and structure from correspondences of line segments between two perspective images. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI 1995) 17(12), 1129–1139 (1995)CrossRef
6.
Zurück zum Zitat Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, New York (2004). ISBN: 0521540518CrossRefMATH Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, New York (2004). ISBN: 0521540518CrossRefMATH
7.
Zurück zum Zitat Bartoli, A., Sturm, P.F.: Structure-from-motion using lines: representation, triangulation, and bundle adjustment. Comput. Vis. Image Underst. (CVIU 2005) 100(3), 416–441 (2005)CrossRef Bartoli, A., Sturm, P.F.: Structure-from-motion using lines: representation, triangulation, and bundle adjustment. Comput. Vis. Image Underst. (CVIU 2005) 100(3), 416–441 (2005)CrossRef
8.
Zurück zum Zitat Schindler, G., Krishnamurthy, P., Dellaert, F.: Line-based structure from motion for urban environments. In: Proceedings of the 3rd International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT 2006), Computer Society, pp. 846–853. IEEE, Washington, DC (2006) Schindler, G., Krishnamurthy, P., Dellaert, F.: Line-based structure from motion for urban environments. In: Proceedings of the 3rd International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT 2006), Computer Society, pp. 846–853. IEEE, Washington, DC (2006)
9.
Zurück zum Zitat Zhang, L., Koch, R.: Structure and motion from line correspondences: representation, projection, initialization and sparse bundle adjustment. J. Vis. Commun. Image Representation 25(5), 904–915 (2014)CrossRef Zhang, L., Koch, R.: Structure and motion from line correspondences: representation, projection, initialization and sparse bundle adjustment. J. Vis. Commun. Image Representation 25(5), 904–915 (2014)CrossRef
10.
Zurück zum Zitat Chandraker, M., Lim, J., Kriegman, D.: Moving in stereo: efficient structure and motion using lines. In: IEEE 12th International Conference on Computer Vision (ICCV 2009), pp. 1741–1748 (2009) Chandraker, M., Lim, J., Kriegman, D.: Moving in stereo: efficient structure and motion using lines. In: IEEE 12th International Conference on Computer Vision (ICCV 2009), pp. 1741–1748 (2009)
11.
Zurück zum Zitat Pradeep, V., Lim, J.: Egomotion using assorted features. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2010), pp. 1514–1521, June 2010 Pradeep, V., Lim, J.: Egomotion using assorted features. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2010), pp. 1514–1521, June 2010
12.
Zurück zum Zitat Koseck, J., Zhang, W.: Extraction, matching, and pose recovery based on dominant rectangular structures. Comput. Vis. Image Underst. (CVIU 2005) 100(3), 274–293 (2005)CrossRef Koseck, J., Zhang, W.: Extraction, matching, and pose recovery based on dominant rectangular structures. Comput. Vis. Image Underst. (CVIU 2005) 100(3), 274–293 (2005)CrossRef
13.
Zurück zum Zitat Montiel, J., Tardós, J., Montano, L.: Structure and motion from straight line segments. Pattern Recogn. (PR 2000) 33(8), 1295–1307 (2000)CrossRef Montiel, J., Tardós, J., Montano, L.: Structure and motion from straight line segments. Pattern Recogn. (PR 2000) 33(8), 1295–1307 (2000)CrossRef
14.
Zurück zum Zitat Bay, H., Ferrari, V., Van Gool, L.: Wide-baseline stereo matching with line segments. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2005), Computer Society, pp. 329–336. IEEE, Washington, DC (2005) Bay, H., Ferrari, V., Van Gool, L.: Wide-baseline stereo matching with line segments. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2005), Computer Society, pp. 329–336. IEEE, Washington, DC (2005)
15.
16.
Zurück zum Zitat Lee, J.K., Yoon, K.J.: Real-time joint estimation of camera orientation and vanishing points. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2015), June 2015 Lee, J.K., Yoon, K.J.: Real-time joint estimation of camera orientation and vanishing points. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2015), June 2015
17.
Zurück zum Zitat Cipolla, R., Drummond, T., Robertson, D.: Camera calibration from vanishing points in images of architectural scenes. In: British Machine Vision Conference (BMVC 1999), pp. 382–391 (1999) Cipolla, R., Drummond, T., Robertson, D.: Camera calibration from vanishing points in images of architectural scenes. In: British Machine Vision Conference (BMVC 1999), pp. 382–391 (1999)
18.
Zurück zum Zitat Rother, C., Carlsson, S.: Linear multi view reconstruction and camera recovery using a reference plane. Int. J. Comput. Vis. (IJCV 2002) 49(2–3), 117–141 (2002)CrossRefMATH Rother, C., Carlsson, S.: Linear multi view reconstruction and camera recovery using a reference plane. Int. J. Comput. Vis. (IJCV 2002) 49(2–3), 117–141 (2002)CrossRefMATH
19.
Zurück zum Zitat Sinha, S.N., Steedly, D., Szeliski, R.: A multi-stage linear approach to structure from motion. In: Kutulakos, K.N. (ed.) ECCV 2010. LNCS, vol. 6554, pp. 267–281. Springer, Heidelberg (2012). doi:10.1007/978-3-642-35740-4_21 Sinha, S.N., Steedly, D., Szeliski, R.: A multi-stage linear approach to structure from motion. In: Kutulakos, K.N. (ed.) ECCV 2010. LNCS, vol. 6554, pp. 267–281. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-35740-4_​21
20.
Zurück zum Zitat Markley, F.L.: Attitude determination using vector observations and the singular value decomposition. J. Astronaut. Sci. 36(3), 245–258 (1988)MathSciNet Markley, F.L.: Attitude determination using vector observations and the singular value decomposition. J. Astronaut. Sci. 36(3), 245–258 (1988)MathSciNet
22.
Zurück zum Zitat Nistér, D.: An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI 2004) 26(6), 756–777 (2004)CrossRef Nistér, D.: An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI 2004) 26(6), 756–777 (2004)CrossRef
23.
Zurück zum Zitat Moulon, P., Monasse, P., Marlet, R.: Adaptive structure from motion with a Contrario model estimation. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7727, pp. 257–270. Springer, Heidelberg (2013). doi:10.1007/978-3-642-37447-0_20 CrossRef Moulon, P., Monasse, P., Marlet, R.: Adaptive structure from motion with a Contrario model estimation. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7727, pp. 257–270. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-37447-0_​20 CrossRef
24.
Zurück zum Zitat Moisan, L., Stival, B.: A probabilistic criterion to detect rigid point matches between two images and estimate the fundamental matrix. Int. J. Comput. Vis. (IJCV 2004) 57(3), 201–218 (2004)CrossRef Moisan, L., Stival, B.: A probabilistic criterion to detect rigid point matches between two images and estimate the fundamental matrix. Int. J. Comput. Vis. (IJCV 2004) 57(3), 201–218 (2004)CrossRef
27.
Zurück zum Zitat Strecha, C., von Hansen, W., Van Gool, L., Fua, P., Thoennessen, U.: On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008). pp. 1–8, June 2008 Strecha, C., von Hansen, W., Van Gool, L., Fua, P., Thoennessen, U.: On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008). pp. 1–8, June 2008
29.
Zurück zum Zitat Salaün, Y., Marlet, R., Monasse, P.: Multiscale line segment detector for robust and accurate SfM. In: 23rd International Conference on Pattern Recognition (ICPR) (2016) Salaün, Y., Marlet, R., Monasse, P.: Multiscale line segment detector for robust and accurate SfM. In: 23rd International Conference on Pattern Recognition (ICPR) (2016)
30.
Zurück zum Zitat Zhang, L., Koch, R.: An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency. J. Vis. Commun. Image Representation 24(7), 794–805 (2013)CrossRef Zhang, L., Koch, R.: An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency. J. Vis. Commun. Image Representation 24(7), 794–805 (2013)CrossRef
31.
Zurück zum Zitat Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. (IJCV 2004) 60(2), 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. (IJCV 2004) 60(2), 91–110 (2004)CrossRef
32.
Zurück zum Zitat Liu, Z., Marlet, R.: Virtual line descriptor and semi-local matching method for reliable feature correspondence. In: British Machine Vision Conference (BMVC 2012), United Kingdom, pp. 16.1–16.11, September 2012 Liu, Z., Marlet, R.: Virtual line descriptor and semi-local matching method for reliable feature correspondence. In: British Machine Vision Conference (BMVC 2012), United Kingdom, pp. 16.1–16.11, September 2012
33.
Zurück zum Zitat Almansa, A., Desolneux, A., Vamech, S.: Vanishing point detection without any a priori information. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI 2003) 25(4), 502–507 (2003)CrossRef Almansa, A., Desolneux, A., Vamech, S.: Vanishing point detection without any a priori information. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI 2003) 25(4), 502–507 (2003)CrossRef
Metadaten
Titel
Robust and Accurate Line- and/or Point-Based Pose Estimation without Manhattan Assumptions
verfasst von
Yohann Salaün
Renaud Marlet
Pascal Monasse
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46478-7_49