Skip to main content
Erschienen in: International Journal of Computer Vision 4/2021

16.01.2021

Incremental Rotation Averaging

verfasst von: Xiang Gao, Lingjie Zhu, Zexiao Xie, Hongmin Liu, Shuhan Shen

Erschienen in: International Journal of Computer Vision | Ausgabe 4/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we present a simple yet effective rotation averaging pipeline, termed Incremental Rotation Averaging (IRA), which is inspired by the well-developed incremental Structure from Motion (SfM) techniques. Unlike the traditional rotation averaging methods which estimate all the absolute rotations simultaneously and focus on designing either robust loss function or outlier filtering strategy, here the absolute rotations are estimated in an incremental way. Similar to the incremental SfM, our IRA is robust to relative rotation outliers and could achieve accurate rotation averaging results. In addition, we propose several key techniques, such as initial triplet and Next-Best-View selection, Weighted Local/Global Optimization, and Re-Rotation Averaging, to push the rotation averaging results one step further. Ablation studies and comparison experiments on the 1DSfM, Campus, and San Francisco datasets demonstrate the effectiveness of our IRA and its advantages over the state-of-the-art rotation averaging methods in accuracy and robustness.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Agarwal, S., Snavely, N., Seitz, S. M., & Szeliski, R. (2010). Bundle adjustment in the large. In European conference on computer vision (ECCV) (pp. 29–42). Agarwal, S., Snavely, N., Seitz, S. M., & Szeliski, R. (2010). Bundle adjustment in the large. In European conference on computer vision (ECCV) (pp. 29–42).
Zurück zum Zitat Bustos, Á. P., Chin, T., Eriksson, A., & Reid, I. (2019). Visual SLAM: Why bundle adjust? In International conference on robotics and automation (ICRA) (pp. 2385–2391). Bustos, Á. P., Chin, T., Eriksson, A., & Reid, I. (2019). Visual SLAM: Why bundle adjust? In International conference on robotics and automation (ICRA) (pp. 2385–2391).
Zurück zum Zitat Chatterjee, A., & Govindu, V. M. (2013). Efficient and robust large-scale rotation averaging. In IEEE international conference on computer vision (ICCV) (pp. 521–528). Chatterjee, A., & Govindu, V. M. (2013). Efficient and robust large-scale rotation averaging. In IEEE international conference on computer vision (ICCV) (pp. 521–528).
Zurück zum Zitat Chatterjee, A., & Govindu, V. M. (2018). Robust relative rotation averaging. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(4), 958–972.CrossRef Chatterjee, A., & Govindu, V. M. (2018). Robust relative rotation averaging. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(4), 958–972.CrossRef
Zurück zum Zitat Chng, C. K., Parra, A., Chin, T. J., & Latif, Y. (2020). Monocular rotational odometry with incremental rotation averaging and loop closure. In Digital image computing: techniques and applications (DICTA). Chng, C. K., Parra, A., Chin, T. J., & Latif, Y. (2020). Monocular rotational odometry with incremental rotation averaging and loop closure. In Digital image computing: techniques and applications (DICTA).
Zurück zum Zitat Crandall, D., Owens, A., Snavely, N., & Huttenlocher, D. (2013). SfM with MRFs: Discrete-continuous optimization for large-scale structure from motion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(12), 2841–2853.CrossRef Crandall, D., Owens, A., Snavely, N., & Huttenlocher, D. (2013). SfM with MRFs: Discrete-continuous optimization for large-scale structure from motion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(12), 2841–2853.CrossRef
Zurück zum Zitat Cui, H., Gao, X., Shen, S., & Hu, Z. (2017). HSfM: Hybrid structure-from-motion. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2393–2402). Cui, H., Gao, X., Shen, S., & Hu, Z. (2017). HSfM: Hybrid structure-from-motion. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2393–2402).
Zurück zum Zitat Cui, H., Shen, S., Gao, X., & Hu, Z. (2017). CSfM: Community-based structure from motion. In IEEE international conference on image processing (ICIP) (pp. 4517–4521). Cui, H., Shen, S., Gao, X., & Hu, Z. (2017). CSfM: Community-based structure from motion. In IEEE international conference on image processing (ICIP) (pp. 4517–4521).
Zurück zum Zitat Cui, H., Shen, S., Gao, W., Liu, H., & Wang, Z. (2019). Efficient and robust large-scale structure-from-motion via track selection and camera prioritization. ISPRS Journal of Photogrammetry and Remote Sensing, 156, 202–214.CrossRef Cui, H., Shen, S., Gao, W., Liu, H., & Wang, Z. (2019). Efficient and robust large-scale structure-from-motion via track selection and camera prioritization. ISPRS Journal of Photogrammetry and Remote Sensing, 156, 202–214.CrossRef
Zurück zum Zitat Cui, Z., & Tan, P. (2015). Global structure-from-motion by similarity averaging. In IEEE international conference on computer vision (ICCV) (pp. 864–872). Cui, Z., & Tan, P. (2015). Global structure-from-motion by similarity averaging. In IEEE international conference on computer vision (ICCV) (pp. 864–872).
Zurück zum Zitat Dong, Q., Gao, X., Cui, H., & Hu, Z. (2020). Robust camera translation estimation via rank enforcement. IEEE Transactions on Cybernetics. Dong, Q., Gao, X., Cui, H., & Hu, Z. (2020). Robust camera translation estimation via rank enforcement. IEEE Transactions on Cybernetics.
Zurück zum Zitat Eriksson, A., Olsson, C., Kahl, F., & Chin, T. (2018). Rotation averaging and strong duality. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 127–135). Eriksson, A., Olsson, C., Kahl, F., & Chin, T. (2018). Rotation averaging and strong duality. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 127–135).
Zurück zum Zitat Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6), 381–395.MathSciNetCrossRef Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6), 381–395.MathSciNetCrossRef
Zurück zum Zitat Govindu, V. M. (2006). Robustness in motion averaging. In Asian conference on computer vision (ACCV) (pp. 457–466). Govindu, V. M. (2006). Robustness in motion averaging. In Asian conference on computer vision (ACCV) (pp. 457–466).
Zurück zum Zitat Haner, S., & Heyden, A. (2012). Covariance propagation and next best view planning for 3D reconstruction. In European conference on computer vision (ECCV) (pp. 545–556). Haner, S., & Heyden, A. (2012). Covariance propagation and next best view planning for 3D reconstruction. In European conference on computer vision (ECCV) (pp. 545–556).
Zurück zum Zitat Hartley, R., Aftab, K., & Trumpf, J. (2011). L1 rotation averaging using the Weiszfeld algorithm. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 3041–3048). Hartley, R., Aftab, K., & Trumpf, J. (2011). L1 rotation averaging using the Weiszfeld algorithm. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 3041–3048).
Zurück zum Zitat Hartley, R., Trumpf, J., Dai, Y., & Li, H. (2013). Rotation averaging. International Journal of Computer Vision, 103, 267–305.MathSciNetCrossRef Hartley, R., Trumpf, J., Dai, Y., & Li, H. (2013). Rotation averaging. International Journal of Computer Vision, 103, 267–305.MathSciNetCrossRef
Zurück zum Zitat Jiang, N., Cui, Z., & Tan, P. (2013). A global linear method for camera pose registration. In IEEE international conference on computer vision (ICCV) (pp. 481–488). Jiang, N., Cui, Z., & Tan, P. (2013). A global linear method for camera pose registration. In IEEE international conference on computer vision (ICCV) (pp. 481–488).
Zurück zum Zitat Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.CrossRef Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.CrossRef
Zurück zum Zitat Moulon, P., Monasse, P., & Marlet, R. (2013). Global fusion of relative motions for robust, accurate and scalable structure from motion. In IEEE international conference on computer vision (ICCV) (pp. 3248–3255). Moulon, P., Monasse, P., & Marlet, R. (2013). Global fusion of relative motions for robust, accurate and scalable structure from motion. In IEEE international conference on computer vision (ICCV) (pp. 3248–3255).
Zurück zum Zitat Nister, D. (2004). An efficient solution to the five-point relative pose problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(6), 756–770.CrossRef Nister, D. (2004). An efficient solution to the five-point relative pose problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(6), 756–770.CrossRef
Zurück zum Zitat Özyeşil, O., & Singer, A. (2015). Robust camera location estimation by convex programming. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2674–2683). Özyeşil, O., & Singer, A. (2015). Robust camera location estimation by convex programming. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2674–2683).
Zurück zum Zitat Schönberger, J. L., & Frahm, J. M. (2016). Structure-from-motion revisited. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 4104–4113). Schönberger, J. L., & Frahm, J. M. (2016). Structure-from-motion revisited. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 4104–4113).
Zurück zum Zitat Shen, T., Zhu, S., Fang, T., Zhang, R., & Quan, L. (2016). Graph-based consistent matching for structure-from-motion. In European conference on computer vision (ECCV) (pp. 139–155). Shen, T., Zhu, S., Fang, T., Zhang, R., & Quan, L. (2016). Graph-based consistent matching for structure-from-motion. In European conference on computer vision (ECCV) (pp. 139–155).
Zurück zum Zitat Snavely, N., Seitz, S. M., & Szeliski, R. (2008). Modeling the world from Internet photo collections. International Journal of Computer Vision, 80(2), 189–210.CrossRef Snavely, N., Seitz, S. M., & Szeliski, R. (2008). Modeling the world from Internet photo collections. International Journal of Computer Vision, 80(2), 189–210.CrossRef
Zurück zum Zitat Sweeney, C., Sattler, T., Höllerer, T., Turk, M., & Pollefeys, M. (2015). Optimizing the viewing graph for structure-from-motion. In IEEE international conference on computer vision (ICCV) (pp. 801–809). Sweeney, C., Sattler, T., Höllerer, T., Turk, M., & Pollefeys, M. (2015). Optimizing the viewing graph for structure-from-motion. In IEEE international conference on computer vision (ICCV) (pp. 801–809).
Zurück zum Zitat Wilson, K., & Snavely, N. (2014). Robust global translations with 1DSfM. In European conference on computer vision (ECCV) (pp. 61–75). Wilson, K., & Snavely, N. (2014). Robust global translations with 1DSfM. In European conference on computer vision (ECCV) (pp. 61–75).
Zurück zum Zitat Wilson, K., Bindel, D., & Snavely, N. (2016). When is rotations averaging hard? In European conference on computer vision (ECCV) (pp. 255–270). Wilson, K., Bindel, D., & Snavely, N. (2016). When is rotations averaging hard? In European conference on computer vision (ECCV) (pp. 255–270).
Zurück zum Zitat Wu, C. (2013). Towards linear-time incremental structure from motion. In International conference on 3D vision (3DV) (pp. 127–134). Wu, C. (2013). Towards linear-time incremental structure from motion. In International conference on 3D vision (3DV) (pp. 127–134).
Zurück zum Zitat Zach, C., Klopschitz, M., & Pollefeys, M. (2010). Disambiguating visual relations using loop constraints. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1426–1433). Zach, C., Klopschitz, M., & Pollefeys, M. (2010). Disambiguating visual relations using loop constraints. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1426–1433).
Zurück zum Zitat Zhu, S., Zhang, R., Zhou, L., Shen, T., Fang, T., Tan, P., & Quan, L. (2018). Very large-scale global SfM by distributed motion averaging. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 4568–4577). Zhu, S., Zhang, R., Zhou, L., Shen, T., Fang, T., Tan, P., & Quan, L. (2018). Very large-scale global SfM by distributed motion averaging. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 4568–4577).
Metadaten
Titel
Incremental Rotation Averaging
verfasst von
Xiang Gao
Lingjie Zhu
Zexiao Xie
Hongmin Liu
Shuhan Shen
Publikationsdatum
16.01.2021
Verlag
Springer US
Erschienen in
International Journal of Computer Vision / Ausgabe 4/2021
Print ISSN: 0920-5691
Elektronische ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-020-01427-7

Weitere Artikel der Ausgabe 4/2021

International Journal of Computer Vision 4/2021 Zur Ausgabe