Skip to main content
Top
Published in: Autonomous Robots 6/2021

03-07-2021

VIR-SLAM: visual, inertial, and ranging SLAM for single and multi-robot systems

Authors: Yanjun Cao, Giovanni Beltrame

Published in: Autonomous Robots | Issue 6/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Monocular cameras coupled with inertial measurements generally give high performance visual inertial odometry. However, drift can be significant with long trajectories, especially when the environment is visually challenging. In this paper, we propose a system that leverages Ultra–WideBand (UWB) ranging with one static anchor placed in the environment to correct the accumulated error whenever the anchor is visible. We also use this setup for collaborative SLAM: different robots use mutual ranging (when available) and the common anchor to estimate the transformation between each other, facilitating map fusion. Our system consists of two modules: a double layer ranging, visual, and inertial odometry for single robots, and a transformation estimation module for collaborative SLAM. We test our system on public datasets by simulating UWB measurements as well as on real robots in different environments. Experiments validate our system and show our method can outperform pure visual-inertial odometry by more than 20%, and in visually challenging environments, our method works even when the visual-inertial pipeline has significant drift. Furthermore, we can compute the inter-robot transformation matrices for collaborative SLAM at almost no extra computation cost.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Barral, V., Suárez-Casal, P., Escudero, C., & García-Naya, J. (2016). Assessment of uwb ranging bias in multipath environments. In Proceedings of the international conference on indoor positioning and indoor navigation (IPIN), Alcala de Henares, Spain (pp. 4–7). Barral, V., Suárez-Casal, P., Escudero, C., & García-Naya, J. (2016). Assessment of uwb ranging bias in multipath environments. In Proceedings of the international conference on indoor positioning and indoor navigation (IPIN), Alcala de Henares, Spain (pp. 4–7).
go back to reference Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., et al. (2016). Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age. IEEE Transactions on Robotics, 32(6), 1309–1332.CrossRef Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., et al. (2016). Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age. IEEE Transactions on Robotics, 32(6), 1309–1332.CrossRef
go back to reference Cao, Y., Yang, C., Li, R., Knoll, A., & Beltrame, G. (2020). Accurate position tracking with a single UWB anchor. In 2020 IEEE international conference on robotics and automation (ICRA). Cao, Y., Yang, C., Li, R., Knoll, A., & Beltrame, G. (2020). Accurate position tracking with a single UWB anchor. In 2020 IEEE international conference on robotics and automation (ICRA).
go back to reference Choudhary, S., Carlone, L., Nieto, C., Rogers, J., Christensen, H. I., & Dellaert, F. (2017). Distributed mapping with privacy and communication constraints: Lightweight algorithms and object-based models. The International Journal of Robotics Research, 36(12), 1286–1311.CrossRef Choudhary, S., Carlone, L., Nieto, C., Rogers, J., Christensen, H. I., & Dellaert, F. (2017). Distributed mapping with privacy and communication constraints: Lightweight algorithms and object-based models. The International Journal of Robotics Research, 36(12), 1286–1311.CrossRef
go back to reference Cominelli, M., Patras, P., & Gringoli, F., (2019). Dead on arrival: An empirical study of the bluetooth 5.1 positioning system. In Proceedings of the 13th international workshop on wireless network testbeds, experimental evaluation & characterization—WiNTECH ’19 (pp. 13–20). ACM Press. https://doi.org/10.1145/3349623.3355475. Cominelli, M., Patras, P., & Gringoli, F., (2019). Dead on arrival: An empirical study of the bluetooth 5.1 positioning system. In Proceedings of the 13th international workshop on wireless network testbeds, experimental evaluation & characterization—WiNTECH ’19 (pp. 13–20). ACM Press. https://​doi.​org/​10.​1145/​3349623.​3355475.
go back to reference Dellaert, F., & Kaess, M. (2006). Square root SAM: Simultaneous localization and mapping via square root information smoothing. The International Journal of Robotics Research, 25(12), 1181–1203.CrossRef Dellaert, F., & Kaess, M. (2006). Square root SAM: Simultaneous localization and mapping via square root information smoothing. The International Journal of Robotics Research, 25(12), 1181–1203.CrossRef
go back to reference Delmerico, J., & Scaramuzza, D., (2018), A benchmark comparison of monocular visual-inertial odometry algorithms for flying robots. In: 2018 IEEE international conference on robotics and automation (ICRA) (pp. 2502–2509). IEEE. Delmerico, J., & Scaramuzza, D., (2018), A benchmark comparison of monocular visual-inertial odometry algorithms for flying robots. In: 2018 IEEE international conference on robotics and automation (ICRA) (pp. 2502–2509). IEEE.
go back to reference Durrant-Whyte, H., & Bailey, T. (2006). SLAM review simultaneous localization and mapping: Part I. IEEE Robotics & Automation Magazine, 13(2), 99–110.CrossRef Durrant-Whyte, H., & Bailey, T. (2006). SLAM review simultaneous localization and mapping: Part I. IEEE Robotics & Automation Magazine, 13(2), 99–110.CrossRef
go back to reference Engel, J., Koltun, V., & Cremers, D. (2017). Direct sparse odometry. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(3), 611–625.CrossRef Engel, J., Koltun, V., & Cremers, D. (2017). Direct sparse odometry. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(3), 611–625.CrossRef
go back to reference Fang, X., Wang, C., Nguyen, T. M., & Xie, L. (2018). Graph optimization approach to localization with range measurements. arXiv:1802.10276 [cs]. Fang, X., Wang, C., Nguyen, T. M., & Xie, L. (2018). Graph optimization approach to localization with range measurements. arXiv:​1802.​10276 [cs].
go back to reference Goldsmith, A. (2005). Wireless communications. Cambridge University Press. Goldsmith, A. (2005). Wireless communications. Cambridge University Press.
go back to reference González, J., Blanco, J. L., Galindo, C., Ortiz-de Galisteo, A., Fernández-Madrigal, J. A., Moreno, F. A., et al. (2009). Mobile robot localization based on ultra-wide-band ranging: A particle filter approach. Robotics and Autonomous Systems, 57(5), 496–507.CrossRef González, J., Blanco, J. L., Galindo, C., Ortiz-de Galisteo, A., Fernández-Madrigal, J. A., Moreno, F. A., et al. (2009). Mobile robot localization based on ultra-wide-band ranging: A particle filter approach. Robotics and Autonomous Systems, 57(5), 496–507.CrossRef
go back to reference Khalajmehrabadi, A., Gatsis, N., & Akopian, D. (2017). Modern wlan fingerprinting indoor positioning methods and deployment challenges. IEEE Communications Surveys & Tutorials, 19(3), 1974–2002.CrossRef Khalajmehrabadi, A., Gatsis, N., & Akopian, D. (2017). Modern wlan fingerprinting indoor positioning methods and deployment challenges. IEEE Communications Surveys & Tutorials, 19(3), 1974–2002.CrossRef
go back to reference Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015). Keyframe-based visual-inertial odometry using nonlinear optimization. The International Journal of Robotics Research, 34(3), 314–334.CrossRef Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015). Keyframe-based visual-inertial odometry using nonlinear optimization. The International Journal of Robotics Research, 34(3), 314–334.CrossRef
go back to reference Lohan, E. S., Talvitie, J., e Silva, P. F., Nurminen, H., Ali-Löytty, S., & Piché, R. (2015). Received signal strength models for wlan and ble-based indoor positioning in multi-floor buildings. In 2015 international conference on localization and GNSS (ICL-GNSS) (pp. 1–6). IEEE. Lohan, E. S., Talvitie, J., e Silva, P. F., Nurminen, H., Ali-Löytty, S., & Piché, R. (2015). Received signal strength models for wlan and ble-based indoor positioning in multi-floor buildings. In 2015 international conference on localization and GNSS (ICL-GNSS) (pp. 1–6). IEEE.
go back to reference Mai, V., Kamel, M., Krebs, M., Schaffner, A., Meier, D., Paull, L., et al. (2018). Local positioning system using UWB range measurements for an unmanned blimp. IEEE Robotics and Automation Letters, 3(4), 2971–2978.CrossRef Mai, V., Kamel, M., Krebs, M., Schaffner, A., Meier, D., Paull, L., et al. (2018). Local positioning system using UWB range measurements for an unmanned blimp. IEEE Robotics and Automation Letters, 3(4), 2971–2978.CrossRef
go back to reference Mangelson, J. G., Dominic, D., Eustice, R. M., & Vasudevan, R. (2018). Pairwise consistent measurement set maximization for robust multi-robot map merging. In 2018 IEEE international conference on robotics and automation (ICRA) (pp. 2916–2923). IEEE. Mangelson, J. G., Dominic, D., Eustice, R. M., & Vasudevan, R. (2018). Pairwise consistent measurement set maximization for robust multi-robot map merging. In 2018 IEEE international conference on robotics and automation (ICRA) (pp. 2916–2923). IEEE.
go back to reference Martel, F. M., Sidorenko, J., Bodensteiner, C., Arens, M., & Hugentobler, U. (2019). Unique 4-DOF relative pose estimation with six distances for UWB/V-SLAM-based devices. Sensors, 19(20), 4366.CrossRef Martel, F. M., Sidorenko, J., Bodensteiner, C., Arens, M., & Hugentobler, U. (2019). Unique 4-DOF relative pose estimation with six distances for UWB/V-SLAM-based devices. Sensors, 19(20), 4366.CrossRef
go back to reference Mendoza-Silva, G. M., Torres-Sospedra, J., & Huerta, J. (2019). A meta-review of indoor positioning systems. Sensors, 19(20), 4507.CrossRef Mendoza-Silva, G. M., Torres-Sospedra, J., & Huerta, J. (2019). A meta-review of indoor positioning systems. Sensors, 19(20), 4507.CrossRef
go back to reference Mueller, M. W., Hamer, M., & D’Andrea, R., (2015). Fusing ultra-wideband range measurements with accelerometers and rate gyroscopes for quadrocopter state estimation. In 2015 IEEE international conference on robotics and automation (ICRA) (pp. 1730–1736). IEEE. https://doi.org/10.1109/ICRA.2015.7139421 Mueller, M. W., Hamer, M., & D’Andrea, R., (2015). Fusing ultra-wideband range measurements with accelerometers and rate gyroscopes for quadrocopter state estimation. In 2015 IEEE international conference on robotics and automation (ICRA) (pp. 1730–1736). IEEE. https://​doi.​org/​10.​1109/​ICRA.​2015.​7139421
go back to reference Nguyen, T. H., Nguyen, T. M., & Xie, L. (2020). Tightly-coupled single-anchor ultra-wideband-aided monocular visual odometry system. In 2020 IEEE international conference on robotics and automation (ICRA). Nguyen, T. H., Nguyen, T. M., & Xie, L. (2020). Tightly-coupled single-anchor ultra-wideband-aided monocular visual odometry system. In 2020 IEEE international conference on robotics and automation (ICRA).
go back to reference Prorok, A., & Martinoli, A. (2014). Accurate indoor localization with ultra-wideband using spatial models and collaboration. The International Journal of Robotics Research, 33(4), 547–568.CrossRef Prorok, A., & Martinoli, A. (2014). Accurate indoor localization with ultra-wideband using spatial models and collaboration. The International Journal of Robotics Research, 33(4), 547–568.CrossRef
go back to reference Saeedi, S., Trentini, M., Seto, M., & Li, H. (2016). multi robot slam review multiple-robot simultaneous localization and mapping: A review. Journal of Field Robotics, 33(1), 3–46.CrossRef Saeedi, S., Trentini, M., Seto, M., & Li, H. (2016). multi robot slam review multiple-robot simultaneous localization and mapping: A review. Journal of Field Robotics, 33(1), 3–46.CrossRef
go back to reference Shen, J., Jin, C., & Liu, D. (2016). A survey on the research of indoor rfid positioning system. In International conference on cloud computing and security (pp. 264–274). Springer. Shen, J., Jin, C., & Liu, D. (2016). A survey on the research of indoor rfid positioning system. In International conference on cloud computing and security (pp. 264–274). Springer.
go back to reference Shi, Q., Cui, X., Li, W., Xia, Y., & Lu, M., (2018). Visual-UWB navigation system for unknown environments. In International technical meeting of the satellite division of the institute of navigation (ION GNSS+) (p. 11). Shi, Q., Cui, X., Li, W., Xia, Y., & Lu, M., (2018). Visual-UWB navigation system for unknown environments. In International technical meeting of the satellite division of the institute of navigation (ION GNSS+) (p. 11).
go back to reference Uradzinski, M., Guo, H., Liu, X., & Yu, M. (2017). Advanced indoor positioning using zigbee wireless technology. Wireless Personal Communications, 97(4), 6509–6518.CrossRef Uradzinski, M., Guo, H., Liu, X., & Yu, M. (2017). Advanced indoor positioning using zigbee wireless technology. Wireless Personal Communications, 97(4), 6509–6518.CrossRef
go back to reference Wang, C., Zhang, H., Nguyen, T. M., & Xie, L. (2017). Ultra-wideband aided fast localization and mapping system. In: 2017 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp.s 1602–1609). IEEE. Wang, C., Zhang, H., Nguyen, T. M., & Xie, L. (2017). Ultra-wideband aided fast localization and mapping system. In: 2017 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp.s 1602–1609). IEEE.
go back to reference Witkin, A. (1983). Scale-space filtering. In Processing of IJCAI. Witkin, A. (1983). Scale-space filtering. In Processing of IJCAI.
go back to reference Xu, H., Wang, L., Zhang, Y., Qiu, K., & Shen, S. (2020). Decentralized visual-inertial-UWB fusion for relative state estimation of aerial swarm. In 2020 IEEE international conference on robotics and automation (ICRA). Xu, H., Wang, L., Zhang, Y., Qiu, K., & Shen, S. (2020). Decentralized visual-inertial-UWB fusion for relative state estimation of aerial swarm. In 2020 IEEE international conference on robotics and automation (ICRA).
Metadata
Title
VIR-SLAM: visual, inertial, and ranging SLAM for single and multi-robot systems
Authors
Yanjun Cao
Giovanni Beltrame
Publication date
03-07-2021
Publisher
Springer US
Published in
Autonomous Robots / Issue 6/2021
Print ISSN: 0929-5593
Electronic ISSN: 1573-7527
DOI
https://doi.org/10.1007/s10514-021-09992-7

Other articles of this Issue 6/2021

Autonomous Robots 6/2021 Go to the issue