Skip to main content
Erschienen in: Autonomous Robots 6/2021

03.07.2021

VIR-SLAM: visual, inertial, and ranging SLAM for single and multi-robot systems

verfasst von: Yanjun Cao, Giovanni Beltrame

Erschienen in: Autonomous Robots | Ausgabe 6/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Monocular cameras coupled with inertial measurements generally give high performance visual inertial odometry. However, drift can be significant with long trajectories, especially when the environment is visually challenging. In this paper, we propose a system that leverages Ultra–WideBand (UWB) ranging with one static anchor placed in the environment to correct the accumulated error whenever the anchor is visible. We also use this setup for collaborative SLAM: different robots use mutual ranging (when available) and the common anchor to estimate the transformation between each other, facilitating map fusion. Our system consists of two modules: a double layer ranging, visual, and inertial odometry for single robots, and a transformation estimation module for collaborative SLAM. We test our system on public datasets by simulating UWB measurements as well as on real robots in different environments. Experiments validate our system and show our method can outperform pure visual-inertial odometry by more than 20%, and in visually challenging environments, our method works even when the visual-inertial pipeline has significant drift. Furthermore, we can compute the inter-robot transformation matrices for collaborative SLAM at almost no extra computation cost.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Barral, V., Suárez-Casal, P., Escudero, C., & García-Naya, J. (2016). Assessment of uwb ranging bias in multipath environments. In Proceedings of the international conference on indoor positioning and indoor navigation (IPIN), Alcala de Henares, Spain (pp. 4–7). Barral, V., Suárez-Casal, P., Escudero, C., & García-Naya, J. (2016). Assessment of uwb ranging bias in multipath environments. In Proceedings of the international conference on indoor positioning and indoor navigation (IPIN), Alcala de Henares, Spain (pp. 4–7).
Zurück zum Zitat Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., et al. (2016). Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age. IEEE Transactions on Robotics, 32(6), 1309–1332.CrossRef Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., et al. (2016). Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age. IEEE Transactions on Robotics, 32(6), 1309–1332.CrossRef
Zurück zum Zitat Cao, Y., Yang, C., Li, R., Knoll, A., & Beltrame, G. (2020). Accurate position tracking with a single UWB anchor. In 2020 IEEE international conference on robotics and automation (ICRA). Cao, Y., Yang, C., Li, R., Knoll, A., & Beltrame, G. (2020). Accurate position tracking with a single UWB anchor. In 2020 IEEE international conference on robotics and automation (ICRA).
Zurück zum Zitat Choudhary, S., Carlone, L., Nieto, C., Rogers, J., Christensen, H. I., & Dellaert, F. (2017). Distributed mapping with privacy and communication constraints: Lightweight algorithms and object-based models. The International Journal of Robotics Research, 36(12), 1286–1311.CrossRef Choudhary, S., Carlone, L., Nieto, C., Rogers, J., Christensen, H. I., & Dellaert, F. (2017). Distributed mapping with privacy and communication constraints: Lightweight algorithms and object-based models. The International Journal of Robotics Research, 36(12), 1286–1311.CrossRef
Zurück zum Zitat Cominelli, M., Patras, P., & Gringoli, F., (2019). Dead on arrival: An empirical study of the bluetooth 5.1 positioning system. In Proceedings of the 13th international workshop on wireless network testbeds, experimental evaluation & characterization—WiNTECH ’19 (pp. 13–20). ACM Press. https://doi.org/10.1145/3349623.3355475. Cominelli, M., Patras, P., & Gringoli, F., (2019). Dead on arrival: An empirical study of the bluetooth 5.1 positioning system. In Proceedings of the 13th international workshop on wireless network testbeds, experimental evaluation & characterization—WiNTECH ’19 (pp. 13–20). ACM Press. https://​doi.​org/​10.​1145/​3349623.​3355475.
Zurück zum Zitat Dellaert, F., & Kaess, M. (2006). Square root SAM: Simultaneous localization and mapping via square root information smoothing. The International Journal of Robotics Research, 25(12), 1181–1203.CrossRef Dellaert, F., & Kaess, M. (2006). Square root SAM: Simultaneous localization and mapping via square root information smoothing. The International Journal of Robotics Research, 25(12), 1181–1203.CrossRef
Zurück zum Zitat Delmerico, J., & Scaramuzza, D., (2018), A benchmark comparison of monocular visual-inertial odometry algorithms for flying robots. In: 2018 IEEE international conference on robotics and automation (ICRA) (pp. 2502–2509). IEEE. Delmerico, J., & Scaramuzza, D., (2018), A benchmark comparison of monocular visual-inertial odometry algorithms for flying robots. In: 2018 IEEE international conference on robotics and automation (ICRA) (pp. 2502–2509). IEEE.
Zurück zum Zitat Durrant-Whyte, H., & Bailey, T. (2006). SLAM review simultaneous localization and mapping: Part I. IEEE Robotics & Automation Magazine, 13(2), 99–110.CrossRef Durrant-Whyte, H., & Bailey, T. (2006). SLAM review simultaneous localization and mapping: Part I. IEEE Robotics & Automation Magazine, 13(2), 99–110.CrossRef
Zurück zum Zitat Engel, J., Koltun, V., & Cremers, D. (2017). Direct sparse odometry. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(3), 611–625.CrossRef Engel, J., Koltun, V., & Cremers, D. (2017). Direct sparse odometry. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(3), 611–625.CrossRef
Zurück zum Zitat Fang, X., Wang, C., Nguyen, T. M., & Xie, L. (2018). Graph optimization approach to localization with range measurements. arXiv:1802.10276 [cs]. Fang, X., Wang, C., Nguyen, T. M., & Xie, L. (2018). Graph optimization approach to localization with range measurements. arXiv:​1802.​10276 [cs].
Zurück zum Zitat Goldsmith, A. (2005). Wireless communications. Cambridge University Press. Goldsmith, A. (2005). Wireless communications. Cambridge University Press.
Zurück zum Zitat González, J., Blanco, J. L., Galindo, C., Ortiz-de Galisteo, A., Fernández-Madrigal, J. A., Moreno, F. A., et al. (2009). Mobile robot localization based on ultra-wide-band ranging: A particle filter approach. Robotics and Autonomous Systems, 57(5), 496–507.CrossRef González, J., Blanco, J. L., Galindo, C., Ortiz-de Galisteo, A., Fernández-Madrigal, J. A., Moreno, F. A., et al. (2009). Mobile robot localization based on ultra-wide-band ranging: A particle filter approach. Robotics and Autonomous Systems, 57(5), 496–507.CrossRef
Zurück zum Zitat Khalajmehrabadi, A., Gatsis, N., & Akopian, D. (2017). Modern wlan fingerprinting indoor positioning methods and deployment challenges. IEEE Communications Surveys & Tutorials, 19(3), 1974–2002.CrossRef Khalajmehrabadi, A., Gatsis, N., & Akopian, D. (2017). Modern wlan fingerprinting indoor positioning methods and deployment challenges. IEEE Communications Surveys & Tutorials, 19(3), 1974–2002.CrossRef
Zurück zum Zitat Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015). Keyframe-based visual-inertial odometry using nonlinear optimization. The International Journal of Robotics Research, 34(3), 314–334.CrossRef Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015). Keyframe-based visual-inertial odometry using nonlinear optimization. The International Journal of Robotics Research, 34(3), 314–334.CrossRef
Zurück zum Zitat Lohan, E. S., Talvitie, J., e Silva, P. F., Nurminen, H., Ali-Löytty, S., & Piché, R. (2015). Received signal strength models for wlan and ble-based indoor positioning in multi-floor buildings. In 2015 international conference on localization and GNSS (ICL-GNSS) (pp. 1–6). IEEE. Lohan, E. S., Talvitie, J., e Silva, P. F., Nurminen, H., Ali-Löytty, S., & Piché, R. (2015). Received signal strength models for wlan and ble-based indoor positioning in multi-floor buildings. In 2015 international conference on localization and GNSS (ICL-GNSS) (pp. 1–6). IEEE.
Zurück zum Zitat Mai, V., Kamel, M., Krebs, M., Schaffner, A., Meier, D., Paull, L., et al. (2018). Local positioning system using UWB range measurements for an unmanned blimp. IEEE Robotics and Automation Letters, 3(4), 2971–2978.CrossRef Mai, V., Kamel, M., Krebs, M., Schaffner, A., Meier, D., Paull, L., et al. (2018). Local positioning system using UWB range measurements for an unmanned blimp. IEEE Robotics and Automation Letters, 3(4), 2971–2978.CrossRef
Zurück zum Zitat Mangelson, J. G., Dominic, D., Eustice, R. M., & Vasudevan, R. (2018). Pairwise consistent measurement set maximization for robust multi-robot map merging. In 2018 IEEE international conference on robotics and automation (ICRA) (pp. 2916–2923). IEEE. Mangelson, J. G., Dominic, D., Eustice, R. M., & Vasudevan, R. (2018). Pairwise consistent measurement set maximization for robust multi-robot map merging. In 2018 IEEE international conference on robotics and automation (ICRA) (pp. 2916–2923). IEEE.
Zurück zum Zitat Martel, F. M., Sidorenko, J., Bodensteiner, C., Arens, M., & Hugentobler, U. (2019). Unique 4-DOF relative pose estimation with six distances for UWB/V-SLAM-based devices. Sensors, 19(20), 4366.CrossRef Martel, F. M., Sidorenko, J., Bodensteiner, C., Arens, M., & Hugentobler, U. (2019). Unique 4-DOF relative pose estimation with six distances for UWB/V-SLAM-based devices. Sensors, 19(20), 4366.CrossRef
Zurück zum Zitat Mendoza-Silva, G. M., Torres-Sospedra, J., & Huerta, J. (2019). A meta-review of indoor positioning systems. Sensors, 19(20), 4507.CrossRef Mendoza-Silva, G. M., Torres-Sospedra, J., & Huerta, J. (2019). A meta-review of indoor positioning systems. Sensors, 19(20), 4507.CrossRef
Zurück zum Zitat Mueller, M. W., Hamer, M., & D’Andrea, R., (2015). Fusing ultra-wideband range measurements with accelerometers and rate gyroscopes for quadrocopter state estimation. In 2015 IEEE international conference on robotics and automation (ICRA) (pp. 1730–1736). IEEE. https://doi.org/10.1109/ICRA.2015.7139421 Mueller, M. W., Hamer, M., & D’Andrea, R., (2015). Fusing ultra-wideband range measurements with accelerometers and rate gyroscopes for quadrocopter state estimation. In 2015 IEEE international conference on robotics and automation (ICRA) (pp. 1730–1736). IEEE. https://​doi.​org/​10.​1109/​ICRA.​2015.​7139421
Zurück zum Zitat Nguyen, T. H., Nguyen, T. M., & Xie, L. (2020). Tightly-coupled single-anchor ultra-wideband-aided monocular visual odometry system. In 2020 IEEE international conference on robotics and automation (ICRA). Nguyen, T. H., Nguyen, T. M., & Xie, L. (2020). Tightly-coupled single-anchor ultra-wideband-aided monocular visual odometry system. In 2020 IEEE international conference on robotics and automation (ICRA).
Zurück zum Zitat Prorok, A., & Martinoli, A. (2014). Accurate indoor localization with ultra-wideband using spatial models and collaboration. The International Journal of Robotics Research, 33(4), 547–568.CrossRef Prorok, A., & Martinoli, A. (2014). Accurate indoor localization with ultra-wideband using spatial models and collaboration. The International Journal of Robotics Research, 33(4), 547–568.CrossRef
Zurück zum Zitat Saeedi, S., Trentini, M., Seto, M., & Li, H. (2016). multi robot slam review multiple-robot simultaneous localization and mapping: A review. Journal of Field Robotics, 33(1), 3–46.CrossRef Saeedi, S., Trentini, M., Seto, M., & Li, H. (2016). multi robot slam review multiple-robot simultaneous localization and mapping: A review. Journal of Field Robotics, 33(1), 3–46.CrossRef
Zurück zum Zitat Shen, J., Jin, C., & Liu, D. (2016). A survey on the research of indoor rfid positioning system. In International conference on cloud computing and security (pp. 264–274). Springer. Shen, J., Jin, C., & Liu, D. (2016). A survey on the research of indoor rfid positioning system. In International conference on cloud computing and security (pp. 264–274). Springer.
Zurück zum Zitat Shi, Q., Cui, X., Li, W., Xia, Y., & Lu, M., (2018). Visual-UWB navigation system for unknown environments. In International technical meeting of the satellite division of the institute of navigation (ION GNSS+) (p. 11). Shi, Q., Cui, X., Li, W., Xia, Y., & Lu, M., (2018). Visual-UWB navigation system for unknown environments. In International technical meeting of the satellite division of the institute of navigation (ION GNSS+) (p. 11).
Zurück zum Zitat Uradzinski, M., Guo, H., Liu, X., & Yu, M. (2017). Advanced indoor positioning using zigbee wireless technology. Wireless Personal Communications, 97(4), 6509–6518.CrossRef Uradzinski, M., Guo, H., Liu, X., & Yu, M. (2017). Advanced indoor positioning using zigbee wireless technology. Wireless Personal Communications, 97(4), 6509–6518.CrossRef
Zurück zum Zitat Wang, C., Zhang, H., Nguyen, T. M., & Xie, L. (2017). Ultra-wideband aided fast localization and mapping system. In: 2017 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp.s 1602–1609). IEEE. Wang, C., Zhang, H., Nguyen, T. M., & Xie, L. (2017). Ultra-wideband aided fast localization and mapping system. In: 2017 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp.s 1602–1609). IEEE.
Zurück zum Zitat Witkin, A. (1983). Scale-space filtering. In Processing of IJCAI. Witkin, A. (1983). Scale-space filtering. In Processing of IJCAI.
Zurück zum Zitat Xu, H., Wang, L., Zhang, Y., Qiu, K., & Shen, S. (2020). Decentralized visual-inertial-UWB fusion for relative state estimation of aerial swarm. In 2020 IEEE international conference on robotics and automation (ICRA). Xu, H., Wang, L., Zhang, Y., Qiu, K., & Shen, S. (2020). Decentralized visual-inertial-UWB fusion for relative state estimation of aerial swarm. In 2020 IEEE international conference on robotics and automation (ICRA).
Metadaten
Titel
VIR-SLAM: visual, inertial, and ranging SLAM for single and multi-robot systems
verfasst von
Yanjun Cao
Giovanni Beltrame
Publikationsdatum
03.07.2021
Verlag
Springer US
Erschienen in
Autonomous Robots / Ausgabe 6/2021
Print ISSN: 0929-5593
Elektronische ISSN: 1573-7527
DOI
https://doi.org/10.1007/s10514-021-09992-7

Weitere Artikel der Ausgabe 6/2021

Autonomous Robots 6/2021 Zur Ausgabe

Neuer Inhalt