Skip to main content
Erschienen in: Intelligent Service Robotics 2/2020

27.11.2019 | Original Research Paper

Accuracy enhancement for the front-end tracking algorithm of RGB-D SLAM

verfasst von: Fuwen Hu, Jingli Cheng, Yunchang Bao, Yunhua He

Erschienen in: Intelligent Service Robotics | Ausgabe 2/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A robust and accurate simultaneous localization and mapping (SLAM) in working scenarios is an essential competence to perform mobile robotic tasks autonomously. Plenty of research indicates that the extraction of point features from RGB-D data that simultaneously take into account the images and the depth data increases the robustness and precision of the visual odometry method, used either as a self-reliant localization system, or as a front-end in pose-based SLAM. However, due to pure rotation, sudden movements, motion blur, noise and large depth variations, RGB-D SLAM systems often suffer from tracking loss in data association. The front-end tracking process of the ORB-SLAM system requires screening step by step, which is more likely to cause tracking loss. In order to solve the above problems, this work is intended to improve the ORB-SLAM front-end tracking algorithm based on the uniform speed model tracking effective frame and the matching of nearby frame algorithms. Then three datasets selected from TUM datasets with more motion blur are used to further verify the effect of the improved front-end algorithmic architecture. The experimental results suggested that the proposed improved scheme can not only effectively increase the number of tracked frames, but also reduce the amount of computation by about two times under the premise of guaranteeing the path accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lv Q, Lin H, Wang G, Wei H, Wang Y (2017) ORB-SLAM-based tracing and 3D reconstruction for robot using Kinect 2.0. In: Control and decision conference. IEEE, pp 3319–3324 Lv Q, Lin H, Wang G, Wei H, Wang Y (2017) ORB-SLAM-based tracing and 3D reconstruction for robot using Kinect 2.0. In: Control and decision conference. IEEE, pp 3319–3324
2.
Zurück zum Zitat Lenac K, Kitanov A, Cupec R, Petrović I (2017) Fast planar surface 3D SLAM using LIDAR. Robot Auton Syst 92:197–220CrossRef Lenac K, Kitanov A, Cupec R, Petrović I (2017) Fast planar surface 3D SLAM using LIDAR. Robot Auton Syst 92:197–220CrossRef
3.
Zurück zum Zitat Liu L, Guo R, Wu J (2018) A collision-free motion planning method by integrating complexity-reduction SLAM and learning-based artificial force design. Robot Auton Syst 100:132–149CrossRef Liu L, Guo R, Wu J (2018) A collision-free motion planning method by integrating complexity-reduction SLAM and learning-based artificial force design. Robot Auton Syst 100:132–149CrossRef
4.
Zurück zum Zitat Cho H, Kim EK, Kim S (2018) Indoor SLAM application using geometric and ICP matching methods based on line features. Robot Auton Syst 100:206–224CrossRef Cho H, Kim EK, Kim S (2018) Indoor SLAM application using geometric and ICP matching methods based on line features. Robot Auton Syst 100:206–224CrossRef
5.
Zurück zum Zitat Shin DW, Ho YS (2017) Local patch descriptor using deep convolutional generative adversarial network for loop closure detection in SLAM. In: Asia-Pacific signal and information processing association summit and conference, pp 546–549 Shin DW, Ho YS (2017) Local patch descriptor using deep convolutional generative adversarial network for loop closure detection in SLAM. In: Asia-Pacific signal and information processing association summit and conference, pp 546–549
6.
Zurück zum Zitat Mustafa M, Stancu A, Delanoue N, Codres E (2018) Guaranteed SLAM—an interval approach. Robot Auton Syst 100:160–170CrossRef Mustafa M, Stancu A, Delanoue N, Codres E (2018) Guaranteed SLAM—an interval approach. Robot Auton Syst 100:160–170CrossRef
7.
Zurück zum Zitat Pire T, Fischer T, Castro G, Decristóforis P, Civera J, Jacoboberlles J (2017) S-PTAM: stereo parallel tracking and mapping. Robot Auton Syst 93:27–42CrossRef Pire T, Fischer T, Castro G, Decristóforis P, Civera J, Jacoboberlles J (2017) S-PTAM: stereo parallel tracking and mapping. Robot Auton Syst 93:27–42CrossRef
8.
Zurück zum Zitat Younes G, Asmar D, Shammas E, Zelek J (2017) Keyframe-based monocular SLAM: design, survey, and future directions. Robot Auton Syst 98:67–88CrossRef Younes G, Asmar D, Shammas E, Zelek J (2017) Keyframe-based monocular SLAM: design, survey, and future directions. Robot Auton Syst 98:67–88CrossRef
9.
Zurück zum Zitat Evers C, Naylor PA (2017) Optimized self-localization for SLAM in dynamic scenes using probability hypothesis density filters. IEEE Trans Signal Process 99:1MATH Evers C, Naylor PA (2017) Optimized self-localization for SLAM in dynamic scenes using probability hypothesis density filters. IEEE Trans Signal Process 99:1MATH
10.
Zurück zum Zitat Cadena C, Carlone L, Carrillo H, Latif Y, Scaramuzza D, Neira J et al (2016) Past, present, and future of simultaneous localization and mapping: toward the robust-perception age. IEEE Trans Robot 32(6):1309–1332CrossRef Cadena C, Carlone L, Carrillo H, Latif Y, Scaramuzza D, Neira J et al (2016) Past, present, and future of simultaneous localization and mapping: toward the robust-perception age. IEEE Trans Robot 32(6):1309–1332CrossRef
11.
Zurück zum Zitat Cheeseman P, Smith R, Self M (1987) A stochastic map for uncertain spatial relationships. In: 4th international symposium on robotic research, pp 467–474 Cheeseman P, Smith R, Self M (1987) A stochastic map for uncertain spatial relationships. In: 4th international symposium on robotic research, pp 467–474
12.
Zurück zum Zitat Frese U (2006) A discussion of simultaneous localization and mapping. Auton Robots 20(1):25–42CrossRef Frese U (2006) A discussion of simultaneous localization and mapping. Auton Robots 20(1):25–42CrossRef
13.
Zurück zum Zitat Spero DJ, Jarvis RA (2007) A review of robotic SLAM, Monash University, Technical Report, MECSE-4-2007 Spero DJ, Jarvis RA (2007) A review of robotic SLAM, Monash University, Technical Report, MECSE-4-2007
14.
Zurück zum Zitat Thrun S, Fox D, Burgard W, Dellaert F (2001) Robust Monte Carlo localization for mobile robots. Artif Intell 128(1–2):99–141CrossRef Thrun S, Fox D, Burgard W, Dellaert F (2001) Robust Monte Carlo localization for mobile robots. Artif Intell 128(1–2):99–141CrossRef
15.
Zurück zum Zitat Montemerlo M, Thrun S, Koller D, Wegbreit B (2002) FastSLAM: a factored solution to the simultaneous localization and mapping problem. In: Aaai/iaai, pp 593–598 Montemerlo M, Thrun S, Koller D, Wegbreit B (2002) FastSLAM: a factored solution to the simultaneous localization and mapping problem. In: Aaai/iaai, pp 593–598
16.
Zurück zum Zitat Montemerlo M, Thrun S, Koller D, Wegbreit B (2003) FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges. In: IJCAI, pp 1151–1156 Montemerlo M, Thrun S, Koller D, Wegbreit B (2003) FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges. In: IJCAI, pp 1151–1156
17.
Zurück zum Zitat Davison AJ (2003) Real-time simultaneous localisation and mapping with a single camera. In: ICCV. IEEE, p 1403 Davison AJ (2003) Real-time simultaneous localisation and mapping with a single camera. In: ICCV. IEEE, p 1403
18.
Zurück zum Zitat Clemente L, Davison A, Reid I, Neira J, Tardós J (2007) Mapping large loops with a single hand-held camera. In: Proceedings of robotics sciences & systems, pp 297–304 Clemente L, Davison A, Reid I, Neira J, Tardós J (2007) Mapping large loops with a single hand-held camera. In: Proceedings of robotics sciences & systems, pp 297–304
19.
Zurück zum Zitat Karlsson N, Bernardo ED, Ostrowski JP, Goncalves L, Pirjanian P, Munich ME (2006) The vSLAM algorithm for robust localization and mapping. In: IEEE international conference on robotics & automation. IEEE Karlsson N, Bernardo ED, Ostrowski JP, Goncalves L, Pirjanian P, Munich ME (2006) The vSLAM algorithm for robust localization and mapping. In: IEEE international conference on robotics & automation. IEEE
20.
Zurück zum Zitat Klein G (2007) Parallel tracking and mapping for small AR workspaces. In: Proceedings of sixth IEEE and ACM international symposium on mixed and augmented reality (ISMAR 2007). IEEE, Nara, Japan Klein G (2007) Parallel tracking and mapping for small AR workspaces. In: Proceedings of sixth IEEE and ACM international symposium on mixed and augmented reality (ISMAR 2007). IEEE, Nara, Japan
21.
Zurück zum Zitat Engel J, Schöps T, Cremers D (2014) LSD-SLAM: large-scale direct monocular SLAM. In: European conference on computer vision. Springer, Cham Engel J, Schöps T, Cremers D (2014) LSD-SLAM: large-scale direct monocular SLAM. In: European conference on computer vision. Springer, Cham
22.
Zurück zum Zitat Engel J, Sturm J, Cremers D (2013) Semi-dense visual odometry for a monocular camera. In: 2013 IEEE international conference on computer vision (ICCV). IEEE Computer Society Engel J, Sturm J, Cremers D (2013) Semi-dense visual odometry for a monocular camera. In: 2013 IEEE international conference on computer vision (ICCV). IEEE Computer Society
23.
Zurück zum Zitat Forster C, Pizzoli M, Scaramuzza D (2014) SVO: fast semi-direct monocular visual odometry. In: IEEE international conference on robotics and automation (ICRA). IEEE, Hong Kong Forster C, Pizzoli M, Scaramuzza D (2014) SVO: fast semi-direct monocular visual odometry. In: IEEE international conference on robotics and automation (ICRA). IEEE, Hong Kong
24.
Zurück zum Zitat Engel J, Koltun V, Cremers D (2017) Direct sparse odometry. IEEE Trans Pattern Anal Mach Intell 40(3):611–625CrossRef Engel J, Koltun V, Cremers D (2017) Direct sparse odometry. IEEE Trans Pattern Anal Mach Intell 40(3):611–625CrossRef
25.
Zurück zum Zitat Labbé M, Michaud F (2014) Online global loop closure detection for large-scale multi-session graph-based SLAM. In: 2014 IEEE/RSJ international conference on intelligent robots and systems. IEEE Labbé M, Michaud F (2014) Online global loop closure detection for large-scale multi-session graph-based SLAM. In: 2014 IEEE/RSJ international conference on intelligent robots and systems. IEEE
26.
Zurück zum Zitat Newcombe RA, Lovegrove SJ, Davison AJ (2011) DTAM: dense tracking and mapping in real-time. In: IEEE international conference on computer vision, ICCV 2011. IEEE, Barcelona, Spain, November 6–13 Newcombe RA, Lovegrove SJ, Davison AJ (2011) DTAM: dense tracking and mapping in real-time. In: IEEE international conference on computer vision, ICCV 2011. IEEE, Barcelona, Spain, November 6–13
27.
Zurück zum Zitat Mur-Artal R, Tardos JD (2017) ORB-SLAM2: an open-source slam system for monocular, stereo, and RGB-D cameras. IEEE Trans Robot 33:1–8CrossRef Mur-Artal R, Tardos JD (2017) ORB-SLAM2: an open-source slam system for monocular, stereo, and RGB-D cameras. IEEE Trans Robot 33:1–8CrossRef
28.
Zurück zum Zitat Mohanty V, Agrawal S, Datta S, Ghosh A, Sharma VD, Chakravarty D (2016) Deepvo: a deep learning approach for monocular visual odometry Mohanty V, Agrawal S, Datta S, Ghosh A, Sharma VD, Chakravarty D (2016) Deepvo: a deep learning approach for monocular visual odometry
29.
Zurück zum Zitat Yousif K, Bab-Hadiashar A, Hoseinnezhad R (2015) An overview to visual odometry and visual SLAM: applications to mobile robotics. Intell Ind Syst 1(4):289–311CrossRef Yousif K, Bab-Hadiashar A, Hoseinnezhad R (2015) An overview to visual odometry and visual SLAM: applications to mobile robotics. Intell Ind Syst 1(4):289–311CrossRef
30.
Zurück zum Zitat Gálvez-López D, Tardos JD (2012) Bags of binary words for fast place recognition in image sequences. IEEE Trans Robot 28(5):1188–1197CrossRef Gálvez-López D, Tardos JD (2012) Bags of binary words for fast place recognition in image sequences. IEEE Trans Robot 28(5):1188–1197CrossRef
31.
Zurück zum Zitat Chai Z, Matsumaru T (2017) ORB-SHOT SLAM: trajectory correction by 3D loop closing based on bag-of-visual-words (BoVW) model for RGB-D visual SLAM. J Robot Mechatron 29(2):365–380CrossRef Chai Z, Matsumaru T (2017) ORB-SHOT SLAM: trajectory correction by 3D loop closing based on bag-of-visual-words (BoVW) model for RGB-D visual SLAM. J Robot Mechatron 29(2):365–380CrossRef
32.
Zurück zum Zitat Sturm J, Engelhard N, Endres F, Burgard W, Cremers D (2012) A benchmark for the evaluation of RGB-D SLAM systems. In: 2012 IEEE/RSJ international conference on intelligent robots and systems. IEEE Sturm J, Engelhard N, Endres F, Burgard W, Cremers D (2012) A benchmark for the evaluation of RGB-D SLAM systems. In: 2012 IEEE/RSJ international conference on intelligent robots and systems. IEEE
33.
Zurück zum Zitat Zhao X, Min H, Xu Z, Wu X, Li X, Sun P (2018) Image antiblurring and statistic filter of feature space displacement: application to visual odometry for outdoor ground vehicle. J Sens 2018:14 Zhao X, Min H, Xu Z, Wu X, Li X, Sun P (2018) Image antiblurring and statistic filter of feature space displacement: application to visual odometry for outdoor ground vehicle. J Sens 2018:14
34.
Zurück zum Zitat Mustaniemi J, Kannala J, Särkkä S, Matas J, Heikkilä J (2018) Fast motion deblurring for feature detection and matching using inertial measurements. In: 2018 24th international conference on pattern recognition (ICPR). IEEE, pp 3068–3073 Mustaniemi J, Kannala J, Särkkä S, Matas J, Heikkilä J (2018) Fast motion deblurring for feature detection and matching using inertial measurements. In: 2018 24th international conference on pattern recognition (ICPR). IEEE, pp 3068–3073
35.
Zurück zum Zitat Russo LO, Farulla GA, Indaco M, Rosa S, Rolfo D, Bona B (2013) Blurring prediction in monocular SLAM. In: 2013 8th IEEE design and test symposium. IEEE, pp 1–6 Russo LO, Farulla GA, Indaco M, Rosa S, Rolfo D, Bona B (2013) Blurring prediction in monocular SLAM. In: 2013 8th IEEE design and test symposium. IEEE, pp 1–6
36.
Zurück zum Zitat Atashgah MA, Malaek SMB (2013) Prediction of aerial-image motion blurs due to the flying vehicle dynamics and camera characteristics in a virtual environment. Proc Inst Mech Eng Part G J Aerosp Eng 227(7):1055–1067CrossRef Atashgah MA, Malaek SMB (2013) Prediction of aerial-image motion blurs due to the flying vehicle dynamics and camera characteristics in a virtual environment. Proc Inst Mech Eng Part G J Aerosp Eng 227(7):1055–1067CrossRef
37.
Zurück zum Zitat Amiri Atashgah MA, Malaek SMB (2011) A simulation environment for path and image generation in an aerial single-camera vision system. Proc Inst Mech Eng Part G J Aerosp Eng 225(5):541–558 Amiri Atashgah MA, Malaek SMB (2011) A simulation environment for path and image generation in an aerial single-camera vision system. Proc Inst Mech Eng Part G J Aerosp Eng 225(5):541–558
38.
Zurück zum Zitat Atashgah MA, Gholampour P, Malaek SMB (2014) Integration of image de-blurring in an aerial Mono-SLAM. Proc Inst Mech Eng Part G J Aerosp Eng 228(8):1348–1362CrossRef Atashgah MA, Gholampour P, Malaek SMB (2014) Integration of image de-blurring in an aerial Mono-SLAM. Proc Inst Mech Eng Part G J Aerosp Eng 228(8):1348–1362CrossRef
Metadaten
Titel
Accuracy enhancement for the front-end tracking algorithm of RGB-D SLAM
verfasst von
Fuwen Hu
Jingli Cheng
Yunchang Bao
Yunhua He
Publikationsdatum
27.11.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Intelligent Service Robotics / Ausgabe 2/2020
Print ISSN: 1861-2776
Elektronische ISSN: 1861-2784
DOI
https://doi.org/10.1007/s11370-019-00299-2

Weitere Artikel der Ausgabe 2/2020

Intelligent Service Robotics 2/2020 Zur Ausgabe

Neuer Inhalt