Skip to main content
Top
Published in: Intelligent Service Robotics 1/2022

29-11-2021 | Original Research Paper

An improved multi-object classification algorithm for visual SLAM under dynamic environment

Authors: Shuhuan Wen, Xin Liu, Zhe Wang, Hong Zhang, Zhishang Zhang, Wenbo Tian

Published in: Intelligent Service Robotics | Issue 1/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, a novel dynamic multi-object classification method is proposed based on real-time localization of a robot equipped with a vision sensor that captures a sparse three-dimensional environment. Specifically, we build upon ORB-SLAM2 and improve its formulation to better handle moving objects in a dynamic environment. We propose a feature classification algorithm for ORB (oriented FAST and rotated BRIEF) features in complex environments. Based on inter-frame texture constraints, we add the reprojection error algorithm, which can reduce the influence of illumination and dynamic objects on the simultaneous localization and mapping (SLAM) algorithm. We then propose a new dynamic initialization strategy and apply the proposed feature classification algorithm to the ORB-SLAM2 tracking thread. For real-world implementations, we focus on the robustness and real-time performance of dynamic target segmentation simultaneously, which cannot be satisfied by existing geometric segmentation and semantic segmentation methods. From an engineering point of view, the proposed work can quickly separate dynamic feature points based on traditional methods, which makes the proposed algorithm has better real time in practical applications. We thoroughly evaluate our approach on the TUM and KITTI benchmark database and on a real environment using the Turtlebot platform equipped with a Bumblebee camera. The experimental results indicate that the proposed method is more robust and accurate than current state-of-the-art methods in different environments.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Zhang G, Tang W, Zeng J, Xu J, Yao E (2014) A survey of multi-robot cslam considering communication conditions. Zidonghua Xuebao/acta Automatica Sinica 40(010):2073–2088 Zhang G, Tang W, Zeng J, Xu J, Yao E (2014) A survey of multi-robot cslam considering communication conditions. Zidonghua Xuebao/acta Automatica Sinica 40(010):2073–2088
2.
go back to reference Wen S, Hu X, Ma J, Sun F, Fang B (2019) Autonomous robot navigation using retinex algorithm for multiscale image adaptability in low-light environment. Intell Serv Robot 12:359–369CrossRef Wen S, Hu X, Ma J, Sun F, Fang B (2019) Autonomous robot navigation using retinex algorithm for multiscale image adaptability in low-light environment. Intell Serv Robot 12:359–369CrossRef
3.
go back to reference Lu Z, Hu Z, Uchimura K (2009) SLAM Estimation in Dynamic Outdoor Environments: A Review, In: Intelligent robotics and applications, Berlin, Heidelberg, pp. 255–267 Lu Z, Hu Z, Uchimura K (2009) SLAM Estimation in Dynamic Outdoor Environments: A Review, In: Intelligent robotics and applications, Berlin, Heidelberg, pp. 255–267
4.
go back to reference Tian G, Liu L, Ri J, Liu Y, Sun Y (2019) Object Fusion : An object detection and segmentation framework with RGB-D SLAM and convolutional neural networks. Neurocomputing 345:3–14CrossRef Tian G, Liu L, Ri J, Liu Y, Sun Y (2019) Object Fusion : An object detection and segmentation framework with RGB-D SLAM and convolutional neural networks. Neurocomputing 345:3–14CrossRef
6.
go back to reference Engel J, Schöps T, Cremers D (2014) LSD-SLAM: Large-Scale Direct Monocular SLAM, In: European Conference on Computer Vision (ECCV), pp. 834–849 Engel J, Schöps T, Cremers D (2014) LSD-SLAM: Large-Scale Direct Monocular SLAM, In: European Conference on Computer Vision (ECCV), pp. 834–849
13.
go back to reference Xiao L, Wang J, Qiu X, Rong Z, Zou X (2019) Dynamic-SLAM: semantic monocular visual localization and mapping based on deep learning in dynamic environment. Robot Auton Sys 117:1–16CrossRef Xiao L, Wang J, Qiu X, Rong Z, Zou X (2019) Dynamic-SLAM: semantic monocular visual localization and mapping based on deep learning in dynamic environment. Robot Auton Sys 117:1–16CrossRef
30.
go back to reference Wen S, Li P, Zhao Y, Zhang H, Sun F, Wang Z (2021) Semantic visual SLAM in dynamic environment. Autonomous Robots 45:493-504CrossRef Wen S, Li P, Zhao Y, Zhang H, Sun F, Wang Z (2021) Semantic visual SLAM in dynamic environment. Autonomous Robots 45:493-504CrossRef
35.
go back to reference Hassanpour H, Sedighi M, Manashty AR (2011) Video Frame’s Background modeling: reviewing the techniques. J Signal Infor Process 2(2):72–78 Hassanpour H, Sedighi M, Manashty AR (2011) Video Frame’s Background modeling: reviewing the techniques. J Signal Infor Process 2(2):72–78
36.
go back to reference Yang G, Chen K, Zhou M, Xu Z, Chen Y (2007) Study on statistics iterative thresholding segmentation based on aviation image, In: Eighth ACIS International conference on software engineering, Artificial intelligence, Networking, and Parallel/Distributed computing (SNPD 2007), Vol. 2, , pp. 187–188. https://doi.org/10.1109/SNPD.2007.512 Yang G, Chen K, Zhou M, Xu Z, Chen Y (2007) Study on statistics iterative thresholding segmentation based on aviation image, In: Eighth ACIS International conference on software engineering, Artificial intelligence, Networking, and Parallel/Distributed computing (SNPD 2007), Vol. 2, , pp. 187–188. https://​doi.​org/​10.​1109/​SNPD.​2007.​512
37.
go back to reference Hartley R. I, Zisserman A (2004) Multiple View Geometry in Computer Vision, 2nd Edition, Cambridge University Press, ISBN: 0521540518, Hartley R. I, Zisserman A (2004) Multiple View Geometry in Computer Vision, 2nd Edition, Cambridge University Press, ISBN: 0521540518,
Metadata
Title
An improved multi-object classification algorithm for visual SLAM under dynamic environment
Authors
Shuhuan Wen
Xin Liu
Zhe Wang
Hong Zhang
Zhishang Zhang
Wenbo Tian
Publication date
29-11-2021
Publisher
Springer Berlin Heidelberg
Published in
Intelligent Service Robotics / Issue 1/2022
Print ISSN: 1861-2776
Electronic ISSN: 1861-2784
DOI
https://doi.org/10.1007/s11370-021-00400-8

Other articles of this Issue 1/2022

Intelligent Service Robotics 1/2022 Go to the issue