Skip to main content
Top

2018 | OriginalPaper | Chapter

Sparse 3D Point-Cloud Map Upsampling and Noise Removal as a vSLAM Post-Processing Step: Experimental Evaluation

Authors : Andrey Bokovoy, Konstantin Yakovlev

Published in: Interactive Collaborative Robotics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The monocular vision-based simultaneous localization and mapping (vSLAM) is one of the most challenging problem in mobile robotics and computer vision. In this work we study the post-processing techniques applied to sparse 3D point-cloud maps, obtained by feature-based vSLAM algorithms. Map post-processing is split into 2 major steps: (1) noise and outlier removal and (2) upsampling. We evaluate different combinations of known algorithms for outlier removing and upsampling on datasets of real indoor and outdoor environments and identify the most promising combination. We further use it to convert a point-cloud map, obtained by the real UAV performing indoor flight to 3D voxel grid (octo-map) potentially suitable for path planning.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
For the sake of simplicity we assume that the image is grayscale and pixels are real numbers.
 
Literature
1.
go back to reference Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., Leonard, J.: Past, present, and future of simultaneous localization and mapping: towards the robust-perception age. IEEE Trans. Robot. 32(6), 1309–1332 (2016)CrossRef Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., Leonard, J.: Past, present, and future of simultaneous localization and mapping: towards the robust-perception age. IEEE Trans. Robot. 32(6), 1309–1332 (2016)CrossRef
2.
go back to reference Balan, A., Flaks, J., Hodges, S., Isard, M., Williams, O., Barham, P., Izadi, S., Hiliges, O., Molyneaux, D., Kim, D., et al.: Distributed asynchronous localization and mapping for augmented reality, January 13 2015. US Patent 8,933,931 Balan, A., Flaks, J., Hodges, S., Isard, M., Williams, O., Barham, P., Izadi, S., Hiliges, O., Molyneaux, D., Kim, D., et al.: Distributed asynchronous localization and mapping for augmented reality, January 13 2015. US Patent 8,933,931
3.
go back to reference Li, R., Liu, J., Zhang, L., Hang, Y.: LIDAR/MEMS IMU integrated navigation (SLAM) method for a small UAV in indoor environments. In: 2014 DGON Inertial Sensors and Systems Symposium (ISS), pp. 1–15. IEEE (2014) Li, R., Liu, J., Zhang, L., Hang, Y.: LIDAR/MEMS IMU integrated navigation (SLAM) method for a small UAV in indoor environments. In: 2014 DGON Inertial Sensors and Systems Symposium (ISS), pp. 1–15. IEEE (2014)
5.
go back to reference Caballero, F., Merino, L., Ferruz, J., Ollero, A.: Vision-based odometry and SLAM for medium and high altitude flying UAVs. J. Intell. Robot. Syst. 54(1–3), 137–161 (2009)CrossRef Caballero, F., Merino, L., Ferruz, J., Ollero, A.: Vision-based odometry and SLAM for medium and high altitude flying UAVs. J. Intell. Robot. Syst. 54(1–3), 137–161 (2009)CrossRef
6.
go back to reference Sazdovski, V., Silson, P.M.: Inertial navigation aided by vision-based simultaneous localization and mapping. IEEE Sens. J. 11(8), 1646–1656 (2011)CrossRef Sazdovski, V., Silson, P.M.: Inertial navigation aided by vision-based simultaneous localization and mapping. IEEE Sens. J. 11(8), 1646–1656 (2011)CrossRef
7.
go back to reference Vu, Q., Nguyen, V., Solenaya, O., Ronzhin, A., Mehmet, H.: Algorithms for joint operation of service robotic platform and set of UAVs in agriculture tasks. In: 2017 5th IEEE Workshop on Advances in Information, Electronic and Electrical Engineering (AIEEE), pp. 1–6. IEEE (2017) Vu, Q., Nguyen, V., Solenaya, O., Ronzhin, A., Mehmet, H.: Algorithms for joint operation of service robotic platform and set of UAVs in agriculture tasks. In: 2017 5th IEEE Workshop on Advances in Information, Electronic and Electrical Engineering (AIEEE), pp. 1–6. IEEE (2017)
8.
go back to reference Buyval, A., Afanasyev, I., Magid, E.: Comparative analysis of ROS-based monocular SLAM methods for indoor navigation. In: Proceedings of the Ninth International Conference on Machine Vision (ICMV 2016), pp. 10341–10341 (2017). https://doi.org/10.1117/12.2268809 Buyval, A., Afanasyev, I., Magid, E.: Comparative analysis of ROS-based monocular SLAM methods for indoor navigation. In: Proceedings of the Ninth International Conference on Machine Vision (ICMV 2016), pp. 10341–10341 (2017). https://​doi.​org/​10.​1117/​12.​2268809
9.
go back to reference Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: An efficient alternative to SIFT or SURF. In: 2011 IEEE international conference on Computer Vision (ICCV), pp. 2564–2571. IEEE (2011) Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: An efficient alternative to SIFT or SURF. In: 2011 IEEE international conference on Computer Vision (ICCV), pp. 2564–2571. IEEE (2011)
11.
go back to reference Bokovoy, A., Yakovlev, K.: Enhancing semi-dense monocular vSLAM used for multi-rotor UAV navigation in indoor environment by fusing IMU data. In: The 2018 International Conference on Artificial Life and Robotics (ICAROB 2018), pp. 391–394. ALife Robotics Corporation Ltd. (2018) Bokovoy, A., Yakovlev, K.: Enhancing semi-dense monocular vSLAM used for multi-rotor UAV navigation in indoor environment by fusing IMU data. In: The 2018 International Conference on Artificial Life and Robotics (ICAROB 2018), pp. 391–394. ALife Robotics Corporation Ltd. (2018)
12.
go back to reference Newcombe, R.A., Lovegrove, S.J., Davison, A.J.: DTAM: Dense tracking and mapping in real-time. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 2320–2327. IEEE (2011) Newcombe, R.A., Lovegrove, S.J., Davison, A.J.: DTAM: Dense tracking and mapping in real-time. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 2320–2327. IEEE (2011)
13.
go back to reference Tateno, K., Tombari, F., Laina, I., Navab, N.: CNN-SLAM: Real-time dense monocular SLAM with learned depth prediction. arXiv preprint arXiv:1704.03489 (2017) Tateno, K., Tombari, F., Laina, I., Navab, N.: CNN-SLAM: Real-time dense monocular SLAM with learned depth prediction. arXiv preprint arXiv:​1704.​03489 (2017)
14.
go back to reference Makarov, I., Aliev, V., Gerasimova, O.: Semi-dense depth interpolation using deep convolutional neural networks. In: Proceedings of the 2017 ACM on Multimedia Conference, MM 2017, pp. 1407–1415. ACM, New York (2017) Makarov, I., Aliev, V., Gerasimova, O.: Semi-dense depth interpolation using deep convolutional neural networks. In: Proceedings of the 2017 ACM on Multimedia Conference, MM 2017, pp. 1407–1415. ACM, New York (2017)
16.
go back to reference Magid, E., Tsubouchi, T., Koyanagi, E., Yoshida, T.: Building a search tree for a pilot system of a rescue search robot in a discretized random step environment. J. Robot. Mechatron. 23(4), 567 (2011)CrossRef Magid, E., Tsubouchi, T., Koyanagi, E., Yoshida, T.: Building a search tree for a pilot system of a rescue search robot in a discretized random step environment. J. Robot. Mechatron. 23(4), 567 (2011)CrossRef
17.
go back to reference Makarov, I., Polyakov, P.: Smoothing voronoi-based path with minimized length and visibility using composite bezier curves. In: AIST (Supplement), pp. 191–202 (2016) Makarov, I., Polyakov, P.: Smoothing voronoi-based path with minimized length and visibility using composite bezier curves. In: AIST (Supplement), pp. 191–202 (2016)
18.
go back to reference Buyval, A., Gabdulin, A., Mustafin, R., Shimchik, I.: Deriving overtaking strategy from nonlinear model predictive control for a race car. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2017), pp. 2623–2628, September 2017 Buyval, A., Gabdulin, A., Mustafin, R., Shimchik, I.: Deriving overtaking strategy from nonlinear model predictive control for a race car. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2017), pp. 2623–2628, September 2017
19.
go back to reference Mur-Artal, R., Tardós, J.D.: ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras. IEEE Trans. Robot. (2017) Mur-Artal, R., Tardós, J.D.: ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras. IEEE Trans. Robot. (2017)
21.
go back to reference Hornung, A., Wurm, K.M., Bennewitz, M., Stachniss, C., Burgard, W.: OctoMap: an efficient probabilistic 3d mapping framework based on octrees. Autonom. Robots 34(3), 189–206 (2013)CrossRef Hornung, A., Wurm, K.M., Bennewitz, M., Stachniss, C., Burgard, W.: OctoMap: an efficient probabilistic 3d mapping framework based on octrees. Autonom. Robots 34(3), 189–206 (2013)CrossRef
22.
go back to reference Rusu, R.B., Marton, Z.C., Blodow, N., Dolha, M., Beetz, M.: Towards 3D point cloud based object maps for household environments. Robot. Autonom. Syst. 56(11), 927–941 (2008)CrossRef Rusu, R.B., Marton, Z.C., Blodow, N., Dolha, M., Beetz, M.: Towards 3D point cloud based object maps for household environments. Robot. Autonom. Syst. 56(11), 927–941 (2008)CrossRef
23.
go back to reference Reuter, P., Joyot, P., Trunzler, J., Boubekeur, T., Schlick, C.: Surface reconstruction with enriched reproducing kernel particle approximation. In: Eurographics/IEEE VGTC Symposium Proceedings on Point-Based Graphics 2005, pp. 79–87. IEEE (2005) Reuter, P., Joyot, P., Trunzler, J., Boubekeur, T., Schlick, C.: Surface reconstruction with enriched reproducing kernel particle approximation. In: Eurographics/IEEE VGTC Symposium Proceedings on Point-Based Graphics 2005, pp. 79–87. IEEE (2005)
24.
go back to reference Skinner, B., Vidal Calleja, T., Valls Miro, J., De Bruijn, F., Falque, R.: 3D point cloud upsampling for accurate reconstruction of dense 2.5 D thickness maps. In: Australasian Conference on Robotics and Automation (2014) Skinner, B., Vidal Calleja, T., Valls Miro, J., De Bruijn, F., Falque, R.: 3D point cloud upsampling for accurate reconstruction of dense 2.5 D thickness maps. In: Australasian Conference on Robotics and Automation (2014)
25.
go back to reference Rusu, R.B., Cousins, S.: 3D is here: Point cloud library (pcl). In: 2011 IEEE International Conference on Robotics and Automation (ICRA), pp. 1–4. IEEE (2011) Rusu, R.B., Cousins, S.: 3D is here: Point cloud library (pcl). In: 2011 IEEE International Conference on Robotics and Automation (ICRA), pp. 1–4. IEEE (2011)
26.
go back to reference Huitl, R., Schroth, G., Hilsenbeck, S., Schweiger, F., Steinbach, E.: TUMindoor: an extensive image and point cloud dataset for visual indoor localization and mapping. In: 2012 19th IEEE International Conference on Image Processing (ICIP), pp. 1773–1776. IEEE (2012) Huitl, R., Schroth, G., Hilsenbeck, S., Schweiger, F., Steinbach, E.: TUMindoor: an extensive image and point cloud dataset for visual indoor localization and mapping. In: 2012 19th IEEE International Conference on Image Processing (ICIP), pp. 1773–1776. IEEE (2012)
27.
go back to reference Blanco, J.L., Moreno, F.A., Gonzalez, J.: A collection of outdoor robotic datasets with centimeter-accuracy ground truth. Autonom. Robots 27(4), 327 (2009)CrossRef Blanco, J.L., Moreno, F.A., Gonzalez, J.: A collection of outdoor robotic datasets with centimeter-accuracy ground truth. Autonom. Robots 27(4), 327 (2009)CrossRef
28.
go back to reference Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of RGB-D SLAM systems. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 573–580. IEEE (2012) Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of RGB-D SLAM systems. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 573–580. IEEE (2012)
Metadata
Title
Sparse 3D Point-Cloud Map Upsampling and Noise Removal as a vSLAM Post-Processing Step: Experimental Evaluation
Authors
Andrey Bokovoy
Konstantin Yakovlev
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-99582-3_3

Premium Partner