Skip to main content
Top

2016 | OriginalPaper | Chapter

GPU-Services: GPU Based Real-Time Processing of 3D Point Clouds Applied to Robotic Systems and Intelligent Vehicles

Authors : Leonardo Christino, Fernando Osório

Published in: Robotics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The GPU-Services project fits into the context of research and development of methods for data processing of three-dimensional sensors data applied to mobile robotics and intelligent vehicles. The implemented methods are called services on this project, which provide 3D point clouds pre-processing algorithms, such as, data alignment, segmentation of safe/unsafe navigable zones (e.g. separating ground from obstacles and borders/curbs) and elements of interest detection. Due to the large amount of data provided by the sensors to be processed in a very short time, these services use the GPU (NVidia CUDA) to perform partial or complete parallel processing of these data. The project aims to provide data processing services to an autonomous car, forcing the services to approach real-time processing, which is defined as completing all data processing routines before the arrival of the sensor’s next frame. This work was implemented considering 3D data acquired from a LIDAR, more specifically from a Velodyne HDL-32. The sensor data is structured in the form of a cloud of three-dimensional points, allowing for great parallel processing. However, the major challenge is the high rate of data received from this sensor (around 700,000 points/sec or 70.000 points/frame at 10 Hz), which gives the motivation of this project: to use the full potential of sensor and to efficiently use the parallelism of GPU programming. The GPU services are divided into four steps: The first step is an intelligent extraction, reorganization and spacial correction of the data provided by the Velodyne multi-layer laser sensor; The second stage is the segmentation of planar data; The third stage is object segmentation; The fourth stage is to develop a methodology that unite the results from the previous steps in order to better detect the curbs. The services were implemented and the performance was evaluated using traditional sequential data processing (CPU data processing) and parallel data processing (GPU CUDA implementations). Besides that, different NVidia GPUs were also tested, allowing us to process the acquired data much faster than using the CPUs, and in some cases faster than it was provided by the Velodyne sensor.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Birant, D., Kut, A.: ST-DBSCAN: an algorithm for clustering spatial-temporal data. Data Knowl. Eng. 60, 208–221 (2007)CrossRef Birant, D., Kut, A.: ST-DBSCAN: an algorithm for clustering spatial-temporal data. Data Knowl. Eng. 60, 208–221 (2007)CrossRef
2.
go back to reference Buehler, M., Iagnemma, K., Singh, S.: The DARPA Urban Challenge: Autonomous Vehicles in City Traffic. Springer, Berlin (2009)CrossRef Buehler, M., Iagnemma, K., Singh, S.: The DARPA Urban Challenge: Autonomous Vehicles in City Traffic. Springer, Berlin (2009)CrossRef
3.
go back to reference Dias, S., Bora, K., Gomes, A.: CUDA-based triangulations of convolution molecular surfaces. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010, pp. 531–540. ACM, New York (2010). http://doi.acm.org/10.1145/1851476.1851553. ISBN: 978-1-60558-942-8 Dias, S., Bora, K., Gomes, A.: CUDA-based triangulations of convolution molecular surfaces. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010, pp. 531–540. ACM, New York (2010). http://​doi.​acm.​org/​10.​1145/​1851476.​1851553. ISBN: 978-1-60558-942-8
4.
go back to reference Fenton, R.E., Cosgriff, R.L., Olson, K., Blackwell, L.M.: One approach to highway automation. Proc. IEEE 56, 556–566 (1968)CrossRef Fenton, R.E., Cosgriff, R.L., Olson, K., Blackwell, L.M.: One approach to highway automation. Proc. IEEE 56, 556–566 (1968)CrossRef
5.
go back to reference Fernandes, L., Souza, J., Pessin, G., Shinzato, P., Sales, D., Mendes, C., Prado, M., Klaser, R., Magalhães, A.C., Hata, A., Pigatto, D., Branco, K.C., Grassi Jr., V., Osorio, F.S., Wolf, D.: CaRINA intelligent robotic car: architectural design and applications. J. Syst. Archit. 60, 372–392 (2014)CrossRef Fernandes, L., Souza, J., Pessin, G., Shinzato, P., Sales, D., Mendes, C., Prado, M., Klaser, R., Magalhães, A.C., Hata, A., Pigatto, D., Branco, K.C., Grassi Jr., V., Osorio, F.S., Wolf, D.: CaRINA intelligent robotic car: architectural design and applications. J. Syst. Archit. 60, 372–392 (2014)CrossRef
6.
go back to reference Biermeyer, J.O., Templeton, T.R., Berger, C., Gonzalez, H., Naikal, N., Rumpe, B., Shankar, S.S.: Rapid integration and calibration of new sensors using the Berkeley Aachen Robotics Toolkit (BART). In: AAET - Automatisierungssysteme, Assistenzsysteme und eingebettete Systeme für Transportmittel: Beiträge zum gleichnamigen 11. Braunschweiger Symposium vom 10. und 11. Februar 2010, Deutsches Zentrum für Luft- und Raumfahrt e.V. am Forschungsflughafen, Braunschweig/Intelligente Transport- und Verkehrssysteme und - dienste Niedersachsen e.V. (Hrsg.), ITS Niedersachsen, Braunschweig (2010). http://publications.rwth-aachen.de/record/126284. Pages 17 S Biermeyer, J.O., Templeton, T.R., Berger, C., Gonzalez, H., Naikal, N., Rumpe, B., Shankar, S.S.: Rapid integration and calibration of new sensors using the Berkeley Aachen Robotics Toolkit (BART). In: AAET - Automatisierungssysteme, Assistenzsysteme und eingebettete Systeme für Transportmittel: Beiträge zum gleichnamigen 11. Braunschweiger Symposium vom 10. und 11. Februar 2010, Deutsches Zentrum für Luft- und Raumfahrt e.V. am Forschungsflughafen, Braunschweig/Intelligente Transport- und Verkehrssysteme und - dienste Niedersachsen e.V. (Hrsg.), ITS Niedersachsen, Braunschweig (2010). http://​publications.​rwth-aachen.​de/​record/​126284. Pages 17 S
7.
go back to reference Guizzo, E.: How google’s self-driving car works, October 2011 Guizzo, E.: How google’s self-driving car works, October 2011
8.
go back to reference Habermann, D., Silva, R., Wolf, D., Osorio, F.: Detecção e classificação de objetos com uso de sensor laser para aplicações em veículos autônomos terrestres. In: XV Simpósio de Aplicações Operacionais em Áreas de Defesa (SIGE), pp. 55–59. DCTA-ITA (2013) Habermann, D., Silva, R., Wolf, D., Osorio, F.: Detecção e classificação de objetos com uso de sensor laser para aplicações em veículos autônomos terrestres. In: XV Simpósio de Aplicações Operacionais em Áreas de Defesa (SIGE), pp. 55–59. DCTA-ITA (2013)
9.
go back to reference Hata, A.Y., Habermann, D., Osorio, F.S., Wolf, D.F.: Road geometry classification using ANN. In: 2014 IEEE Intelligent Vehicles Symposium Proceedings, pp. 1319–1324. IEEE (2014) Hata, A.Y., Habermann, D., Osorio, F.S., Wolf, D.F.: Road geometry classification using ANN. In: 2014 IEEE Intelligent Vehicles Symposium Proceedings, pp. 1319–1324. IEEE (2014)
10.
go back to reference Hata, A.Y., Osorio, F.S., Wolf, D.F.: Robust curb detection and vehicle localization in urban environments. In: 2014 IEEE Intelligent Vehicles Symposium Proceedings, pp. 1257–1262. IEEE (2014) Hata, A.Y., Osorio, F.S., Wolf, D.F.: Robust curb detection and vehicle localization in urban environments. In: 2014 IEEE Intelligent Vehicles Symposium Proceedings, pp. 1257–1262. IEEE (2014)
11.
go back to reference Henderson, T.C., Minor, M., Drake, S., Quist, J., Roberts, J., Sani, H., Rasmussen, M., Collins, A., Sun, Y., Fan, X., Louis, St., Mikuriya, S., Dean, K.: Robust autonomous vehicles DARPA urban challenge. DARPA Grand Challenge Tech Papers (2007) Henderson, T.C., Minor, M., Drake, S., Quist, J., Roberts, J., Sani, H., Rasmussen, M., Collins, A., Sun, Y., Fan, X., Louis, St., Mikuriya, S., Dean, K.: Robust autonomous vehicles DARPA urban challenge. DARPA Grand Challenge Tech Papers (2007)
12.
go back to reference Langdon, W.B.: Performing with CUDA. ACM (2011) Langdon, W.B.: Performing with CUDA. ACM (2011)
13.
go back to reference Luettel, T., Himmelsbach, M., Wuensche, H.J.: Autonomous ground vehicles: concepts and a path to the future. Proc. IEEE 100, 1831–1839 (2012)CrossRef Luettel, T., Himmelsbach, M., Wuensche, H.J.: Autonomous ground vehicles: concepts and a path to the future. Proc. IEEE 100, 1831–1839 (2012)CrossRef
14.
go back to reference Montemerlo, M., Becker, J., Bhat, S., Dahlkamp, H., Dolgov, D., Ettinger, S., Haehnel, D., Hilden, T., Hoffmann, G., Huhnke, B., Johnston, D., Langer, D., Lev, A., Levinson, J., Marcil, J., Orenstein, D., Paefgen, J., Penny, I., Petrovskaya, A., Pflueger, M., Stanek, G., Stavens, D., Vogt, A., Thrun, S.: Junior: the stanford entry in the urban challenge. In: Buehler, M., Iagnemma, K., Singh, S. (eds.) The DARPA Urban Challenge. Springer, Heidelberg (2007) Montemerlo, M., Becker, J., Bhat, S., Dahlkamp, H., Dolgov, D., Ettinger, S., Haehnel, D., Hilden, T., Hoffmann, G., Huhnke, B., Johnston, D., Langer, D., Lev, A., Levinson, J., Marcil, J., Orenstein, D., Paefgen, J., Penny, I., Petrovskaya, A., Pflueger, M., Stanek, G., Stavens, D., Vogt, A., Thrun, S.: Junior: the stanford entry in the urban challenge. In: Buehler, M., Iagnemma, K., Singh, S. (eds.) The DARPA Urban Challenge. Springer, Heidelberg (2007)
16.
go back to reference Shane, R., Rodrigues, C.I., Baghsorkhi, S.S., Stone, S.S., Kirk, D.B., Hwu, W.W.: Optimization principles and application performance evaluation of a multithreaded GPU using CUDA. In: Proceedings of the 13th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP 2008, pp. 73–82. ACM, New York, NY, USA (2008). http://doi.acm.org/10.1145/1345206.1345220. ISBN: 978-1-59593-795-7 Shane, R., Rodrigues, C.I., Baghsorkhi, S.S., Stone, S.S., Kirk, D.B., Hwu, W.W.: Optimization principles and application performance evaluation of a multithreaded GPU using CUDA. In: Proceedings of the 13th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP 2008, pp. 73–82. ACM, New York, NY, USA (2008). http://​doi.​acm.​org/​10.​1145/​1345206.​1345220. ISBN: 978-1-59593-795-7
17.
go back to reference Shinzato, P.: Estimação de obstáculos e área de pista com pontos 3D esparsos. CCMC-ICMC-USP, USP São Carlos, Brazil (2015) Shinzato, P.: Estimação de obstáculos e área de pista com pontos 3D esparsos. CCMC-ICMC-USP, USP São Carlos, Brazil (2015)
18.
go back to reference Russ, J.C.: Image Processing Handbook, 6th edn. CRC Press, Inc., Boca Raton (2016). ISBN: 978-1-4398-4063-4 (Ebook-PDF) Russ, J.C.: Image Processing Handbook, 6th edn. CRC Press, Inc., Boca Raton (2016). ISBN: 978-1-4398-4063-4 (Ebook-PDF)
19.
go back to reference Thrun, S., Montemerl, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M.: The robot that won the darpa grand challenge. J. Field Robot. 23, 661–692 (2006)CrossRef Thrun, S., Montemerl, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M.: The robot that won the darpa grand challenge. J. Field Robot. 23, 661–692 (2006)CrossRef
20.
go back to reference Troniak, D.M.: PR2 rides the elevator - a problem in vision-based localization (2012) Troniak, D.M.: PR2 rides the elevator - a problem in vision-based localization (2012)
Metadata
Title
GPU-Services: GPU Based Real-Time Processing of 3D Point Clouds Applied to Robotic Systems and Intelligent Vehicles
Authors
Leonardo Christino
Fernando Osório
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-47247-8_10