Skip to main content
Top
Published in: The Journal of Supercomputing 8/2019

30-03-2019

3D object recognition method with multiple feature extraction from LiDAR point clouds

Authors: Yifei Tian, Wei Song, Su Sun, Simon Fong, Shuanghui Zou

Published in: The Journal of Supercomputing | Issue 8/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

During autonomous driving, fast and accurate object recognition supports environment perception for local path planning of unmanned ground vehicles. Feature extraction and object recognition from large-scale 3D point clouds incur massive computational and time costs. To implement fast environment perception, this paper proposes a 3D recognition system with multiple feature extraction from light detection and ranging point clouds modified by parallel computing. Effective object feature extraction is a necessary step prior to executing an object recognition procedure. In the proposed system, multiple geometry features of a point cloud that resides in corresponding voxels are computed concurrently. In addition, a scale filter is employed to convert feature vectors from uncertain count voxels to a normalized object feature matrix, which is convenient for object-recognizing classifiers. After generating the object feature matrices of all voxels, an initialized multilayer neural network (NN) model is trained offline through a large number of iterations. Using the trained NN model, real-time object recognition is realized using parallel computing technology to accelerate computation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Yao J, Zhang K, Yang Y et al (2018) Emergency vehicle route oriented signal coordinated control model with two-level programming. Soft Comput 2(13):4283–4294CrossRef Yao J, Zhang K, Yang Y et al (2018) Emergency vehicle route oriented signal coordinated control model with two-level programming. Soft Comput 2(13):4283–4294CrossRef
2.
go back to reference Simony M, Milzy S, Amende K et al (2018) Complex-YOLO: an Euler-region-proposal for real-time 3D object detection on point clouds. In: Computer Vision-ECCV 2018 Workshops, pp 197–209 Simony M, Milzy S, Amende K et al (2018) Complex-YOLO: an Euler-region-proposal for real-time 3D object detection on point clouds. In: Computer Vision-ECCV 2018 Workshops, pp 197–209
3.
go back to reference Chen X, Ma H, Wan J et al (2017) Multi-view 3D object detection network for autonomous driving. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 1907–1915 Chen X, Ma H, Wan J et al (2017) Multi-view 3D object detection network for autonomous driving. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 1907–1915
4.
go back to reference Guo Y, Bennamoun M, Sohel F et al (2014) 3D object recognition in cluttered scenes with local surface features: a survey. IEEE Trans Pattern Anal Mach Intell 36(11):2270–2287CrossRef Guo Y, Bennamoun M, Sohel F et al (2014) 3D object recognition in cluttered scenes with local surface features: a survey. IEEE Trans Pattern Anal Mach Intell 36(11):2270–2287CrossRef
5.
go back to reference Stamatis OK, Aouf N, Gray G et al (2018) Local feature based automatic target recognition for future 3D active homing seeker missiles. Aerosp Sci Technol 73:309–317CrossRef Stamatis OK, Aouf N, Gray G et al (2018) Local feature based automatic target recognition for future 3D active homing seeker missiles. Aerosp Sci Technol 73:309–317CrossRef
6.
go back to reference Zeng H, Wang H, Dong J (2017) Robust 3D keypoint detection method based on double Gaussian weighted dissimilarity measure. Multimed Tools Appl 76(24):26377–26389CrossRef Zeng H, Wang H, Dong J (2017) Robust 3D keypoint detection method based on double Gaussian weighted dissimilarity measure. Multimed Tools Appl 76(24):26377–26389CrossRef
7.
go back to reference Wang J, Lindenbergh R, Menenti M (2017) SigVox—a 3D feature matching algorithm for automatic street object recognition in mobile laser scanning point clouds. ISPRS J Photogramm Remote Sens 128:111–129CrossRef Wang J, Lindenbergh R, Menenti M (2017) SigVox—a 3D feature matching algorithm for automatic street object recognition in mobile laser scanning point clouds. ISPRS J Photogramm Remote Sens 128:111–129CrossRef
8.
go back to reference Zeng H, Liu Y, Liu J et al (2018) Non-rigid 3D model retrieval based on quadruplet convolutional neural networks. IEEE Access 6:76087–76097CrossRef Zeng H, Liu Y, Liu J et al (2018) Non-rigid 3D model retrieval based on quadruplet convolutional neural networks. IEEE Access 6:76087–76097CrossRef
9.
go back to reference Watanabe T, Yamazaki K, Yokokohji Y (2017) Survey of robotic manipulation studies intending practical applications in real environments-object recognition, soft robot hand, and challenge program and benchmarking. Adv Robot 31(19–20):1114–1132CrossRef Watanabe T, Yamazaki K, Yokokohji Y (2017) Survey of robotic manipulation studies intending practical applications in real environments-object recognition, soft robot hand, and challenge program and benchmarking. Adv Robot 31(19–20):1114–1132CrossRef
10.
go back to reference Li L, Ota K, Dong M (2018) Humanlike driving: empirical decision-making system for autonomous vehicles. IEEE Trans Veh Technol 67(8):6814–6823CrossRef Li L, Ota K, Dong M (2018) Humanlike driving: empirical decision-making system for autonomous vehicles. IEEE Trans Veh Technol 67(8):6814–6823CrossRef
11.
go back to reference Buenoa M, González-Jorgea H, Sánchez JM et al (2017) Automatic point cloud coarse registration using geometric keypoint descriptors for indoor scenes. Autom Constr 81:134–148CrossRef Buenoa M, González-Jorgea H, Sánchez JM et al (2017) Automatic point cloud coarse registration using geometric keypoint descriptors for indoor scenes. Autom Constr 81:134–148CrossRef
12.
go back to reference Sun J, Zhang J, Zhang G (2016) An automatic 3D point cloud registration method based on regional curvature maps. Image Vis Comput 56:49–58CrossRef Sun J, Zhang J, Zhang G (2016) An automatic 3D point cloud registration method based on regional curvature maps. Image Vis Comput 56:49–58CrossRef
13.
go back to reference Persad RA, Armenakis C (2017) Automatic co-registration of 3D multi-sensor point clouds. ISPRS J Photogramm Remote Sens 130:162–186CrossRef Persad RA, Armenakis C (2017) Automatic co-registration of 3D multi-sensor point clouds. ISPRS J Photogramm Remote Sens 130:162–186CrossRef
14.
go back to reference Ge X (2017) Automatic markerless registration of point clouds with semantic-keypoint-based 4-points congruent sets. ISPRS J Photogramm Remote Sens 130:344–357CrossRef Ge X (2017) Automatic markerless registration of point clouds with semantic-keypoint-based 4-points congruent sets. ISPRS J Photogramm Remote Sens 130:344–357CrossRef
15.
go back to reference Hansch R, Webera T, Hellwich O (2014) Comparison of 3D interest point detectors and descriptors for point cloud fusion. ISPRS Ann Photogramm Remote Sens Spat Inf Sci II-3:57–64CrossRef Hansch R, Webera T, Hellwich O (2014) Comparison of 3D interest point detectors and descriptors for point cloud fusion. ISPRS Ann Photogramm Remote Sens Spat Inf Sci II-3:57–64CrossRef
16.
go back to reference Weber T, Hänsch R, Hellwich O (2015) Automatic registration of unordered point clouds acquired by Kinect sensors using an overlap heuristic. ISPRS J Photogramm Remote Sens 102:96–109CrossRef Weber T, Hänsch R, Hellwich O (2015) Automatic registration of unordered point clouds acquired by Kinect sensors using an overlap heuristic. ISPRS J Photogramm Remote Sens 102:96–109CrossRef
17.
go back to reference Yang J, Zhang Q, Cao Z (2017) The effect of spatial information characterization on 3D local feature descriptors: a quantitative evaluation. Pattern Recogn 66:375–391CrossRef Yang J, Zhang Q, Cao Z (2017) The effect of spatial information characterization on 3D local feature descriptors: a quantitative evaluation. Pattern Recogn 66:375–391CrossRef
18.
go back to reference Yang J, Cao Z, Zhang Q (2016) A fast and robust local descriptor for 3D point cloud registration. Inf Sci 346–347:163–179CrossRef Yang J, Cao Z, Zhang Q (2016) A fast and robust local descriptor for 3D point cloud registration. Inf Sci 346–347:163–179CrossRef
19.
go back to reference Garcia AG, Escolano SO, Rodriguez JG et al (2018) Interactive 3D object recognition pipeline on mobile GPGPU computing platforms using low-cost RGB-D sensors. J Real-Time Image Proc 14:585–604CrossRef Garcia AG, Escolano SO, Rodriguez JG et al (2018) Interactive 3D object recognition pipeline on mobile GPGPU computing platforms using low-cost RGB-D sensors. J Real-Time Image Proc 14:585–604CrossRef
20.
go back to reference Quan S, Ma J, Hu F et al (2018) Local voxelized structure for 3D binary feature representation and robust registration of point clouds from low-cost sensors. Inf Sci 444:153–171CrossRef Quan S, Ma J, Hu F et al (2018) Local voxelized structure for 3D binary feature representation and robust registration of point clouds from low-cost sensors. Inf Sci 444:153–171CrossRef
21.
go back to reference Zhu Q, Li Y, Hu H et al (2017) Robust point cloud classification based on multi-level semantic relationships for urban scenes. ISPRS J Photogramm Remote Sens 129:86–102CrossRef Zhu Q, Li Y, Hu H et al (2017) Robust point cloud classification based on multi-level semantic relationships for urban scenes. ISPRS J Photogramm Remote Sens 129:86–102CrossRef
22.
go back to reference Xu Y, Tuttas S, Hoegner L et al (2018) Voxel-based segmentation of 3D point clouds from construction sites using a probabilistic connectivity model. Pattern Recogn Lett 102:67–74CrossRef Xu Y, Tuttas S, Hoegner L et al (2018) Voxel-based segmentation of 3D point clouds from construction sites using a probabilistic connectivity model. Pattern Recogn Lett 102:67–74CrossRef
23.
go back to reference Yang B, Dong Z, Zhao G et al (2015) Hierarchical extraction of urban objects from mobile laser scanning data. ISPRS J Photogramm Remote Sens 99:45–57CrossRef Yang B, Dong Z, Zhao G et al (2015) Hierarchical extraction of urban objects from mobile laser scanning data. ISPRS J Photogramm Remote Sens 99:45–57CrossRef
24.
go back to reference Lei H, Jiang G, Quan L (2017) Fast descriptors and correspondence propagation for robust global point cloud registration. IEEE Trans Image Process 26(8):3614–3623MathSciNetMATH Lei H, Jiang G, Quan L (2017) Fast descriptors and correspondence propagation for robust global point cloud registration. IEEE Trans Image Process 26(8):3614–3623MathSciNetMATH
25.
go back to reference Elbaz G, Avraham T, Fischer A (2017) 3D point cloud registration for localization using a deep neural network auto-encoder. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 4631–4640 Elbaz G, Avraham T, Fischer A (2017) 3D point cloud registration for localization using a deep neural network auto-encoder. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 4631–4640
26.
go back to reference Ligon J, Bein D, Ly P et al (2018) 3D point cloud processing using spin images for object detection. In: 2018 IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC), pp 731–736 Ligon J, Bein D, Ly P et al (2018) 3D point cloud processing using spin images for object detection. In: 2018 IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC), pp 731–736
27.
go back to reference Yang J, Zhang Q, Xian K et al (2017) Rotational contour signatures for both real-valued and binary feature representations of 3D local shape. Comput Vis Image Underst 160:133–147CrossRef Yang J, Zhang Q, Xian K et al (2017) Rotational contour signatures for both real-valued and binary feature representations of 3D local shape. Comput Vis Image Underst 160:133–147CrossRef
28.
go back to reference Dong Z, Yang B, Liu Y et al (2017) A novel binary shape context for 3D local surface description. ISPRS J Photogramm Remote Sens 130:431–452CrossRef Dong Z, Yang B, Liu Y et al (2017) A novel binary shape context for 3D local surface description. ISPRS J Photogramm Remote Sens 130:431–452CrossRef
29.
go back to reference Tu Y, Lin Y, Wang J et al (2018) Semi-supervised learning with generative adversarial networks on digital signal modulation classification. Comput Mater Contin 55(2):243–254 Tu Y, Lin Y, Wang J et al (2018) Semi-supervised learning with generative adversarial networks on digital signal modulation classification. Comput Mater Contin 55(2):243–254
30.
go back to reference Zeng D, Dai Y, Li F et al (2018) Adversarial learning for distant supervised relation extraction. Comput Mater Contin 55(1):121–136 Zeng D, Dai Y, Li F et al (2018) Adversarial learning for distant supervised relation extraction. Comput Mater Contin 55(1):121–136
31.
go back to reference Dubé R, Gollub MG, Sommer H et al (2018) Incremental-segment-based localization in 3-D point clouds. IEEE Robot Autom Lett 3(3):1832–1839CrossRef Dubé R, Gollub MG, Sommer H et al (2018) Incremental-segment-based localization in 3-D point clouds. IEEE Robot Autom Lett 3(3):1832–1839CrossRef
32.
go back to reference Soilán M, Riveiro B, Sánchez JM et al (2017) Segmentation and classification of road markings using MLS data. ISPRS J Photogramm Remote Sens 123:94–103CrossRef Soilán M, Riveiro B, Sánchez JM et al (2017) Segmentation and classification of road markings using MLS data. ISPRS J Photogramm Remote Sens 123:94–103CrossRef
33.
go back to reference Roveri R, Rahmann L, Oztireli AC et al (2018) A network architecture for point cloud classification via automatic depth images generation. In: IEEE Conference on Computer Vision Pattern Recognition (CVPR), pp 4176–4184 Roveri R, Rahmann L, Oztireli AC et al (2018) A network architecture for point cloud classification via automatic depth images generation. In: IEEE Conference on Computer Vision Pattern Recognition (CVPR), pp 4176–4184
34.
go back to reference Bobkov D, Chen S, Jian R et al (2018) Noise-resistant deep learning for object classification in three-dimensional point clouds using a point pair descriptor. IEEE Robot Autom Lett 3(2):865–872CrossRef Bobkov D, Chen S, Jian R et al (2018) Noise-resistant deep learning for object classification in three-dimensional point clouds using a point pair descriptor. IEEE Robot Autom Lett 3(2):865–872CrossRef
35.
go back to reference Chen J, Cho YK, Ueda J (2018) Sampled-point network for classification of deformed building element point clouds. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp 2164–2169 Chen J, Cho YK, Ueda J (2018) Sampled-point network for classification of deformed building element point clouds. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp 2164–2169
36.
go back to reference Song W, Tian Y, Fong S et al (2016) GPU-accelerated foreground segmentation and labeling for real-time video surveillance. Sustainability 8(10):916CrossRef Song W, Tian Y, Fong S et al (2016) GPU-accelerated foreground segmentation and labeling for real-time video surveillance. Sustainability 8(10):916CrossRef
Metadata
Title
3D object recognition method with multiple feature extraction from LiDAR point clouds
Authors
Yifei Tian
Wei Song
Su Sun
Simon Fong
Shuanghui Zou
Publication date
30-03-2019
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 8/2019
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-019-02830-9

Other articles of this Issue 8/2019

The Journal of Supercomputing 8/2019 Go to the issue

Premium Partner