Skip to main content

2023 | OriginalPaper | Buchkapitel

An Efficient Real-Time Object Detection and Tracking Framework Based on Lidar and Ins

verfasst von : Yuan Zou, Yuanyuan Li, Xudong Zhang, Guoshun Dong, Zheng Zang

Erschienen in: Proceedings of China SAE Congress 2022: Selected Papers

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Obstacle detection and tracking is an integral part of the autonomous vehicle perception algorithm. Because most of the existing tracking algorithms have the problems of insufficient accuracy and poor real-time performance, an obstacle detection and tracking method based on LiDAR is proposed in this paper. Firstly, for the scene with the undulating ground in the environment, a twice-ground segmentation method based on plane fitting and scan line geometric features is proposed to accurately and robustly extract the high obstacle point cloud. Secondly, the density clustering algorithm is optimized, and a convex hull rectangular 3D bounding box fitting algorithm is proposed to detect obstacles. Finally, the Mahalanobis distance measurement feature is used to realize the data association between the previous and the current frame. And the interacting multiple model filter algorithm embedded in the unscented Kalman filter is used to estimate the state of the object optimally. Based on the public data set, the proposed algorithm improves the accuracy of tracking detection. After verification on the self-developed real vehicle experimental platform, the results show that the algorithm has good object tracking and correlation performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Guo, N., et al.: Real-time predictive energy management of plug-in hybrid electric vehicles for coordination of fuel economy and battery degradation. Energy 214, 119070 (2021)CrossRef Guo, N., et al.: Real-time predictive energy management of plug-in hybrid electric vehicles for coordination of fuel economy and battery degradation. Energy 214, 119070 (2021)CrossRef
2.
Zurück zum Zitat Guo, N., et al.: Predictive energy management of plug-in hybrid electric vehicles by real-time optimization and data-driven calibration. IEEE Trans. Veh. Technol. 71(6), 5677–5691 (2021)CrossRef Guo, N., et al.: Predictive energy management of plug-in hybrid electric vehicles by real-time optimization and data-driven calibration. IEEE Trans. Veh. Technol. 71(6), 5677–5691 (2021)CrossRef
3.
Zurück zum Zitat Guo, N., et al.: A real-time nonlinear model predictive controller for yaw motion optimization of distributed drive electric vehicles. IEEE Trans. Veh. Technol. 69(5), 4935–4946 (2020)MathSciNetCrossRef Guo, N., et al.: A real-time nonlinear model predictive controller for yaw motion optimization of distributed drive electric vehicles. IEEE Trans. Veh. Technol. 69(5), 4935–4946 (2020)MathSciNetCrossRef
4.
Zurück zum Zitat Redmon, J., et al.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016) Redmon, J., et al.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016)
5.
Zurück zum Zitat Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017) Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
7.
Zurück zum Zitat Bochkovskiy, A., Wang, C.-Y., Liao, H.-Y.M.: YOLOv4: optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934 (2020) Bochkovskiy, A., Wang, C.-Y., Liao, H.-Y.M.: YOLOv4: optimal speed and accuracy of object detection. arXiv preprint arXiv:​2004.​10934 (2020)
8.
Zurück zum Zitat Jocher, G., et al.: ultralytics/yolov5: v5.0-YOLOv5-P6 1280 models AWS supervise. ly and YouTube integrations. Zenodo, November 2021 Jocher, G., et al.: ultralytics/yolov5: v5.0-YOLOv5-P6 1280 models AWS supervise. ly and YouTube integrations. Zenodo, November 2021
9.
Zurück zum Zitat León, L.C., Hirata, R., Jr.: Car detection in sequences of images of urban environments using mixture of deformable part models. Pattern Recogn. Lett. 39, 39–51 (2014)CrossRef León, L.C., Hirata, R., Jr.: Car detection in sequences of images of urban environments using mixture of deformable part models. Pattern Recogn. Lett. 39, 39–51 (2014)CrossRef
10.
Zurück zum Zitat Dai, B., Fu, Y., Wu, T.: A vehicle detection method via symmetry in multi-scale windows. In: 2007 2nd IEEE Conference on Industrial Electronics and Applications. IEEE (2007) Dai, B., Fu, Y., Wu, T.: A vehicle detection method via symmetry in multi-scale windows. In: 2007 2nd IEEE Conference on Industrial Electronics and Applications. IEEE (2007)
11.
Zurück zum Zitat Hasecke, F., Hahn, L., Kummert, A.: Fast lidar clustering by density and connectivity. arXiv preprint arXiv:2003.00575, March 2020 Hasecke, F., Hahn, L., Kummert, A.: Fast lidar clustering by density and connectivity. arXiv preprint arXiv:​2003.​00575, March 2020
13.
Zurück zum Zitat Hwang, S., et al.: Fast multiple objects detection and tracking fusing color camera and 3D LIDAR for intelligent vehicles. In: 2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI). IEEE (2016) Hwang, S., et al.: Fast multiple objects detection and tracking fusing color camera and 3D LIDAR for intelligent vehicles. In: 2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI). IEEE (2016)
14.
Zurück zum Zitat Gao, F., Li, C., Zhang, B.: A dynamic clustering algorithm for LiDAR obstacle detection of autonomous driving system. IEEE Sens. J. 21(22), 25922–25930 (2021)CrossRef Gao, F., Li, C., Zhang, B.: A dynamic clustering algorithm for LiDAR obstacle detection of autonomous driving system. IEEE Sens. J. 21(22), 25922–25930 (2021)CrossRef
15.
Zurück zum Zitat Zhou, Y., Tuzel, O.: VoxelNet: end-to-end learning for point cloud based 3D object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018) Zhou, Y., Tuzel, O.: VoxelNet: end-to-end learning for point cloud based 3D object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018)
16.
Zurück zum Zitat Qi, C.R., et al.: Frustum pointnets for 3D object detection from RGB-D data. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018) Qi, C.R., et al.: Frustum pointnets for 3D object detection from RGB-D data. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018)
17.
Zurück zum Zitat Verucchi, M., et al.: Real-time clustering and LiDAR-camera fusion on embedded platforms for self-driving cars. In: 2020 Fourth IEEE International Conference on Robotic Computing (IRC). IEEE (2020) Verucchi, M., et al.: Real-time clustering and LiDAR-camera fusion on embedded platforms for self-driving cars. In: 2020 Fourth IEEE International Conference on Robotic Computing (IRC). IEEE (2020)
18.
Zurück zum Zitat Wen, L.-H., Jo, K.-H.: Fast and accurate 3D object detection for lidar-camera-based autonomous vehicles using one shared voxel-based backbone. IEEE Access 9, 22080–22089 (2021)CrossRef Wen, L.-H., Jo, K.-H.: Fast and accurate 3D object detection for lidar-camera-based autonomous vehicles using one shared voxel-based backbone. IEEE Access 9, 22080–22089 (2021)CrossRef
20.
Zurück zum Zitat Chu, Q., et al.: Online multi-object tracking using CNN-based single object tracker with spatial-temporal attention mechanism. In: Proceedings of the IEEE International Conference on Computer Vision (2017) Chu, Q., et al.: Online multi-object tracking using CNN-based single object tracker with spatial-temporal attention mechanism. In: Proceedings of the IEEE International Conference on Computer Vision (2017)
22.
Zurück zum Zitat Ogawa, T., et al.: Pedestrian detection and tracking using in-vehicle lidar for automotive application. In: 2011 IEEE Intelligent Vehicles Symposium (IV). IEEE (2011) Ogawa, T., et al.: Pedestrian detection and tracking using in-vehicle lidar for automotive application. In: 2011 IEEE Intelligent Vehicles Symposium (IV). IEEE (2011)
23.
Zurück zum Zitat Dewan, A., et al.: Motion-based detection and tracking in 3D LiDAR scans. In: 2016 IEEE International Conference on Robotics and Automation (ICRA). IEEE (2016) Dewan, A., et al.: Motion-based detection and tracking in 3D LiDAR scans. In: 2016 IEEE International Conference on Robotics and Automation (ICRA). IEEE (2016)
24.
Zurück zum Zitat Vaquero, V., et al.: Dual-branch CNNs for vehicle detection and tracking on LiDAR data. IEEE Trans. Intell. Transp. Syst. 22(11), 6942–6953 (2020)CrossRef Vaquero, V., et al.: Dual-branch CNNs for vehicle detection and tracking on LiDAR data. IEEE Trans. Intell. Transp. Syst. 22(11), 6942–6953 (2020)CrossRef
25.
Zurück zum Zitat Ye, G.: Multi-target detection and tracking algorithm for autonomous driving car based on a 3D lidar in urban traffic environment. Beijing Institute of Technology, Beijing (2016) Ye, G.: Multi-target detection and tracking algorithm for autonomous driving car based on a 3D lidar in urban traffic environment. Beijing Institute of Technology, Beijing (2016)
26.
Zurück zum Zitat Huang, K., Hao, Q.: Joint multi-object detection and tracking with camera-LiDAR fusion for autonomous driving. In: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE (2021) Huang, K., Hao, Q.: Joint multi-object detection and tracking with camera-LiDAR fusion for autonomous driving. In: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE (2021)
27.
Zurück zum Zitat Weng, X., et al.: AB3DMOT: a baseline for 3D multi-object tracking and new evaluation metrics. arXiv preprint arXiv:2008.08063 (2020) Weng, X., et al.: AB3DMOT: a baseline for 3D multi-object tracking and new evaluation metrics. arXiv preprint arXiv:​2008.​08063 (2020)
28.
Zurück zum Zitat Xie, D., Xu, Y., Wang, R.: Obstacle detection and tracking method for autonomous vehicle based on three-dimensional LiDAR. Int. J. Adv. Rob. Syst. 16(2), 1729881419831587 (2019) Xie, D., Xu, Y., Wang, R.: Obstacle detection and tracking method for autonomous vehicle based on three-dimensional LiDAR. Int. J. Adv. Rob. Syst. 16(2), 1729881419831587 (2019)
29.
Zurück zum Zitat Ester, M., et al.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD (1996) Ester, M., et al.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD (1996)
30.
Zurück zum Zitat Naujoks, B., Wuensche, H.-J.: An orientation corrected bounding box fit based on the convex hull under real time constraints. In: 2018 IEEE Intelligent Vehicles Symposium (IV). IEEE (2018) Naujoks, B., Wuensche, H.-J.: An orientation corrected bounding box fit based on the convex hull under real time constraints. In: 2018 IEEE Intelligent Vehicles Symposium (IV). IEEE (2018)
31.
Zurück zum Zitat Mazor, E., et al.: Interacting multiple model methods in target tracking: a survey. IEEE Trans. Aerosp. Electron. Syst. 34(1), 103–123 (1998)CrossRef Mazor, E., et al.: Interacting multiple model methods in target tracking: a survey. IEEE Trans. Aerosp. Electron. Syst. 34(1), 103–123 (1998)CrossRef
32.
Zurück zum Zitat Julier, S.J., Uhlmann, J.K.: Unscented filtering and nonlinear estimation. Proc. IEEE 92(3), 401–422 (2004)CrossRef Julier, S.J., Uhlmann, J.K.: Unscented filtering and nonlinear estimation. Proc. IEEE 92(3), 401–422 (2004)CrossRef
33.
Zurück zum Zitat Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE (2012) Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE (2012)
34.
Zurück zum Zitat Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the clear mot metrics. EURASIP J. Image Video Process. 2008, 1–10 (2008)CrossRef Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the clear mot metrics. EURASIP J. Image Video Process. 2008, 1–10 (2008)CrossRef
35.
Zurück zum Zitat Baser, E., et al.: FANTrack: 3D multi-object tracking with feature association network. In: 2019 IEEE Intelligent Vehicles Symposium (IV). IEEE (2019) Baser, E., et al.: FANTrack: 3D multi-object tracking with feature association network. In: 2019 IEEE Intelligent Vehicles Symposium (IV). IEEE (2019)
36.
Zurück zum Zitat Zhang, W., et al.: Robust multi-modality multi-object tracking. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (2019) Zhang, W., et al.: Robust multi-modality multi-object tracking. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (2019)
Metadaten
Titel
An Efficient Real-Time Object Detection and Tracking Framework Based on Lidar and Ins
verfasst von
Yuan Zou
Yuanyuan Li
Xudong Zhang
Guoshun Dong
Zheng Zang
Copyright-Jahr
2023
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-1365-7_37

    Premium Partner