Skip to main content
Top

2019 | OriginalPaper | Chapter

LiDAR Based System for Tracking Loader Crane Operator

Authors : Karol Miądlicki, Mateusz Saków

Published in: Advances in Manufacturing II

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nowadays, particularly in the IoT, industry 4.0, smart devices, intelligent robots and autonomous vehicles, the segmentation and analysis of the environment using 3D data (point clouds) is a current and relevant research topic. The reducing prices of depth sensors based on light detection and ranging (LIDAR), time of flight (ToF), radio detection and ranging (RADAR) technologies and high computing power, facilitate the development of intelligent systems. In this work real-time LiDAR based system for tracking loader crane operator has been presented. Developed system uses a Velodyne VLP-16 LiDAR to detect and track loader crane operator and is fully integrated with open-source ROS (Robot Operating System). This solution will help to determine whether the operator is in the crane working zone, which will increase his safety. The work presents the main assumptions of the system, subsequent stages of point clouds processing and used algorithms. Detection and tracking algorithms performance was evaluated based on real data acquired under different conditions, and the results were compared to similar solutions found in the literature. The results of conducted test were presented. Furthermore, in this article, we discussed other methods used to detect and track humans in real time, described Velodyne VLP-16 scanner, robot operating system and data processing methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Sanjaya, K., Henning, F., Purba, K.R.: 3D LIDAR city model application and marketing plan development. In: International Conference on Soft Computing, Intelligent System and Information Technology: Building Intelligence Through IOT and Big Data, pp. 238–242. IEEE (2018) Sanjaya, K., Henning, F., Purba, K.R.: 3D LIDAR city model application and marketing plan development. In: International Conference on Soft Computing, Intelligent System and Information Technology: Building Intelligence Through IOT and Big Data, pp. 238–242. IEEE (2018)
2.
go back to reference Gopalakrishnan, R., Thomas, V.A., Wynne, R.H., Coulston, J.W., Fox, T.R.: Shrub detection using disparate airborne laser scanning acquisitions over varied forest cover types. Int. J. Remote Sens. 39, 1220–1242 (2018)CrossRef Gopalakrishnan, R., Thomas, V.A., Wynne, R.H., Coulston, J.W., Fox, T.R.: Shrub detection using disparate airborne laser scanning acquisitions over varied forest cover types. Int. J. Remote Sens. 39, 1220–1242 (2018)CrossRef
3.
go back to reference Zhou, Q., Tan, Z., Yang, C.: Theoretical limit evaluation of ranging accuracy and power for LiDAR systems in autonomous cars. Opt. Eng. 57, 1–8 (2018) Zhou, Q., Tan, Z., Yang, C.: Theoretical limit evaluation of ranging accuracy and power for LiDAR systems in autonomous cars. Opt. Eng. 57, 1–8 (2018)
4.
go back to reference Malavazi, F.B.P., Guyonneau, R., Fasquel, J.B., Lagrange, S., Mercier, F.: LiDAR-only based navigation algorithm for an autonomous agricultural robot. Comput. Electron. Agric. 154, 71–79 (2018)CrossRef Malavazi, F.B.P., Guyonneau, R., Fasquel, J.B., Lagrange, S., Mercier, F.: LiDAR-only based navigation algorithm for an autonomous agricultural robot. Comput. Electron. Agric. 154, 71–79 (2018)CrossRef
5.
go back to reference Sakib, M.N., Rahman, M.A.: Traffic bottleneck reconstruction LIDAR orthoimages: a RANSAC algorithm feature extraction. Adv. Intell. Syst. Comput. 843, 302–307 (2018) Sakib, M.N., Rahman, M.A.: Traffic bottleneck reconstruction LIDAR orthoimages: a RANSAC algorithm feature extraction. Adv. Intell. Syst. Comput. 843, 302–307 (2018)
6.
go back to reference Wu, J., Xu, H., Zheng, Y., Tian, Z.: A novel method of vehicle-pedestrian near-crash identification with roadside LiDAR data. Accid. Anal. Prev. 121, 238–249 (2018)CrossRef Wu, J., Xu, H., Zheng, Y., Tian, Z.: A novel method of vehicle-pedestrian near-crash identification with roadside LiDAR data. Accid. Anal. Prev. 121, 238–249 (2018)CrossRef
7.
go back to reference Nakashima, K., Jung, H., Oto, Y., Iwashita, Y., Kurazume, R., Mozos, O.M.: Learning geometric and photometric features from panoramic LiDAR scans for outdoor place categorization. Adv. Robot. 32, 750–765 (2018)CrossRef Nakashima, K., Jung, H., Oto, Y., Iwashita, Y., Kurazume, R., Mozos, O.M.: Learning geometric and photometric features from panoramic LiDAR scans for outdoor place categorization. Adv. Robot. 32, 750–765 (2018)CrossRef
8.
go back to reference Herbin, P., Pajor, M.: The torque control system of exoskeleton ExoArm 7-DOF used in bilateral teleoperation system. In: AIP Conference Proceedings, pp. 020020–020020-9 (2018) Herbin, P., Pajor, M.: The torque control system of exoskeleton ExoArm 7-DOF used in bilateral teleoperation system. In: AIP Conference Proceedings, pp. 020020–020020-9 (2018)
9.
go back to reference Pajor, M., Grudziński, M., Marchewka, Ł.: Stereovision system for motion tracking and position error compensation of loading crane. In: AIP Conference Proceedings, pp. 020050–020050-10 (2018) Pajor, M., Grudziński, M., Marchewka, Ł.: Stereovision system for motion tracking and position error compensation of loading crane. In: AIP Conference Proceedings, pp. 020050–020050-10 (2018)
10.
go back to reference Jasiewicz, M., Miądlicki, K., Powałka, B.: Assistance of machining parameters selection for slender tools in CNC control. In: AIP Conference Proceedings, pp. 020024–020024-10 (2018) Jasiewicz, M., Miądlicki, K., Powałka, B.: Assistance of machining parameters selection for slender tools in CNC control. In: AIP Conference Proceedings, pp. 020024–020024-10 (2018)
11.
go back to reference Jasiewicz, M., Powalka, B.: Identification of a lathe spindle dynamics using extended inverse receptance coupling. J. Dyn. Syst. Meas. Control 140(12), 121015-1–121015-11 (2018)CrossRef Jasiewicz, M., Powalka, B.: Identification of a lathe spindle dynamics using extended inverse receptance coupling. J. Dyn. Syst. Meas. Control 140(12), 121015-1–121015-11 (2018)CrossRef
12.
go back to reference Jasiewicz, M., Powałka, B.: Prediction of turning stability using receptance coupling. In: AIP Conference Proceedings, pp. 100005-1–100005-9 (2018) Jasiewicz, M., Powałka, B.: Prediction of turning stability using receptance coupling. In: AIP Conference Proceedings, pp. 100005-1–100005-9 (2018)
13.
go back to reference Majewski, M., Kacalak, W., Budniak, Z., Pajor, M.: Interactive control systems for mobile cranes. Adv. Intell. Syst. Comput. 1, 10–19 (2018) Majewski, M., Kacalak, W., Budniak, Z., Pajor, M.: Interactive control systems for mobile cranes. Adv. Intell. Syst. Comput. 1, 10–19 (2018)
14.
go back to reference Rybarczyk, D., Owczarek, P., Myszkowski, A.: Development of force feedback controller for the loader crane. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 345–354. Springer (2018) Rybarczyk, D., Owczarek, P., Myszkowski, A.: Development of force feedback controller for the loader crane. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 345–354. Springer (2018)
15.
go back to reference Myszkowski, A., Bartkowiak, T., Staniek, R.: Novel type of biaxial wheel-type haptic input device with MR-brakes to control hydraulic multi-axis manipulators. In: Volume 4A: Dynamics, Vibration, and Control, pp. 71300-1–71300-6. ASME (2017) Myszkowski, A., Bartkowiak, T., Staniek, R.: Novel type of biaxial wheel-type haptic input device with MR-brakes to control hydraulic multi-axis manipulators. In: Volume 4A: Dynamics, Vibration, and Control, pp. 71300-1–71300-6. ASME (2017)
16.
go back to reference Westerberg, S., Manchester, I.R., Mettin, U., Hera, P.L, Shiriaev, A.: Virtual environment teleoperation of a hydraulic forestry crane. In: IEEE International Conference on Robotics and Automation, pp. 4049–4054. IEEE (2008) Westerberg, S., Manchester, I.R., Mettin, U., Hera, P.L, Shiriaev, A.: Virtual environment teleoperation of a hydraulic forestry crane. In: IEEE International Conference on Robotics and Automation, pp. 4049–4054. IEEE (2008)
17.
go back to reference Lagerev, I.A., Lagerev, A.V.: Universal mathematical model of a hydraulic loader crane. In: IOP Conference Series: Earth and Environmental Science, vol. 194, pp. 032015-1–032015-6 (2018) Lagerev, I.A., Lagerev, A.V.: Universal mathematical model of a hydraulic loader crane. In: IOP Conference Series: Earth and Environmental Science, vol. 194, pp. 032015-1–032015-6 (2018)
18.
go back to reference Miądlicki, K., Pajor, M.: Overview of user interfaces used in load lifting devices. Int. J. Sci. Eng. Res. 6, 1215–1220 (2015) Miądlicki, K., Pajor, M.: Overview of user interfaces used in load lifting devices. Int. J. Sci. Eng. Res. 6, 1215–1220 (2015)
19.
go back to reference Majewski, M., Kacalak, W.: Human-machine speech-based interfaces with augmented reality and interactive systems for controlling mobile cranes. Lecture Notes in Computer Science, pp. 89–98. Springer (2016) Majewski, M., Kacalak, W.: Human-machine speech-based interfaces with augmented reality and interactive systems for controlling mobile cranes. Lecture Notes in Computer Science, pp. 89–98. Springer (2016)
20.
go back to reference Majewski, M., Kacalak, W.: Intelligent speech-based interactive communication between mobile cranes and their human operators. Lecture Notes in Computer Science, pp. 523–530. Springer (2016) Majewski, M., Kacalak, W.: Intelligent speech-based interactive communication between mobile cranes and their human operators. Lecture Notes in Computer Science, pp. 523–530. Springer (2016)
21.
go back to reference Saków, M., Miądlicki, K., Parus, A.: Self-sensing teleoperation system based on 1-DOF pneumatic manipulator. J. Autom. Mob. Robot. Intell. Syst. 11, 64–76 (2017) Saków, M., Miądlicki, K., Parus, A.: Self-sensing teleoperation system based on 1-DOF pneumatic manipulator. J. Autom. Mob. Robot. Intell. Syst. 11, 64–76 (2017)
22.
go back to reference Saków, M., Parus, A., Pajor, M., Miądlicki, K.: Nonlinear inverse modeling with signal prediction in bilateral teleoperation with force-feedback. In: 22nd International Conference on Methods and Models in Automation and Robotics, pp. 141–146. IEEE (2017) Saków, M., Parus, A., Pajor, M., Miądlicki, K.: Nonlinear inverse modeling with signal prediction in bilateral teleoperation with force-feedback. In: 22nd International Conference on Methods and Models in Automation and Robotics, pp. 141–146. IEEE (2017)
23.
go back to reference Saków, M., Miądlicki, K.: Transport delay and first order inertia time signal prediction dedicated to teleoperation. In: Advances in Automation, Robotics and Measurement Techniques, pp. 142–151. Springer (2018) Saków, M., Miądlicki, K.: Transport delay and first order inertia time signal prediction dedicated to teleoperation. In: Advances in Automation, Robotics and Measurement Techniques, pp. 142–151. Springer (2018)
24.
go back to reference Saków, M., Parus, A., Pajor, M., Miadlicki, K.: Unilateral hydraulic telemanipulation system for operation in machining work area. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 415–425. Springer (2018) Saków, M., Parus, A., Pajor, M., Miadlicki, K.: Unilateral hydraulic telemanipulation system for operation in machining work area. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 415–425. Springer (2018)
25.
go back to reference Herbin, P., Pajor, M.: Interactive 7-DOF motion controller of the operator arm (ExoArm 7-DOF). In: International Conference on Innovations in Intelligent Systems and Applications, pp. 185–188. IEEE (2017) Herbin, P., Pajor, M.: Interactive 7-DOF motion controller of the operator arm (ExoArm 7-DOF). In: International Conference on Innovations in Intelligent Systems and Applications, pp. 185–188. IEEE (2017)
26.
go back to reference Saków, M., Marchelek, K., Parus, A., Pajor, M., Miądlicki, K.: Signal prediction in bilateral teleoperation with force-feedback. In: Proceedings in Mathematics and Statistics, pp. 311–323. Springer (2018) Saków, M., Marchelek, K., Parus, A., Pajor, M., Miądlicki, K.: Signal prediction in bilateral teleoperation with force-feedback. In: Proceedings in Mathematics and Statistics, pp. 311–323. Springer (2018)
27.
go back to reference Sakow, M., Marchelek, K.: Model-free and time-constant prediction for closed-loop systems with time delay. Control Eng. Pract. 81, 1–8 (2018)CrossRef Sakow, M., Marchelek, K.: Model-free and time-constant prediction for closed-loop systems with time delay. Control Eng. Pract. 81, 1–8 (2018)CrossRef
28.
go back to reference Herbin, P., Pajor, M.: ExoArm 7-DOF (interactive 7-DOF motion controller of the operator arm) master device for control of loading crane. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 439–449. Springer (2018) Herbin, P., Pajor, M.: ExoArm 7-DOF (interactive 7-DOF motion controller of the operator arm) master device for control of loading crane. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 439–449. Springer (2018)
29.
go back to reference Herbin, P.: Design and modeling of an exoskeleton torque sensor. Sci. J. Marit. Univ. Szczecin 51(123), 89–94 (2017) Herbin, P.: Design and modeling of an exoskeleton torque sensor. Sci. J. Marit. Univ. Szczecin 51(123), 89–94 (2017)
30.
go back to reference Berczyński, S., Lachowicz, M., Pajor, M.: An improved method of approximating frequency characteristics in the problem of modal analysis and its applications. Comput. Eng. 30, 575–584 (2001) Berczyński, S., Lachowicz, M., Pajor, M.: An improved method of approximating frequency characteristics in the problem of modal analysis and its applications. Comput. Eng. 30, 575–584 (2001)
31.
go back to reference Pulikowski, D., Lackner, F., Scheuerlein, C., Meinel, D., Savary, F., Tommasini, D., Pajor, M.: Testing mechanical behavior of Nb3Sn Rutherford cable during coil winding. IEEE Trans. Appl. Supercond. 27, 1–5 (2017)CrossRef Pulikowski, D., Lackner, F., Scheuerlein, C., Meinel, D., Savary, F., Tommasini, D., Pajor, M.: Testing mechanical behavior of Nb3Sn Rutherford cable during coil winding. IEEE Trans. Appl. Supercond. 27, 1–5 (2017)CrossRef
32.
go back to reference Pajor, M., Marchelek, K., Powałka, B.: Experimental verification of method of machine tool-cutting process system model reduction in face milling. Comput. Methods Exp. Meas. 22, 503–512 (1999) Pajor, M., Marchelek, K., Powałka, B.: Experimental verification of method of machine tool-cutting process system model reduction in face milling. Comput. Methods Exp. Meas. 22, 503–512 (1999)
33.
go back to reference Glennie, C.L., Kusari, A., Facchin, A.: Calibration and stability analysis of the VLP-16 laser scanner. Int. Arch. Photogram. Remote Sens. Spat. Inf. Sci. - ISPRS Arch. 40, 55–60 (2016)CrossRef Glennie, C.L., Kusari, A., Facchin, A.: Calibration and stability analysis of the VLP-16 laser scanner. Int. Arch. Photogram. Remote Sens. Spat. Inf. Sci. - ISPRS Arch. 40, 55–60 (2016)CrossRef
34.
go back to reference Miądlicki, K., Pajor, M., Saków, M.: Ground plane estimation from sparse LIDAR data for loader crane sensor fusion system. In: 2nd International Conference on Methods and Models in Automation and Robotics, pp. 717–722. IEEE (2017) Miądlicki, K., Pajor, M., Saków, M.: Ground plane estimation from sparse LIDAR data for loader crane sensor fusion system. In: 2nd International Conference on Methods and Models in Automation and Robotics, pp. 717–722. IEEE (2017)
35.
go back to reference Miadlicki, K., Pajor, M., Saków M.: Real-time ground filtration method for a loader crane environment monitoring system using sparse LIDAR data. In: International Conference on Innovations in Intelligent Systems and Applications, pp. 207–212. IEEE (2017) Miadlicki, K., Pajor, M., Saków M.: Real-time ground filtration method for a loader crane environment monitoring system using sparse LIDAR data. In: International Conference on Innovations in Intelligent Systems and Applications, pp. 207–212. IEEE (2017)
36.
go back to reference Miadlicki, K., Pajor, M., Saków, M., Loader crane working area monitoring system based on LIDAR scanner. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 465–474. Springer (2018) Miadlicki, K., Pajor, M., Saków, M., Loader crane working area monitoring system based on LIDAR scanner. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 465–474. Springer (2018)
37.
go back to reference Bogoslavskyi, I., Stachniss, C.: Fast range image-based segmentation of sparse 3D laser scans for online operation. In: IEEE International Conference on Intelligent Robots and Systems, pp. 163–169. IEEE (2016) Bogoslavskyi, I., Stachniss, C.: Fast range image-based segmentation of sparse 3D laser scans for online operation. In: IEEE International Conference on Intelligent Robots and Systems, pp. 163–169. IEEE (2016)
38.
go back to reference Bogoslavskyi, I., Stachniss, C.: Analyzing the quality of matched 3D point clouds of objects. In: International Conference on Intelligent Robots and Systems, pp. 6685–6690. IEEE (2017) Bogoslavskyi, I., Stachniss, C.: Analyzing the quality of matched 3D point clouds of objects. In: International Conference on Intelligent Robots and Systems, pp. 6685–6690. IEEE (2017)
39.
go back to reference Bogoslavskyi, I., Stachniss, C.: Efficient online segmentation for sparse 3D laser scans. Photogram. Fernerkundung Geoinf. 85, 41–52 (2017) Bogoslavskyi, I., Stachniss, C.: Efficient online segmentation for sparse 3D laser scans. Photogram. Fernerkundung Geoinf. 85, 41–52 (2017)
40.
go back to reference Koide, K., Miura J.: A Portable person behavior measurement system using a 3D LIDAR. In: The Proceedings of JSME Annual Conference on Robotics and Mechatronics (Robomec), pp. 11–111. IEEE (2017)CrossRef Koide, K., Miura J.: A Portable person behavior measurement system using a 3D LIDAR. In: The Proceedings of JSME Annual Conference on Robotics and Mechatronics (Robomec), pp. 11–111. IEEE (2017)CrossRef
Metadata
Title
LiDAR Based System for Tracking Loader Crane Operator
Authors
Karol Miądlicki
Mateusz Saków
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-18715-6_34

Premium Partner