Skip to main content

2019 | OriginalPaper | Buchkapitel

LiDAR Based System for Tracking Loader Crane Operator

verfasst von : Karol Miądlicki, Mateusz Saków

Erschienen in: Advances in Manufacturing II

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nowadays, particularly in the IoT, industry 4.0, smart devices, intelligent robots and autonomous vehicles, the segmentation and analysis of the environment using 3D data (point clouds) is a current and relevant research topic. The reducing prices of depth sensors based on light detection and ranging (LIDAR), time of flight (ToF), radio detection and ranging (RADAR) technologies and high computing power, facilitate the development of intelligent systems. In this work real-time LiDAR based system for tracking loader crane operator has been presented. Developed system uses a Velodyne VLP-16 LiDAR to detect and track loader crane operator and is fully integrated with open-source ROS (Robot Operating System). This solution will help to determine whether the operator is in the crane working zone, which will increase his safety. The work presents the main assumptions of the system, subsequent stages of point clouds processing and used algorithms. Detection and tracking algorithms performance was evaluated based on real data acquired under different conditions, and the results were compared to similar solutions found in the literature. The results of conducted test were presented. Furthermore, in this article, we discussed other methods used to detect and track humans in real time, described Velodyne VLP-16 scanner, robot operating system and data processing methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Sanjaya, K., Henning, F., Purba, K.R.: 3D LIDAR city model application and marketing plan development. In: International Conference on Soft Computing, Intelligent System and Information Technology: Building Intelligence Through IOT and Big Data, pp. 238–242. IEEE (2018) Sanjaya, K., Henning, F., Purba, K.R.: 3D LIDAR city model application and marketing plan development. In: International Conference on Soft Computing, Intelligent System and Information Technology: Building Intelligence Through IOT and Big Data, pp. 238–242. IEEE (2018)
2.
Zurück zum Zitat Gopalakrishnan, R., Thomas, V.A., Wynne, R.H., Coulston, J.W., Fox, T.R.: Shrub detection using disparate airborne laser scanning acquisitions over varied forest cover types. Int. J. Remote Sens. 39, 1220–1242 (2018)CrossRef Gopalakrishnan, R., Thomas, V.A., Wynne, R.H., Coulston, J.W., Fox, T.R.: Shrub detection using disparate airborne laser scanning acquisitions over varied forest cover types. Int. J. Remote Sens. 39, 1220–1242 (2018)CrossRef
3.
Zurück zum Zitat Zhou, Q., Tan, Z., Yang, C.: Theoretical limit evaluation of ranging accuracy and power for LiDAR systems in autonomous cars. Opt. Eng. 57, 1–8 (2018) Zhou, Q., Tan, Z., Yang, C.: Theoretical limit evaluation of ranging accuracy and power for LiDAR systems in autonomous cars. Opt. Eng. 57, 1–8 (2018)
4.
Zurück zum Zitat Malavazi, F.B.P., Guyonneau, R., Fasquel, J.B., Lagrange, S., Mercier, F.: LiDAR-only based navigation algorithm for an autonomous agricultural robot. Comput. Electron. Agric. 154, 71–79 (2018)CrossRef Malavazi, F.B.P., Guyonneau, R., Fasquel, J.B., Lagrange, S., Mercier, F.: LiDAR-only based navigation algorithm for an autonomous agricultural robot. Comput. Electron. Agric. 154, 71–79 (2018)CrossRef
5.
Zurück zum Zitat Sakib, M.N., Rahman, M.A.: Traffic bottleneck reconstruction LIDAR orthoimages: a RANSAC algorithm feature extraction. Adv. Intell. Syst. Comput. 843, 302–307 (2018) Sakib, M.N., Rahman, M.A.: Traffic bottleneck reconstruction LIDAR orthoimages: a RANSAC algorithm feature extraction. Adv. Intell. Syst. Comput. 843, 302–307 (2018)
6.
Zurück zum Zitat Wu, J., Xu, H., Zheng, Y., Tian, Z.: A novel method of vehicle-pedestrian near-crash identification with roadside LiDAR data. Accid. Anal. Prev. 121, 238–249 (2018)CrossRef Wu, J., Xu, H., Zheng, Y., Tian, Z.: A novel method of vehicle-pedestrian near-crash identification with roadside LiDAR data. Accid. Anal. Prev. 121, 238–249 (2018)CrossRef
7.
Zurück zum Zitat Nakashima, K., Jung, H., Oto, Y., Iwashita, Y., Kurazume, R., Mozos, O.M.: Learning geometric and photometric features from panoramic LiDAR scans for outdoor place categorization. Adv. Robot. 32, 750–765 (2018)CrossRef Nakashima, K., Jung, H., Oto, Y., Iwashita, Y., Kurazume, R., Mozos, O.M.: Learning geometric and photometric features from panoramic LiDAR scans for outdoor place categorization. Adv. Robot. 32, 750–765 (2018)CrossRef
8.
Zurück zum Zitat Herbin, P., Pajor, M.: The torque control system of exoskeleton ExoArm 7-DOF used in bilateral teleoperation system. In: AIP Conference Proceedings, pp. 020020–020020-9 (2018) Herbin, P., Pajor, M.: The torque control system of exoskeleton ExoArm 7-DOF used in bilateral teleoperation system. In: AIP Conference Proceedings, pp. 020020–020020-9 (2018)
9.
Zurück zum Zitat Pajor, M., Grudziński, M., Marchewka, Ł.: Stereovision system for motion tracking and position error compensation of loading crane. In: AIP Conference Proceedings, pp. 020050–020050-10 (2018) Pajor, M., Grudziński, M., Marchewka, Ł.: Stereovision system for motion tracking and position error compensation of loading crane. In: AIP Conference Proceedings, pp. 020050–020050-10 (2018)
10.
Zurück zum Zitat Jasiewicz, M., Miądlicki, K., Powałka, B.: Assistance of machining parameters selection for slender tools in CNC control. In: AIP Conference Proceedings, pp. 020024–020024-10 (2018) Jasiewicz, M., Miądlicki, K., Powałka, B.: Assistance of machining parameters selection for slender tools in CNC control. In: AIP Conference Proceedings, pp. 020024–020024-10 (2018)
11.
Zurück zum Zitat Jasiewicz, M., Powalka, B.: Identification of a lathe spindle dynamics using extended inverse receptance coupling. J. Dyn. Syst. Meas. Control 140(12), 121015-1–121015-11 (2018)CrossRef Jasiewicz, M., Powalka, B.: Identification of a lathe spindle dynamics using extended inverse receptance coupling. J. Dyn. Syst. Meas. Control 140(12), 121015-1–121015-11 (2018)CrossRef
12.
Zurück zum Zitat Jasiewicz, M., Powałka, B.: Prediction of turning stability using receptance coupling. In: AIP Conference Proceedings, pp. 100005-1–100005-9 (2018) Jasiewicz, M., Powałka, B.: Prediction of turning stability using receptance coupling. In: AIP Conference Proceedings, pp. 100005-1–100005-9 (2018)
13.
Zurück zum Zitat Majewski, M., Kacalak, W., Budniak, Z., Pajor, M.: Interactive control systems for mobile cranes. Adv. Intell. Syst. Comput. 1, 10–19 (2018) Majewski, M., Kacalak, W., Budniak, Z., Pajor, M.: Interactive control systems for mobile cranes. Adv. Intell. Syst. Comput. 1, 10–19 (2018)
14.
Zurück zum Zitat Rybarczyk, D., Owczarek, P., Myszkowski, A.: Development of force feedback controller for the loader crane. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 345–354. Springer (2018) Rybarczyk, D., Owczarek, P., Myszkowski, A.: Development of force feedback controller for the loader crane. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 345–354. Springer (2018)
15.
Zurück zum Zitat Myszkowski, A., Bartkowiak, T., Staniek, R.: Novel type of biaxial wheel-type haptic input device with MR-brakes to control hydraulic multi-axis manipulators. In: Volume 4A: Dynamics, Vibration, and Control, pp. 71300-1–71300-6. ASME (2017) Myszkowski, A., Bartkowiak, T., Staniek, R.: Novel type of biaxial wheel-type haptic input device with MR-brakes to control hydraulic multi-axis manipulators. In: Volume 4A: Dynamics, Vibration, and Control, pp. 71300-1–71300-6. ASME (2017)
16.
Zurück zum Zitat Westerberg, S., Manchester, I.R., Mettin, U., Hera, P.L, Shiriaev, A.: Virtual environment teleoperation of a hydraulic forestry crane. In: IEEE International Conference on Robotics and Automation, pp. 4049–4054. IEEE (2008) Westerberg, S., Manchester, I.R., Mettin, U., Hera, P.L, Shiriaev, A.: Virtual environment teleoperation of a hydraulic forestry crane. In: IEEE International Conference on Robotics and Automation, pp. 4049–4054. IEEE (2008)
17.
Zurück zum Zitat Lagerev, I.A., Lagerev, A.V.: Universal mathematical model of a hydraulic loader crane. In: IOP Conference Series: Earth and Environmental Science, vol. 194, pp. 032015-1–032015-6 (2018) Lagerev, I.A., Lagerev, A.V.: Universal mathematical model of a hydraulic loader crane. In: IOP Conference Series: Earth and Environmental Science, vol. 194, pp. 032015-1–032015-6 (2018)
18.
Zurück zum Zitat Miądlicki, K., Pajor, M.: Overview of user interfaces used in load lifting devices. Int. J. Sci. Eng. Res. 6, 1215–1220 (2015) Miądlicki, K., Pajor, M.: Overview of user interfaces used in load lifting devices. Int. J. Sci. Eng. Res. 6, 1215–1220 (2015)
19.
Zurück zum Zitat Majewski, M., Kacalak, W.: Human-machine speech-based interfaces with augmented reality and interactive systems for controlling mobile cranes. Lecture Notes in Computer Science, pp. 89–98. Springer (2016) Majewski, M., Kacalak, W.: Human-machine speech-based interfaces with augmented reality and interactive systems for controlling mobile cranes. Lecture Notes in Computer Science, pp. 89–98. Springer (2016)
20.
Zurück zum Zitat Majewski, M., Kacalak, W.: Intelligent speech-based interactive communication between mobile cranes and their human operators. Lecture Notes in Computer Science, pp. 523–530. Springer (2016) Majewski, M., Kacalak, W.: Intelligent speech-based interactive communication between mobile cranes and their human operators. Lecture Notes in Computer Science, pp. 523–530. Springer (2016)
21.
Zurück zum Zitat Saków, M., Miądlicki, K., Parus, A.: Self-sensing teleoperation system based on 1-DOF pneumatic manipulator. J. Autom. Mob. Robot. Intell. Syst. 11, 64–76 (2017) Saków, M., Miądlicki, K., Parus, A.: Self-sensing teleoperation system based on 1-DOF pneumatic manipulator. J. Autom. Mob. Robot. Intell. Syst. 11, 64–76 (2017)
22.
Zurück zum Zitat Saków, M., Parus, A., Pajor, M., Miądlicki, K.: Nonlinear inverse modeling with signal prediction in bilateral teleoperation with force-feedback. In: 22nd International Conference on Methods and Models in Automation and Robotics, pp. 141–146. IEEE (2017) Saków, M., Parus, A., Pajor, M., Miądlicki, K.: Nonlinear inverse modeling with signal prediction in bilateral teleoperation with force-feedback. In: 22nd International Conference on Methods and Models in Automation and Robotics, pp. 141–146. IEEE (2017)
23.
Zurück zum Zitat Saków, M., Miądlicki, K.: Transport delay and first order inertia time signal prediction dedicated to teleoperation. In: Advances in Automation, Robotics and Measurement Techniques, pp. 142–151. Springer (2018) Saków, M., Miądlicki, K.: Transport delay and first order inertia time signal prediction dedicated to teleoperation. In: Advances in Automation, Robotics and Measurement Techniques, pp. 142–151. Springer (2018)
24.
Zurück zum Zitat Saków, M., Parus, A., Pajor, M., Miadlicki, K.: Unilateral hydraulic telemanipulation system for operation in machining work area. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 415–425. Springer (2018) Saków, M., Parus, A., Pajor, M., Miadlicki, K.: Unilateral hydraulic telemanipulation system for operation in machining work area. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 415–425. Springer (2018)
25.
Zurück zum Zitat Herbin, P., Pajor, M.: Interactive 7-DOF motion controller of the operator arm (ExoArm 7-DOF). In: International Conference on Innovations in Intelligent Systems and Applications, pp. 185–188. IEEE (2017) Herbin, P., Pajor, M.: Interactive 7-DOF motion controller of the operator arm (ExoArm 7-DOF). In: International Conference on Innovations in Intelligent Systems and Applications, pp. 185–188. IEEE (2017)
26.
Zurück zum Zitat Saków, M., Marchelek, K., Parus, A., Pajor, M., Miądlicki, K.: Signal prediction in bilateral teleoperation with force-feedback. In: Proceedings in Mathematics and Statistics, pp. 311–323. Springer (2018) Saków, M., Marchelek, K., Parus, A., Pajor, M., Miądlicki, K.: Signal prediction in bilateral teleoperation with force-feedback. In: Proceedings in Mathematics and Statistics, pp. 311–323. Springer (2018)
27.
Zurück zum Zitat Sakow, M., Marchelek, K.: Model-free and time-constant prediction for closed-loop systems with time delay. Control Eng. Pract. 81, 1–8 (2018)CrossRef Sakow, M., Marchelek, K.: Model-free and time-constant prediction for closed-loop systems with time delay. Control Eng. Pract. 81, 1–8 (2018)CrossRef
28.
Zurück zum Zitat Herbin, P., Pajor, M.: ExoArm 7-DOF (interactive 7-DOF motion controller of the operator arm) master device for control of loading crane. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 439–449. Springer (2018) Herbin, P., Pajor, M.: ExoArm 7-DOF (interactive 7-DOF motion controller of the operator arm) master device for control of loading crane. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 439–449. Springer (2018)
29.
Zurück zum Zitat Herbin, P.: Design and modeling of an exoskeleton torque sensor. Sci. J. Marit. Univ. Szczecin 51(123), 89–94 (2017) Herbin, P.: Design and modeling of an exoskeleton torque sensor. Sci. J. Marit. Univ. Szczecin 51(123), 89–94 (2017)
30.
Zurück zum Zitat Berczyński, S., Lachowicz, M., Pajor, M.: An improved method of approximating frequency characteristics in the problem of modal analysis and its applications. Comput. Eng. 30, 575–584 (2001) Berczyński, S., Lachowicz, M., Pajor, M.: An improved method of approximating frequency characteristics in the problem of modal analysis and its applications. Comput. Eng. 30, 575–584 (2001)
31.
Zurück zum Zitat Pulikowski, D., Lackner, F., Scheuerlein, C., Meinel, D., Savary, F., Tommasini, D., Pajor, M.: Testing mechanical behavior of Nb3Sn Rutherford cable during coil winding. IEEE Trans. Appl. Supercond. 27, 1–5 (2017)CrossRef Pulikowski, D., Lackner, F., Scheuerlein, C., Meinel, D., Savary, F., Tommasini, D., Pajor, M.: Testing mechanical behavior of Nb3Sn Rutherford cable during coil winding. IEEE Trans. Appl. Supercond. 27, 1–5 (2017)CrossRef
32.
Zurück zum Zitat Pajor, M., Marchelek, K., Powałka, B.: Experimental verification of method of machine tool-cutting process system model reduction in face milling. Comput. Methods Exp. Meas. 22, 503–512 (1999) Pajor, M., Marchelek, K., Powałka, B.: Experimental verification of method of machine tool-cutting process system model reduction in face milling. Comput. Methods Exp. Meas. 22, 503–512 (1999)
33.
Zurück zum Zitat Glennie, C.L., Kusari, A., Facchin, A.: Calibration and stability analysis of the VLP-16 laser scanner. Int. Arch. Photogram. Remote Sens. Spat. Inf. Sci. - ISPRS Arch. 40, 55–60 (2016)CrossRef Glennie, C.L., Kusari, A., Facchin, A.: Calibration and stability analysis of the VLP-16 laser scanner. Int. Arch. Photogram. Remote Sens. Spat. Inf. Sci. - ISPRS Arch. 40, 55–60 (2016)CrossRef
34.
Zurück zum Zitat Miądlicki, K., Pajor, M., Saków, M.: Ground plane estimation from sparse LIDAR data for loader crane sensor fusion system. In: 2nd International Conference on Methods and Models in Automation and Robotics, pp. 717–722. IEEE (2017) Miądlicki, K., Pajor, M., Saków, M.: Ground plane estimation from sparse LIDAR data for loader crane sensor fusion system. In: 2nd International Conference on Methods and Models in Automation and Robotics, pp. 717–722. IEEE (2017)
35.
Zurück zum Zitat Miadlicki, K., Pajor, M., Saków M.: Real-time ground filtration method for a loader crane environment monitoring system using sparse LIDAR data. In: International Conference on Innovations in Intelligent Systems and Applications, pp. 207–212. IEEE (2017) Miadlicki, K., Pajor, M., Saków M.: Real-time ground filtration method for a loader crane environment monitoring system using sparse LIDAR data. In: International Conference on Innovations in Intelligent Systems and Applications, pp. 207–212. IEEE (2017)
36.
Zurück zum Zitat Miadlicki, K., Pajor, M., Saków, M., Loader crane working area monitoring system based on LIDAR scanner. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 465–474. Springer (2018) Miadlicki, K., Pajor, M., Saków, M., Loader crane working area monitoring system based on LIDAR scanner. In: Advances in Manufacturing. Lecture Notes in Mechanical Engineering, pp. 465–474. Springer (2018)
37.
Zurück zum Zitat Bogoslavskyi, I., Stachniss, C.: Fast range image-based segmentation of sparse 3D laser scans for online operation. In: IEEE International Conference on Intelligent Robots and Systems, pp. 163–169. IEEE (2016) Bogoslavskyi, I., Stachniss, C.: Fast range image-based segmentation of sparse 3D laser scans for online operation. In: IEEE International Conference on Intelligent Robots and Systems, pp. 163–169. IEEE (2016)
38.
Zurück zum Zitat Bogoslavskyi, I., Stachniss, C.: Analyzing the quality of matched 3D point clouds of objects. In: International Conference on Intelligent Robots and Systems, pp. 6685–6690. IEEE (2017) Bogoslavskyi, I., Stachniss, C.: Analyzing the quality of matched 3D point clouds of objects. In: International Conference on Intelligent Robots and Systems, pp. 6685–6690. IEEE (2017)
39.
Zurück zum Zitat Bogoslavskyi, I., Stachniss, C.: Efficient online segmentation for sparse 3D laser scans. Photogram. Fernerkundung Geoinf. 85, 41–52 (2017) Bogoslavskyi, I., Stachniss, C.: Efficient online segmentation for sparse 3D laser scans. Photogram. Fernerkundung Geoinf. 85, 41–52 (2017)
40.
Zurück zum Zitat Koide, K., Miura J.: A Portable person behavior measurement system using a 3D LIDAR. In: The Proceedings of JSME Annual Conference on Robotics and Mechatronics (Robomec), pp. 11–111. IEEE (2017)CrossRef Koide, K., Miura J.: A Portable person behavior measurement system using a 3D LIDAR. In: The Proceedings of JSME Annual Conference on Robotics and Mechatronics (Robomec), pp. 11–111. IEEE (2017)CrossRef
Metadaten
Titel
LiDAR Based System for Tracking Loader Crane Operator
verfasst von
Karol Miądlicki
Mateusz Saków
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-18715-6_34