Skip to main content
SpringerLink
Log in

Automatic Identification of Excavator Activities Using Joystick Signals

  • Regular Paper
  • Published:
International Journal of Precision Engineering and Manufacturing Aims and scope Submit manuscript

Abstract

Monitoring and analyzing the operations of construction equipment is critical in the construction engineering and management domain. The ability to detect and classify major activities that construction equipment performs can support a project manager in making proper project-related decisions such as resource allocation and scheduling, resulting in improved productivity. Earth-moving activities as performed by an excavator, which is one of the most frequently used pieces of construction equipment, are normally repetitive by nature and possess unique features in terms of their patterns of operation. This study develops an activity identification algorithm capable of automatically classifying predefined earth-moving activities that are currently in progress. Given that the excavator is operated using joysticks, the joystick signals include unique patterns that exhibit the similar overall shapes but may not uniformly line up with time for a specific activity. The proposed study examines a dynamic time warping algorithm that determines similarities between a predefined activity and a measured signal distorted in time. The feasibility of the algorithm is verified through experiments involving activities such as digging, leveling, lifting, and trenching that were easily and accurately identified by the algorithm. The proposed task-identification algorithm could be used to develop an automated system of establishing machine parameters and to calculate the durations of operations and cycle times.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Refenences

  1. Gong, J., & Caldas, C. H. (2010). Computer vision-based video interpretation model for automated productivity analysis of construction operations. Journal of Computing in Civil Engineering,24(3), 252–263. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000027.

    Article  Google Scholar 

  2. Golparvar-Fard, M., Heydarian, A., & Niebles, J. C. (2013). Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers. Advanced Engineering Informatics,27(4), 652–663. https://doi.org/10.1016/j.aei.2013.09.001.

    Article  Google Scholar 

  3. Kim, J., Chi, S., & Seo, J. (2018). Interaction analysis for vision-based activity identification of earthmoving excavators and dump trucks. Automation in Construction,87, 297–308. https://doi.org/10.1016/j.autcon.2017.12.016.

    Article  Google Scholar 

  4. Yang, J., Edwards, D. J., & Love, P. E. D. (2003). A computational intelligent fuzzy model approach for excavator cycle time simulation. Automation in Construction,12(6), 725–735. https://doi.org/10.1016/S0926-5805(03)00056-6.

    Article  Google Scholar 

  5. Oloufa, A. A., Ikeda, M., & Oda, H. (2003). Situational awareness of construction equipment using GPS, wireless and web technologies. Automation in Construction,12(6), 737–748. https://doi.org/10.1016/S0926-5805(03)00057-8.

    Article  Google Scholar 

  6. Ergen, E., Akinci, B., & Sacks, R. (2007). Tracking and locating components in a precast storage yard utilizing radio frequency identification technology and GPS. Automation in Construction,16(3), 354–367. https://doi.org/10.1016/j.autcon.2006.07.004.

    Article  Google Scholar 

  7. Teizer, J., Lao, D., & Sofer, M. (2007). Rapid automated monitoring of construction site activities using ultra-wide band. In The 24th international symposium on automation and robotics in construction (ISARC 2007) (pp. 23–28).

  8. Zhang, C., Hammad, A., & Rodriguez, S. (2012). Crane pose estimation using UWB real-time location system. Journal of Computing in Civil Engineering,26(5), 625–637. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000172.

    Article  Google Scholar 

  9. Rezazadeh Azar, E., & McCabe, B. (2012). Part based model and spatial–temporal reasoning to recognize hydraulic excavators in construction images and videos. Automation in Construction,24, 194–202. https://doi.org/10.1016/j.autcon.2012.03.003.

    Article  Google Scholar 

  10. Zou, J., & Kim, H. (2007). Using hue, saturation, and value color space for hydraulic excavator idle time analysis. Journal of Computing in Civil Engineering,21(4), 238–246. https://doi.org/10.1061/(ASCE)0887-3801(2007)21:4(238).

    Article  Google Scholar 

  11. Yuan, C., Li, S., & Cai, H. (2017). Vision-based excavator detection and tracking using hybrid kinematic shapes and key nodes. Journal of Computing in Civil Engineering,31(1), 04016038. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000602.

    Article  Google Scholar 

  12. Ahn, C. R., Lee, S., & Peña-Mora, F. (2013). Acceleromter-based measurement of construction equipment operating efficiency for monitoring environmental performance. ASCE International Workshop on Computing in Civil Engineering. https://doi.org/10.1061/9780784413029.071.

    Article  Google Scholar 

  13. Ahn, C. R., Lee, S., & Peña-Mora, F. (2015). Application of low-cost accelerometers for measuring the operational efficiency of a construction equipment fleet. Journal of Computing in Civil Engineering,29(2), 04014042. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000337.

    Article  Google Scholar 

  14. Mathur, N., Aria, S., Adams, T., Ahn, C., & Lee, S. (2015). Automated cycle time measurement and analysis of excavator’s loading operation using smart phone-embedded IMU sensors. International Workshop on Computing in Civil Engineering,2015, 215–222. https://doi.org/10.1061/9780784479247.027.

    Article  Google Scholar 

  15. Akhavian, R., & Behzadan, A. H. (2015). Construction equipment activity recognition for simulation input modeling using mobile sensors and machine learning classifiers. Advanced Engineering Informatics,29(4), 867–877. https://doi.org/10.1016/j.aei.2015.03.001.

    Article  Google Scholar 

  16. Kim, H., Ahn, C. R., Engelhaupt, D., & Lee, S. (2018). Application of dynamic time warping to the recognition of mixed equipment activities in cycle time measurement. Automation in Construction,87, 225–234. https://doi.org/10.1016/j.autcon.2017.12.014.

    Article  Google Scholar 

  17. Domingue, B. B. (2016). Coordinated rate control user interface and task identification of an excavator. MSc thesis, Georgia Institute of Technology. Retrieved from http://hdl.handle.net/1853/56373. Accessed 4 Sep 2019.

  18. Aach, J., & Church, G. M. (2001). Aligning gene expression time series with time warping algorithms. Bioinformatics,17(6), 495–508. https://doi.org/10.1093/bioinformatics/17.6.495.

    Article  Google Scholar 

  19. Rath, T. M., & Manmatha, R. (2003). Word image matching using dynamic time warping. In 2003 IEEE computer society conference on computer vision and pattern recognition (Vol. 2, pp. II/521–II/527). https://doi.org/10.1109/CVPR.2003.1211511.

  20. Fischer, A., & Plamondon, R. (2017). Signature verification based on the kinematic theory of rapid human movements. IEEE Transactions on Human-Machine Systems,47(2), 169–180. https://doi.org/10.1109/THMS.2016.2634922.

    Article  Google Scholar 

  21. Keogh, E., & Ratanamahatana, C. A. (2005). Exact indexing of dynamic time warping. Knowledge and Information Systems,7(3), 358–386. https://doi.org/10.1007/s10115-004-0154-9.

    Article  Google Scholar 

  22. Salvadora, S., & Chan, P. (2007). Toward accurate dynamic time warping in linear time and space. Intelligent Data Analysis,11(5), 561–580. https://doi.org/10.3233/ida-2007-11508.

    Article  Google Scholar 

  23. Jeong, Y. S., Jeong, M. K., & Omitaomu, O. A. (2011). Weighted dynamic time warping for time series classification. Pattern Recognition,44(9), 2231–2240. https://doi.org/10.1016/j.patcog.2010.09.022.

    Article  Google Scholar 

  24. Sankoff, D., & Kruskal, J. B. (1983). Time warps, string edits, and macromolecules: The theory and practice of sequence comparison. Boston: Addison-Wesley.

    MATH  Google Scholar 

Download references

Acknowledgements

This research was supported by a grant (19AUDP-B121595-04) from Architecture & Urban Development Research Program funded by the Ministry of Land, Infrastructure and Transport of the Korean Government.

Author information

Authors and Affiliations

  1. School of Mechanical Engineering, Korea University, Anam-Dong, Sungbuk-Ku, Seoul, 136-713, Republic of Korea

    Jangho Bae, Kiyoung Kim & Daehie Hong

Authors
  1. Jangho Bae
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kiyoung Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Daehie Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daehie Hong.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bae, J., Kim, K. & Hong, D. Automatic Identification of Excavator Activities Using Joystick Signals. Int. J. Precis. Eng. Manuf. 20, 2101–2107 (2019). https://doi.org/10.1007/s12541-019-00219-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12541-019-00219-5

Keywords

Search

Navigation