Skip to main content
Top

2020 | OriginalPaper | Chapter

Assessing Deep Learning Models for Human-Robot Collaboration Collision Detection in Industrial Environments

Authors : Iago R. R. Silva, Gibson B. N. Barbosa, Carolina C. D. Ledebour, Assis T. Oliveira Filho, Judith Kelner, Djamel Sadok, Silvia Lins, Ricardo Souza

Published in: Intelligent Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The increasing adoption of industrial robots to boost production efficiency is turning human-robot collaborative scenarios much more frequent. In this context, technical factory workers need to be safe at all times from collisions and prepare for emergencies and potential accidents. Another trend in industrial automation is the usage of machine learning techniques - specifically, deep learning algorithms - for image classification. Following these tendencies, this work evaluates the application of deep learning models to detect physical collision in human-robot interactions. Security camera images are used as the primary information source for intelligent collision detection. Unlike other proposed approaches in the literature that apply sensors like Light Detection And Ranging (LIDAR), Laser Range Finder (LRF), or torque sensors from robots, this work does not consider extra sensors, using only 2D cameras. Results show more than 99% of accuracy in the evaluated scenarios, revealing that approaches adopting deep learning algorithms could be promising for human-robot collision avoidance in industrial scenarios. The proposed models may support safety in industrial environments and reduce the impact of collision accidents.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference 365 Microsoft Dynamics: 2019 manufacturing trends report (2019). Accessed 09 Sep 2019 365 Microsoft Dynamics: 2019 manufacturing trends report (2019). Accessed 09 Sep 2019
2.
go back to reference Das, N., Yip, M.: Learning-based proxy collision detection for robot motion planning applications. arXiv preprint arXiv:1902.08164 (2019) Das, N., Yip, M.: Learning-based proxy collision detection for robot motion planning applications. arXiv preprint arXiv:​1902.​08164 (2019)
3.
go back to reference Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: CVPR 2009 (2009) Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: CVPR 2009 (2009)
4.
go back to reference Ferreira, J.L.C., Aloise, A.F., Matter, V.K., Barbosa, J.L.V., Rigo, S.J., de Oliveira, K.S.F.: A model for predicting disapproval of apprentices in distance education using decision tree. In: Proceedings of the XV Brazilian Symposium on Information Systems, SBSI 2019, Aracaju, Brazil, 20–24 May 2019, pp. 14:1–14:8 (2019). https://doi.org/10.1145/3330204.3330223 Ferreira, J.L.C., Aloise, A.F., Matter, V.K., Barbosa, J.L.V., Rigo, S.J., de Oliveira, K.S.F.: A model for predicting disapproval of apprentices in distance education using decision tree. In: Proceedings of the XV Brazilian Symposium on Information Systems, SBSI 2019, Aracaju, Brazil, 20–24 May 2019, pp. 14:1–14:8 (2019). https://​doi.​org/​10.​1145/​3330204.​3330223
5.
go back to reference Gecks, T., Henrich, D.: Multi-camera collision detection allowing for object occlusions. In: 37th International Symposium on Robotics (ISR 2006)/4th German Conference on Robotics (Robotik 2006) (2006) Gecks, T., Henrich, D.: Multi-camera collision detection allowing for object occlusions. In: 37th International Symposium on Robotics (ISR 2006)/4th German Conference on Robotics (Robotik 2006) (2006)
6.
go back to reference Henrich, D., Gecks, T.: Multi-camera collision detection between known and unknown objects. In: 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras, pp. 1–10. IEEE (2008) Henrich, D., Gecks, T.: Multi-camera collision detection between known and unknown objects. In: 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras, pp. 1–10. IEEE (2008)
7.
go back to reference Howard, A.G., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017) Howard, A.G., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:​1704.​04861 (2017)
8.
go back to reference Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, 7–9 May 2015, Conference Track Proceedings (2015). http://arxiv.org/abs/1412.6980 Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, 7–9 May 2015, Conference Track Proceedings (2015). http://​arxiv.​org/​abs/​1412.​6980
9.
go back to reference Bureau of Labor Statistics: Employer-reported workplace injuries and illnesses -2017 (2018) Bureau of Labor Statistics: Employer-reported workplace injuries and illnesses -2017 (2018)
10.
go back to reference LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., et al.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., et al.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef
14.
go back to reference Sharkawy, A.N., Aspragathos, N.: Human-robot collision detection based on neural networks. Int. J. Mech. Eng. Robot. Res 7(2), 150–157 (2018)CrossRef Sharkawy, A.N., Aspragathos, N.: Human-robot collision detection based on neural networks. Int. J. Mech. Eng. Robot. Res 7(2), 150–157 (2018)CrossRef
15.
16.
go back to reference Silva, I.R.R., Silva, G.S.L., Souza, R.G., Santos, W.P., Fagundes, R.A.A.: Model based on deep feature extraction for diagnosis of Alzheimer’s disease. In: Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), vol. 1 (2019) Silva, I.R.R., Silva, G.S.L., Souza, R.G., Santos, W.P., Fagundes, R.A.A.: Model based on deep feature extraction for diagnosis of Alzheimer’s disease. In: Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), vol. 1 (2019)
17.
go back to reference Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, 7–9 May 2015, Conference Track Proceedings (2015). http://arxiv.org/abs/1409.1556 Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, 7–9 May 2015, Conference Track Proceedings (2015). http://​arxiv.​org/​abs/​1409.​1556
18.
go back to reference Takiguchi, T., Lee, J.H., Okamoto, S.: Collision avoidance algorithm using deep learning type artificial intelligence for a mobile robot. In: Proceedings of the International MultiConference of Engineers and Computer Scientists, vol. 1 (2018) Takiguchi, T., Lee, J.H., Okamoto, S.: Collision avoidance algorithm using deep learning type artificial intelligence for a mobile robot. In: Proceedings of the International MultiConference of Engineers and Computer Scientists, vol. 1 (2018)
Metadata
Title
Assessing Deep Learning Models for Human-Robot Collaboration Collision Detection in Industrial Environments
Authors
Iago R. R. Silva
Gibson B. N. Barbosa
Carolina C. D. Ledebour
Assis T. Oliveira Filho
Judith Kelner
Djamel Sadok
Silvia Lins
Ricardo Souza
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-61377-8_17

Premium Partner