Skip to main content
Top

2021 | OriginalPaper | Chapter

Real-Time Object Detection for Smart Connected Worker in 3D Printing

Authors : Shijie Bian, Tiancheng Lin, Chen Li, Yongwei Fu, Mengrui Jiang, Tongzi Wu, Xiyi Hang, Bingbing Li

Published in: Computational Science – ICCS 2021

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

IoT and smart systems have been introduced into the advanced manufacturing, especially 3D printing with the trend of the fourth industrial revolution. The rapid development of computer vision and IoT devices in recent years has led the fruitful direction to the development of real-time machine state monitoring. In this study, computer vision technology was adopted into the Smart Connected Worker (SCW) system with the use case of 3D printing. Specifically, artificial intelligence (AI) models were investigated instead of discrete labor-intensive methods to monitor the machine state and predict the errors and risks for the advanced manufacturing. The model achieves accurate supervision in real-time for twenty-four hours a day, which can reduce human resource costs significantly. At the same time, the experiments demonstrate the feasibility of adopting AI technology to more aspects of the advanced manufacturing.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Schaller, R.R.: Moore’s law: past, present and future. IEEE Spectrum 34(6), 52–59 (1997)CrossRef Schaller, R.R.: Moore’s law: past, present and future. IEEE Spectrum 34(6), 52–59 (1997)CrossRef
2.
go back to reference Weinstein, B.G.: A computer vision for animal ecology. J. Anim. Ecol. 87(3), 533–545 (2018)CrossRef Weinstein, B.G.: A computer vision for animal ecology. J. Anim. Ecol. 87(3), 533–545 (2018)CrossRef
3.
go back to reference Wang, Y., Zheng, P., Xun, X., Yang, H., Zou, J.: Production planning for cloud-based additive manufacturing–a computer vision-based approach. Robot. Comput.-Integr. Manuf. 58, 145–157 (2019)CrossRef Wang, Y., Zheng, P., Xun, X., Yang, H., Zou, J.: Production planning for cloud-based additive manufacturing–a computer vision-based approach. Robot. Comput.-Integr. Manuf. 58, 145–157 (2019)CrossRef
4.
go back to reference Pathak, A.R., Pandey, M., Rautaray, S., Pawar, K.: Assessment of object detection using deep convolutional neural networks. In: Bhalla, S., Bhateja, V., Chandavale, A.A., Hiwale, A.S., Satapathy, S.C. (eds.) Intelligent Computing and Information and Communication. AISC, vol. 673, pp. 457–466. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-7245-1_45CrossRef Pathak, A.R., Pandey, M., Rautaray, S., Pawar, K.: Assessment of object detection using deep convolutional neural networks. In: Bhalla, S., Bhateja, V., Chandavale, A.A., Hiwale, A.S., Satapathy, S.C. (eds.) Intelligent Computing and Information and Communication. AISC, vol. 673, pp. 457–466. Springer, Singapore (2018). https://​doi.​org/​10.​1007/​978-981-10-7245-1_​45CrossRef
5.
go back to reference Zhang, B., Jaiswal, P., Rai, R., Guerrier, P., Baggs, G.: Convolutional neural network-based inspection of metal additive manufacturing parts. Rapid Prototyping J. 25(3), 530–540 (2019)CrossRef Zhang, B., Jaiswal, P., Rai, R., Guerrier, P., Baggs, G.: Convolutional neural network-based inspection of metal additive manufacturing parts. Rapid Prototyping J. 25(3), 530–540 (2019)CrossRef
6.
go back to reference Li, J., Götvall, P., Provost, J., Åkesson, K.: Training convolutional neural networks with synthesized data for object recognition in industrial manufacturing. In: 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), pp. 1544–1547 (2019) Li, J., Götvall, P., Provost, J., Åkesson, K.: Training convolutional neural networks with synthesized data for object recognition in industrial manufacturing. In: 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), pp. 1544–1547 (2019)
7.
go back to reference Beschi, M., Villagrossi, E., Molinari Tosatti, L., Surdilovic, D.: Sensorless model-based object-detection applied on an underactuated adaptive hand enabling an impedance behavior. Robot. Comput.-Integr. Manuf. 46, 38–47 (2017) Beschi, M., Villagrossi, E., Molinari Tosatti, L., Surdilovic, D.: Sensorless model-based object-detection applied on an underactuated adaptive hand enabling an impedance behavior. Robot. Comput.-Integr. Manuf. 46, 38–47 (2017)
8.
go back to reference Khodabandeh, M., Vahdat, A., Ranjbar, M., Macready, W.G.: A robust learning approach to domain adaptive object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2019 Khodabandeh, M., Vahdat, A., Ranjbar, M., Macready, W.G.: A robust learning approach to domain adaptive object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2019
9.
go back to reference Anitha, R., Jayalakshmi, S.: A systematic hybrid smart region based detection (SRBD) method for object detection. In: 2020 3rd International Conference on Intelligent Sustainable Systems (ICISS), pp. 139–145 (2020) Anitha, R., Jayalakshmi, S.: A systematic hybrid smart region based detection (SRBD) method for object detection. In: 2020 3rd International Conference on Intelligent Sustainable Systems (ICISS), pp. 139–145 (2020)
10.
go back to reference Mehmood, F., Ullah, I., Ahmad, S., Kim, D.: Object detection mechanism based on deep learning algorithm using embedded IOT devices for smart home appliances control in cot. Journal of Ambient Intelligence and Humanized Computing (2019) Mehmood, F., Ullah, I., Ahmad, S., Kim, D.: Object detection mechanism based on deep learning algorithm using embedded IOT devices for smart home appliances control in cot. Journal of Ambient Intelligence and Humanized Computing (2019)
11.
go back to reference Hu, L., Ni, Q.: Iot-driven automated object detection algorithm for urban surveillance systems in smart cities. IEEE Internet of Things J. 5(2), 747–754 (2018)CrossRef Hu, L., Ni, Q.: Iot-driven automated object detection algorithm for urban surveillance systems in smart cities. IEEE Internet of Things J. 5(2), 747–754 (2018)CrossRef
12.
go back to reference Sudharsan, B., Kumar, S.P., Dhakshinamurthy, R.: Ai vision: smart speaker design and implementation with object detection custom skill and advanced voice interaction capability. In: 2019 11th International Conference on Advanced Computing (ICoAC), pp. 97–102 (2019) Sudharsan, B., Kumar, S.P., Dhakshinamurthy, R.: Ai vision: smart speaker design and implementation with object detection custom skill and advanced voice interaction capability. In: 2019 11th International Conference on Advanced Computing (ICoAC), pp. 97–102 (2019)
13.
go back to reference Wilson, G., et al.: Robot-enabled support of daily activities in smart home environments. Cognitive Syst. Res. 54, 258–272 (2019)CrossRef Wilson, G., et al.: Robot-enabled support of daily activities in smart home environments. Cognitive Syst. Res. 54, 258–272 (2019)CrossRef
14.
go back to reference LeCun, Y., et al.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRef LeCun, Y., et al.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRef
15.
go back to reference Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation (2014) Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation (2014)
16.
go back to reference Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)MATH Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)MATH
18.
go back to reference Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition (2015) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition (2015)
19.
go back to reference Redmon, J., Divvala, S., Girshick, R., Ali, F.: Unified, real-time object detection, You only look once (2016) Redmon, J., Divvala, S., Girshick, R., Ali, F.: Unified, real-time object detection, You only look once (2016)
20.
go back to reference Chen, S.L., Lin, S.C., Huang, Y., Jen, C.W., Lin, Z.L., Su, S.F.: A vision-based dual-axis positioning system with yolov4 and improved genetic algorithms. In: 2020 Fourth IEEE International Conference on Robotic Computing (IRC), pp. 127–134 (2020) Chen, S.L., Lin, S.C., Huang, Y., Jen, C.W., Lin, Z.L., Su, S.F.: A vision-based dual-axis positioning system with yolov4 and improved genetic algorithms. In: 2020 Fourth IEEE International Conference on Robotic Computing (IRC), pp. 127–134 (2020)
21.
go back to reference Bradski, G.: The OpenCV library. Dr. Dobb’s J. Softw. Tools 25, 120–125 (2000) Bradski, G.: The OpenCV library. Dr. Dobb’s J. Softw. Tools 25, 120–125 (2000)
22.
go back to reference San Diego Pacific Research Platform University of California. Nautilus San Diego Pacific Research Platform University of California. Nautilus
23.
go back to reference Redmon, J., Farhadi, A.: Yolov3: An incremental improvement. arXiv (2018) Redmon, J., Farhadi, A.: Yolov3: An incremental improvement. arXiv (2018)
24.
go back to reference Lin, T.-Y., et al.: Microsoft coco: Common objects in context (2015) Lin, T.-Y., et al.: Microsoft coco: Common objects in context (2015)
25.
go back to reference He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn (2018) He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn (2018)
Metadata
Title
Real-Time Object Detection for Smart Connected Worker in 3D Printing
Authors
Shijie Bian
Tiancheng Lin
Chen Li
Yongwei Fu
Mengrui Jiang
Tongzi Wu
Xiyi Hang
Bingbing Li
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-77970-2_42

Premium Partner