Skip to main content
Top

2021 | OriginalPaper | Chapter

Deep Learning-Enabled Real Time In-Site Quality Inspection Based On Gesture Classification

Authors : Ioan-Matei Sarivan, Stefan Andreas Baumann, Daniel Díez Álvarez, Felix Euteneuer, Matthias Reichenbach, Ulrich Berger, Ole Madsen, Simon Bøgh

Published in: Advances in Automotive Production Technology – Theory and Application

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper we present a novel method for performing in site real time quality inspection (QI) and consequently, digitalization of manual processes performed by human workers. It complements and improves our previous work in this area, which makes use of telemetry gathered from a smartwatch to classify manual actions as successful or unsuccessful. This new methodology provides the worker with a real time capable, robust and more accurate quality inspector. This work enhances the existing system through the elimination of input from the user by making use of a BIOX bracelet that detects gestures. The signal processing and classification methods are simplified and optimised by using assembled neural networks thus merging together the data gathered from multiple signal sources. Consequently, the overall QI system is improved with around 70%, thus furthering the necessary development needed to have a system ready to be used on a production environment.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Brandt, Anders: Noise and vibration analysis: signal analysis and experimental procedures. John Wiley & Sons (2011) Brandt, Anders: Noise and vibration analysis: signal analysis and experimental procedures. John Wiley & Sons (2011)
2.
go back to reference Ilya Sutskever Geoffrey E. Hinton Alexander Krizhevsky and Nitish Srivastva. System and Method for Addressing Overfitting in a Neural Network. patentUS. [Patent: US9406017B2 ]. Aug. 2016 Ilya Sutskever Geoffrey E. Hinton Alexander Krizhevsky and Nitish Srivastva. System and Method for Addressing Overfitting in a Neural Network. patentUS. [Patent: US9406017B2 ]. Aug. 2016
4.
go back to reference Muhammad R. U. Islam, Kun Xu, and Shaoping Bai. “Position Sensing and Control with FMG Sensors for Exoskeleton Physical Assistance". In: Wearable Robotics: Challenges and Trends. Ed. by Maria Chiara Carrozza, Silvestro Micera, and José L. Pons. Cham: Springer International Publishing, 2019, pp. 3–7. isbn: 978-3-030-01887-0 Muhammad R. U. Islam, Kun Xu, and Shaoping Bai. “Position Sensing and Control with FMG Sensors for Exoskeleton Physical Assistance". In: Wearable Robotics: Challenges and Trends. Ed. by Maria Chiara Carrozza, Silvestro Micera, and José L. Pons. Cham: Springer International Publishing, 2019, pp. 3–7. isbn: 978-3-030-01887-0
5.
go back to reference Muhammad Raza Ul Islam and Shaoping Bai. “Intention Detection for Dexterous Human Arm Motion with FSR Sensor Bands". In: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. HRI ’17. Vienna, Austria: Association for Computing Machinery, 2017, pp. 139–140. isbn: 9781450348850. https://doi.org/10.1145/3029798.3038377 Muhammad Raza Ul Islam and Shaoping Bai. “Intention Detection for Dexterous Human Arm Motion with FSR Sensor Bands". In: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. HRI ’17. Vienna, Austria: Association for Computing Machinery, 2017, pp. 139–140. isbn: 9781450348850. https://​doi.​org/​10.​1145/​3029798.​3038377
6.
go back to reference Bo Si Kuo and Ming Chyuan Lu: Analysis of a Sound Signal for Quality Monitoring in Laser Microlap Welding. English. In: Applied Sciences 10(6), 1934 (2020) Bo Si Kuo and Ming Chyuan Lu: Analysis of a Sound Signal for Quality Monitoring in Laser Microlap Welding. English. In: Applied Sciences 10(6), 1934 (2020)
7.
go back to reference T. Phienthrakul. “Armband Gesture Recognition on Electromyography Signal for Virtual Control". In: 2018 10th International Conference on Knowledge and Smart Technology (KST). 2018, pp. 149–153 T. Phienthrakul. “Armband Gesture Recognition on Electromyography Signal for Virtual Control". In: 2018 10th International Conference on Knowledge and Smart Technology (KST). 2018, pp. 149–153
8.
go back to reference I.-M. Sarivan et al. “Enabling Real-Time Quality Inspection in Smart Manufacturing Through Wearable Smart Devices and Deep Learning". In: Procedia Manufacturing 51 (2020). 30th International Conference on Flexible Automation and Intelligent Manufacturing (FAIM2021), pp. 373–380 I.-M. Sarivan et al. “Enabling Real-Time Quality Inspection in Smart Manufacturing Through Wearable Smart Devices and Deep Learning". In: Procedia Manufacturing 51 (2020). 30th International Conference on Flexible Automation and Intelligent Manufacturing (FAIM2021), pp. 373–380
9.
go back to reference I.-M Sarivan et al. (2021) Verfahren zur Überprüfung mindestens eines durch eine Person durchgeführten manuellen Arbeitsschritts (Daimler AG, Stuttgart, DE. Patent No. DE 10 2020 006 056 A1), German Patent and Trade Mark Office I.-M Sarivan et al. (2021) Verfahren zur Überprüfung mindestens eines durch eine Person durchgeführten manuellen Arbeitsschritts (Daimler AG, Stuttgart, DE. Patent No. DE 10 2020 006 056 A1), German Patent and Trade Mark Office
10.
go back to reference Visconti, P., et al.: Technical features and functionalities of Myo armband: an overview on related literature and advanced applications of myoelectric armbands mainly focused on arm prostheses. International Journal on Smart Sensing and Intelligent Systems 11(1), 1–25 (2018) Visconti, P., et al.: Technical features and functionalities of Myo armband: an overview on related literature and advanced applications of myoelectric armbands mainly focused on arm prostheses. International Journal on Smart Sensing and Intelligent Systems 11(1), 1–25 (2018)
Metadata
Title
Deep Learning-Enabled Real Time In-Site Quality Inspection Based On Gesture Classification
Authors
Ioan-Matei Sarivan
Stefan Andreas Baumann
Daniel Díez Álvarez
Felix Euteneuer
Matthias Reichenbach
Ulrich Berger
Ole Madsen
Simon Bøgh
Copyright Year
2021
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-662-62962-8_26

Premium Partner