Skip to main content

2022 | OriginalPaper | Buchkapitel

Fast and Automatic Object Registration for Human-Robot Collaboration in Industrial Manufacturing

verfasst von : Manuela Geiß, Martin Baresch, Georgios Chasparis, Edwin Schweiger, Nico Teringl, Michael Zwick

Erschienen in: Database and Expert Systems Applications - DEXA 2022 Workshops

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present an end-to-end framework for fast retraining of object detection models in human-robot-collaboration. Our Faster R-CNN based setup covers the whole workflow of automatic image generation and labeling, model retraining on-site as well as inference on a FPGA edge device. The intervention of a human operator reduces to providing the new object together with its label and starting the training process. Moreover, we present a new loss, the intraspread-objectosphere loss, to tackle the problem of open world recognition. Though it fails to completely solve the problem, it significantly reduces the number of false positive detections of unknown objects.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bendale, A., Boult, T.: Towards open world recognition. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition, pp. 1893–1902 (2015) Bendale, A., Boult, T.: Towards open world recognition. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition, pp. 1893–1902 (2015)
2.
Zurück zum Zitat Chen, J., Ran, X.: Deep learning with edge computing: a review. Proc. IEEE 107(8), 1655–1674 (2019)CrossRef Chen, J., Ran, X.: Deep learning with edge computing: a review. Proc. IEEE 107(8), 1655–1674 (2019)CrossRef
3.
Zurück zum Zitat Dhamija, A.R., Günther, M., Boult, T.: Reducing network agnostophobia. Adv. Neural Inf. Process. Syst. 31, 9157–9168 (2018) Dhamija, A.R., Günther, M., Boult, T.: Reducing network agnostophobia. Adv. Neural Inf. Process. Syst. 31, 9157–9168 (2018)
4.
5.
Zurück zum Zitat Hassen, M., Chan, P.K.: Learning a neural-network-based representation for open set recognition. In: Proceedings of SIAM International Conference on Data Mining, pp. 154–162. SIAM (2020) Hassen, M., Chan, P.K.: Learning a neural-network-based representation for open set recognition. In: Proceedings of SIAM International Conference on Data Mining, pp. 154–162. SIAM (2020)
6.
Zurück zum Zitat Joseph, K., Khan, S., Khan, F.S., Balasubramanian, V.N.: Towards open world object detection. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition, pp. 5830–5840 (2021) Joseph, K., Khan, S., Khan, F.S., Balasubramanian, V.N.: Towards open world object detection. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition, pp. 5830–5840 (2021)
8.
Zurück zum Zitat Matheson, E., Minto, R., Zampieri, E., Faccio, M., Rosati, G.: Human-robot collaboration in manufacturing applications: a review. Robotics 8, 100 (2019)CrossRef Matheson, E., Minto, R., Zampieri, E., Faccio, M., Rosati, G.: Human-robot collaboration in manufacturing applications: a review. Robotics 8, 100 (2019)CrossRef
9.
Zurück zum Zitat Mehrabi, M., Ulsoy, A., Koren, Y.: Reconfigurable manufacturing systems: key to future manufacturing. J. Intell. Manuf. 11, 403–419 (2000)CrossRef Mehrabi, M., Ulsoy, A., Koren, Y.: Reconfigurable manufacturing systems: key to future manufacturing. J. Intell. Manuf. 11, 403–419 (2000)CrossRef
10.
Zurück zum Zitat Murshed, M.G.S., Murphy, C., Hou, D., Khan, N., Ananthanarayanan, G., Hussain, F.: Machine learning at the network edge: a survey. ACM Comput. Surv. 54(8), 1–37 (2021)CrossRef Murshed, M.G.S., Murphy, C., Hou, D., Khan, N., Ananthanarayanan, G., Hussain, F.: Machine learning at the network edge: a survey. ACM Comput. Surv. 54(8), 1–37 (2021)CrossRef
11.
Zurück zum Zitat Ramasesh, V.V., Dyer, E., Raghu, M.: Anatomy of catastrophic forgetting: hidden representations and task semantics. In: International Conference on Learning Representation (2021) Ramasesh, V.V., Dyer, E., Raghu, M.: Anatomy of catastrophic forgetting: hidden representations and task semantics. In: International Conference on Learning Representation (2021)
13.
Zurück zum Zitat Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advanced Neural Information Processing Systems, vol. 28 (2015) Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advanced Neural Information Processing Systems, vol. 28 (2015)
14.
Zurück zum Zitat Ryan Fanello, S., et al.: iCuB world: friendly robots help building good vision data-sets. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition Workshops (2013) Ryan Fanello, S., et al.: iCuB world: friendly robots help building good vision data-sets. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition Workshops (2013)
15.
Zurück zum Zitat Scheirer, W.J., de Rezende Rocha, A., Sapkota, A., Boult, T.E.: Toward open set recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1757–1772 (2012)CrossRef Scheirer, W.J., de Rezende Rocha, A., Sapkota, A., Boult, T.E.: Toward open set recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1757–1772 (2012)CrossRef
16.
Zurück zum Zitat Zhao, X., Li, W., Zhang, Y., Gulliver, T.A., Chang, S., Feng, Z.: A faster RCNN-based pedestrian detection system. In: VTC2016-Fall, pp. 1–5 (2016) Zhao, X., Li, W., Zhang, Y., Gulliver, T.A., Chang, S., Feng, Z.: A faster RCNN-based pedestrian detection system. In: VTC2016-Fall, pp. 1–5 (2016)
17.
Zurück zum Zitat Zhao, X., Liu, X., Shen, Y., Ma, Y., Qiao, Y., Wang, D.: Revisiting open world object detection. arXiv preprint arXiv:2201.00471 (2022) Zhao, X., Liu, X., Shen, Y., Ma, Y., Qiao, Y., Wang, D.: Revisiting open world object detection. arXiv preprint arXiv:​2201.​00471 (2022)
Metadaten
Titel
Fast and Automatic Object Registration for Human-Robot Collaboration in Industrial Manufacturing
verfasst von
Manuela Geiß
Martin Baresch
Georgios Chasparis
Edwin Schweiger
Nico Teringl
Michael Zwick
Copyright-Jahr
2022
DOI
https://doi.org/10.1007/978-3-031-14343-4_22

Premium Partner