Skip to main content

2019 | OriginalPaper | Buchkapitel

Gesture-Based Robot Programming Using Microsoft Kinect

verfasst von : Sebastian Blankemeyer, Joshua Göke, Tobias Grimm, Benedikt Meier, Annika Raatz

Erschienen in: Precision Assembly in the Digital Age

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Companies have to face constantly changing framework conditions. Product lifecycles are reduced and the number of variants increase as a result of increasing product individualization. To ensure that production systems such as robots can achieve this flexibility, more and more programming procedures are being developed that do not require a high level of qualification. This thesis deals with an intuitive approach that can be used for programming adhesive joints. With the help of the simple pointing to surfaces, a path corresponding to the intersection line of the two planes is calculated. The required algorithm for fingertip recognition is implemented with the help of Voronoi diagrams. The recognition of the planes is based on a region growing algorithm. The accuracy of the whole process is limited by the current technical state of the art and does not yet meet the necessary requirements.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Akgun, B., et al.: Trajectories for kinesthetic teaching: a human-robot interaction perspective. In: Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, vol. 12, pp. 391–398 (2012) Akgun, B., et al.: Trajectories for kinesthetic teaching: a human-robot interaction perspective. In: Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, vol. 12, pp. 391–398 (2012)
2.
Zurück zum Zitat Lun, R., Zhao, W.: A survey of applications and human motion recognition with microsoft kinect. Int. J. Pattern Recogn. Artif. Intell. 29(5), 1555008 (2015)CrossRef Lun, R., Zhao, W.: A survey of applications and human motion recognition with microsoft kinect. Int. J. Pattern Recogn. Artif. Intell. 29(5), 1555008 (2015)CrossRef
3.
Zurück zum Zitat Yang, L., et al.: Evaluating and improving the depth accuracy of kinect for windows v2. IEEE Sens. J. 15(8), 4275–4285 (2015)CrossRef Yang, L., et al.: Evaluating and improving the depth accuracy of kinect for windows v2. IEEE Sens. J. 15(8), 4275–4285 (2015)CrossRef
5.
Zurück zum Zitat Landa-Huartado, L., et al.: Kinect-based trajectory teaching for industrial robots. In: Pan-American Congress of Applied Mechanics, vol. 14 (2016) Landa-Huartado, L., et al.: Kinect-based trajectory teaching for industrial robots. In: Pan-American Congress of Applied Mechanics, vol. 14 (2016)
6.
Zurück zum Zitat Canal, G.: A real-time human-robot interaction system based on gestures for assistive scenarios. Comput. Vis. Image Underst. 149, 65–77 (2016)CrossRef Canal, G.: A real-time human-robot interaction system based on gestures for assistive scenarios. Comput. Vis. Image Underst. 149, 65–77 (2016)CrossRef
7.
Zurück zum Zitat Taylor, J., et al.: Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. ACM Trans. Graph. (TOG) 35(4), 143 (2016)CrossRef Taylor, J., et al.: Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. ACM Trans. Graph. (TOG) 35(4), 143 (2016)CrossRef
8.
Zurück zum Zitat Yeo, H., et al.: Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware. Multimed. Tools Appl. 74(8), 2687–2715 (2015)CrossRef Yeo, H., et al.: Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware. Multimed. Tools Appl. 74(8), 2687–2715 (2015)CrossRef
9.
Zurück zum Zitat Gesing, S.: Approximation von Punktmengen durch Kreise (2005) Gesing, S.: Approximation von Punktmengen durch Kreise (2005)
10.
Zurück zum Zitat Holz, D., Behnke, S.: Fast range image segmentation and smoothing using approximate surface reconstruction and region growing. Intell. Auton. Syst. 12, 61–73 (2012) Holz, D., Behnke, S.: Fast range image segmentation and smoothing using approximate surface reconstruction and region growing. Intell. Auton. Syst. 12, 61–73 (2012)
11.
Zurück zum Zitat Stueckler, J., et al.: Real-time 3D perception and efficient grasp planning for everyday manipulation tasks. In: European Conference on Mobile Robots, vol. 5 (2011) Stueckler, J., et al.: Real-time 3D perception and efficient grasp planning for everyday manipulation tasks. In: European Conference on Mobile Robots, vol. 5 (2011)
12.
Zurück zum Zitat Zhang, L., et al.: Fast plane segmentation with line primitives for RGB-D sensor. Int. J. Adv. Robot. Syst. 6, 1–8 (2016)CrossRef Zhang, L., et al.: Fast plane segmentation with line primitives for RGB-D sensor. Int. J. Adv. Robot. Syst. 6, 1–8 (2016)CrossRef
13.
Zurück zum Zitat Vosselmann, G., et al.: Recognising structure in laser scanner point clouds. Inf. Sci. 46(8), 1–6 (2004) Vosselmann, G., et al.: Recognising structure in laser scanner point clouds. Inf. Sci. 46(8), 1–6 (2004)
14.
Zurück zum Zitat Borrmann, D., et al.: The 3D Hough transform for plane detection in point clouds: a review and a new accumulator design. 3D. Research 2, 1–13 (2011) Borrmann, D., et al.: The 3D Hough transform for plane detection in point clouds: a review and a new accumulator design. 3D. Research 2, 1–13 (2011)
15.
Zurück zum Zitat Lachat, E., et al.: First experiences with kinect V2 sensor for close range 3D modelling. In: International Workshop 3D-ARCH, vol. 6, pp. 93–100 (2015) Lachat, E., et al.: First experiences with kinect V2 sensor for close range 3D modelling. In: International Workshop 3D-ARCH, vol. 6, pp. 93–100 (2015)
Metadaten
Titel
Gesture-Based Robot Programming Using Microsoft Kinect
verfasst von
Sebastian Blankemeyer
Joshua Göke
Tobias Grimm
Benedikt Meier
Annika Raatz
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-05931-6_7

Premium Partner