Skip to main content
Top

2019 | OriginalPaper | Chapter

Gesture-Based Robot Programming Using Microsoft Kinect

Authors : Sebastian Blankemeyer, Joshua Göke, Tobias Grimm, Benedikt Meier, Annika Raatz

Published in: Precision Assembly in the Digital Age

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Companies have to face constantly changing framework conditions. Product lifecycles are reduced and the number of variants increase as a result of increasing product individualization. To ensure that production systems such as robots can achieve this flexibility, more and more programming procedures are being developed that do not require a high level of qualification. This thesis deals with an intuitive approach that can be used for programming adhesive joints. With the help of the simple pointing to surfaces, a path corresponding to the intersection line of the two planes is calculated. The required algorithm for fingertip recognition is implemented with the help of Voronoi diagrams. The recognition of the planes is based on a region growing algorithm. The accuracy of the whole process is limited by the current technical state of the art and does not yet meet the necessary requirements.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Akgun, B., et al.: Trajectories for kinesthetic teaching: a human-robot interaction perspective. In: Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, vol. 12, pp. 391–398 (2012) Akgun, B., et al.: Trajectories for kinesthetic teaching: a human-robot interaction perspective. In: Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, vol. 12, pp. 391–398 (2012)
2.
go back to reference Lun, R., Zhao, W.: A survey of applications and human motion recognition with microsoft kinect. Int. J. Pattern Recogn. Artif. Intell. 29(5), 1555008 (2015)CrossRef Lun, R., Zhao, W.: A survey of applications and human motion recognition with microsoft kinect. Int. J. Pattern Recogn. Artif. Intell. 29(5), 1555008 (2015)CrossRef
3.
go back to reference Yang, L., et al.: Evaluating and improving the depth accuracy of kinect for windows v2. IEEE Sens. J. 15(8), 4275–4285 (2015)CrossRef Yang, L., et al.: Evaluating and improving the depth accuracy of kinect for windows v2. IEEE Sens. J. 15(8), 4275–4285 (2015)CrossRef
5.
go back to reference Landa-Huartado, L., et al.: Kinect-based trajectory teaching for industrial robots. In: Pan-American Congress of Applied Mechanics, vol. 14 (2016) Landa-Huartado, L., et al.: Kinect-based trajectory teaching for industrial robots. In: Pan-American Congress of Applied Mechanics, vol. 14 (2016)
6.
go back to reference Canal, G.: A real-time human-robot interaction system based on gestures for assistive scenarios. Comput. Vis. Image Underst. 149, 65–77 (2016)CrossRef Canal, G.: A real-time human-robot interaction system based on gestures for assistive scenarios. Comput. Vis. Image Underst. 149, 65–77 (2016)CrossRef
7.
go back to reference Taylor, J., et al.: Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. ACM Trans. Graph. (TOG) 35(4), 143 (2016)CrossRef Taylor, J., et al.: Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. ACM Trans. Graph. (TOG) 35(4), 143 (2016)CrossRef
8.
go back to reference Yeo, H., et al.: Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware. Multimed. Tools Appl. 74(8), 2687–2715 (2015)CrossRef Yeo, H., et al.: Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware. Multimed. Tools Appl. 74(8), 2687–2715 (2015)CrossRef
9.
go back to reference Gesing, S.: Approximation von Punktmengen durch Kreise (2005) Gesing, S.: Approximation von Punktmengen durch Kreise (2005)
10.
go back to reference Holz, D., Behnke, S.: Fast range image segmentation and smoothing using approximate surface reconstruction and region growing. Intell. Auton. Syst. 12, 61–73 (2012) Holz, D., Behnke, S.: Fast range image segmentation and smoothing using approximate surface reconstruction and region growing. Intell. Auton. Syst. 12, 61–73 (2012)
11.
go back to reference Stueckler, J., et al.: Real-time 3D perception and efficient grasp planning for everyday manipulation tasks. In: European Conference on Mobile Robots, vol. 5 (2011) Stueckler, J., et al.: Real-time 3D perception and efficient grasp planning for everyday manipulation tasks. In: European Conference on Mobile Robots, vol. 5 (2011)
12.
go back to reference Zhang, L., et al.: Fast plane segmentation with line primitives for RGB-D sensor. Int. J. Adv. Robot. Syst. 6, 1–8 (2016)CrossRef Zhang, L., et al.: Fast plane segmentation with line primitives for RGB-D sensor. Int. J. Adv. Robot. Syst. 6, 1–8 (2016)CrossRef
13.
go back to reference Vosselmann, G., et al.: Recognising structure in laser scanner point clouds. Inf. Sci. 46(8), 1–6 (2004) Vosselmann, G., et al.: Recognising structure in laser scanner point clouds. Inf. Sci. 46(8), 1–6 (2004)
14.
go back to reference Borrmann, D., et al.: The 3D Hough transform for plane detection in point clouds: a review and a new accumulator design. 3D. Research 2, 1–13 (2011) Borrmann, D., et al.: The 3D Hough transform for plane detection in point clouds: a review and a new accumulator design. 3D. Research 2, 1–13 (2011)
15.
go back to reference Lachat, E., et al.: First experiences with kinect V2 sensor for close range 3D modelling. In: International Workshop 3D-ARCH, vol. 6, pp. 93–100 (2015) Lachat, E., et al.: First experiences with kinect V2 sensor for close range 3D modelling. In: International Workshop 3D-ARCH, vol. 6, pp. 93–100 (2015)
Metadata
Title
Gesture-Based Robot Programming Using Microsoft Kinect
Authors
Sebastian Blankemeyer
Joshua Göke
Tobias Grimm
Benedikt Meier
Annika Raatz
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-05931-6_7

Premium Partner