Skip to main content
Erschienen in: Autonomous Robots 1-2/2014

01.01.2014

Learning of grasp selection based on shape-templates

verfasst von: Alexander Herzog, Peter Pastor, Mrinal Kalakrishnan, Ludovic Righetti, Jeannette Bohg, Tamim Asfour, Stefan Schaal

Erschienen in: Autonomous Robots | Ausgabe 1-2/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The ability to grasp unknown objects still remains an unsolved problem in the robotics community. One of the challenges is to choose an appropriate grasp configuration, i.e., the 6D pose of the hand relative to the object and its finger configuration. In this paper, we introduce an algorithm that is based on the assumption that similarly shaped objects can be grasped in a similar way. It is able to synthesize good grasp poses for unknown objects by finding the best matching object shape templates associated with previously demonstrated grasps. The grasp selection algorithm is able to improve over time by using the information of previous grasp attempts to adapt the ranking of the templates to new situations. We tested our approach on two different platforms, the Willow Garage PR2 and the Barrett WAM robot, which have very different hand kinematics. Furthermore, we compared our algorithm with other grasp planners and demonstrated its superior performance. The results presented in this paper show that the algorithm is able to find good grasp configurations for a large set of unknown objects from a relatively small set of demonstrations, and does improve its performance over time.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Balasubramanian, R., Xu, L., Brook, P. D., Smith, J. R., & Matsuoka, Y. (2012). Physical human interactive guidance: Identifying grasping principles from human-planned grasps. IEEE Transactions on Robotics, 28(4), 899–910.CrossRef Balasubramanian, R., Xu, L., Brook, P. D., Smith, J. R., & Matsuoka, Y. (2012). Physical human interactive guidance: Identifying grasping principles from human-planned grasps. IEEE Transactions on Robotics, 28(4), 899–910.CrossRef
Zurück zum Zitat Bohg, J., & Kragic, D. (2009). Grasping familiar objects using shape context. In International conference on advanced robotics (pp. 1–6). Bohg, J., & Kragic, D. (2009). Grasping familiar objects using shape context. In International conference on advanced robotics (pp. 1–6).
Zurück zum Zitat Bohren, J., Rusu, R.B., Gil Jones, E., Marder-Eppstein, E., Pantofaru, C., Wise, M., et al. (2011). Towards autonomous robotic butlers: Lessons learned with the PR2. In IEEE international conference on robotics and automation (pp. 5568–5575). Bohren, J., Rusu, R.B., Gil Jones, E., Marder-Eppstein, E., Pantofaru, C., Wise, M., et al. (2011). Towards autonomous robotic butlers: Lessons learned with the PR2. In IEEE international conference on robotics and automation (pp. 5568–5575).
Zurück zum Zitat Boularias, A., Kroemer, O., & Peters, J. (2011). Learning robot grasping from 3-D images with Markov random fields. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1548–1553). Boularias, A., Kroemer, O., & Peters, J. (2011). Learning robot grasping from 3-D images with Markov random fields. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1548–1553).
Zurück zum Zitat Curtis, N., Xiao, J., & Member, S. (2008). Efficient and effective grasping of novel objects through learning and adapting a knowledge base. In IEEE international conference on robotics and automation (pp. 2252–2257). Curtis, N., Xiao, J., & Member, S. (2008). Efficient and effective grasping of novel objects through learning and adapting a knowledge base. In IEEE international conference on robotics and automation (pp. 2252–2257).
Zurück zum Zitat Detry, R., Başeski, E., Popovic, M., Touati, Y., Krueger, N., Kroemer, O., et al. (2010). Learning continuous grasp affordances by sensorimotor exploration. In From motor learning to interaction learning in robots (pp. 451–465). Heidelberg: Springer. Detry, R., Başeski, E., Popovic, M., Touati, Y., Krueger, N., Kroemer, O., et al. (2010). Learning continuous grasp affordances by sensorimotor exploration. In From motor learning to interaction learning in robots (pp. 451–465). Heidelberg: Springer.
Zurück zum Zitat Detry, R., Ek, C. H., Madry, M., & Kragic, D. (2013). Learning a dictionary of prototypical grasp-predicting parts from grasping experience. In IEEE international conference on robotics and automation. Detry, R., Ek, C. H., Madry, M., & Kragic, D. (2013). Learning a dictionary of prototypical grasp-predicting parts from grasping experience. In IEEE international conference on robotics and automation.
Zurück zum Zitat Diankov, R., & Kuffner, J. (2008). Openrave: A planning architecture for autonomous robotics. Tech. Rep. CMU-RI-TR-08-34. Robotics Institute, Pittsburgh, PA. Diankov, R., & Kuffner, J. (2008). Openrave: A planning architecture for autonomous robotics. Tech. Rep. CMU-RI-TR-08-34. Robotics Institute, Pittsburgh, PA.
Zurück zum Zitat Erkan, A., Kroemer, O., Detry, R., Altun, Y., Piater, J., & Peters, J. (2010). Learning probabilistic discriminative models of grasp affordances under limited supervision. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1586–1591). Erkan, A., Kroemer, O., Detry, R., Altun, Y., Piater, J., & Peters, J. (2010). Learning probabilistic discriminative models of grasp affordances under limited supervision. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1586–1591).
Zurück zum Zitat Ferrari, C., & Canny, J. (1992). Planning optimal grasps. In IEEE international conference on robotics and automation (pp. 2290–2295). Ferrari, C., & Canny, J. (1992). Planning optimal grasps. In IEEE international conference on robotics and automation (pp. 2290–2295).
Zurück zum Zitat Goldfeder, C., & Allen, P. (2011). Data-driven grasping. Autonomous Robots, 31, 1–20.CrossRef Goldfeder, C., & Allen, P. (2011). Data-driven grasping. Autonomous Robots, 31, 1–20.CrossRef
Zurück zum Zitat Goldfeder, C., Allen, P. K., Lackner, C., & Pelossof, R. (2007). Grasp planning via decomposition trees. In IEEE international conference on robotics and automation (pp. 4679–4684). Goldfeder, C., Allen, P. K., Lackner, C., & Pelossof, R. (2007). Grasp planning via decomposition trees. In IEEE international conference on robotics and automation (pp. 4679–4684).
Zurück zum Zitat Herzog, A., Pastor, P., Kalakrishnan, M., Righetti, L., Asfour, T., & Schaal, S. (2012). Template-based learning of grasp selection. In IEEE international conference on robotics and automation (pp. 2379–2384). Herzog, A., Pastor, P., Kalakrishnan, M., Righetti, L., Asfour, T., & Schaal, S. (2012). Template-based learning of grasp selection. In IEEE international conference on robotics and automation (pp. 2379–2384).
Zurück zum Zitat Hsiao, K., Chitta, S., Ciocarlie, M., & Jones, E. G. (2010). Contact-reactive grasping of objects with partial shape information. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1228–1235). Hsiao, K., Chitta, S., Ciocarlie, M., & Jones, E. G. (2010). Contact-reactive grasping of objects with partial shape information. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1228–1235).
Zurück zum Zitat Huebner, K., Welke, K., Przybylski, M., Vahrenkamp, N., Asfour, T., et al. (2009). Grasping known objects with humanoid robots: A box-based approach. In International conference on advanced robotics (pp. 1–6). Huebner, K., Welke, K., Przybylski, M., Vahrenkamp, N., Asfour, T., et al. (2009). Grasping known objects with humanoid robots: A box-based approach. In International conference on advanced robotics (pp. 1–6).
Zurück zum Zitat Kalakrishnan, M., Buchli, J., Pastor, P., & Schaal, S. (2009). Learning locomotion over rough terrain using terrain templates. In IEEE/RSJ international conference on intelligent robots and systems (pp. 167–172). Kalakrishnan, M., Buchli, J., Pastor, P., & Schaal, S. (2009). Learning locomotion over rough terrain using terrain templates. In IEEE/RSJ international conference on intelligent robots and systems (pp. 167–172).
Zurück zum Zitat Klingbeil, E., Rao, D., Carpenter, B., Ganapathi, V., Ng, A. Y., & Khatib, O. (2011). Grasping with application to an autonomous checkout robot. In IEEE international conference on robotics and automation (pp. 2837–2844). Klingbeil, E., Rao, D., Carpenter, B., Ganapathi, V., Ng, A. Y., & Khatib, O. (2011). Grasping with application to an autonomous checkout robot. In IEEE international conference on robotics and automation (pp. 2837–2844).
Zurück zum Zitat Kroemer, O., Ugur, E., Oztop, E., & Peters, J. (2012). A kernel-based approach to direct action perception. In IEEE international conference on robotics and automation (pp. 2605–2610). Kroemer, O., Ugur, E., Oztop, E., & Peters, J. (2012). A kernel-based approach to direct action perception. In IEEE international conference on robotics and automation (pp. 2605–2610).
Zurück zum Zitat Leon, B., Ulbrich, S., Diankov, R., Puche, G., Przybylski, M., Morales, A., et al. (2010). Opengrasp: A toolkit for robot grasping simulation. In 2nd international conference on simulation, modeling, and programming for autonomous robots. Leon, B., Ulbrich, S., Diankov, R., Puche, G., Przybylski, M., Morales, A., et al. (2010). Opengrasp: A toolkit for robot grasping simulation. In 2nd international conference on simulation, modeling, and programming for autonomous robots.
Zurück zum Zitat Miller, A. T., & Allen, P. K. (2004). Graspit! A versatile simulator for robotic grasping. IEEE Robotics & Automation Magazine, 11(4), 110–122.CrossRef Miller, A. T., & Allen, P. K. (2004). Graspit! A versatile simulator for robotic grasping. IEEE Robotics & Automation Magazine, 11(4), 110–122.CrossRef
Zurück zum Zitat Miller, A. T., Knoop, S., Christensen, H. I., & Allen, P. K. (2003). Automatic grasp planning using shape primitives. In IEEE international conference on robotics and automation (pp. 1824–1829). Miller, A. T., Knoop, S., Christensen, H. I., & Allen, P. K. (2003). Automatic grasp planning using shape primitives. In IEEE international conference on robotics and automation (pp. 1824–1829).
Zurück zum Zitat Montesano, L., & Lopes, M. (2009). Learning grasping affordances from local visual descriptors. In IEEE international conference on development and learning (pp. 1–6). Montesano, L., & Lopes, M. (2009). Learning grasping affordances from local visual descriptors. In IEEE international conference on development and learning (pp. 1–6).
Zurück zum Zitat Papazov, C., Haddadin, S., Parusel, S., Krieger, K., & Burschka, D. (2012). Rigid 3D geometry matching for grasping of known objects in cluttered scenes. The International Journal of Robotics Research, 31(4), 538–553.CrossRef Papazov, C., Haddadin, S., Parusel, S., Krieger, K., & Burschka, D. (2012). Rigid 3D geometry matching for grasping of known objects in cluttered scenes. The International Journal of Robotics Research, 31(4), 538–553.CrossRef
Zurück zum Zitat Popović, M., Kootstra, G., Jørgensen, J. A., Kragic, D., & Krüger, N. (2011). Grasping unknown objects using an early cognitive vision system for general scene understanding. In IEEE/RSJ international conference on intelligent robots and systems (pp. 987–994). Popović, M., Kootstra, G., Jørgensen, J. A., Kragic, D., & Krüger, N. (2011). Grasping unknown objects using an early cognitive vision system for general scene understanding. In IEEE/RSJ international conference on intelligent robots and systems (pp. 987–994).
Zurück zum Zitat Przybylski, M., & Asfour, T. (2010). Unions of balls for shape approximation in robot grasping. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1592–1599). Przybylski, M., & Asfour, T. (2010). Unions of balls for shape approximation in robot grasping. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1592–1599).
Zurück zum Zitat Ratliff, N., Bagnell, J., & Srinivasa, S. S. (2007). Imitation learning for locomotion and manipulation. In IEEE-RAS international conference on humanoid robots (pp. 392–397). Ratliff, N., Bagnell, J., & Srinivasa, S. S. (2007). Imitation learning for locomotion and manipulation. In IEEE-RAS international conference on humanoid robots (pp. 392–397).
Zurück zum Zitat Richtsfeld, M., & Zillich, M. (2008). Grasping unknown objects based on 2.5D range data. In Proceedings of IEEE international conference on automation science and engineering CASE (pp. 691–696). Richtsfeld, M., & Zillich, M. (2008). Grasping unknown objects based on 2.5D range data. In Proceedings of IEEE international conference on automation science and engineering CASE (pp. 691–696).
Zurück zum Zitat Righetti, L., Kalakrishnan, M., Pastor, P., Binney, J., Kelly, J., Voorhies, R., et al. (2013). An autonomous manipulation system based on force control and optimization. Autonomous Robots Journal Special Issue: Autonomous Grasping and Manipulation. doi:10.1007/s10514-013-9365-9. Righetti, L., Kalakrishnan, M., Pastor, P., Binney, J., Kelly, J., Voorhies, R., et al. (2013). An autonomous manipulation system based on force control and optimization. Autonomous Robots Journal Special Issue: Autonomous Grasping and Manipulation. doi:10.​1007/​s10514-013-9365-9.
Zurück zum Zitat Rubio, O., Huebner, K., & Kragic, D. (2010). Representations for object grasping and learning from experience. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1566–1571). Rubio, O., Huebner, K., & Kragic, D. (2010). Representations for object grasping and learning from experience. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1566–1571).
Zurück zum Zitat Rusu, R. B., & Cousins, S. (2011). 3D is here: Point Cloud Library (PCL). In IEEE international conference on robotics and automation (pp. 1–4). Rusu, R. B., & Cousins, S. (2011). 3D is here: Point Cloud Library (PCL). In IEEE international conference on robotics and automation (pp. 1–4).
Zurück zum Zitat Saxena, A., Driemeyer, J., & Ng, A. Y. (2008). Robotic grasping of novel objects using vision. The International Journal of Robotics Research, 27(2), 157–173.CrossRef Saxena, A., Driemeyer, J., & Ng, A. Y. (2008). Robotic grasping of novel objects using vision. The International Journal of Robotics Research, 27(2), 157–173.CrossRef
Zurück zum Zitat Saxena, A., Wong, L., & Ng, A. Y. (2008). Learning grasp strategies with partial shape information. In AAAI conference on artificial intelligence (pp. 1491–1494). Saxena, A., Wong, L., & Ng, A. Y. (2008). Learning grasp strategies with partial shape information. In AAAI conference on artificial intelligence (pp. 1491–1494).
Zurück zum Zitat Stark, M., Lies, P., Zillich, M., Wyatt, J., & Schiele, B. (2008). Functional object class detection based on learned affordance cues. In International conference on computer vision systems. LNAI (Vol. 5008, pp. 435–444). Heidelberg: Springer. Stark, M., Lies, P., Zillich, M., Wyatt, J., & Schiele, B. (2008). Functional object class detection based on learned affordance cues. In International conference on computer vision systems. LNAI (Vol. 5008, pp. 435–444). Heidelberg: Springer.
Zurück zum Zitat Stückler, J., Steffens, R., Holz, D., & Behnke, S. (2011). Real-time 3D perception and efficient grasp planning for everyday manipulation tasks. In European conference on mobile robots (ECMR). Örebro, Sweden. Stückler, J., Steffens, R., Holz, D., & Behnke, S. (2011). Real-time 3D perception and efficient grasp planning for everyday manipulation tasks. In European conference on mobile robots (ECMR). Örebro, Sweden.
Zurück zum Zitat Ulbrich, S., Kappler, D., Asfour, T., Vahrenkamp, N., Bierbaum, A., et al. (2011). The OpenGRASP benchmarking suite: An environment for the comparative analysis of grasping and dexterous manipulation. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1761–1767). Ulbrich, S., Kappler, D., Asfour, T., Vahrenkamp, N., Bierbaum, A., et al. (2011). The OpenGRASP benchmarking suite: An environment for the comparative analysis of grasping and dexterous manipulation. In IEEE/RSJ international conference on intelligent robots and systems (pp. 1761–1767).
Metadaten
Titel
Learning of grasp selection based on shape-templates
verfasst von
Alexander Herzog
Peter Pastor
Mrinal Kalakrishnan
Ludovic Righetti
Jeannette Bohg
Tamim Asfour
Stefan Schaal
Publikationsdatum
01.01.2014
Verlag
Springer US
Erschienen in
Autonomous Robots / Ausgabe 1-2/2014
Print ISSN: 0929-5593
Elektronische ISSN: 1573-7527
DOI
https://doi.org/10.1007/s10514-013-9366-8

Weitere Artikel der Ausgabe 1-2/2014

Autonomous Robots 1-2/2014 Zur Ausgabe