Skip to main content

2018 | OriginalPaper | Buchkapitel

Using Geometry to Detect Grasp Poses in 3D Point Clouds

verfasst von : Andreas ten Pas, Robert Platt

Erschienen in: Robotics Research

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a new approach to using machine learning to detect grasp poses on novel objects presented in clutter. The input to our algorithm is a point cloud and the geometric parameters of the robot hand. The output is a set of hand poses that are expected to be good grasps. There are two main contributions. First, we identify a set of necessary conditions on the geometry of a grasp that can be used to generate a set of grasp hypotheses. This helps focus grasp detection away from regions where no grasp can exist. Second, we show how geometric grasp conditions can be used to generate labeled datasets for the purpose of training the machine learning algorithm. This enables us to generate large amounts of training data and it grounds our training labels in grasp mechanics. Overall, our method achieves an average grasp success rate of 88% when grasping novels objects presented in isolation and an average success rate of 73% when grasping novel objects presented in dense clutter. This system is available as a ROS package at http://​wiki.​ros.​org/​agile_​grasp.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
A friction cone describes the space of normal and frictional forces that a point contact with friction can apply to the contacted surface [13].
 
2
Any frame aligned with the surface normal is a Darboux frame. Here we restrict consideration to the special case where it is also aligned with the principal directions.
 
3
Taubin’s method is an analytic solution that performs this fit efficiently by solving a generalized Eigenvalue problem on two \(10\times 10\) matrices [18]. In comparison to using first order estimates of surface normal and curvature, the estimates derived from this quadratic are more robust to local surface discontinuities.
 
Literatur
1.
Zurück zum Zitat Balasubramanian, R., Xu, L., Brook, P.D., Smith, J.R., Matsuoka, Y.: Human-guided grasp measures improve grasp robustness on physical robot. In: IEEE Intl Conf. on Robots and Automation, pp. 2294–2301. IEEE (2010) Balasubramanian, R., Xu, L., Brook, P.D., Smith, J.R., Matsuoka, Y.: Human-guided grasp measures improve grasp robustness on physical robot. In: IEEE Intl Conf. on Robots and Automation, pp. 2294–2301. IEEE (2010)
2.
Zurück zum Zitat Chang, L., Smith, J.R., Fox, D.: Interactive singulation of objects from a pile. In: IEEE International Conference on Robotics and Automation, pp. 3875–3882. IEEE (2012) Chang, L., Smith, J.R., Fox, D.: Interactive singulation of objects from a pile. In: IEEE International Conference on Robotics and Automation, pp. 3875–3882. IEEE (2012)
3.
Zurück zum Zitat Detry, R., Ek, C.H., Madry, M., Kragic, D.: Learning a dictionary of prototypical grasp-predicting parts from grasping experience. In: IEEE International Conference on Robotics and Automation (2013) Detry, R., Ek, C.H., Madry, M., Kragic, D.: Learning a dictionary of prototypical grasp-predicting parts from grasping experience. In: IEEE International Conference on Robotics and Automation (2013)
4.
Zurück zum Zitat Fischinger, D., Vincze, M.: Empty the basket - a shape based learning approach for grasping piles of unknown objects. In: IEEE International Conference on Intelligent Robot Systems (2012) Fischinger, D., Vincze, M.: Empty the basket - a shape based learning approach for grasping piles of unknown objects. In: IEEE International Conference on Intelligent Robot Systems (2012)
5.
Zurück zum Zitat Fischinger, D., Vincze, M., Jiang, Y.: Learning grasps for unknown objects in cluttered scenes. In: IEEE International Conference on Robotics and Automation, pp. 609–616. IEEE (2013) Fischinger, D., Vincze, M., Jiang, Y.: Learning grasps for unknown objects in cluttered scenes. In: IEEE International Conference on Robotics and Automation, pp. 609–616. IEEE (2013)
6.
Zurück zum Zitat Glover, J., Popovic, S.: Bingham procrustean alignment for object detection in clutter. In: IEEE International Conference on Intelligent Robot Systems (2013) Glover, J., Popovic, S.: Bingham procrustean alignment for object detection in clutter. In: IEEE International Conference on Intelligent Robot Systems (2013)
7.
Zurück zum Zitat Herzog, A., Pastor, P., Kalakrishnan, M., Righetti, L., Asfour, T., Schaal, S.: Template-based learning of grasp selection. In: IEEE International Conference on Robotics and Automation (2012) Herzog, A., Pastor, P., Kalakrishnan, M., Righetti, L., Asfour, T., Schaal, S.: Template-based learning of grasp selection. In: IEEE International Conference on Robotics and Automation (2012)
8.
Zurück zum Zitat Jiang, Y., Moseson, S., Saxena, A.: Efficient grasping from rgbd images: learning using a new rectangle representation. In: IEEE International Conference on Robotics and Automation (2011) Jiang, Y., Moseson, S., Saxena, A.: Efficient grasping from rgbd images: learning using a new rectangle representation. In: IEEE International Conference on Robotics and Automation (2011)
9.
Zurück zum Zitat Katz, D., Kazemi, M., Bagnell, D., Stentz, A.: Clearing a pile of unknown objects using interactive perception. In: IEEE International Conference on Robotics and Automation (2013) Katz, D., Kazemi, M., Bagnell, D., Stentz, A.: Clearing a pile of unknown objects using interactive perception. In: IEEE International Conference on Robotics and Automation (2013)
10.
Zurück zum Zitat Klingbeil, E., Rao, D., Carpenter, B., Ganapathi, B., Ng, A., Khatib, O.: Grasping with application to an autonomous checkout robot. In: IEEE International Conference on Robotics and Automation (2011) Klingbeil, E., Rao, D., Carpenter, B., Ganapathi, B., Ng, A., Khatib, O.: Grasping with application to an autonomous checkout robot. In: IEEE International Conference on Robotics and Automation (2011)
11.
Zurück zum Zitat Kroemer, O., Ugur, E., Oztop, E., Peters, J.: A kernel-based approach to direct action perception. In: IEEE International Conference on Robots and Automation, pp. 2605–2610. IEEE (2012) Kroemer, O., Ugur, E., Oztop, E., Peters, J.: A kernel-based approach to direct action perception. In: IEEE International Conference on Robots and Automation, pp. 2605–2610. IEEE (2012)
12.
Zurück zum Zitat Lenz, I., Lee, H., Saxena, A.: Deep learning for detecting robotic grasps. In: Robotics: Science and Systems (2013) Lenz, I., Lee, H., Saxena, A.: Deep learning for detecting robotic grasps. In: Robotics: Science and Systems (2013)
13.
Zurück zum Zitat Murray, R.M., Li, Z., Sastry, S.S., Sastry, S.S.: A Mathematical Introduction to Robotic Manipulation. CRC press, Boca Raton (1994) Murray, R.M., Li, Z., Sastry, S.S., Sastry, S.S.: A Mathematical Introduction to Robotic Manipulation. CRC press, Boca Raton (1994)
14.
Zurück zum Zitat Nguyen, V.: Constructing force-closure grasps. IEEE Int. Conf. Robot. Autom. 3, 1368–1373 (1986) Nguyen, V.: Constructing force-closure grasps. IEEE Int. Conf. Robot. Autom. 3, 1368–1373 (1986)
15.
Zurück zum Zitat Rusu, R., Blodow, N., Beetz, M.: Fast point feature histograms (fpfh) for 3d registration. In: IEEE International Conference on Robots and Automation (2009) Rusu, R., Blodow, N., Beetz, M.: Fast point feature histograms (fpfh) for 3d registration. In: IEEE International Conference on Robots and Automation (2009)
16.
Zurück zum Zitat Saxena, A., Driemeyer, J., Ng, A.: Robotic grasping of novel objects using vision. Int. J. Robot. Res. 27(4), 157 (2008)CrossRef Saxena, A., Driemeyer, J., Ng, A.: Robotic grasping of novel objects using vision. Int. J. Robot. Res. 27(4), 157 (2008)CrossRef
17.
Zurück zum Zitat Sudsang, A., Ponce, J.: New techniques for computing four-finger force-closure grasps of polyhedral objects. IEEE Int. Conf. Robot. Autom. 2, 1355–1360 (1995) Sudsang, A., Ponce, J.: New techniques for computing four-finger force-closure grasps of polyhedral objects. IEEE Int. Conf. Robot. Autom. 2, 1355–1360 (1995)
18.
Zurück zum Zitat Taubin, G.: Estimation of planar curves, surfaces and nonplanar space curves defined by implicit equations, with applications to edge and range image segmentation. IEEE Trans. PAMI 13, 1115–1138 (1991)CrossRef Taubin, G.: Estimation of planar curves, surfaces and nonplanar space curves defined by implicit equations, with applications to edge and range image segmentation. IEEE Trans. PAMI 13, 1115–1138 (1991)CrossRef
19.
Zurück zum Zitat ten Pas, A., Platt, R.: Localizing handle-like grasp affordances in 3d point clouds. In: International Symposium on Experimental Robotics (2014) ten Pas, A., Platt, R.: Localizing handle-like grasp affordances in 3d point clouds. In: International Symposium on Experimental Robotics (2014)
20.
Zurück zum Zitat Tombari, F., Salti, S., Di Stefano, L.: Unique signatures of histograms for local surface description. In: Computer Vision–ECCV 2010, pp. 356–369. Springer (2010) Tombari, F., Salti, S., Di Stefano, L.: Unique signatures of histograms for local surface description. In: Computer Vision–ECCV 2010, pp. 356–369. Springer (2010)
Metadaten
Titel
Using Geometry to Detect Grasp Poses in 3D Point Clouds
verfasst von
Andreas ten Pas
Robert Platt
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-51532-8_19

Neuer Inhalt