Skip to main content


Weitere Kapitel dieses Buchs durch Wischen aufrufen

2016 | OriginalPaper | Buchkapitel

Interpreting Manipulation Actions: From Language to Execution

verfasst von: Bao-Anh Dang-Vu, Oliver Porges, Máximo A. Roa

Erschienen in: Robot 2015: Second Iberian Robotics Conference

Verlag: Springer International Publishing


Processing natural language instructions for execution of robotic tasks has been regarded as a means to make more intuitive the interaction with robots. This paper is focused on the applications of natural language processing in manipulation, specifically on the problem of recovering from the instruction the information missing for the manipulation planning, which has been traditionally assumed to be available for instance via pre-computed grasps or pre-labeled objects. The proposed approach includes a clustering process that discriminates areas on the object that can be used for different types of tasks (therefore providing valuable information for the grasp planning process), the extraction and consideration of task information and grasp constraints for solving the manipulation problem, and the use of an integrated grasp and motion planning that avoids relying on a predefined grasp database.

Interpreting Manipulation Actions: From Language to Execution
verfasst von
Bao-Anh Dang-Vu
Oliver Porges
Máximo A. Roa

Premium Partner