Skip to main content
Top

2017 | OriginalPaper | Chapter

Reading Comprehension of Natural Language Instructions by Robots

Authors : Irena Markievicz, Minija Tamosiunaite, Daiva Vitkute-Adzgauskiene, Jurgita Kapociute-Dzikiene, Rita Valteryte, Tomas Krilavicius

Published in: Beyond Databases, Architectures and Structures. Towards Efficient Solutions for Data Analysis and Knowledge Representation

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We address the problem of robots executing instructions written for humans. The goal is to simplify and speed-up the process of robot adaptation to certain tasks, which are described in human language. We propose an approach, where semantic roles are attached to the components of instructions which lead to robotic execution. However, extraction of such roles from the sentence is not trivial due to the prevalent non determinism of human language. We propose algorithms for extracting actions and object names with roles and explain, how it leads to the robotic execution via attached sub-symbolic information of previous execution examples for rotor assembly and bio(technology) laboratory scenarios. The precision for the main action extraction is 0.977, for the main, primary and secondary objects is 0.828, 0.943 and 0.954, respectively.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aksoy, E.E., Abramov, A., Dörr, J., Ning, K., Dellen, B., Wörgötter, F.: Learning the semantics of object-action relations by observation. The Int. J. Robot. Res. 30(10), 1229–1249 (2011)CrossRef Aksoy, E.E., Abramov, A., Dörr, J., Ning, K., Dellen, B., Wörgötter, F.: Learning the semantics of object-action relations by observation. The Int. J. Robot. Res. 30(10), 1229–1249 (2011)CrossRef
2.
go back to reference Chen, D., Manning, C.D.: A fast and accurate dependency parser using neural networks. In: Proceedings of Empirical Methods in Natural Language Processing (EMNLP), pp. 740–750 (2014) Chen, D., Manning, C.D.: A fast and accurate dependency parser using neural networks. In: Proceedings of Empirical Methods in Natural Language Processing (EMNLP), pp. 740–750 (2014)
3.
go back to reference Daudaravičius, V., Marcinkevičienė, R.: Gravity counts for the boundaries of collocations. Int. J. Corpus Linguist. 9(2), 321–348 (2004)CrossRef Daudaravičius, V., Marcinkevičienė, R.: Gravity counts for the boundaries of collocations. Int. J. Corpus Linguist. 9(2), 321–348 (2004)CrossRef
4.
go back to reference De Marneffe, M.C., Manning, C.D.: Stanford typed dependencies manual. Technical report, Stanford University (2008) De Marneffe, M.C., Manning, C.D.: Stanford typed dependencies manual. Technical report, Stanford University (2008)
5.
go back to reference El Idrissi, B., Baïna, S., Baïna, K.: Ontology learning from relational database: how to label the relationships between concepts? In: Publishing, S.I. (ed.) International Conference: Beyond Databases, Architectures and Structures, pp. 235–244 (2015) El Idrissi, B., Baïna, S., Baïna, K.: Ontology learning from relational database: how to label the relationships between concepts? In: Publishing, S.I. (ed.) International Conference: Beyond Databases, Architectures and Structures, pp. 235–244 (2015)
6.
go back to reference Kumova, B.İ.: Generating ontologies from relational data with fuzzy-syllogistic reasoning. In: Kozielski, S., Mrozek, D., Kasprowski, P., Małysiak-Mrozek, B., Kostrzewa, D. (eds.) BDAS 2015. CCIS, vol. 521, pp. 21–32. Springer, Cham (2015). doi:10.1007/978-3-319-18422-7_2 Kumova, B.İ.: Generating ontologies from relational data with fuzzy-syllogistic reasoning. In: Kozielski, S., Mrozek, D., Kasprowski, P., Małysiak-Mrozek, B., Kostrzewa, D. (eds.) BDAS 2015. CCIS, vol. 521, pp. 21–32. Springer, Cham (2015). doi:10.​1007/​978-3-319-18422-7_​2
7.
go back to reference Marcus, M.P., Marcinkiewicz, M.A., Santorini, B.: Building a large annotated corpus of english: the penn treebank. Computat. Linguist. 19(2), 313–330 (1993) Marcus, M.P., Marcinkiewicz, M.A., Santorini, B.: Building a large annotated corpus of english: the penn treebank. Computat. Linguist. 19(2), 313–330 (1993)
8.
go back to reference Markievicz, I., Vitkute-Adzgauskiene, D., Tamosiunaite, M.: Semi-supervised learning of action ontology from domain-specific corpora. In: Skersys, T., Butleris, R., Butkiene, R. (eds.) ICIST 2013. CCIS, vol. 403, pp. 173–185. Springer, Heidelberg (2013). doi:10.1007/978-3-642-41947-8_16 CrossRef Markievicz, I., Vitkute-Adzgauskiene, D., Tamosiunaite, M.: Semi-supervised learning of action ontology from domain-specific corpora. In: Skersys, T., Butleris, R., Butkiene, R. (eds.) ICIST 2013. CCIS, vol. 403, pp. 173–185. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-41947-8_​16 CrossRef
9.
go back to reference Misra, D.K., Sung, J., Lee, K., Saxena, A.: Tell me dave: context-sensitive grounding of natural language to manipulation instructions. Int. J. Robot. Res. 35(1–3), 281–300 (2016)CrossRef Misra, D.K., Sung, J., Lee, K., Saxena, A.: Tell me dave: context-sensitive grounding of natural language to manipulation instructions. Int. J. Robot. Res. 35(1–3), 281–300 (2016)CrossRef
10.
go back to reference Nyga, D., Beetz, M.: Cloud-based probabilistic knowledge services for instruction interpretation. In: ISRR, Genoa, Italy (2015) Nyga, D., Beetz, M.: Cloud-based probabilistic knowledge services for instruction interpretation. In: ISRR, Genoa, Italy (2015)
11.
go back to reference Tellex, S., Kollar, T., Dickerson, S., Walter, M.R., Banerjee, A.G., Teller, S., Roy, N.: Approaching the symbol grounding problem with probabilistic graphical models. AI Mag. 32(4), 64–76 (2011) Tellex, S., Kollar, T., Dickerson, S., Walter, M.R., Banerjee, A.G., Teller, S., Roy, N.: Approaching the symbol grounding problem with probabilistic graphical models. AI Mag. 32(4), 64–76 (2011)
12.
go back to reference Yang, Y., Guha, A., Fermuller, C., Aloimonos, Y.: A cognitive system for understanding human manipulation actions. Adv. Cogn. Syst. 3, 67–86 (2014) Yang, Y., Guha, A., Fermuller, C., Aloimonos, Y.: A cognitive system for understanding human manipulation actions. Adv. Cogn. Syst. 3, 67–86 (2014)
Metadata
Title
Reading Comprehension of Natural Language Instructions by Robots
Authors
Irena Markievicz
Minija Tamosiunaite
Daiva Vitkute-Adzgauskiene
Jurgita Kapociute-Dzikiene
Rita Valteryte
Tomas Krilavicius
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-58274-0_24

Premium Partner