Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Learning Transferable Policies for Monocular Reactive MAV Control Read chapter Read first chapter

2017 | OriginalPaper | Chapter

Integrated Intelligence for Human-Robot Teams

Authors : Jean Oh, Thomas M. Howard, Matthew R. Walter, Daniel Barber, Menglong Zhu, Sangdon Park, Arne Suppe, Luis Navarro-Serment, Felix Duvallet, Abdeslam Boularias, Oscar Romero, Jerry Vinokurov, Terence Keegan, Robert Dean, Craig Lennon, Barry Bodt, Marshal Childers, Jianbo Shi, Kostas Daniilidis, Nicholas Roy, Christian Lebiere, Martial Hebert, Anthony Stentz

Published in: 2016 International Symposium on Experimental Robotics

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With recent advances in robotics technologies and autonomous systems, the idea of human-robot teams is gaining ever-increasing attention. In this context, our research focuses on developing an intelligent robot that can autonomously perform non-trivial, but specific tasks conveyed through natural language. Toward this goal, a consortium of researchers develop and integrate various types of intelligence into mobile robot platforms, including cognitive abilities to reason about high-level missions, perception to classify regions and detect relevant objects in an environment, and linguistic abilities to associate instructions with the robot’s world model and to communicate with human teammates in a natural way. This paper describes the resulting system with integrated intelligence and reports on the latest assessment.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Design and Control of Lightweight Supernumerary Robotic Limbs for Sitting/Standing Assistance
next chapter EUROPtus: A Mixed-Initiative Controller for Multi-vehicle Oceanographic Field Experiments
Literature
1.
Anderson, J.R., Bothell, D., Byrne, M.D., Douglass, S.A., Lebiere, C., Qin, Y.: An integrated theory of the mind. Psychol. Rev. 111, 1036–1060 (2004)CrossRef
2.
Barber, D., Howard, T.M., Walter, M.R.: A multimodal interface for real-time soldier-robot teaming. In Proceedings of the SPIE 9837, Unmanned Systems Technology XVIII (2016)
3.
Boularias, A., Duvallet, F., Oh, F., Stentz, A.: Grounding spatial relations for outdoor robot navigation. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1976–1982 (2015)
4.
Chung, I., Propp, O., Walter, M.R., Howard, T.M.: On the performance of hierarchical distributed correspondence graphs for efficient symbol grounding of robot instructions. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5247–5252 (2015)
5.
Dean, R.: Common world model for unmanned systems. In: Procedings of the SPIE 8741, Unmanned Systems Technology XV (2013)
6.
Duvallet, F., Walter, M.R., Howard, T., Hemachandra, S., Oh, J., Teller, S., Roy, N., Stentz, A.: Inferring maps and behaviors from natural language instructions. In: Hsieh, M.A., Khatib, O., Kumar, V. (eds.) Experimental Robotics. STAR, vol. 109, pp. 373–388. Springer, Heidelberg (2016). doi:10.​1007/​978-3-319-23778-7_​25 CrossRef
7.
Eiter, T., Mannila, H.: Computing discrete frechet distance. Technical report, Christian Doppler Laboratory, Vienna University of Technology (1994)
8.
Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2010)CrossRef
9.
Golland, D., Liang, P., Klein, D.: A game-theoretic approach to generating spatial descriptions. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 410–419 (2010)
10.
Hawes, N., Klenk, M., Lockwood, K., Horn, G.S., Kelleher, J.D.: Towards a cognitive system that can recognize spatial regions based on context. In: Proceedings of the AAAI Conference on Artificial Intelligence (2012)
11.
Hemachandra, S., Duvallet, F., Howard, T.M., Roy, N., Stentz, A., Walter, M.R.: Learning models for following natural language directions in unknown environments. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 5608–5615 (2015)
12.
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Proceedings of the Neural Information Processing Systems, pp. 1097–1105 (2012)
13.
Lebiere, C., Jentsch, F., Ososky, S.: Cognitive models of decision making processes for human-robot interaction. In: Proceedings of the International Conference on Virtual, Augmented and Mixed Reality, pp. 285–294 (2013)
14.
Lennon, C., Bodt, B., Childers, M., Dean, R., Oh, J., DiBerardino, C.: Assessment of navigation using a hybrid cognitive/metric world model. Technical Report ARL-TR-7175, Army Research Labs, January 2015
15.
Lennon, C., Bodt, B., Childers, M., Dean, R., Oh, J., DiBerardino, C., Keegan, T.: RCTA Capstone Assessment. In Proceedings of the SPIE 9468, Unmanned Systems Technology XVII (2015)
16.
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
17.
Matuszek, C., Herbst, E., Zettlemoyer, L., Fox, D.: Learning to parse natural language commands to a robot control system. In: Proceedings of the International Symposium on Experimental Robotics (2012)
18.
Munoz, D.: Inference Machines: Parsing Scenes via Iterated Predictions. PhD thesis, The Robotics Institute, Carnegie Mellon University, 2013
19.
Oh, J., Suppe, A., Duvallet, F., Boularias, A., Vinokurov, J., Navarro-Serment, L., Romero, O., Dean, R., Lebiere, C., Hebert, M., Stentz, A.: Toward mobile robots reasoning like humans. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 1371–1379 (2015)
20.
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Proceedings of the Neural Information Processing Systems (2015)
21.
Tellex, S., Kollar, T., Dickerson, S., Walter, M.R., Banerjee, A.G., Teller, S.J., Roy, M.: Understanding natural language commands for robotic navigation and mobile manipulation. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 1507–1514 (2011)
22.
Yang, Y., Ramanan, D.: Articulated pose estimation using flexible mixtures of parts. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1385–1392 (2011)
23.
Zhu, M., Atanasov, N., Pappas, G.J., Daniilidis, K.: Active deformable part models inference. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8695, pp. 281–296. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10584-0_​19
Metadata
Title
Integrated Intelligence for Human-Robot Teams
Authors
Jean Oh
Thomas M. Howard
Matthew R. Walter
Daniel Barber
Menglong Zhu
Sangdon Park
Arne Suppe
Luis Navarro-Serment
Felix Duvallet
Abdeslam Boularias
Oscar Romero
Jerry Vinokurov
Terence Keegan
Robert Dean
Craig Lennon
Barry Bodt
Marshal Childers
Jianbo Shi
Kostas Daniilidis
Nicholas Roy
Christian Lebiere
Martial Hebert
Anthony Stentz
Copyright Year
2017
Book
2016 International Symposium on Experimental Robotics

Print ISBN: 978-3-319-50114-7

Electronic ISBN: 978-3-319-50115-4

Copyright Year: 2017

DOI
https://doi.org/10.1007/978-3-319-50115-4_28