Skip to main content
Top
Published in: Cognitive Processing 1/2011

01-02-2011 | Research Report

Multimodal cognitive interface for robot navigation

Authors: Mohammed Elmogy, Christopher Habel, Jianwei Zhang

Published in: Cognitive Processing | Issue 1/2011

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

To build effective interactions between humans and robots, they should have common ground of understanding that creates realistic expectations and forms the basis communications. An emerging approach to doing this is to create cognitive models of human reasoning and behavior selection. We have developed a robot navigation system that uses both spatial language and graphical representation to describe route-based navigation tasks for a mobile robot. Our proposed route instruction language (RIL) is intended as a semi-formal language for instructing the robot to execute a route in an indoor environment. We implemented an instruction interpreter to process the route description and generate its equivalent symbolic and topological map representations. A topological map is generated to describe relationships among features of the environment in a more abstract form without any absolute reference system to treat the ambiguity which can occur when the robot cannot recognize the current landmark. The symbolic and topological map representations are supplied to other system components as an initial path estimation to guide the robot while it plans its navigation task. We conducted some experiments to evaluate the routes which are written by using the RIL instructions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Bugmann G, Klein E, Lauria S, Kyriacou T (2004) Corpus-based robotics: a route instruction example. In: Proceedings of intelligent autonomous system, Amsterdam, pp 96–103 Bugmann G, Klein E, Lauria S, Kyriacou T (2004) Corpus-based robotics: a route instruction example. In: Proceedings of intelligent autonomous system, Amsterdam, pp 96–103
go back to reference Chella A, Coradeschi S, Frixione M, Saffiotti A (2004) Perceptual anchoring via conceptual spaces. In: Proceedings of the AAAI-04 workshop on anchoring symbols to sensor data. AAAI Press, Menlo Park Chella A, Coradeschi S, Frixione M, Saffiotti A (2004) Perceptual anchoring via conceptual spaces. In: Proceedings of the AAAI-04 workshop on anchoring symbols to sensor data. AAAI Press, Menlo Park
go back to reference Elmogy M, Zhang J (2008) Robust real-time landmark recognition for humanoid robot navigation. In: Proceedings of the 2008 IEEE international conference on robotics and biomimetics (ROBIO), Bangkok, pp 572–577, Dec 14–17 Elmogy M, Zhang J (2008) Robust real-time landmark recognition for humanoid robot navigation. In: Proceedings of the 2008 IEEE international conference on robotics and biomimetics (ROBIO), Bangkok, pp 572–577, Dec 14–17
go back to reference Elmogy M, Habel C, Zhang J (2008) Robot topological map generation from formal route instructions. In: Proceedings of the 6th international cognitive robotics workshop at 18th European conference on artificial intelligence (ECAI), Patras. IOS Press, pp 60–67, July 21–22 Elmogy M, Habel C, Zhang J (2008) Robot topological map generation from formal route instructions. In: Proceedings of the 6th international cognitive robotics workshop at 18th European conference on artificial intelligence (ECAI), Patras. IOS Press, pp 60–67, July 21–22
go back to reference Elmogy M, Habel C, Zhang J (2009) Online motion planning for hoap-2 humanoid robot navigation. In: Proceedings of the 2009 IEEE international conference on intelligent robots and systems (IROS), St. Louis, pp 3531–3536 Elmogy M, Habel C, Zhang J (2009) Online motion planning for hoap-2 humanoid robot navigation. In: Proceedings of the 2009 IEEE international conference on intelligent robots and systems (IROS), St. Louis, pp 3531–3536
go back to reference Eschenbach C, Tschander L, Habel C, Kulik L (2000) Lexical specifications of paths, Lecture Notes in Computer Science, vol 1849/2000. Springer, Berlin, pp 127–144 Eschenbach C, Tschander L, Habel C, Kulik L (2000) Lexical specifications of paths, Lecture Notes in Computer Science, vol 1849/2000. Springer, Berlin, pp 127–144
go back to reference Gärdenfors P (2000) Conceptual spaces: the geometry of thought. MIT Press, Cambridge Gärdenfors P (2000) Conceptual spaces: the geometry of thought. MIT Press, Cambridge
go back to reference Habel C (2003) Incremental generation of multimodal route instructions. In: Natural language generation in spoken and written dialogue, AAAI spring symposium 2003, Palo Alto, pp 44–51 Habel C (2003) Incremental generation of multimodal route instructions. In: Natural language generation in spoken and written dialogue, AAAI spring symposium 2003, Palo Alto, pp 44–51
go back to reference Kollar T, Tellex S, Roy D, Roy N (2010) Toward understanding natural language directions. In: Proceedings of the 5th ACM/IEEE international conference on human–robot interaction (HRI’10), Osaka, pp 259–266 Kollar T, Tellex S, Roy D, Roy N (2010) Toward understanding natural language directions. In: Proceedings of the 5th ACM/IEEE international conference on human–robot interaction (HRI’10), Osaka, pp 259–266
go back to reference Kyriacou T, Bugmann G, Lauria S (2002) Vision-based urban navigation procedures for verbally instructed robots. Robot Auton Syst 51:1326–1331 Kyriacou T, Bugmann G, Lauria S (2002) Vision-based urban navigation procedures for verbally instructed robots. Robot Auton Syst 51:1326–1331
go back to reference Lauria S, Bugmann G, Kyriacou T, Bos J, Klein E (2001) Training personal robots using natural language instruction. IEEE Intell Syst 16:38–45 Lauria S, Bugmann G, Kyriacou T, Bos J, Klein E (2001) Training personal robots using natural language instruction. IEEE Intell Syst 16:38–45
go back to reference Levit M, Roy D (2007) Interpretation of spatial language in a map navigation task. IEEE Trans Syst Man Cybern B 37(3):667–679CrossRef Levit M, Roy D (2007) Interpretation of spatial language in a map navigation task. IEEE Trans Syst Man Cybern B 37(3):667–679CrossRef
go back to reference Litvintseva L, Tanaka T, Yamafuji K, Ulyanov V (1997) Intelligence computing for direct human–robot communication using natural language and cognitive graphics. In: Proceedings of the IEEE international symposium on computational intelligence in robotics and automation (CIRA’97), pp 332–337 Litvintseva L, Tanaka T, Yamafuji K, Ulyanov V (1997) Intelligence computing for direct human–robot communication using natural language and cognitive graphics. In: Proceedings of the IEEE international symposium on computational intelligence in robotics and automation (CIRA’97), pp 332–337
go back to reference MacMahon M (2005) Marco: a modular architecture for following route instructions. In: Proceedings of the AAAI workshop on modular construction of human-like intelligence, Pittsburgh, pp 48–55 MacMahon M (2005) Marco: a modular architecture for following route instructions. In: Proceedings of the AAAI workshop on modular construction of human-like intelligence, Pittsburgh, pp 48–55
go back to reference MacMahon M, Stankiewicz B, Kuipers B (2006) Walk the talk: connecting language, knowledge, and action in route instructions. In: Proceedings of the 21st national conference on artificial intelligence (AAAI-2006), Boston, pp 1475–1482 MacMahon M, Stankiewicz B, Kuipers B (2006) Walk the talk: connecting language, knowledge, and action in route instructions. In: Proceedings of the 21st national conference on artificial intelligence (AAAI-2006), Boston, pp 1475–1482
go back to reference Pires G, Nunes U (2002) A wheelchair steered through voice commands and assisted by a reactive fuzzy-logic controller. J Intell Robot Syst 34:301–314CrossRef Pires G, Nunes U (2002) A wheelchair steered through voice commands and assisted by a reactive fuzzy-logic controller. J Intell Robot Syst 34:301–314CrossRef
go back to reference Pradel G, Hoppenot P (2006) Symbolic trajectory description in mobile robotics. J Intell Robot Syst 45(2):157–180CrossRef Pradel G, Hoppenot P (2006) Symbolic trajectory description in mobile robotics. J Intell Robot Syst 45(2):157–180CrossRef
go back to reference Schulz R, Stockwell P, Wakabayashi M, Wiles J (2006) Towards a spatial language for mobile robots. In: Proceedings of the 6th international conference on the evolution of language, pp 291–298 Schulz R, Stockwell P, Wakabayashi M, Wiles J (2006) Towards a spatial language for mobile robots. In: Proceedings of the 6th international conference on the evolution of language, pp 291–298
go back to reference Simpson RC, Levine SP (1997) Adaptive shared control of a smart wheelchair operated by voice control. In: Proceedings of the 1997 IEEE/RSJ international conference on intelligent robots and systems (IROS ’97), vol 2, pp 622–626 Simpson RC, Levine SP (1997) Adaptive shared control of a smart wheelchair operated by voice control. In: Proceedings of the 1997 IEEE/RSJ international conference on intelligent robots and systems (IROS ’97), vol 2, pp 622–626
go back to reference Skubic M, Perzanowski D, Blisard S, Schultz A, Adams W, Bugajska M, Brock D (2004) Spatial language for human–robot dialogs. IEEE Trans Syst Man Cybern C Appl Rev 34(2):154–167CrossRef Skubic M, Perzanowski D, Blisard S, Schultz A, Adams W, Bugajska M, Brock D (2004) Spatial language for human–robot dialogs. IEEE Trans Syst Man Cybern C Appl Rev 34(2):154–167CrossRef
go back to reference Tellex S, Roy D (2006) Spatial routines for a simulated speech-controlled vehicle. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on human–robot interaction, Salt Lake City, pp 156–163 Tellex S, Roy D (2006) Spatial routines for a simulated speech-controlled vehicle. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on human–robot interaction, Salt Lake City, pp 156–163
go back to reference Tellex S, Roy D (2007) Grounding language in spatial routines. In: Proceedings of AAAI spring symposium on control mechanisms for spatial knowledge processing in cognitive/intelligent systems Tellex S, Roy D (2007) Grounding language in spatial routines. In: Proceedings of AAAI spring symposium on control mechanisms for spatial knowledge processing in cognitive/intelligent systems
go back to reference Tschander LB, Schmidtke H, Habel C, Eschenbach C, Kulik L (2003) A geometric agent following route instructions, Lecture Notes in Computer Science, vol 2685/2003. Springer, Berlin, pp 89–111 Tschander LB, Schmidtke H, Habel C, Eschenbach C, Kulik L (2003) A geometric agent following route instructions, Lecture Notes in Computer Science, vol 2685/2003. Springer, Berlin, pp 89–111
Metadata
Title
Multimodal cognitive interface for robot navigation
Authors
Mohammed Elmogy
Christopher Habel
Jianwei Zhang
Publication date
01-02-2011
Publisher
Springer-Verlag
Published in
Cognitive Processing / Issue 1/2011
Print ISSN: 1612-4782
Electronic ISSN: 1612-4790
DOI
https://doi.org/10.1007/s10339-010-0386-4

Other articles of this Issue 1/2011

Cognitive Processing 1/2011 Go to the issue