Skip to main content
Erschienen in: Cognitive Processing 1/2011

01.02.2011 | Research Report

Multimodal cognitive interface for robot navigation

verfasst von: Mohammed Elmogy, Christopher Habel, Jianwei Zhang

Erschienen in: Cognitive Processing | Ausgabe 1/2011

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

To build effective interactions between humans and robots, they should have common ground of understanding that creates realistic expectations and forms the basis communications. An emerging approach to doing this is to create cognitive models of human reasoning and behavior selection. We have developed a robot navigation system that uses both spatial language and graphical representation to describe route-based navigation tasks for a mobile robot. Our proposed route instruction language (RIL) is intended as a semi-formal language for instructing the robot to execute a route in an indoor environment. We implemented an instruction interpreter to process the route description and generate its equivalent symbolic and topological map representations. A topological map is generated to describe relationships among features of the environment in a more abstract form without any absolute reference system to treat the ambiguity which can occur when the robot cannot recognize the current landmark. The symbolic and topological map representations are supplied to other system components as an initial path estimation to guide the robot while it plans its navigation task. We conducted some experiments to evaluate the routes which are written by using the RIL instructions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Bugmann G, Klein E, Lauria S, Kyriacou T (2004) Corpus-based robotics: a route instruction example. In: Proceedings of intelligent autonomous system, Amsterdam, pp 96–103 Bugmann G, Klein E, Lauria S, Kyriacou T (2004) Corpus-based robotics: a route instruction example. In: Proceedings of intelligent autonomous system, Amsterdam, pp 96–103
Zurück zum Zitat Chella A, Coradeschi S, Frixione M, Saffiotti A (2004) Perceptual anchoring via conceptual spaces. In: Proceedings of the AAAI-04 workshop on anchoring symbols to sensor data. AAAI Press, Menlo Park Chella A, Coradeschi S, Frixione M, Saffiotti A (2004) Perceptual anchoring via conceptual spaces. In: Proceedings of the AAAI-04 workshop on anchoring symbols to sensor data. AAAI Press, Menlo Park
Zurück zum Zitat Elmogy M, Zhang J (2008) Robust real-time landmark recognition for humanoid robot navigation. In: Proceedings of the 2008 IEEE international conference on robotics and biomimetics (ROBIO), Bangkok, pp 572–577, Dec 14–17 Elmogy M, Zhang J (2008) Robust real-time landmark recognition for humanoid robot navigation. In: Proceedings of the 2008 IEEE international conference on robotics and biomimetics (ROBIO), Bangkok, pp 572–577, Dec 14–17
Zurück zum Zitat Elmogy M, Habel C, Zhang J (2008) Robot topological map generation from formal route instructions. In: Proceedings of the 6th international cognitive robotics workshop at 18th European conference on artificial intelligence (ECAI), Patras. IOS Press, pp 60–67, July 21–22 Elmogy M, Habel C, Zhang J (2008) Robot topological map generation from formal route instructions. In: Proceedings of the 6th international cognitive robotics workshop at 18th European conference on artificial intelligence (ECAI), Patras. IOS Press, pp 60–67, July 21–22
Zurück zum Zitat Elmogy M, Habel C, Zhang J (2009) Online motion planning for hoap-2 humanoid robot navigation. In: Proceedings of the 2009 IEEE international conference on intelligent robots and systems (IROS), St. Louis, pp 3531–3536 Elmogy M, Habel C, Zhang J (2009) Online motion planning for hoap-2 humanoid robot navigation. In: Proceedings of the 2009 IEEE international conference on intelligent robots and systems (IROS), St. Louis, pp 3531–3536
Zurück zum Zitat Eschenbach C, Tschander L, Habel C, Kulik L (2000) Lexical specifications of paths, Lecture Notes in Computer Science, vol 1849/2000. Springer, Berlin, pp 127–144 Eschenbach C, Tschander L, Habel C, Kulik L (2000) Lexical specifications of paths, Lecture Notes in Computer Science, vol 1849/2000. Springer, Berlin, pp 127–144
Zurück zum Zitat Gärdenfors P (2000) Conceptual spaces: the geometry of thought. MIT Press, Cambridge Gärdenfors P (2000) Conceptual spaces: the geometry of thought. MIT Press, Cambridge
Zurück zum Zitat Habel C (2003) Incremental generation of multimodal route instructions. In: Natural language generation in spoken and written dialogue, AAAI spring symposium 2003, Palo Alto, pp 44–51 Habel C (2003) Incremental generation of multimodal route instructions. In: Natural language generation in spoken and written dialogue, AAAI spring symposium 2003, Palo Alto, pp 44–51
Zurück zum Zitat Kollar T, Tellex S, Roy D, Roy N (2010) Toward understanding natural language directions. In: Proceedings of the 5th ACM/IEEE international conference on human–robot interaction (HRI’10), Osaka, pp 259–266 Kollar T, Tellex S, Roy D, Roy N (2010) Toward understanding natural language directions. In: Proceedings of the 5th ACM/IEEE international conference on human–robot interaction (HRI’10), Osaka, pp 259–266
Zurück zum Zitat Kyriacou T, Bugmann G, Lauria S (2002) Vision-based urban navigation procedures for verbally instructed robots. Robot Auton Syst 51:1326–1331 Kyriacou T, Bugmann G, Lauria S (2002) Vision-based urban navigation procedures for verbally instructed robots. Robot Auton Syst 51:1326–1331
Zurück zum Zitat Lauria S, Bugmann G, Kyriacou T, Bos J, Klein E (2001) Training personal robots using natural language instruction. IEEE Intell Syst 16:38–45 Lauria S, Bugmann G, Kyriacou T, Bos J, Klein E (2001) Training personal robots using natural language instruction. IEEE Intell Syst 16:38–45
Zurück zum Zitat Levit M, Roy D (2007) Interpretation of spatial language in a map navigation task. IEEE Trans Syst Man Cybern B 37(3):667–679CrossRef Levit M, Roy D (2007) Interpretation of spatial language in a map navigation task. IEEE Trans Syst Man Cybern B 37(3):667–679CrossRef
Zurück zum Zitat Litvintseva L, Tanaka T, Yamafuji K, Ulyanov V (1997) Intelligence computing for direct human–robot communication using natural language and cognitive graphics. In: Proceedings of the IEEE international symposium on computational intelligence in robotics and automation (CIRA’97), pp 332–337 Litvintseva L, Tanaka T, Yamafuji K, Ulyanov V (1997) Intelligence computing for direct human–robot communication using natural language and cognitive graphics. In: Proceedings of the IEEE international symposium on computational intelligence in robotics and automation (CIRA’97), pp 332–337
Zurück zum Zitat MacMahon M (2005) Marco: a modular architecture for following route instructions. In: Proceedings of the AAAI workshop on modular construction of human-like intelligence, Pittsburgh, pp 48–55 MacMahon M (2005) Marco: a modular architecture for following route instructions. In: Proceedings of the AAAI workshop on modular construction of human-like intelligence, Pittsburgh, pp 48–55
Zurück zum Zitat MacMahon M, Stankiewicz B, Kuipers B (2006) Walk the talk: connecting language, knowledge, and action in route instructions. In: Proceedings of the 21st national conference on artificial intelligence (AAAI-2006), Boston, pp 1475–1482 MacMahon M, Stankiewicz B, Kuipers B (2006) Walk the talk: connecting language, knowledge, and action in route instructions. In: Proceedings of the 21st national conference on artificial intelligence (AAAI-2006), Boston, pp 1475–1482
Zurück zum Zitat Pires G, Nunes U (2002) A wheelchair steered through voice commands and assisted by a reactive fuzzy-logic controller. J Intell Robot Syst 34:301–314CrossRef Pires G, Nunes U (2002) A wheelchair steered through voice commands and assisted by a reactive fuzzy-logic controller. J Intell Robot Syst 34:301–314CrossRef
Zurück zum Zitat Pradel G, Hoppenot P (2006) Symbolic trajectory description in mobile robotics. J Intell Robot Syst 45(2):157–180CrossRef Pradel G, Hoppenot P (2006) Symbolic trajectory description in mobile robotics. J Intell Robot Syst 45(2):157–180CrossRef
Zurück zum Zitat Schulz R, Stockwell P, Wakabayashi M, Wiles J (2006) Towards a spatial language for mobile robots. In: Proceedings of the 6th international conference on the evolution of language, pp 291–298 Schulz R, Stockwell P, Wakabayashi M, Wiles J (2006) Towards a spatial language for mobile robots. In: Proceedings of the 6th international conference on the evolution of language, pp 291–298
Zurück zum Zitat Simpson RC, Levine SP (1997) Adaptive shared control of a smart wheelchair operated by voice control. In: Proceedings of the 1997 IEEE/RSJ international conference on intelligent robots and systems (IROS ’97), vol 2, pp 622–626 Simpson RC, Levine SP (1997) Adaptive shared control of a smart wheelchair operated by voice control. In: Proceedings of the 1997 IEEE/RSJ international conference on intelligent robots and systems (IROS ’97), vol 2, pp 622–626
Zurück zum Zitat Skubic M, Perzanowski D, Blisard S, Schultz A, Adams W, Bugajska M, Brock D (2004) Spatial language for human–robot dialogs. IEEE Trans Syst Man Cybern C Appl Rev 34(2):154–167CrossRef Skubic M, Perzanowski D, Blisard S, Schultz A, Adams W, Bugajska M, Brock D (2004) Spatial language for human–robot dialogs. IEEE Trans Syst Man Cybern C Appl Rev 34(2):154–167CrossRef
Zurück zum Zitat Tellex S, Roy D (2006) Spatial routines for a simulated speech-controlled vehicle. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on human–robot interaction, Salt Lake City, pp 156–163 Tellex S, Roy D (2006) Spatial routines for a simulated speech-controlled vehicle. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on human–robot interaction, Salt Lake City, pp 156–163
Zurück zum Zitat Tellex S, Roy D (2007) Grounding language in spatial routines. In: Proceedings of AAAI spring symposium on control mechanisms for spatial knowledge processing in cognitive/intelligent systems Tellex S, Roy D (2007) Grounding language in spatial routines. In: Proceedings of AAAI spring symposium on control mechanisms for spatial knowledge processing in cognitive/intelligent systems
Zurück zum Zitat Tschander LB, Schmidtke H, Habel C, Eschenbach C, Kulik L (2003) A geometric agent following route instructions, Lecture Notes in Computer Science, vol 2685/2003. Springer, Berlin, pp 89–111 Tschander LB, Schmidtke H, Habel C, Eschenbach C, Kulik L (2003) A geometric agent following route instructions, Lecture Notes in Computer Science, vol 2685/2003. Springer, Berlin, pp 89–111
Metadaten
Titel
Multimodal cognitive interface for robot navigation
verfasst von
Mohammed Elmogy
Christopher Habel
Jianwei Zhang
Publikationsdatum
01.02.2011
Verlag
Springer-Verlag
Erschienen in
Cognitive Processing / Ausgabe 1/2011
Print ISSN: 1612-4782
Elektronische ISSN: 1612-4790
DOI
https://doi.org/10.1007/s10339-010-0386-4

Weitere Artikel der Ausgabe 1/2011

Cognitive Processing 1/2011 Zur Ausgabe

Neuer Inhalt