Skip to main content
Erschienen in: International Journal of Social Robotics 5/2015

01.11.2015

Capturing Expertise: Developing Interaction Content for a Robot Through Teleoperation by Domain Experts

verfasst von: Kanae Wada, Dylan F. Glas, Masahiro Shiomi, Takayuki Kanda, Hiroshi Ishiguro, Norihiro Hagita

Erschienen in: International Journal of Social Robotics | Ausgabe 5/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The development of humanlike service robots which interact socially raises a new question: how can we create good interaction content for such robots? Domain experts specializing in the target service have the knowledge for making such content. Yet, while they can easily engage in good face-to-face interactions, we found it difficult for them to prepare conversational content for a robot in written form. Instead, we propose involving experts as teleoperators in a short-cycle iterative development process in which the expert develops content, teleoperates a robot using that content, and then revises the content based on that interaction. We propose a software system and design guidelines to enable such an iterative design process. To validate these solutions, we conducted a comparison experiment in the field, with a teleoperated robot acting as a guide at a tourist information center in Nara, Japan. The results showed that our system and guidelines enabled domain experts with no robotics background to create better interaction content and conduct better interactions than domain experts without our system.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Pineau J, Montemerlo M, Pollack M, Roy N, Thrun S (2003) Towards robotic assistants in nursing homes: challenges and results. Robot Autonom Syst 42:271–281CrossRefMATH Pineau J, Montemerlo M, Pollack M, Roy N, Thrun S (2003) Towards robotic assistants in nursing homes: challenges and results. Robot Autonom Syst 42:271–281CrossRefMATH
2.
Zurück zum Zitat Shiomi M, Kanda T, Glas DF, Satake S, Ishiguro H, Hagita N (2009) Field trial of networked social robots in a shopping mall. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS2009), pp 2846–2853 Shiomi M, Kanda T, Glas DF, Satake S, Ishiguro H, Hagita N (2009) Field trial of networked social robots in a shopping mall. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS2009), pp 2846–2853
3.
Zurück zum Zitat Gross H-M, Boehme H-J, Schroeter C, Mueller S, Koenig A, Martin C, Merten M, Bley A (2008) ShopBot: progress in developing an interactive mobile shopping assistant for everyday use. IEEE international conference on systems, man, and cybernetics, pp 3471–3478 Gross H-M, Boehme H-J, Schroeter C, Mueller S, Koenig A, Martin C, Merten M, Bley A (2008) ShopBot: progress in developing an interactive mobile shopping assistant for everyday use. IEEE international conference on systems, man, and cybernetics, pp 3471–3478
4.
Zurück zum Zitat Gockley R, Bruce A, Forlizzi J, Michalowski M, Mundell A, Rosenthal S, Sellner B, Simmons R, Snipes K, Schultz AC, Wang J (2005) Designing robots for long-term social interaction. In: IEEE/RSJ international conference on intelligent robots and systems (IROS2005), pp 1338–1343 Gockley R, Bruce A, Forlizzi J, Michalowski M, Mundell A, Rosenthal S, Sellner B, Simmons R, Snipes K, Schultz AC, Wang J (2005) Designing robots for long-term social interaction. In: IEEE/RSJ international conference on intelligent robots and systems (IROS2005), pp 1338–1343
5.
Zurück zum Zitat Weiss A, Igelsbock J, Tscheligi M, Bauer A, Kuhnlenz K, Wollherr D, Buss M (2010) Robots asking for directions: the willingness of passers-by to support robots. In: Proceedings of the ACM/IEEE international conference on human-robot interaction (HRI2010), pp 23–30 Weiss A, Igelsbock J, Tscheligi M, Bauer A, Kuhnlenz K, Wollherr D, Buss M (2010) Robots asking for directions: the willingness of passers-by to support robots. In: Proceedings of the ACM/IEEE international conference on human-robot interaction (HRI2010), pp 23–30
6.
Zurück zum Zitat Polanyi M (1962) Personal knowledge: towards a post-critical philosophy. University of Chicago Press, Chicago Polanyi M (1962) Personal knowledge: towards a post-critical philosophy. University of Chicago Press, Chicago
7.
Zurück zum Zitat Eraut M (2000) Non-formal learning and tacit knowledge in professional work. Br J Educat Psychol 70:113–136CrossRef Eraut M (2000) Non-formal learning and tacit knowledge in professional work. Br J Educat Psychol 70:113–136CrossRef
8.
Zurück zum Zitat Kahn P, Freier N, Kandau T, Ishiguro H, Ruckert J, Severson R, Kane S (2008) Design patterns for sociality in human-robot interaction. In: ACM/IEEE international conference on human-robot interaction, pp 97–104 Kahn P, Freier N, Kandau T, Ishiguro H, Ruckert J, Severson R, Kane S (2008) Design patterns for sociality in human-robot interaction. In: ACM/IEEE international conference on human-robot interaction, pp 97–104
9.
Zurück zum Zitat Kanda T, Shiomi M, Miyashita Z, Ishiguro H, Hagita N (2010) A communication robot in a shopping mall. IEEE Trans Robot 26:897–913CrossRef Kanda T, Shiomi M, Miyashita Z, Ishiguro H, Hagita N (2010) A communication robot in a shopping mall. IEEE Trans Robot 26:897–913CrossRef
10.
Zurück zum Zitat Glas DF, Kanda T, Ishiguro H, Hagita N (2012) Teleoperation of multiple social robots. IEEE Trans Syst Man Cybernet A Syst Humans 42(3):530–544CrossRef Glas DF, Kanda T, Ishiguro H, Hagita N (2012) Teleoperation of multiple social robots. IEEE Trans Syst Man Cybernet A Syst Humans 42(3):530–544CrossRef
11.
Zurück zum Zitat McTear MF (2002) Spoken dialogue technology: enabling the conversational user interface. ACM Comput Surv (CSUR) 34:90–169CrossRef McTear MF (2002) Spoken dialogue technology: enabling the conversational user interface. ACM Comput Surv (CSUR) 34:90–169CrossRef
12.
Zurück zum Zitat Glas DF, Satake S, Kanda T, Hagita N (2011) An interaction design framework for social robots. In: Robotics: science and systems conference Glas DF, Satake S, Kanda T, Hagita N (2011) An interaction design framework for social robots. In: Robotics: science and systems conference
13.
Zurück zum Zitat McTear MF (1998) Modelling spoken dialogues with state transition diagrams: experiences with the CSLU toolkit. In: International conference on spoken language processing (ICSLP1998), pp 1223–1226 McTear MF (1998) Modelling spoken dialogues with state transition diagrams: experiences with the CSLU toolkit. In: International conference on spoken language processing (ICSLP1998), pp 1223–1226
14.
Zurück zum Zitat Bohus D, Raux A, Harris TK, Eskenazi M, Rudnicky AI (2007) Olympus: an open-source framework for conversational spoken language interface research. In: HLT-NAACL 2007 workshop on bridging the gap: academic and industrial research in dialog technology, 2007, pp 32–39 Bohus D, Raux A, Harris TK, Eskenazi M, Rudnicky AI (2007) Olympus: an open-source framework for conversational spoken language interface research. In: HLT-NAACL 2007 workshop on bridging the gap: academic and industrial research in dialog technology, 2007, pp 32–39
15.
Zurück zum Zitat Krenn B, Sieber G (2008) Functional mark-up for behaviour planning: theory and practice. In: Proceedings of the AAMAS 2008 workshop FML: functional markup language. Why conversational agents do what they do Krenn B, Sieber G (2008) Functional mark-up for behaviour planning: theory and practice. In: Proceedings of the AAMAS 2008 workshop FML: functional markup language. Why conversational agents do what they do
16.
Zurück zum Zitat Nishimura Y, Minotsu S, Dohi H, Ishizuka M, Nakano M, Funakoshi K, Takeuchi J, Hasegawa Y, Tsujino H (2007) A markup language for describing interactive humanoid robot presentations. In: International conference on intelligent user interfaces (IUI 2007), pp 333–336 Nishimura Y, Minotsu S, Dohi H, Ishizuka M, Nakano M, Funakoshi K, Takeuchi J, Hasegawa Y, Tsujino H (2007) A markup language for describing interactive humanoid robot presentations. In: International conference on intelligent user interfaces (IUI 2007), pp 333–336
17.
Zurück zum Zitat Chernova S, Orkin J, Breazeal C (2010) Crowdsourcing HRI through online multiplayer games. In: The AAAI fall symposium dialog with robots, pp 14–19 Chernova S, Orkin J, Breazeal C (2010) Crowdsourcing HRI through online multiplayer games. In: The AAAI fall symposium dialog with robots, pp 14–19
18.
Zurück zum Zitat Wallis P, Mitchard H, Das J, ODea D (2001) Dialogue modelling for a conversational agent. In: Stumptner M, Corbett D, Brooks M (eds) AI 2001: advances in artificial intelligence, vol 2256. Lecture notes in artificial intelligenceSpringer, Berlin Wallis P, Mitchard H, Das J, ODea D (2001) Dialogue modelling for a conversational agent. In: Stumptner M, Corbett D, Brooks M (eds) AI 2001: advances in artificial intelligence, vol 2256. Lecture notes in artificial intelligenceSpringer, Berlin
19.
Zurück zum Zitat Boose JH, Bradshaw JM (1987) Expertise transfer and complex problems: using AQUINAS as a knowledge-acquisition workbench for knowledge-based systems. Int J Man Mach Stud 26(1):3–28 Boose JH, Bradshaw JM (1987) Expertise transfer and complex problems: using AQUINAS as a knowledge-acquisition workbench for knowledge-based systems. Int J Man Mach Stud 26(1):3–28
20.
Zurück zum Zitat Kuo I-H, Jayawardena C, Broadbent E, MacDonald BA (2011) Multidisciplinary design approach for implementation of interactive services: communication initiation and user identification for healthcare service robots. Int J Soc Robot 3:443–456CrossRef Kuo I-H, Jayawardena C, Broadbent E, MacDonald BA (2011) Multidisciplinary design approach for implementation of interactive services: communication initiation and user identification for healthcare service robots. Int J Soc Robot 3:443–456CrossRef
21.
Zurück zum Zitat Lohse M, Siepmann F (2014) A modeling framework for user-driven iterative design of autonomous systems. Int J Soc Robot 6(1):121–139CrossRef Lohse M, Siepmann F (2014) A modeling framework for user-driven iterative design of autonomous systems. Int J Soc Robot 6(1):121–139CrossRef
22.
Zurück zum Zitat Ross D, Lim J, Lin R-S, Yang M-H (2008) Incremental learning for robust visual tracking. Int J Comput Vis 77(1–3):125–141CrossRef Ross D, Lim J, Lin R-S, Yang M-H (2008) Incremental learning for robust visual tracking. Int J Comput Vis 77(1–3):125–141CrossRef
23.
Zurück zum Zitat Zang P, Tian R, Thomaz AL, Isbell CL (2010) Batch versus interactive learning by demonstration. In: Proceedings of the IEEE 9th international conference on development and learning (ICDL), pp 219–224 Zang P, Tian R, Thomaz AL, Isbell CL (2010) Batch versus interactive learning by demonstration. In: Proceedings of the IEEE 9th international conference on development and learning (ICDL), pp 219–224
24.
Zurück zum Zitat Petelin JB, Nelson ME, Goodman J (2007) Deployment and early experience with remote-presence patient care in a community hospital. Surgic Endosc 21:53–56CrossRef Petelin JB, Nelson ME, Goodman J (2007) Deployment and early experience with remote-presence patient care in a community hospital. Surgic Endosc 21:53–56CrossRef
25.
Zurück zum Zitat Tsui KM, Desai M, Yanco HA, Uhlik C (2011) Exploring use cases for telepresence robots. In: ACM/IEEE international conference on human-robot interaction (HRI2011) Tsui KM, Desai M, Yanco HA, Uhlik C (2011) Exploring use cases for telepresence robots. In: ACM/IEEE international conference on human-robot interaction (HRI2011)
26.
Zurück zum Zitat Yun S-S, Kim M, Choi M-T (2013) Easy interface and control of tele-education robots. Int J Soc Robot 5:335–343CrossRef Yun S-S, Kim M, Choi M-T (2013) Easy interface and control of tele-education robots. Int J Soc Robot 5:335–343CrossRef
27.
Zurück zum Zitat Takayama L, Marder-Eppstein E, Harris H, Beer JM (2011) Assisted driving of a mobile remote presence system: system design and controlled user evaluation. In Proceedings of the IEEE international conference on robotics and automation (ICRA2011), pp 1883–1889 Takayama L, Marder-Eppstein E, Harris H, Beer JM (2011) Assisted driving of a mobile remote presence system: system design and controlled user evaluation. In Proceedings of the IEEE international conference on robotics and automation (ICRA2011), pp 1883–1889
28.
Zurück zum Zitat Zheng K, Glas DF, Kanda T, Ishiguro H, Hagita N (2011) How many social robots can one operator control? Proceedings of the ACM/IEEE 6th annual conference on human-robot interaction. Lausanne, Switzerland, pp 379–386 Zheng K, Glas DF, Kanda T, Ishiguro H, Hagita N (2011) How many social robots can one operator control? Proceedings of the ACM/IEEE 6th annual conference on human-robot interaction. Lausanne, Switzerland, pp 379–386
29.
Zurück zum Zitat Kanda T, Shiomi M, Miyashita Z, Ishiguro H, Hagita N (2009) An affective guide robot in a shopping mall. In: ACM/IEEE international conference on human-robot interaction (HRI2009), pp 173–180 Kanda T, Shiomi M, Miyashita Z, Ishiguro H, Hagita N (2009) An affective guide robot in a shopping mall. In: ACM/IEEE international conference on human-robot interaction (HRI2009), pp 173–180
30.
Zurück zum Zitat Castro-Gonzlez Á, Malfaz M, Salichs MA (2011) Learning the selection of actions for an autonomous social robot by reinforcement learning based on motivations. Int J Soc Robot 3:427–441CrossRef Castro-Gonzlez Á, Malfaz M, Salichs MA (2011) Learning the selection of actions for an autonomous social robot by reinforcement learning based on motivations. Int J Soc Robot 3:427–441CrossRef
31.
Zurück zum Zitat Hollingsed TK, Ward Nigel G (2007) A combined method for discovering short-term affect-based response rules for spoken tutorial dialog. In: Proceedings of the ISCA ITRW workshop on speech and language technology in education (SLaTE) Hollingsed TK, Ward Nigel G (2007) A combined method for discovering short-term affect-based response rules for spoken tutorial dialog. In: Proceedings of the ISCA ITRW workshop on speech and language technology in education (SLaTE)
32.
Zurück zum Zitat Nigel W, Anais GR, Karen W, David GN (2005) Some usability issues and research priorities in spoken dialog applications. Technical report UTEP-CS-05-23, University of Texas at El Paso Nigel W, Anais GR, Karen W, David GN (2005) Some usability issues and research priorities in spoken dialog applications. Technical report UTEP-CS-05-23, University of Texas at El Paso
33.
Zurück zum Zitat Jung J, Kanda T, Kim M-S (2013) Guidelines for contextual motion design of a humanoid robot. Int J Soc Robot 5(2):153–169CrossRef Jung J, Kanda T, Kim M-S (2013) Guidelines for contextual motion design of a humanoid robot. Int J Soc Robot 5(2):153–169CrossRef
34.
Zurück zum Zitat Sacks HH, Schegloff EA, Jefferson G (1974) A simplest systematics for the organization of turn-taking for conversation. Language 50(4):696–735CrossRef Sacks HH, Schegloff EA, Jefferson G (1974) A simplest systematics for the organization of turn-taking for conversation. Language 50(4):696–735CrossRef
35.
Zurück zum Zitat Chao C, Thomaz AL (2010) Turn taking for human-robot interaction. Paper presented at the AAAI fall symposium: dialog with robots Chao C, Thomaz AL (2010) Turn taking for human-robot interaction. Paper presented at the AAAI fall symposium: dialog with robots
36.
Zurück zum Zitat Nagaoka C, Komori M, Nakamura T (2005) Influence of response latencies on impression evaluation of speakers in dialogues: differences of cues used for evaluation by degree of social skill. Tech Rep IEICE 104(745):57–60 Nagaoka C, Komori M, Nakamura T (2005) Influence of response latencies on impression evaluation of speakers in dialogues: differences of cues used for evaluation by degree of social skill. Tech Rep IEICE 104(745):57–60
37.
Zurück zum Zitat Jaffe J, Feldstein S (1970) Rhythms of dialogue. Academic, New York Jaffe J, Feldstein S (1970) Rhythms of dialogue. Academic, New York
38.
Zurück zum Zitat Shiwa T, Kanda T, Imai M, Ishiguro H, Hagita N (2008) How quickly should communication robots respond? In: Proceedings of the ACM/IEEE international conference on human-robot interaction (HRI2008), pp 153–160 Shiwa T, Kanda T, Imai M, Ishiguro H, Hagita N (2008) How quickly should communication robots respond? In: Proceedings of the ACM/IEEE international conference on human-robot interaction (HRI2008), pp 153–160
39.
Zurück zum Zitat Glas DF, Kanda T, Ishiguro H, Hagita N (2012) Temporal awareness in teleoperation of conversational robots. IEEE Trans Syst Man Cybernet A Syst Humans 42(4):905–919CrossRef Glas DF, Kanda T, Ishiguro H, Hagita N (2012) Temporal awareness in teleoperation of conversational robots. IEEE Trans Syst Man Cybernet A Syst Humans 42(4):905–919CrossRef
40.
Zurück zum Zitat Ward N, Tsukahara W (2000) Prosodic features which cue back-channel responses in English and Japanese. J Pragmat 32(8):1177–1207CrossRef Ward N, Tsukahara W (2000) Prosodic features which cue back-channel responses in English and Japanese. J Pragmat 32(8):1177–1207CrossRef
41.
Zurück zum Zitat Kanda T, Ishiguro H, Imai M, Ono T (2004) Development and evaluation of interactive humanoid robots. Proc IEEE 92(11):1839–1850CrossRef Kanda T, Ishiguro H, Imai M, Ono T (2004) Development and evaluation of interactive humanoid robots. Proc IEEE 92(11):1839–1850CrossRef
42.
Zurück zum Zitat Miller GA (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychological Rev 63(2):81CrossRef Miller GA (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychological Rev 63(2):81CrossRef
43.
Zurück zum Zitat Dahlbck N, Jnsson A, Ahrenberg L (1993) Wizard of Oz studies: why and how. In: International conference on intelligent user interfaces, pp 193–200 Dahlbck N, Jnsson A, Ahrenberg L (1993) Wizard of Oz studies: why and how. In: International conference on intelligent user interfaces, pp 193–200
44.
Zurück zum Zitat Villano M, Crowell CR, Wier K, Tang K, Thomas B, Shea N, Schmitt LM, Diehl JJ (2011) DOMER: a wizard of oz interface for using interactive robots to scaffold social skills for children with autism spectrum disorders. In: ACM/IEEE 6th international conference on human-robot interaction, Lausanne, Switzerland Villano M, Crowell CR, Wier K, Tang K, Thomas B, Shea N, Schmitt LM, Diehl JJ (2011) DOMER: a wizard of oz interface for using interactive robots to scaffold social skills for children with autism spectrum disorders. In: ACM/IEEE 6th international conference on human-robot interaction, Lausanne, Switzerland
45.
Zurück zum Zitat Kawai H, Toda T, Ni J, Tsuzaki M, Tokuda K (2004) XIMERA: a new TTS from ATR based on corpus-based technologies. In: ISCA speech synthesis workshop, pp 179–184 Kawai H, Toda T, Ni J, Tsuzaki M, Tokuda K (2004) XIMERA: a new TTS from ATR based on corpus-based technologies. In: ISCA speech synthesis workshop, pp 179–184
Metadaten
Titel
Capturing Expertise: Developing Interaction Content for a Robot Through Teleoperation by Domain Experts
verfasst von
Kanae Wada
Dylan F. Glas
Masahiro Shiomi
Takayuki Kanda
Hiroshi Ishiguro
Norihiro Hagita
Publikationsdatum
01.11.2015
Verlag
Springer Netherlands
Erschienen in
International Journal of Social Robotics / Ausgabe 5/2015
Print ISSN: 1875-4791
Elektronische ISSN: 1875-4805
DOI
https://doi.org/10.1007/s12369-015-0288-9

Weitere Artikel der Ausgabe 5/2015

International Journal of Social Robotics 5/2015 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.