Ioannis Papaioannou
ABSTRACT
We develop the first system to combine task-based and chatbot-style dialogue in a multimodal system for Human-Robot Interaction. We show that Reinforcement Learning is beneficial for training dialogue management (DM) in such systems -- providing a scalable method for training from data and/or simulated users. We first train in simulation, and evaluate the benefits of a combined chat/task policy over systems which can only perform chat or task-based conversation. In a real user evaluation, we then show that a trained combined chat/task multimodal dialogue policy results in longer dialogue interactions than a rule-based approach, suggesting that the learned dialogue policy provides a more engaging mixture of chat and task interaction than a rule-based DM method.
- ALICE AI Foundation. Program AB. https://code.google.com/p/program-ab/, 2013.Google Scholar
- A. Dingli and D. Scerri. Building a hybrid: Chatterbot - dialog system. Text, Speech, and Dialogue , pages 145--152, 2013.Google Scholar
- O. Lemon, A. Bracy, A. Gruenstein, and S. Peters. A multi-modal dialogue system for human-robot conversation. In Proc. NAACL . 2001.Google Scholar
- O. Lemon and O. Pietquin, editors. Data-driven Methods for Adaptive Spoken Dialogue Systems . Springer, 2012. Google ScholarDigital Library
- J. MacGlashan. Burlap. http://burlap.cs.brown.edu/, 2016.Google Scholar
- M. F. McTear. Spoken dialogue technology: enabling the conversational user interface. CSUR , 34(1):90--169, 2002. Google ScholarDigital Library
- V. Rieser and O. Lemon. Reinforcement learning for adaptive dialogue systems . Springer, 2011. Google ScholarDigital Library
- G. Skantze and S. Al Moubayed. Iristk: a statechart-based toolkit for multi-party face-to-face interaction. Proc. ICMI , 2012. Google ScholarDigital Library
- R. Sutton and A. Barto. Reinforcement learning . MIT Press, 1998. Google ScholarDigital Library
- A. van Woudenberg. A Chatbot Dialogue Manager . PhD thesis, Open University of the Netherlands, 2014.Google Scholar
- S. Young, M. Gasic, B. Thomson, and J. D. Williams. Pomdp-based statistical spoken dialog systems: A review. Proceedings of the IEEE , 101(5):1160--1179, 2013Google ScholarCross Ref
Index Terms
- Combining Chat and Task-Based Multimodal Dialogue for More Engaging HRI: A Scalable Method Using Reinforcement Learning
Recommendations
Human-robot collaborative tutoring using multiparty multimodal spoken dialogue
HRI '14: Proceedings of the 2014 ACM/IEEE international conference on Human-robot interactionIn this paper, we describe a project that explores a novel experimental setup towards building a spoken, multi-modally rich, and human-like multiparty tutoring robot. A human-robot interaction setup is designed, and a human-human dialogue corpus is ...
Timing multimodal turn-taking for human-robot cooperation
ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interactionIn human cooperation, the concurrent usage of multiple social modalities such as speech, gesture, and gaze results in robust and efficient communicative acts. Such multimodality in combination with reciprocal intentions supports fluent turn-taking. I ...
Hybrid chat and task dialogue for more engaging HRI using reinforcement learning
2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)Most of today's task-based spoken dialogue systems perform poorly if the user goal is not within the system's task domain. On the other hand, chatbots cannot perform tasks involving robot actions but are able to deal with unforeseen user input. To ...
Comments