ABSTRACT
This tutorial surveys neural approaches to conversational AI that were developed in the last few years. We group conversational systems into three categories: (1) question answering agents, (2) task-oriented dialogue agents, and (3) social bots. For each category, we present a review of state-of-the-art neural approaches, draw the connection between neural approaches and traditional symbolic approaches, and discuss the progress we have made and challenges we are facing, using specific systems and models as case studies.
- Hongshen Chen, Xiaorui Liu, Dawei Yin, and Jiliang Tang. 2017. A Survey on Dialogue Systems: Recent Advances and New Frontiers. arXiv preprint arXiv:1711.01731 (2017).Google Scholar
- Yun-Nung Chen, Asli Celikyilmaz, and Dilek Hakkani-Tür. 2017. Deep Learning for Dialogue Systems. Proceedings of ACL 2017, Tutorial Abstracts (2017), 8--14.Google ScholarCross Ref
- Jianfeng Gao. 2017. An Introduction to Deep Learning for Natural Language Processing. In International Summer School on Deep Learning, Bilbao.Google Scholar
- Marjan Ghazvininejad, Chris Brockett, Ming-Wei Chang, Bill Dolan, Jianfeng Gao, Wen-tau Yih, and Michel Galley. 2018. A Knowledge-Grounded Neural Conversation Model. In AAAI.Google Scholar
- Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2016. A diversity-promoting objective function for neural conversation models. In NAACL-HLT.Google Scholar
- Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2016. A Persona-Based Neural Conversation Model. In ACL.Google Scholar
- Jiwei Li, Will Monroe, Alan Ritter, Dan Jurafsky, Michel Galley, and Jianfeng Gao. 2016. Deep Reinforcement Learning for Dialogue Generation. In EMNLP.Google Scholar
- Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, and Kam-Fai Wong. 2018. Integrating planning for task-completion dialogue policy learning. arXiv preprint arXiv:1801.06176 (2018).Google Scholar
- Iulian Vlad Serban, Ryan Lowe, Peter Henderson, Laurent Charlin, and Joelle Pineau. 2015. A survey of available corpora for building data-driven dialogue systems. arXiv preprint arXiv:1512.05742 (2015).Google Scholar
- Iulian Vlad Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C Courville, and Joelle Pineau. 2016. Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models.. In AAAI. 3776--3784. Google ScholarDigital Library
- Yelong Shen, Po-Sen Huang, Ming-Wei Chang, and Jianfeng Gao. 2017. Traversing Knowledge Graph in Vector Space without Symbolic Space Guidance. arXiv preprint arXiv:1611.04642 (2017).Google Scholar
- Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Margaret Mitchell, Jian-Yun Nie, Jianfeng Gao, and Bill Dolan. 2015. A neural network approach to context-sensitive generation of conversational responses. In NAACL-HLT.Google Scholar
- Richard S Sutton. 1990. Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. In Proceedings of the seventh international conference on machine learning. 216--224. Google ScholarDigital Library
- Richard S. Sutton, Doina Precup, and Satinder P. Singh. 1999. Between MDPs and semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning. Artificial Intelligence 112, 1--2 (1999), 181--211. An earlier version appeared as Technical Report 98--74, Department of Computer Science, University of Massachusetts, Amherst, MA 01003. April, 1998.Google Scholar
- Gokhan Tur and Renato De Mori. 2011. Spoken language understanding: Systems for extracting semantic information from speech. John Wiley & Sons.Google Scholar
- Oriol Vinyals and Quoc Le. 2015. A Neural Conversational Model. In ICML Deep Learning Workshop.Google Scholar
- Wen-tau Yih, Xiaodong He, and Jianfeng Gao. 2015. Deep Learning and Continuous Representations for Natural Language Processing. In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Tutorial.Google Scholar
- Wen-tau Yih, Xiaodong He, and Jianfeng Gao. 2016. Deep Learning and Continuous Representations for Natural Language Processing. In IJCAI: Tutorial.Google Scholar
- Steve Young, Milica Gašić, Blaise Thomson, and Jason D Williams. 2013. Pomdpbased statistical spoken dialog systems: A review. Proc. IEEE 101, 5 (2013), 1160-- 1179.Google ScholarCross Ref
- Tiancheng Zhao, Allen Lu, Kyusong Lee, and Maxine Eskenazi. 2017. Generative encoder-decoder models for task-oriented spoken dialog systems with chatting capability. arXiv preprint arXiv:1706.08476 (2017).Google Scholar
- Neural Approaches to Conversational AI
Recommendations
Towards an Open-Doman Dialog System
ICTIR '19: Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information RetrievalDeveloping an intelligent dialogue system that not only emulates human conversation, but also can answer questions of topics ranging from latest news of a movie star to Einstein's theory of relativity, and fulfill complex tasks such as travel planning, ...
Conversational gaze mechanisms for humanlike robots
During conversations, speakers employ a number of verbal and nonverbal mechanisms to establish who participates in the conversation, when, and in what capacity. Gaze cues and mechanisms are particularly instrumental in establishing the participant roles ...
Endowing Virtual Characters with Expressive Conversational Skills
IVA '09: Proceedings of the 9th International Conference on Intelligent Virtual AgentsWhen humans interact with one another, socially intelligent conversational behaviors arise from the interaction of a number of different factors: the conversants' personality, cultural knowledge, the ability to observe and reason about social ...
Comments