Skip to main content

2018 | OriginalPaper | Buchkapitel

Dialogue Intent Classification with Long Short-Term Memory Networks

verfasst von : Lian Meng, Minlie Huang

Erschienen in: Natural Language Processing and Chinese Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Dialogue intent analysis plays an important role for dialogue systems. In this paper, we present a deep hierarchical LSTM model to classify the intent of a dialogue utterance. The model is able to recognize and classify user’s dialogue intent in an efficient way. Moreover, we introduce a memory module to the hierarchical LSTM model, so that our model can utilize more context information to perform classification. We evaluate the two proposed models on a real-world conversational dataset from a Chinese famous e-commerce service. The experimental results show that our proposed model outperforms the baselines.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Austin, J.L., Gu, Y.: How to Do Things With Words. Clarendon Press, Oxford (2012) Austin, J.L., Gu, Y.: How to Do Things With Words. Clarendon Press, Oxford (2012)
2.
Zurück zum Zitat Liu, C., Xu, P., Sarikaya, R.: Deep Contextual Language Understanding in Spoken Dialogue Systems (2015) Liu, C., Xu, P., Sarikaya, R.: Deep Contextual Language Understanding in Spoken Dialogue Systems (2015)
3.
Zurück zum Zitat Shen, L., Zhang, J.: Empirical Evaluation of RNN Architectures on Sentence Classification Task (2016) Shen, L., Zhang, J.: Empirical Evaluation of RNN Architectures on Sentence Classification Task (2016)
4.
Zurück zum Zitat Bub, T., Schwinn, J.: VERBMOBIL: The Evolution of a Complex Large Speech-to-Speech Translation System, vol. 4, pp. 2371–2374, October 1996 Bub, T., Schwinn, J.: VERBMOBIL: The Evolution of a Complex Large Speech-to-Speech Translation System, vol. 4, pp. 2371–2374, October 1996
5.
Zurück zum Zitat Surendran, D., Levow, G.A.: Dialog act tagging with support vector machines and hidden Markov models. In: Proceedings of INTERSPEECH/ICSLP, pp. 1–28 (2006) Surendran, D., Levow, G.A.: Dialog act tagging with support vector machines and hidden Markov models. In: Proceedings of INTERSPEECH/ICSLP, pp. 1–28 (2006)
6.
Zurück zum Zitat Ali, S.A., Sulaiman, N., Mustapha, A., Mustapha, N.: Improving accuracy of intention-based response classification using decision tree. Inf. Technol. J. 8(6), 923–928 (2009)CrossRef Ali, S.A., Sulaiman, N., Mustapha, A., Mustapha, N.: Improving accuracy of intention-based response classification using decision tree. Inf. Technol. J. 8(6), 923–928 (2009)CrossRef
7.
Zurück zum Zitat Keizer, S.: Dialogue Act Modelling Using Bayesian Networks (2001) Keizer, S.: Dialogue Act Modelling Using Bayesian Networks (2001)
8.
Zurück zum Zitat Niimi, Y., Oku, T., Nishimoto, T., Araki, M.: A rule based approach to extraction of topics and dialog acts in a spoken dialog system. In: EUROSPEECH 2001 Scandinavia, European Conference on Speech Communication and Technology, INTERSPEECH Event, Aalborg, Denmark, September, pp. 2185–2188 (2001) Niimi, Y., Oku, T., Nishimoto, T., Araki, M.: A rule based approach to extraction of topics and dialog acts in a spoken dialog system. In: EUROSPEECH 2001 Scandinavia, European Conference on Speech Communication and Technology, INTERSPEECH Event, Aalborg, Denmark, September, pp. 2185–2188 (2001)
9.
Zurück zum Zitat Henderson, M., Thomson, B., Young, S.: Word-based dialog state tracking with recurrent neural networks. In: Meeting of the Special Interest Group on Discourse and Dialogue, pp. 292–299 (2014) Henderson, M., Thomson, B., Young, S.: Word-based dialog state tracking with recurrent neural networks. In: Meeting of the Special Interest Group on Discourse and Dialogue, pp. 292–299 (2014)
10.
Zurück zum Zitat Khanpour, H., Guntakandla, N., Nielsen, R.: Dialogue act classification in domain-independent conversations using a deep recurrent neural network. In: COLING (2016) Khanpour, H., Guntakandla, N., Nielsen, R.: Dialogue act classification in domain-independent conversations using a deep recurrent neural network. In: COLING (2016)
11.
Zurück zum Zitat Weston, J., Chopra, S., Bordes, A.: Memory networks. Eprint Arxiv (2014) Weston, J., Chopra, S., Bordes, A.: Memory networks. Eprint Arxiv (2014)
13.
Zurück zum Zitat Sukhbaatar, S., Szlam, A., Weston, J., Fergus, R.: End-to-end memory networks. Comput. Sci. (2015) Sukhbaatar, S., Szlam, A., Weston, J., Fergus, R.: End-to-end memory networks. Comput. Sci. (2015)
14.
Zurück zum Zitat Kumar, A., Irsoy, O., Ondruska, P., Iyyer, M., Bradbury, J., Gulrajani, I., Zhong, V., Paulus, R., Socher, R.: Ask me anything: dynamic memory networks for natural language processing. Comput. Sci. 1378–1387 (2015) Kumar, A., Irsoy, O., Ondruska, P., Iyyer, M., Bradbury, J., Gulrajani, I., Zhong, V., Paulus, R., Socher, R.: Ask me anything: dynamic memory networks for natural language processing. Comput. Sci. 1378–1387 (2015)
15.
Zurück zum Zitat Mikolov, T., Karafiát, M., Burget, L., Cernocký, J., Khudanpur, S.: Recurrent neural network based language model. In: INTERSPEECH 2010, Conference of the International Speech Communication Association, Makuhari, Chiba, Japan, September, pp. 1045–1048 (2010) Mikolov, T., Karafiát, M., Burget, L., Cernocký, J., Khudanpur, S.: Recurrent neural network based language model. In: INTERSPEECH 2010, Conference of the International Speech Communication Association, Makuhari, Chiba, Japan, September, pp. 1045–1048 (2010)
16.
Zurück zum Zitat Deng, L.Y.: The cross-entropy method: a unified approach to combinatorial optimization, Monte-Carlo simulation, and machine learning. Technometrics 48(1), 147–148 (2006)CrossRef Deng, L.Y.: The cross-entropy method: a unified approach to combinatorial optimization, Monte-Carlo simulation, and machine learning. Technometrics 48(1), 147–148 (2006)CrossRef
17.
Zurück zum Zitat Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. Comput. Sci. (2013) Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. Comput. Sci. (2013)
Metadaten
Titel
Dialogue Intent Classification with Long Short-Term Memory Networks
verfasst von
Lian Meng
Minlie Huang
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-73618-1_4