Skip to main content
Top

2017 | OriginalPaper | Chapter

Mining Implicit Intention Using Attention-Based RNN Encoder-Decoder Model

Authors : ChenXing Li, YaJun Du, SiDa Wang

Published in: Intelligent Computing Methodologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nowadays, people are increasingly inclined to use social tools to express their intentions explicitly and implicitly. Most of the work is dedicated to solving the explicit intention detection, ignoring the implicit intention detection, as the former is relatively easy to solve with the classification method. In this work, we use the Attention-Based Encoder-Decoder model which is specified for the sequence-to-sequence task for user implicit intention detection. Our key idea is to leverage the model to “translate” the implicit intention into the corresponding explicit intent by using the parallel corpora built on the social data. Specifically, our model has domain adaptability since the way people express implicit intentions for different domain is variable, while the way to express explicit intentions is mostly in the same form, such as “I want to do sth”. In order to demonstrate the effectiveness of our method, we conduct experiments in four domains. The results show that our method offers a powerful “translation” for the implicit intentions and consequently identifies them.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Agarwal, A., Xie, B., Vovsha, I., Rambow, O., Passonneau, R.: Sentiment analysis of Twitter data. In: Workshop on Languages in Social Media, pp. 30–38. Association for Computational Linguistics (2011) Agarwal, A., Xie, B., Vovsha, I., Rambow, O., Passonneau, R.: Sentiment analysis of Twitter data. In: Workshop on Languages in Social Media, pp. 30–38. Association for Computational Linguistics (2011)
2.
go back to reference Maynard, D., Funk, A.: Automatic detection of political opinions in tweets. In: Proceedings of the 1st Workshop on Making Sense of Microposts at ESWC 11 (2011) Maynard, D., Funk, A.: Automatic detection of political opinions in tweets. In: Proceedings of the 1st Workshop on Making Sense of Microposts at ESWC 11 (2011)
3.
go back to reference Hollerit, B., Kröll, M., Strohmaier, M.: Towards linking buyers and sellers: detecting commercial intent on Twitter. In: the 22nd International Conference on World Wide Web Companion, pp. 629–632. International World Wide Web Conferences Steering Committee, Rio de Janeiro (2013) Hollerit, B., Kröll, M., Strohmaier, M.: Towards linking buyers and sellers: detecting commercial intent on Twitter. In: the 22nd International Conference on World Wide Web Companion, pp. 629–632. International World Wide Web Conferences Steering Committee, Rio de Janeiro (2013)
4.
go back to reference Wang, J., Cong, G., Zhao, X.W., Li, X.: Mining user intents in Twitter: a semi-supervised approach to inferring intent categories for tweets. In: Twenty-Ninth AAAI Conference on Artificial Intelligence, Texas (2015) Wang, J., Cong, G., Zhao, X.W., Li, X.: Mining user intents in Twitter: a semi-supervised approach to inferring intent categories for tweets. In: Twenty-Ninth AAAI Conference on Artificial Intelligence, Texas (2015)
5.
go back to reference Ding, X., Liu, T., Duan, J., Nie, J.-Y.: Mining user consumption intention from social media using domain adaptive convolutional neural network. In: AAAI (2015) Ding, X., Liu, T., Duan, J., Nie, J.-Y.: Mining user consumption intention from social media using domain adaptive convolutional neural network. In: AAAI (2015)
6.
go back to reference Cho, K., van Merrienboer, B., Gulcehre, C., Bougares, F., Schwenk, H., Bengio, Y.: Learning phrase representations using RNN Encoder-Decoder for statistical machine translation. In: Proceedings of the Empiricial Methods in Natural Language Processing (2014) Cho, K., van Merrienboer, B., Gulcehre, C., Bougares, F., Schwenk, H., Bengio, Y.: Learning phrase representations using RNN Encoder-Decoder for statistical machine translation. In: Proceedings of the Empiricial Methods in Natural Language Processing (2014)
8.
go back to reference Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014) Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:​1409.​0473 (2014)
9.
go back to reference Broder, A.: A taxonomy of web search. In: ACM SIGIR Forum, vol. 36, pp. 3–10. ACM (2002) Broder, A.: A taxonomy of web search. In: ACM SIGIR Forum, vol. 36, pp. 3–10. ACM (2002)
10.
go back to reference Dai, H.K., Zhao, L., Nie, Z., Wen, J.R., Wang, L., Li, Y.: Detecting online commercial intention (OCI). In: The 15th International Conference on World Wide Web, pp. 829–837. ACM, Edinburgh (2006) Dai, H.K., Zhao, L., Nie, Z., Wen, J.R., Wang, L., Li, Y.: Detecting online commercial intention (OCI). In: The 15th International Conference on World Wide Web, pp. 829–837. ACM, Edinburgh (2006)
11.
go back to reference Ashkan, A., Clarke, C.L.: Impact of query intent and search context on clickthrough behavior in sponsored search. J. KIS 34(2), 425–452 (2013) Ashkan, A., Clarke, C.L.: Impact of query intent and search context on clickthrough behavior in sponsored search. J. KIS 34(2), 425–452 (2013)
12.
go back to reference Guo, Q., Agichtein, E.: Ready to buy or just browsing?: detecting web searcher goals from interaction data. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (2010) Guo, Q., Agichtein, E.: Ready to buy or just browsing?: detecting web searcher goals from interaction data. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (2010)
13.
go back to reference Chen, Z., Liu, B., Hsu, M., Castellanos, M., Ghosh, R.: Identifying intention posts in discussion forums. In: HLT-NAACL, Atlanta, pp. 1041–1050 (2013) Chen, Z., Liu, B., Hsu, M., Castellanos, M., Ghosh, R.: Identifying intention posts in discussion forums. In: HLT-NAACL, Atlanta, pp. 1041–1050 (2013)
14.
go back to reference Park, D.H., et al.: Mobile App Retrieval for Social Media Users via Inference of Implicit Intent in Social Media Text. In: the 25th ACM International Conference on Information and Knowledge. (2016) Park, D.H., et al.: Mobile App Retrieval for Social Media Users via Inference of Implicit Intent in Social Media Text. In: the 25th ACM International Conference on Information and Knowledge. (2016)
15.
go back to reference Graves, A., Jaitly, N., Mohamed, A.-R.: Hybrid speech recognition with deep bidirectional LSTM. In: IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) (2013) Graves, A., Jaitly, N., Mohamed, A.-R.: Hybrid speech recognition with deep bidirectional LSTM. In: IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) (2013)
16.
go back to reference Sutskever, I., Vinyals, O., Le, Q.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems (2014) Sutskever, I., Vinyals, O., Le, Q.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems (2014)
17.
go back to reference Goodfellow, I., Warde-Farley, D., Mirza, M., Courville, A., Bengio, Y.: Maxout networks. In: Proceedings of the 30th International Conference on Machine Learning, pp. 1319–1327 (2013) Goodfellow, I., Warde-Farley, D., Mirza, M., Courville, A., Bengio, Y.: Maxout networks. In: Proceedings of the 30th International Conference on Machine Learning, pp. 1319–1327 (2013)
18.
go back to reference Pascanu, R., Gulcehre, C., Cho, K., Bengio, Y.: How to construct deep recurrent neural networks. In: Proceedings of the Second International Conference on Learning Representations (2014) Pascanu, R., Gulcehre, C., Cho, K., Bengio, Y.: How to construct deep recurrent neural networks. In: Proceedings of the Second International Conference on Learning Representations (2014)
19.
go back to reference Graves, A.: Sequence transduction with recurrent neural networks. In: Proceedings of the 29th International Conference on Machine Learning (2012) Graves, A.: Sequence transduction with recurrent neural networks. In: Proceedings of the 29th International Conference on Machine Learning (2012)
20.
go back to reference Boulanger-Lewandowski, N., Bengio, Y., Vincent, P.: Audio chord recognition with recurrent neural networks. In: ISMIR (2013) Boulanger-Lewandowski, N., Bengio, Y., Vincent, P.: Audio chord recognition with recurrent neural networks. In: ISMIR (2013)
Metadata
Title
Mining Implicit Intention Using Attention-Based RNN Encoder-Decoder Model
Authors
ChenXing Li
YaJun Du
SiDa Wang
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-63315-2_36

Premium Partner