Skip to main content

2018 | OriginalPaper | Buchkapitel

Accounting for Named Entities in Intent Recognition from Short Chats

verfasst von : Ghislain Landry Tsafack, Sharva Kant

Erschienen in: Information and Software Technologies

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The operational cost of call centres accounts for a large part of the total spending of any modern organization. As a consequence, the automated conversation agent powered by Artificial Intelligence (AI) through Natural Language Processing (NLP) alternative has gained major attraction over the past years. Efforts to achieve such level of automation generally rely on predefined business intents or intents, which are in turn tightly related to business entities or processes that they represent. As the success of the automated conversation agent fully relies on its ability to accurately recognise user intents, a good automated agent will be the one that recognises intents it is meant to recognise. In light of the strong relationship that exists between business entities and business intents or entities and intents in general, we propose two approaches for accounting for named entities in the task of intents recognition from short chats. The first approach relies on Bi-Normal Separation (BNS) to weight term features that are named entities more than other features, whereas, the second approach takes advantage of word embedding to encode the relationship between entities and chats. Evaluation of proposed methodologies, on a data set composed of one to one conversations between human actors, suggests that accounting for named entities improves the performance of the intents recognition task.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aixin, S.: Short text classification using very few words. In: Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1145–1146. AMC, Portland (2012) Aixin, S.: Short text classification using very few words. In: Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1145–1146. AMC, Portland (2012)
2.
Zurück zum Zitat T. Kolenda, L. Hansen, J. Larsen and O. Winther, Independent component analysis for understanding multimedia content. In: Bengio, S.,. Larsen, J., Bourlard, H., Adali, T., Douglas, S. (eds.) Proceedings of IEEE Workshop on Neural Networks for Signal Processing XII, pp. 757–766. IEEE Press, Piscataway (2002) T. Kolenda, L. Hansen, J. Larsen and O. Winther, Independent component analysis for understanding multimedia content. In: Bengio, S.,. Larsen, J., Bourlard, H., Adali, T., Douglas, S. (eds.) Proceedings of IEEE Workshop on Neural Networks for Signal Processing XII, pp. 757–766. IEEE Press, Piscataway (2002)
3.
Zurück zum Zitat Kosala, R., Blockeel, H.: Web mining research: a survey. In: SIGKDD: SIGKDD Explorations: Newsletter of the Special Interest Group (SIG) on Knowledge Discovery & Data Mining, pp. 1–15. ACM Press, ACM (2000)CrossRef Kosala, R., Blockeel, H.: Web mining research: a survey. In: SIGKDD: SIGKDD Explorations: Newsletter of the Special Interest Group (SIG) on Knowledge Discovery & Data Mining, pp. 1–15. ACM Press, ACM (2000)CrossRef
4.
Zurück zum Zitat Madsen, R.E., Larsen, J., Hansen, L.K.: Part-of-speech enhanced context recognition. In: Proceedings of the 14th IEEE Signal Processing Society Workshop in Machine Learning for Signal Processing, pp. 635–643 (2004) Madsen, R.E., Larsen, J., Hansen, L.K.: Part-of-speech enhanced context recognition. In: Proceedings of the 14th IEEE Signal Processing Society Workshop in Machine Learning for Signal Processing, pp. 635–643 (2004)
5.
Zurück zum Zitat Deerwester, S., Dumais, S., Landauer, T., Funas, G., Harshman, R.: Indexing by latent semantic analysis. J. Am. Soc. Inf. Sci. 41, 391–407 (1990)CrossRef Deerwester, S., Dumais, S., Landauer, T., Funas, G., Harshman, R.: Indexing by latent semantic analysis. J. Am. Soc. Inf. Sci. 41, 391–407 (1990)CrossRef
6.
Zurück zum Zitat Furnas, G.W., Deerwester, S., Dumais, S.T., Landauer, T.K., Harshman, R.A., Streeter, L.A., Lochbaum, K.E.: Information retrieval using a singular value decomposition model of latent semantic structure. In: Proceedings of the 11th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Grenoble, France. ACM (1988) Furnas, G.W., Deerwester, S., Dumais, S.T., Landauer, T.K., Harshman, R.A., Streeter, L.A., Lochbaum, K.E.: Information retrieval using a singular value decomposition model of latent semantic structure. In: Proceedings of the 11th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Grenoble, France. ACM (1988)
7.
Zurück zum Zitat Forman, G.: An extensive empirical study of feature selection metrics for text classification. J. Mach. Learn. Res. 3, 1289–1305 (2003)MATH Forman, G.: An extensive empirical study of feature selection metrics for text classification. J. Mach. Learn. Res. 3, 1289–1305 (2003)MATH
8.
Zurück zum Zitat Joachims, T.: Text categorization with support vector machines: learning with many relevant features. In: Proceedings of the 10th European Conference on Machine Learning (ECML), Berlin, pp. 137–142 (1998) Joachims, T.: Text categorization with support vector machines: learning with many relevant features. In: Proceedings of the 10th European Conference on Machine Learning (ECML), Berlin, pp. 137–142 (1998)
9.
Zurück zum Zitat McCallum, A., Wei, L.: Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. In: Proceedings of the 7th Conference on Natural Language Learning, Edmonton, Canada, pp. 188–191 (2003) McCallum, A., Wei, L.: Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. In: Proceedings of the 7th Conference on Natural Language Learning, Edmonton, Canada, pp. 188–191 (2003)
10.
Zurück zum Zitat Bikel, M.D., Schwartz, R., Weischedel, R.M.: An algorithm that learns what’s in a name. Mach. Learn. J. 34(1–3), 211–231 (1999)CrossRef Bikel, M.D., Schwartz, R., Weischedel, R.M.: An algorithm that learns what’s in a name. Mach. Learn. J. 34(1–3), 211–231 (1999)CrossRef
11.
Zurück zum Zitat Radu, F., Ittycheriah, A., Hongyan, J., Tong, Z.: Named entity recognition through classifier combination. In: Proceedings of the 7th Conference on Natural Language Learning, Edmonton, Canada, pp. 168–171 (2003) Radu, F., Ittycheriah, A., Hongyan, J., Tong, Z.: Named entity recognition through classifier combination. In: Proceedings of the 7th Conference on Natural Language Learning, Edmonton, Canada, pp. 168–171 (2003)
12.
Zurück zum Zitat Ratinov, L., Roth, D.: Design challenges and misconceptions in named entity recognition. In: Proceedings of the 13th Conference on Computational Natural Language Learning, Boulder, Colorado, pp. 147–155 (2009) Ratinov, L., Roth, D.: Design challenges and misconceptions in named entity recognition. In: Proceedings of the 13th Conference on Computational Natural Language Learning, Boulder, Colorado, pp. 147–155 (2009)
13.
Zurück zum Zitat Ronan, C., Jason, W., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)MATH Ronan, C., Jason, W., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)MATH
14.
Zurück zum Zitat Passos, A., Kumar, V., McCallum, A.: Lexicon infused phrase embeddings for named entity resolution. In: CoRR (2014) Passos, A., Kumar, V., McCallum, A.: Lexicon infused phrase embeddings for named entity resolution. In: CoRR (2014)
15.
Zurück zum Zitat Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., Dyer, C.: Neural architectures for named entity recognition. In: CoRR (2016) Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., Dyer, C.: Neural architectures for named entity recognition. In: CoRR (2016)
16.
Zurück zum Zitat Jason, P., Chiu, C., Nichols, E.: Named entity recognition with bidirectional LSTM-CNNs. In: CoRR (2016) Jason, P., Chiu, C., Nichols, E.: Named entity recognition with bidirectional LSTM-CNNs. In: CoRR (2016)
17.
Zurück zum Zitat Choi, J.D., Tetreault, R.J., Stent, A.: It depends: dependency parser comparison using a web-based evaluation tool. In: Proceedings of Association for Computational Linguistics (ACL), pp. 387–396 (2015) Choi, J.D., Tetreault, R.J., Stent, A.: It depends: dependency parser comparison using a web-based evaluation tool. In: Proceedings of Association for Computational Linguistics (ACL), pp. 387–396 (2015)
18.
Zurück zum Zitat Shoushan, L., Rui, X., Chengqing, Z., Chu-Ren, H.: A framework of feature selection methods for text categorization. In: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, vol. 2, pp. 692–700 (2009) Shoushan, L., Rui, X., Chengqing, Z., Chu-Ren, H.: A framework of feature selection methods for text categorization. In: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, vol. 2, pp. 692–700 (2009)
19.
Zurück zum Zitat Dhillon, I.S., Subramanyam, M., Rahul, K.: A divisive information theoretic feature clustering algorithm for text classification. J. Mach. Learn. Res. 3, 1265–1287 (2003)MathSciNetMATH Dhillon, I.S., Subramanyam, M., Rahul, K.: A divisive information theoretic feature clustering algorithm for text classification. J. Mach. Learn. Res. 3, 1265–1287 (2003)MathSciNetMATH
20.
Zurück zum Zitat Evgeniy, G., Shaul, M.: Text categorization with many redundant features: using aggressive feature selection to make SVMs competitive with C4.5. In: Proceedings of the 21st International Conference on Machine Learning, Banff, Alberta, Canada, pp. 2493–2537 (2004) Evgeniy, G., Shaul, M.: Text categorization with many redundant features: using aggressive feature selection to make SVMs competitive with C4.5. In: Proceedings of the 21st International Conference on Machine Learning, Banff, Alberta, Canada, pp. 2493–2537 (2004)
21.
Zurück zum Zitat Yang, Y., Pedersen, J.O.: A comparative study on feature selection in text categorization. In: Proceedings of the Fourteenth International Conference on Machine Learning, San Francisco, CA, USA (1997) Yang, Y., Pedersen, J.O.: A comparative study on feature selection in text categorization. In: Proceedings of the Fourteenth International Conference on Machine Learning, San Francisco, CA, USA (1997)
22.
Zurück zum Zitat Yang, Y., Liu, X.: A re-examination of text categorization methods. In: Proceedings of SIGIR-99, The 22nd Annual International ACM Conference on Research and Development in Information Retrieval (1999) Yang, Y., Liu, X.: A re-examination of text categorization methods. In: Proceedings of SIGIR-99, The 22nd Annual International ACM Conference on Research and Development in Information Retrieval (1999)
23.
24.
Zurück zum Zitat Hellrich, J., Hahn, U.: Bad company - neighborhoods in neural embedding spaces considered harmful. In: COLING (2016) Hellrich, J., Hahn, U.: Bad company - neighborhoods in neural embedding spaces considered harmful. In: COLING (2016)
25.
Zurück zum Zitat Li, J., Jurafsky, D.: Do multi-sense embeddings improve natural language understanding? In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015, Lisbon, Portugal, 17–21 September 2015 Li, J., Jurafsky, D.: Do multi-sense embeddings improve natural language understanding? In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015, Lisbon, Portugal, 17–21 September 2015
Metadaten
Titel
Accounting for Named Entities in Intent Recognition from Short Chats
verfasst von
Ghislain Landry Tsafack
Sharva Kant
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-99972-2_48