Skip to main content
Erschienen in:
Buchtitelbild

2019 | OriginalPaper | Buchkapitel

Adaptive Multilingual Representations for Cross-Lingual Entity Linking with Attention on Entity Descriptions

verfasst von : Chenhao Wang, Yubo Chen, Kang Liu, Jun Zhao

Erschienen in: Knowledge Graph and Semantic Computing: Knowledge Computing and Language Understanding

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cross-lingual entity linking is the task of resolving ambiguous mentions in text to corresponding entities in knowledge base, where the query text and knowledge base are in different languages. Recent multilingual embedding based methods bring significant progress in this task. However, they still meet some potential problems: (1) They directly use multilingual embeddings obtained by cross-lingual mapping, which may bring noise and degrade the performance; (2) They also rely on the pre-trained fixed entity embeddings, which only carry limited information about entities. In this paper, we propose a cross-lingual entity linking framework with the help of more adaptive representations. For the first problem, we apply trainable adjusting matrices to fine-tune the semantic representations built from multilingual embeddings. For the second problem, we introduce attention mechanisms on entity descriptions to obtain dynamic entity representations, exploiting more clues about entity candidates according to the query mentions. Experiments on the TAC KBP 2015 Chinese-English cross-lingual entity linking dataset show that our model yields better performance than state-of-the-art models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bahdanau, D., Cho, K., Bengio, Y.: Neural Machine Translation by Jointly Learning to Align and Translate. arXiv:1409.0473 [cs, stat], September 2014 Bahdanau, D., Cho, K., Bengio, Y.: Neural Machine Translation by Jointly Learning to Align and Translate. arXiv:​1409.​0473 [cs, stat], September 2014
2.
Zurück zum Zitat Cho, K., et al.: Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. arXiv:1406.1078 [cs, stat], June 2014 Cho, K., et al.: Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. arXiv:​1406.​1078 [cs, stat], June 2014
3.
Zurück zum Zitat Conneau, A., Lample, G., Ranzato, M., Denoyer, L., Jégou, H.: Word Translation Without Parallel Data. arXiv:1710.04087 [cs], October 2017 Conneau, A., Lample, G., Ranzato, M., Denoyer, L., Jégou, H.: Word Translation Without Parallel Data. arXiv:​1710.​04087 [cs], October 2017
4.
Zurück zum Zitat Faruqui, M., Dyer, C.: Improving vector space word representations using multilingual correlation. In: Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pp. 462–471. Association for Computational Linguistics, Gothenburg, Sweden (2014) Faruqui, M., Dyer, C.: Improving vector space word representations using multilingual correlation. In: Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pp. 462–471. Association for Computational Linguistics, Gothenburg, Sweden (2014)
5.
6.
Zurück zum Zitat Ji, H., Grishman, R., Dang, H.: Overview of the TAC 2011 knowledge base population track. In: Text Analysis Conference (TAC 2011), January 2011 Ji, H., Grishman, R., Dang, H.: Overview of the TAC 2011 knowledge base population track. In: Text Analysis Conference (TAC 2011), January 2011
7.
Zurück zum Zitat Ji, H., Nothman, J., Hachey, B.: Overview of TAC-KBP2014 entity discovery and linking tasks. In: Text Analysis Conference (TAC 2014) (2014) Ji, H., Nothman, J., Hachey, B.: Overview of TAC-KBP2014 entity discovery and linking tasks. In: Text Analysis Conference (TAC 2014) (2014)
8.
Zurück zum Zitat Ji, H., Nothman, J., Hachey, B., Florian, R.: Overview of TAC-KBP2015 tri-lingual entity discovery and linking. In: Text Analysis Conference (TAC 2015) (2015) Ji, H., Nothman, J., Hachey, B., Florian, R.: Overview of TAC-KBP2015 tri-lingual entity discovery and linking. In: Text Analysis Conference (TAC 2015) (2015)
9.
Zurück zum Zitat Luong, M.T., Pham, H., Manning, C.D.: Effective Approaches to Attention-based Neural Machine Translation. arXiv:1508.04025 [cs], August 2015 Luong, M.T., Pham, H., Manning, C.D.: Effective Approaches to Attention-based Neural Machine Translation. arXiv:​1508.​04025 [cs], August 2015
10.
Zurück zum Zitat McNamee, P., Mayfield, J., Lawrie, D., Oard, D., Doermann, D.: Cross-language entity linking. In: Proceedings of 5th International Joint Conference on Natural Language Processing, pp. 255–263. Asian Federation of Natural Language Processing, Chiang Mai, Thailand, November 2011 McNamee, P., Mayfield, J., Lawrie, D., Oard, D., Doermann, D.: Cross-language entity linking. In: Proceedings of 5th International Joint Conference on Natural Language Processing, pp. 255–263. Asian Federation of Natural Language Processing, Chiang Mai, Thailand, November 2011
11.
Zurück zum Zitat Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient Estimation of Word Representations in Vector Space. arXiv:1301.3781 [cs], January 2013 Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient Estimation of Word Representations in Vector Space. arXiv:​1301.​3781 [cs], January 2013
12.
Zurück zum Zitat Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed Representations of Words and Phrases and their Compositionality. arXiv:1310.4546 [cs, stat], October 2013 Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed Representations of Words and Phrases and their Compositionality. arXiv:​1310.​4546 [cs, stat], October 2013
13.
Zurück zum Zitat Shen, W., Wang, J., Han, J.: Entity linking with a knowledge base: issues, techniques, and solutions. IEEE Trans. Knowl. Data Eng. 27(2), 443–460 (2015)CrossRef Shen, W., Wang, J., Han, J.: Entity linking with a knowledge base: issues, techniques, and solutions. IEEE Trans. Knowl. Data Eng. 27(2), 443–460 (2015)CrossRef
14.
15.
Zurück zum Zitat Sil, A., Kundu, G., Florian, R., Hamza, W.: Neural cross-lingual entity linking. In: Thirty-Second AAAI Conference on Artificial Intelligence, April 2018 Sil, A., Kundu, G., Florian, R., Hamza, W.: Neural cross-lingual entity linking. In: Thirty-Second AAAI Conference on Artificial Intelligence, April 2018
16.
Zurück zum Zitat Tsai, C.T., Roth, D.: Cross-lingual wikification using multilingual embeddings. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 589–598. Association for Computational Linguistics, San Diego (2016) Tsai, C.T., Roth, D.: Cross-lingual wikification using multilingual embeddings. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 589–598. Association for Computational Linguistics, San Diego (2016)
17.
Zurück zum Zitat Wang, H., Zheng, J.G., Ma, X., Fox, P., Ji, H.: Language and domain independent entity linking with quantified collective validation. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 695–704. Association for Computational Linguistics, Lisbon, September 2015 Wang, H., Zheng, J.G., Ma, X., Fox, P., Ji, H.: Language and domain independent entity linking with quantified collective validation. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 695–704. Association for Computational Linguistics, Lisbon, September 2015
18.
Zurück zum Zitat Yamada, I., Shindo, H., Takeda, H., Takefuji, Y.: Joint learning of the embedding of words and entities for named entity disambiguation. In: Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning, pp. 250–259. Association for Computational Linguistics, Berlin (2016) Yamada, I., Shindo, H., Takeda, H., Takefuji, Y.: Joint learning of the embedding of words and entities for named entity disambiguation. In: Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning, pp. 250–259. Association for Computational Linguistics, Berlin (2016)
19.
Zurück zum Zitat Yamada, I., Shindo, H., Takeda, H., Takefuji, Y.: Learning Distributed Representations of Texts and Entities from Knowledge Base. arXiv:1705.02494 [cs], May 2017 Yamada, I., Shindo, H., Takeda, H., Takefuji, Y.: Learning Distributed Representations of Texts and Entities from Knowledge Base. arXiv:​1705.​02494 [cs], May 2017
20.
Zurück zum Zitat Zhang, T., Liu, K., Zhao, J.: Cross lingual entity linking with bilingual topic model. In: Twenty-Third International Joint Conference on Artificial Intelligence (2013) Zhang, T., Liu, K., Zhao, J.: Cross lingual entity linking with bilingual topic model. In: Twenty-Third International Joint Conference on Artificial Intelligence (2013)
Metadaten
Titel
Adaptive Multilingual Representations for Cross-Lingual Entity Linking with Attention on Entity Descriptions
verfasst von
Chenhao Wang
Yubo Chen
Kang Liu
Jun Zhao
Copyright-Jahr
2019
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-1956-7_1