Skip to main content
Erschienen in: Knowledge and Information Systems 10/2023

29.05.2023 | Regular Paper

Multi-task entity linking with supervision from a taxonomy

verfasst von: Xuwu Wang, Lihan Chen, Wei Zhu, Yuan Ni, Guotong Xie, Deqing Yang, Yanghua Xiao

Erschienen in: Knowledge and Information Systems | Ausgabe 10/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Entity linking is the task of resolving ambiguous mentions in documents to their referent entities in a knowledge graph (KG). Existing solutions mainly rely on three kinds of information: local contextual similarity, global coherence, and prior probability. But the information of the mentions’ types is rarely utilized, which is helpful for precise entity linking. That is to say, if the type information of a mention is obtained from a mention classifier, we can exclude candidate entities with different types. However, the key challenge of realizing it lies in obtaining the type labels with appropriate granularity and performing entity linking with the error propagated from the mention classifier. To solve the challenges, we propose a model named type-oriented multi-task entity linking (TMTEL). First, we select types with appropriate granularity from the taxonomy of a KG, which is modeled as a nonlinear integer programming problem. Second, we use a multi-task learning framework to incorporate the selected types into entity linking. The type information is used to enhance the representation of the mentions’ context, which is more robust to the errors of the mention classifier. Experimental results show that our model outperforms multiple existing solutions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
In this paper, entity linking refers to the task of disambiguating a detected mention instead of the task of detecting and disambiguating mentions, which is also denoted as entity linking in some works.
 
3
If we use 1/0 to indicate whether type \(t_l \in T\) is selected or not, then the variables for this problem are all integers. Besides, the objective function \(C(\cdot )\) and the constraint \(\varGamma (T^*,R)\) are nonlinear. Therefore, this is a nonlinear integer programming problem.
 
4
The dataset of TAC-KBP is no longer available. The dataset of ACE2004 is relatively small, so we do not test on them in this paper.
 
5
All the datasets can be obtained from https://​github.​com/​lephong/​mulrel-nel.
 
6
Six types are manually selected from the taxonomy by volunteers.
 
Literatur
1.
Zurück zum Zitat Blanco R, Ottaviano G, Meij E (2015) Fast and space-efficient entity linking for queries. In: Proceedings of the eighth ACM international conference on web search and data mining, ACM, pp 179–188 Blanco R, Ottaviano G, Meij E (2015) Fast and space-efficient entity linking for queries. In: Proceedings of the eighth ACM international conference on web search and data mining, ACM, pp 179–188
3.
Zurück zum Zitat Clark K, Luong MT, Khandelwal U, Manning CD, Le QV (2019) Bam! born-again multi-task networks for natural language understanding. arXiv:1907.04829 Clark K, Luong MT, Khandelwal U, Manning CD, Le QV (2019) Bam! born-again multi-task networks for natural language understanding. arXiv:​1907.​04829
4.
Zurück zum Zitat Fang Z, Cao Y, Li Q, Zhang D, Zhang Z, Liu Y (2019) Joint entity linking with deep reinforcement learning. In: The World Wide Web conference, pp 438–447 Fang Z, Cao Y, Li Q, Zhang D, Zhang Z, Liu Y (2019) Joint entity linking with deep reinforcement learning. In: The World Wide Web conference, pp 438–447
7.
Zurück zum Zitat Hoffart J, Yosef MA, Bordino I, Fürstenau H, Pinkal M, Spaniol M, Taneva B, Thater S, Weikum G (2011) Robust disambiguation of named entities in text. In: Proceedings of the conference on empirical methods in Natural Language Processing, Association for Computational Linguistics, pp 782–792 Hoffart J, Yosef MA, Bordino I, Fürstenau H, Pinkal M, Spaniol M, Taneva B, Thater S, Weikum G (2011) Robust disambiguation of named entities in text. In: Proceedings of the conference on empirical methods in Natural Language Processing, Association for Computational Linguistics, pp 782–792
8.
Zurück zum Zitat Hoffart J, Seufert S, Nguyen DB, Theobald M, Weikum G (2012) Kore: keyphrase overlap relatedness for entity disambiguation. In: Proceedings of the 21st ACM international conference on Information and knowledge management, ACM, pp 545–554 Hoffart J, Seufert S, Nguyen DB, Theobald M, Weikum G (2012) Kore: keyphrase overlap relatedness for entity disambiguation. In: Proceedings of the 21st ACM international conference on Information and knowledge management, ACM, pp 545–554
9.
Zurück zum Zitat Hoffmann R, Zhang C, Ling X, Zettlemoyer L, Weld DS (2011) Knowledge-based weak supervision for information extraction of overlapping relations. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, Association for Computational Linguistics, pp 541–550 Hoffmann R, Zhang C, Ling X, Zettlemoyer L, Weld DS (2011) Knowledge-based weak supervision for information extraction of overlapping relations. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, Association for Computational Linguistics, pp 541–550
10.
Zurück zum Zitat Koch M, Gilmer J, Soderland S, Weld DS (2014) Type-aware distantly supervised relation extraction with linked arguments. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 1891–1901 Koch M, Gilmer J, Soderland S, Weld DS (2014) Type-aware distantly supervised relation extraction with linked arguments. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 1891–1901
11.
Zurück zum Zitat Lazic N, Subramanya A, Ringgaard M, Pereira F (2015) Plato: a selective context model for entity resolution. Trans Assoc Comput Linguist 3:503–515CrossRef Lazic N, Subramanya A, Ringgaard M, Pereira F (2015) Plato: a selective context model for entity resolution. Trans Assoc Comput Linguist 3:503–515CrossRef
14.
Zurück zum Zitat Li J, Shang S, Shao L (2020) Metaner: named entity recognition with meta-learning. In: Proceedings of The Web Conference, pp 429–440 Li J, Shang S, Shao L (2020) Metaner: named entity recognition with meta-learning. In: Proceedings of The Web Conference, pp 429–440
15.
Zurück zum Zitat Lin TY, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision, pp 2980–2988 Lin TY, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision, pp 2980–2988
16.
Zurück zum Zitat Ling X, Singh S, Weld DS (2015) Design challenges for entity linking. Trans Assoc Comput Linguist 3:315–328CrossRef Ling X, Singh S, Weld DS (2015) Design challenges for entity linking. Trans Assoc Comput Linguist 3:315–328CrossRef
17.
Zurück zum Zitat Liu M, Zhao Y, Qin B, Liu T (2019) Collective entity linking: a random walk-based perspective. Knowl Inf Syst 60(3):1611–1643CrossRef Liu M, Zhao Y, Qin B, Liu T (2019) Collective entity linking: a random walk-based perspective. Knowl Inf Syst 60(3):1611–1643CrossRef
18.
Zurück zum Zitat Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. In: 1st international conference on learning representations, ICLR 2013, Scottsdale, Arizona, USA, May 2–4, 2013, workshop track proceedings, http://arxiv.org/abs/1301.3781 Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. In: 1st international conference on learning representations, ICLR 2013, Scottsdale, Arizona, USA, May 2–4, 2013, workshop track proceedings, http://​arxiv.​org/​abs/​1301.​3781
19.
Zurück zum Zitat Nadeau D, Sekine S (2007) A survey of named entity recognition and classification. Lingvisticae Investigationes 30(1):3–26CrossRef Nadeau D, Sekine S (2007) A survey of named entity recognition and classification. Lingvisticae Investigationes 30(1):3–26CrossRef
21.
Zurück zum Zitat Pershina M, He Y, Grishman R (2015) Personalized page rank for named entity disambiguation. In: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 238–243 Pershina M, He Y, Grishman R (2015) Personalized page rank for named entity disambiguation. In: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 238–243
22.
Zurück zum Zitat Radhakrishnan P, Talukdar P, Varma V (2018) Elden: Improved entity linking using densified knowledge graphs. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp 1844–1853 Radhakrishnan P, Talukdar P, Varma V (2018) Elden: Improved entity linking using densified knowledge graphs. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp 1844–1853
23.
Zurück zum Zitat Raiman JR, Raiman OM (2018) Deeptype: multilingual entity linking by neural type system evolution. In: Thirty-second AAAI conference on artificial intelligence Raiman JR, Raiman OM (2018) Deeptype: multilingual entity linking by neural type system evolution. In: Thirty-second AAAI conference on artificial intelligence
24.
Zurück zum Zitat Ratinov L, Roth D, Downey D, Anderson M (2011) Local and global algorithms for disambiguation to wikipedia. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, Association for Computational Linguistics, pp 1375–1384 Ratinov L, Roth D, Downey D, Anderson M (2011) Local and global algorithms for disambiguation to wikipedia. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, Association for Computational Linguistics, pp 1375–1384
26.
Zurück zum Zitat Sener O, Koltun V (2018) Multi-task learning as multi-objective optimization. In: Advances in neural information processing systems, pp 527–538 Sener O, Koltun V (2018) Multi-task learning as multi-objective optimization. In: Advances in neural information processing systems, pp 527–538
27.
Zurück zum Zitat Shen W, Wang J, Han J (2014) Entity linking with a knowledge base: issues, techniques, and solutions. IEEE Trans Knowl Data Eng 27(2):443–460CrossRef Shen W, Wang J, Han J (2014) Entity linking with a knowledge base: issues, techniques, and solutions. IEEE Trans Knowl Data Eng 27(2):443–460CrossRef
28.
Zurück zum Zitat Van Laarhoven PJ, Aarts EH (1987) Simulated annealing. In: Simulated annealing: theory and applications. Springer, pp 7–15 Van Laarhoven PJ, Aarts EH (1987) Simulated annealing. In: Simulated annealing: theory and applications. Springer, pp 7–15
29.
Zurück zum Zitat Wang C, He X, Zhou A (2020) Heel: exploratory entity linking for heterogeneous information networks. Knowl Inf Syst 62(2):485–506CrossRef Wang C, He X, Zhou A (2020) Heel: exploratory entity linking for heterogeneous information networks. Knowl Inf Syst 62(2):485–506CrossRef
30.
Zurück zum Zitat Wu L, Petroni F, Josifoski M, Riedel S, Zettlemoyer L (2019) Scalable zero-shot entity linking with dense entity retrieval. arXiv:1911.03814 Wu L, Petroni F, Josifoski M, Riedel S, Zettlemoyer L (2019) Scalable zero-shot entity linking with dense entity retrieval. arXiv:​1911.​03814
31.
32.
Zurück zum Zitat Yamada I, Shindo H, Takeda H, Takefuji Y (2016) Joint learning of the embedding of words and entities for named entity disambiguation. arXiv:1601.01343 Yamada I, Shindo H, Takeda H, Takefuji Y (2016) Joint learning of the embedding of words and entities for named entity disambiguation. arXiv:​1601.​01343
33.
Zurück zum Zitat Yamada I, Shindo H, Takeda H, Takefuji Y (2017) Learning distributed representations of texts and entities from knowledge base. Trans Assoc Comput Linguist 5:397–411CrossRef Yamada I, Shindo H, Takeda H, Takefuji Y (2017) Learning distributed representations of texts and entities from knowledge base. Trans Assoc Comput Linguist 5:397–411CrossRef
34.
Zurück zum Zitat Yang X, Gu X, Lin S, Tang S, Zhuang Y, Wu F, Chen Z, Hu G, Ren X (2019) Learning dynamic context augmentation for global entity linking. arXiv:1909.02117 Yang X, Gu X, Lin S, Tang S, Zhuang Y, Wu F, Chen Z, Hu G, Ren X (2019) Learning dynamic context augmentation for global entity linking. arXiv:​1909.​02117
35.
Zurück zum Zitat Yih SWt, Chang MW, He X, Gao J (2015) Semantic parsing via staged query graph generation: Question answering with knowledge base. In: Proceedings of the joint conference of the 53rd annual meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP Yih SWt, Chang MW, He X, Gao J (2015) Semantic parsing via staged query graph generation: Question answering with knowledge base. In: Proceedings of the joint conference of the 53rd annual meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP
Metadaten
Titel
Multi-task entity linking with supervision from a taxonomy
verfasst von
Xuwu Wang
Lihan Chen
Wei Zhu
Yuan Ni
Guotong Xie
Deqing Yang
Yanghua Xiao
Publikationsdatum
29.05.2023
Verlag
Springer London
Erschienen in
Knowledge and Information Systems / Ausgabe 10/2023
Print ISSN: 0219-1377
Elektronische ISSN: 0219-3116
DOI
https://doi.org/10.1007/s10115-023-01905-7

Weitere Artikel der Ausgabe 10/2023

Knowledge and Information Systems 10/2023 Zur Ausgabe

Premium Partner