Top

Published in:

2019 | OriginalPaper | Chapter

Knowledge-Aware and Retrieval-Based Models for Distantly Supervised Relation Extraction

Authors : Xuemiao Zhang, Kejun Deng, Leilei Zhang, Zhouxing Tan, Junfei Liu

Published in: PRICAI 2019: Trends in Artificial Intelligence

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Distantly supervised relation extraction (RE) has been an effective way to find novel relational facts from text without a large amount of well-labeled training data. However, distant supervision always suffers from wrong labelling problem. Many neural approaches have been proposed to alleviate this problem recently, but none of them can make use of the rich semantic knowledge in the knowledge bases (KBs). In this paper, we propose a knowledge-aware attention model, which can leverage the semantic knowledge in the KB to select the valid sentences. Furthermore, based on knowledge representation learning (KRL), we formalize distantly supervised RE as relation retrieval instead of relation classification to leverage the semantic knowledge further. Experimental results on widely used datasets show that our approaches significantly outperform the popular benchmark methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter A Better Understanding of the Interaction Between Users and Items by Knowledge Graph Learning for Temporal Recommendation

next chapter Two-Stage Entity Alignment: Combining Hybrid Knowledge Graph Embedding with Similarity-Based Relation Alignment

Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., Ives, Z.: DBpedia: a nucleus for a web of open data. In: Aberer, K., et al. (eds.) ASWC/ISWC -2007. LNCS, vol. 4825, pp. 722–735. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-76298-0_52 CrossRef

Bollacker, E.K., Paritosh, C., Sturge, P., Taylor, T.: Freebase: a collaboratively created graph database for structuring human knowledge. In: SIGMOD Conference, pp. 1247–1250 (2008)

Bordes, A., Usunier, N., Weston, J.: Translating embeddings for modeling multi-relational. In: International Conference on Neural Information Processing Systems, pp. 2787–2795 (2013)

Bunescu, R., Mooney, R.: Learning to extract relations from the web using minimal supervision. In: ACL, pp. 576–583 (2007)

Thomas, G., Richard, H.: Solving the multiple instance problem with axis-parallel rectangles. J. Artif. Intell. 89(12), 31–71 (1997)MATH

Geoffrey, E., Srivastava, N., Krizhevsky, A., Sutskever, I., Ruslan, R.: Improving neural networks by preventing co-adaptation of feature detectors. J. Comput. Sci. 3(4), 212–223 (2012)

Hoffmann, H., Zhang, C., Ling, X., Zettlemoyer, L., Daniel, W.: Knowledge-based weak supervision for information extraction of overlapping relations. In: Meeting of the Association for Computational Linguistics (ACL), pp. 541–550 (2011)

Ji, G., Liu, K., He, S., Zhao, J.: Distant supervision for relation extraction with sentence-level attention and entity descriptions. In: AAAI, pp. 3060–3066 (2017)

Lin, Y., Liu, Z., Sun, M.: Knowledge representation learning with entities, attributes and relations. J. Ethnicity 1, 41–52 (2016a)

10.

Lin, Y., Liu, Z., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: AAAI, pp. 2181–2187 (2015)

11.

Lin, Y., Shen, S., Liu, Z., Luan, H., Sun, M.: Neural relation extraction with selective attention over instances. In: ACL, pp. 2124–2133 (2016)

12.

Lukovnikov, D., Fischer, A., Lehmann, J., Auer, S.: Neural network-based question answering over knowledge graphs on word and character level. In: Proceedings of International Conference on World Wide Web (WWW), pp. 1211–1220 (2017)

13.

Luong, M., Pham, H., Manning, C.: Effective approaches to attention based neural machine translation. J. Comput. Sci. (2015)

14.

Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. In: NIPS, pp. 3111–3119 (2013)

15.

Mintz, M., Bills, S., Jurafsky, D.: Distant supervision for relation extraction without labeled data. In: Joint Conference of the Meeting of the ACL and the International Joint Conference on Natural Language Processing of the AFNLP, pp. 1003–1011 (2009)

16.

Mitra, B., Craswell, N.: Neural models for information retrieval. CoRR, abs/1705.01509 (2017)

17.

Riedel, S., Yao, L., Mccallum, A.: Modeling relations and their mentions without labeled text. In: European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 148–163 (2010)CrossRef

18.

See, A., Liu, P., Manning, C.: Get to the point: summarization with pointer generator networks. In: ACL, pp. 1073–1083 (2017)

19.

Shen, Y., He, X., Gao, J., Deng, L., Mesnil, G.: A latent semantic model with convolutional-pooling structure for information retrieval. In: Proceedings of ACM International Conference on Conference on Information and Knowledge Management, (CIKM), pp. 101–110 (2014)

20.

Baoxu, S.B., Weninger, T.: Open-world knowledge graph completion. In: AAAI (2018)

21.

Surdeanu, M., Tibshirani, J., Nallapati, R., Manning, C.: Multi-instance multi-label learning for relation extraction. In: Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 455–465 (2012)

22.

Tan, M., Santos, C., Xiang, B., Zhou, B.: Improved representation learning for question answer matching. In: ACL, pp. 464–473 (2016)

23.

Yang, B., Mitchell, T.: Leveraging knowledge bases in LSTMs for improving machine reading. In: ACL, pp. 1436–1446 (2017)

24.

Yao, X., Durme, B.: Information extraction over structured data: question answering with freebase. In: ACL, pp. 956–966 (2014)

25.

Zeng, D., Liu, K., Chen, Y., Zhao, J.: Distant supervision for relation extraction via piecewise convolutional neural networks. In: EMNLP, pp. 1753–1762 (2015)

Title: Knowledge-Aware and Retrieval-Based Models for Distantly Supervised Relation Extraction
Authors: Xuemiao Zhang
Kejun Deng
Leilei Zhang
Zhouxing Tan
Junfei Liu
Publisher: Springer International Publishing
Book: PRICAI 2019: Trends in Artificial Intelligence
Print ISBN: 978-3-030-29907-1

Electronic ISBN: 978-3-030-29908-8

Copyright Year: 2019
DOI: https://doi.org/10.1007/978-3-030-29908-8_12

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner