Skip to main content
Top

2021 | OriginalPaper | Chapter

Entity-Aware Relation Representation Learning for Open Relation Extraction

Authors : Zihao Liu, Yan Zhang, Huizhen Wang, Jingbo Zhu

Published in: Natural Language Processing and Chinese Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Open relation extraction aims at extracting novel relations from open-domain corpora. However, most recent works typically treat entities and tokens equally while encoding sentences, without taking full advantage of the guiding role of entities in representation learning. In this work, we propose the Entity-Aware Relation Representation learning framework for open relation extraction and establish the new state-of-the-art on standard benchmarks. It gives more attention to entities when learning representations by leveraging an entity-aware attention mechanism. And we further propose a pair-wise contrastive loss to learn relation representations effectively in terms of alignment and uniformity. Extensive experimental results show that our framework achieves significant improvements compared to state-of-the-art models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The FewRel benchmark provides a training set with 64 relations, a validation set with 16 relations, and a hidden test set with 20 relations which are only for evaluation on https://​thunlp.​github.​io/​1/​fewrel1.​html.
 
Literature
1.
go back to reference Bagga, A., Baldwin, B.: Entity-based cross-document coreferencing using the vector space model. In: COLING-ACL (1998) Bagga, A., Baldwin, B.: Entity-based cross-document coreferencing using the vector space model. In: COLING-ACL (1998)
2.
go back to reference Banko, M., Cafarella, M.J., Soderland, S., Broadhead, M., Etzioni, O.: Open information extraction from the web (2008) Banko, M., Cafarella, M.J., Soderland, S., Broadhead, M., Etzioni, O.: Open information extraction from the web (2008)
3.
go back to reference Banko, M., Etzioni, O.: The tradeoffs between open and traditional relation extraction. In: ACL (2008) Banko, M., Etzioni, O.: The tradeoffs between open and traditional relation extraction. In: ACL (2008)
4.
go back to reference Blondel, V., Guillaume, J.L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. J. Stat. Mech. Theory Exp. 2008, 10008 (2008) Blondel, V., Guillaume, J.L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. J. Stat. Mech. Theory Exp. 2008, 10008 (2008)
5.
go back to reference Bordes, A., Usunier, N., García-Durán, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: NIPS (2013) Bordes, A., Usunier, N., García-Durán, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: NIPS (2013)
6.
go back to reference Cugmas, M., Ferligoj, A.: On comparing partitions. International Federation of Classification Societies (2015) Cugmas, M., Ferligoj, A.: On comparing partitions. International Federation of Classification Societies (2015)
7.
go back to reference Cui, L., Wei, F., Zhou, M.: Neural open information extraction (2018) Cui, L., Wei, F., Zhou, M.: Neural open information extraction (2018)
9.
go back to reference Han, X., et al.: FewRel: a large-scale supervised few-shot relation classification dataset with state-of-the-art evaluation. ArXiv abs/1810.10147 (2018) Han, X., et al.: FewRel: a large-scale supervised few-shot relation classification dataset with state-of-the-art evaluation. ArXiv abs/1810.10147 (2018)
10.
go back to reference Hu, X., Wen, L., Xu, Y., Zhang, C., Yu, P.S.: SelfORE: self-supervised relational feature learning for open relation extraction. ArXiv abs/2004.02438 (2020) Hu, X., Wen, L., Xu, Y., Zhang, C., Yu, P.S.: SelfORE: self-supervised relational feature learning for open relation extraction. ArXiv abs/2004.02438 (2020)
11.
go back to reference Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: ACL (2015) Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: ACL (2015)
12.
go back to reference Lin, D., Pantel, P.: Dirt @sbt@discovery of inference rules from text. In: KDD 2001 (2001) Lin, D., Pantel, P.: Dirt @sbt@discovery of inference rules from text. In: KDD 2001 (2001)
13.
go back to reference Marcheggiani, D., Titov, I.: Discrete-state variational autoencoders for joint discovery and factorization of relations. Trans. Assoc. Comput. Linguist. 4, 231–244 (2016) Marcheggiani, D., Titov, I.: Discrete-state variational autoencoders for joint discovery and factorization of relations. Trans. Assoc. Comput. Linguist. 4, 231–244 (2016)
14.
go back to reference Peng, H., et al.: Learning from context or names? An empirical study on neural relation extraction. In: EMNLP (2020) Peng, H., et al.: Learning from context or names? An empirical study on neural relation extraction. In: EMNLP (2020)
15.
go back to reference Pennington, J., Socher, R., Manning, C.D.: Glove: Global vectors for word representation. In: EMNLP (2014) Pennington, J., Socher, R., Manning, C.D.: Glove: Global vectors for word representation. In: EMNLP (2014)
16.
go back to reference Rosenberg, A., Hirschberg, J.: V-measure: a conditional entropy-based external cluster evaluation measure. In: EMNLP-CoNLL (2007) Rosenberg, A., Hirschberg, J.: V-measure: a conditional entropy-based external cluster evaluation measure. In: EMNLP-CoNLL (2007)
17.
go back to reference Simon, É., Guigue, V., Piwowarski, B.: Unsupervised information extraction: regularizing discriminative approaches with relation distribution losses. In: ACL (2019) Simon, É., Guigue, V., Piwowarski, B.: Unsupervised information extraction: regularizing discriminative approaches with relation distribution losses. In: ACL (2019)
18.
go back to reference Stanovsky, G., Michael, J., Zettlemoyer, L., Dagan, I.: Supervised open information extraction. In: NAACL-HLT (2018) Stanovsky, G., Michael, J., Zettlemoyer, L., Dagan, I.: Supervised open information extraction. In: NAACL-HLT (2018)
19.
go back to reference Tran, T.T., Le, P., Ananiadou, S.: Revisiting unsupervised relation extraction. ArXiv abs/2005.00087 (2020) Tran, T.T., Le, P., Ananiadou, S.: Revisiting unsupervised relation extraction. ArXiv abs/2005.00087 (2020)
20.
go back to reference Vaswani, A., et al.: Attention is all you need. ArXiv abs/1706.03762 (2017) Vaswani, A., et al.: Attention is all you need. ArXiv abs/1706.03762 (2017)
21.
go back to reference Wu, R., et al.: Open relation extraction: Relational knowledge transfer from supervised data to unsupervised data. In: EMNLP/IJCNLP (2019) Wu, R., et al.: Open relation extraction: Relational knowledge transfer from supervised data to unsupervised data. In: EMNLP/IJCNLP (2019)
22.
go back to reference Yao, L., Riedel, S., McCallum, A.: Unsupervised relation discovery with sense disambiguation. In: ACL (2012) Yao, L., Riedel, S., McCallum, A.: Unsupervised relation discovery with sense disambiguation. In: ACL (2012)
23.
go back to reference Zeng, D., Liu, K., Lai, S., Zhou, G., Zhao, J.: Relation classification via convolutional deep neural network. In: COLING (2014) Zeng, D., Liu, K., Lai, S., Zhou, G., Zhao, J.: Relation classification via convolutional deep neural network. In: COLING (2014)
24.
go back to reference Zhang, S., Huang, H., Liu, J., Li, H.: Spelling error correction with soft-masked BERT (2020) Zhang, S., Huang, H., Liu, J., Li, H.: Spelling error correction with soft-masked BERT (2020)
Metadata
Title
Entity-Aware Relation Representation Learning for Open Relation Extraction
Authors
Zihao Liu
Yan Zhang
Huizhen Wang
Jingbo Zhu
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-88480-2_23

Premium Partner