Skip to main content

2021 | OriginalPaper | Buchkapitel

Entity-Aware Relation Representation Learning for Open Relation Extraction

verfasst von : Zihao Liu, Yan Zhang, Huizhen Wang, Jingbo Zhu

Erschienen in: Natural Language Processing and Chinese Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Open relation extraction aims at extracting novel relations from open-domain corpora. However, most recent works typically treat entities and tokens equally while encoding sentences, without taking full advantage of the guiding role of entities in representation learning. In this work, we propose the Entity-Aware Relation Representation learning framework for open relation extraction and establish the new state-of-the-art on standard benchmarks. It gives more attention to entities when learning representations by leveraging an entity-aware attention mechanism. And we further propose a pair-wise contrastive loss to learn relation representations effectively in terms of alignment and uniformity. Extensive experimental results show that our framework achieves significant improvements compared to state-of-the-art models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The FewRel benchmark provides a training set with 64 relations, a validation set with 16 relations, and a hidden test set with 20 relations which are only for evaluation on https://​thunlp.​github.​io/​1/​fewrel1.​html.
 
Literatur
1.
Zurück zum Zitat Bagga, A., Baldwin, B.: Entity-based cross-document coreferencing using the vector space model. In: COLING-ACL (1998) Bagga, A., Baldwin, B.: Entity-based cross-document coreferencing using the vector space model. In: COLING-ACL (1998)
2.
Zurück zum Zitat Banko, M., Cafarella, M.J., Soderland, S., Broadhead, M., Etzioni, O.: Open information extraction from the web (2008) Banko, M., Cafarella, M.J., Soderland, S., Broadhead, M., Etzioni, O.: Open information extraction from the web (2008)
3.
Zurück zum Zitat Banko, M., Etzioni, O.: The tradeoffs between open and traditional relation extraction. In: ACL (2008) Banko, M., Etzioni, O.: The tradeoffs between open and traditional relation extraction. In: ACL (2008)
4.
Zurück zum Zitat Blondel, V., Guillaume, J.L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. J. Stat. Mech. Theory Exp. 2008, 10008 (2008) Blondel, V., Guillaume, J.L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. J. Stat. Mech. Theory Exp. 2008, 10008 (2008)
5.
Zurück zum Zitat Bordes, A., Usunier, N., García-Durán, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: NIPS (2013) Bordes, A., Usunier, N., García-Durán, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: NIPS (2013)
6.
Zurück zum Zitat Cugmas, M., Ferligoj, A.: On comparing partitions. International Federation of Classification Societies (2015) Cugmas, M., Ferligoj, A.: On comparing partitions. International Federation of Classification Societies (2015)
7.
Zurück zum Zitat Cui, L., Wei, F., Zhou, M.: Neural open information extraction (2018) Cui, L., Wei, F., Zhou, M.: Neural open information extraction (2018)
8.
9.
Zurück zum Zitat Han, X., et al.: FewRel: a large-scale supervised few-shot relation classification dataset with state-of-the-art evaluation. ArXiv abs/1810.10147 (2018) Han, X., et al.: FewRel: a large-scale supervised few-shot relation classification dataset with state-of-the-art evaluation. ArXiv abs/1810.10147 (2018)
10.
Zurück zum Zitat Hu, X., Wen, L., Xu, Y., Zhang, C., Yu, P.S.: SelfORE: self-supervised relational feature learning for open relation extraction. ArXiv abs/2004.02438 (2020) Hu, X., Wen, L., Xu, Y., Zhang, C., Yu, P.S.: SelfORE: self-supervised relational feature learning for open relation extraction. ArXiv abs/2004.02438 (2020)
11.
Zurück zum Zitat Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: ACL (2015) Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: ACL (2015)
12.
Zurück zum Zitat Lin, D., Pantel, P.: Dirt @sbt@discovery of inference rules from text. In: KDD 2001 (2001) Lin, D., Pantel, P.: Dirt @sbt@discovery of inference rules from text. In: KDD 2001 (2001)
13.
Zurück zum Zitat Marcheggiani, D., Titov, I.: Discrete-state variational autoencoders for joint discovery and factorization of relations. Trans. Assoc. Comput. Linguist. 4, 231–244 (2016) Marcheggiani, D., Titov, I.: Discrete-state variational autoencoders for joint discovery and factorization of relations. Trans. Assoc. Comput. Linguist. 4, 231–244 (2016)
14.
Zurück zum Zitat Peng, H., et al.: Learning from context or names? An empirical study on neural relation extraction. In: EMNLP (2020) Peng, H., et al.: Learning from context or names? An empirical study on neural relation extraction. In: EMNLP (2020)
15.
Zurück zum Zitat Pennington, J., Socher, R., Manning, C.D.: Glove: Global vectors for word representation. In: EMNLP (2014) Pennington, J., Socher, R., Manning, C.D.: Glove: Global vectors for word representation. In: EMNLP (2014)
16.
Zurück zum Zitat Rosenberg, A., Hirschberg, J.: V-measure: a conditional entropy-based external cluster evaluation measure. In: EMNLP-CoNLL (2007) Rosenberg, A., Hirschberg, J.: V-measure: a conditional entropy-based external cluster evaluation measure. In: EMNLP-CoNLL (2007)
17.
Zurück zum Zitat Simon, É., Guigue, V., Piwowarski, B.: Unsupervised information extraction: regularizing discriminative approaches with relation distribution losses. In: ACL (2019) Simon, É., Guigue, V., Piwowarski, B.: Unsupervised information extraction: regularizing discriminative approaches with relation distribution losses. In: ACL (2019)
18.
Zurück zum Zitat Stanovsky, G., Michael, J., Zettlemoyer, L., Dagan, I.: Supervised open information extraction. In: NAACL-HLT (2018) Stanovsky, G., Michael, J., Zettlemoyer, L., Dagan, I.: Supervised open information extraction. In: NAACL-HLT (2018)
19.
Zurück zum Zitat Tran, T.T., Le, P., Ananiadou, S.: Revisiting unsupervised relation extraction. ArXiv abs/2005.00087 (2020) Tran, T.T., Le, P., Ananiadou, S.: Revisiting unsupervised relation extraction. ArXiv abs/2005.00087 (2020)
20.
Zurück zum Zitat Vaswani, A., et al.: Attention is all you need. ArXiv abs/1706.03762 (2017) Vaswani, A., et al.: Attention is all you need. ArXiv abs/1706.03762 (2017)
21.
Zurück zum Zitat Wu, R., et al.: Open relation extraction: Relational knowledge transfer from supervised data to unsupervised data. In: EMNLP/IJCNLP (2019) Wu, R., et al.: Open relation extraction: Relational knowledge transfer from supervised data to unsupervised data. In: EMNLP/IJCNLP (2019)
22.
Zurück zum Zitat Yao, L., Riedel, S., McCallum, A.: Unsupervised relation discovery with sense disambiguation. In: ACL (2012) Yao, L., Riedel, S., McCallum, A.: Unsupervised relation discovery with sense disambiguation. In: ACL (2012)
23.
Zurück zum Zitat Zeng, D., Liu, K., Lai, S., Zhou, G., Zhao, J.: Relation classification via convolutional deep neural network. In: COLING (2014) Zeng, D., Liu, K., Lai, S., Zhou, G., Zhao, J.: Relation classification via convolutional deep neural network. In: COLING (2014)
24.
Zurück zum Zitat Zhang, S., Huang, H., Liu, J., Li, H.: Spelling error correction with soft-masked BERT (2020) Zhang, S., Huang, H., Liu, J., Li, H.: Spelling error correction with soft-masked BERT (2020)
Metadaten
Titel
Entity-Aware Relation Representation Learning for Open Relation Extraction
verfasst von
Zihao Liu
Yan Zhang
Huizhen Wang
Jingbo Zhu
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-88480-2_23