Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 2/2022

15-07-2021 | Research Article-Computer Engineering and Computer Science

Entity-Context and Relation-Context Combined Knowledge Graph Embeddings

Authors: Yong Wu, Wei Li, Xiaoming Fan, Binjun Wang

Published in: Arabian Journal for Science and Engineering | Issue 2/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Hierarchical structures are very common in knowledge graphs, and semantic hierarchy-preserved knowledge graph embeddings have achieved promising results in the knowledge graph link prediction task. However, handling one-to-many, many-to-one, and many-to-many relations that can provide hierarchical information is challenging and brings entity indistinguishability issues. To address this limitation, this paper proposes a novel knowledge graph embedding model, namely Entity-context and Relation-context combined Knowledge Graph Embeddings (ERKE), in which each relation is defined as a rotation with variable moduli from the source entity to the target entity in the polar coordinate system. It can be seen as a combination of two spaces—modulus space and phase space. In the modulus space, modulus information is used to model semantic hierarchies, and entity-context information is adopted to make node representations more expressive. Besides, based on the design of the propagation rule of Graph Convolution Network (GCN), a new GCN model suitable for processing semantic hierarchies in knowledge graphs is proposed. In the phase space, relation-context information is used to make entities easier to distinguish. Specifically, a rotation operation in the polar coordinate system is transformed to the addition operation in the rectangular coordinate system, and relations between entities are mapped into their entity-specific hyperplanes. The proposed method is verified by the experiments on three benchmark datasets, and experimental results demonstrate that the proposed method can learn the semantic hierarchies in knowledge graphs and improve the prediction accuracy of complex one-to-many, many-to-one, and many-to-many cases simultaneously.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference He, H.; Balakrishnan, A.; Eric, M.; Liang, P.: Learning symmetric collaborative dialogue agents with dynamic knowledge graph embeddings. In: Proceedings of the Association for Computational Linguistics, pp. 1766–1776. ACL (2017) He, H.; Balakrishnan, A.; Eric, M.; Liang, P.: Learning symmetric collaborative dialogue agents with dynamic knowledge graph embeddings. In: Proceedings of the Association for Computational Linguistics, pp. 1766–1776. ACL (2017)
2.
go back to reference Wang, X.; He, X.; Cao, Y.; Liu, M.; Chua, T. S.: KGAT: knowledge graph attention network for recommendation. In: International Conference on Knowledge Discovery and Data Mining, pp. 950–958. ACM (2019) Wang, X.; He, X.; Cao, Y.; Liu, M.; Chua, T. S.: KGAT: knowledge graph attention network for recommendation. In: International Conference on Knowledge Discovery and Data Mining, pp. 950–958. ACM (2019)
3.
go back to reference Diefenbach, D.; Singh, K.; Maret, P.: Wdaqua-core1: a question answering service for rdf knowledge bases. In: International Conference on World Wide Web, pp. 1087–1091. ACM (2018) Diefenbach, D.; Singh, K.; Maret, P.: Wdaqua-core1: a question answering service for rdf knowledge bases. In: International Conference on World Wide Web, pp. 1087–1091. ACM (2018)
4.
go back to reference Denis, K.; Stephan, B.; Volker, T.: Type-constrained representation learning in knowledge graphs. In: International Semantic Web Conference, pp. 640–655. Springer (2015) Denis, K.; Stephan, B.; Volker, T.: Type-constrained representation learning in knowledge graphs. In: International Semantic Web Conference, pp. 640–655. Springer (2015)
5.
go back to reference Robert, W.; Evgeniy G.; Kevin M.; Sun, S. H.; Rahul G.: Knowledge base completion via search-based question answering. In: International Conference on World Wide Web, pp. 516–526. ACM (2014) Robert, W.; Evgeniy G.; Kevin M.; Sun, S. H.; Rahul G.: Knowledge base completion via search-based question answering. In: International Conference on World Wide Web, pp. 516–526. ACM (2014)
6.
go back to reference Xie, R.; Liu, Z.; Sun, M.: Representation learning of knowledge graphs with hierarchical types. In: International Joint Conference on Artificial Intelligence, pp. 2965–2971. Morgan Kaufmann (2016) Xie, R.; Liu, Z.; Sun, M.: Representation learning of knowledge graphs with hierarchical types. In: International Joint Conference on Artificial Intelligence, pp. 2965–2971. Morgan Kaufmann (2016)
7.
go back to reference Zhang, Z.; Zhuang, F.; Qu, M.; Lin, F.; He, Q.: Knowledge graph embedding with hierarchical relation structure. In: International Conference on Empirical Methods in Natural Language Processing, pp. 3198–3207. ACL (2018) Zhang, Z.; Zhuang, F.; Qu, M.; Lin, F.; He, Q.: Knowledge graph embedding with hierarchical relation structure. In: International Conference on Empirical Methods in Natural Language Processing, pp. 3198–3207. ACL (2018)
8.
go back to reference Zhang, Z.; Cai, J.; Zhang, Y.; Wang, J.: Learning hierarchy-aware knowledge graph embeddings for link prediction. In: International AAAI Conference on Artificial Intelligence, pp. 3065–3072. AAAI (2020) Zhang, Z.; Cai, J.; Zhang, Y.; Wang, J.: Learning hierarchy-aware knowledge graph embeddings for link prediction. In: International AAAI Conference on Artificial Intelligence, pp. 3065–3072. AAAI (2020)
10.
go back to reference Wang, Z.; Zhang, J.; Feng, J.; Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: International AAAI Conference on Artificial Intelligence, pp. 1112–1119. AAAI (2014) Wang, Z.; Zhang, J.; Feng, J.; Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: International AAAI Conference on Artificial Intelligence, pp. 1112–1119. AAAI (2014)
11.
go back to reference Lin, Y.; Liu, Z.; Sun, M.; Liu Y.; Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: International AAAI Conference on Artificial Intelligence, pp. 2181–2187, AAAI (2015) Lin, Y.; Liu, Z.; Sun, M.; Liu Y.; Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: International AAAI Conference on Artificial Intelligence, pp. 2181–2187, AAAI (2015)
12.
go back to reference Ji, G.; He, S.; Xu, L.; Liu K.; Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the Association for Computational Linguistics, pp. 687–696. ACL (2015) Ji, G.; He, S.; Xu, L.; Liu K.; Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the Association for Computational Linguistics, pp. 687–696. ACL (2015)
13.
go back to reference Bordes, A.; Usunier, N.; Garcia-Duran, A.; Weston, J.; Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Proceedings of the Annual Conference on Neural Information Processing Systems, pp. 2787–2795. MIT (2013) Bordes, A.; Usunier, N.; Garcia-Duran, A.; Weston, J.; Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Proceedings of the Annual Conference on Neural Information Processing Systems, pp. 2787–2795. MIT (2013)
14.
go back to reference Ji, G.; Liu, K.; He S.; Zhao, J.: Knowledge graph completion with adaptive sparse transfer matrix. In: International AAAI Conference on Artificial Intelligence, pp. 985–991. AAAI (2016) Ji, G.; Liu, K.; He S.; Zhao, J.: Knowledge graph completion with adaptive sparse transfer matrix. In: International AAAI Conference on Artificial Intelligence, pp. 985–991. AAAI (2016)
15.
go back to reference Ebisu, T.; Ichise, R.: TorusE: Knowledge graph embedding on a lie group. In: International AAAI Conference on Artificial Intelligence, pp. 1819–1826. AAAI (2018) Ebisu, T.; Ichise, R.: TorusE: Knowledge graph embedding on a lie group. In: International AAAI Conference on Artificial Intelligence, pp. 1819–1826. AAAI (2018)
17.
go back to reference Zhang, S.; Tay, Y.; Yao, L.; Liu, Q.: Quaternion knowledge graph embeddings. In: Proceedings in Advances in Neural Information Processing Systems, pp. 2735–2745. MIT (2019) Zhang, S.; Tay, Y.; Yao, L.; Liu, Q.: Quaternion knowledge graph embeddings. In: Proceedings in Advances in Neural Information Processing Systems, pp. 2735–2745. MIT (2019)
20.
go back to reference Liu, H.; Wu, Y.; Yang, Y.: Analogical inference for multi-relational embeddings, In: International Conference on Machine Learning, pp. 2168–2178. ACM (2017) Liu, H.; Wu, Y.; Yang, Y.: Analogical inference for multi-relational embeddings, In: International Conference on Machine Learning, pp. 2168–2178. ACM (2017)
21.
go back to reference Kazemi, S.M.; Poole, D.: Simple embedding for link prediction in knowledge graphs. In: Proceedings in Advances in Neural Information Processing Systems, pp. 4284–4295. MIT Press (2018) Kazemi, S.M.; Poole, D.: Simple embedding for link prediction in knowledge graphs. In: Proceedings in Advances in Neural Information Processing Systems, pp. 4284–4295. MIT Press (2018)
22.
go back to reference Trouillon, T.; Welbl, J.; Riedel, S.; Gaussier, E.; Bouchard, G.: Complex embeddings for simple link prediction. In: International Conference on Machine Learning, pp. 2071–2080. ACM (2016) Trouillon, T.; Welbl, J.; Riedel, S.; Gaussier, E.; Bouchard, G.: Complex embeddings for simple link prediction. In: International Conference on Machine Learning, pp. 2071–2080. ACM (2016)
23.
go back to reference Xu, C.; Li, R.: Relation embedding with dihedral group in knowledge graph. In: Proceedings of the Association for Computational Linguistics, pp. 263–272. ACL (2019) Xu, C.; Li, R.: Relation embedding with dihedral group in knowledge graph. In: Proceedings of the Association for Computational Linguistics, pp. 263–272. ACL (2019)
24.
go back to reference Nickel, M.; Rosasco, L.; Poggio, T.: Holographic embeddings of knowledge graphs. In: International AAAI Conference on Artificial Intelligence, pp. 1955–1961. AAAI (2016) Nickel, M.; Rosasco, L.; Poggio, T.: Holographic embeddings of knowledge graphs. In: International AAAI Conference on Artificial Intelligence, pp. 1955–1961. AAAI (2016)
25.
go back to reference Socher, R.; Chen, D.; Manning, C. D.; Ng, A.: Reasoning with neural tensor networks for knowledge base completion. In: Proceedings in Advances in Neural Information Processing Systems, pp. 926–934. MIT (2013) Socher, R.; Chen, D.; Manning, C. D.; Ng, A.: Reasoning with neural tensor networks for knowledge base completion. In: Proceedings in Advances in Neural Information Processing Systems, pp. 926–934. MIT (2013)
26.
go back to reference Shi, B.; Weninger, T.: ProjE: embedding projection for knowledge graph completion. In: International AAAI Conference on Artificial Intelligence, pp. 1236–1242. AAAI (2017) Shi, B.; Weninger, T.: ProjE: embedding projection for knowledge graph completion. In: International AAAI Conference on Artificial Intelligence, pp. 1236–1242. AAAI (2017)
27.
go back to reference Dong, X.; Gabrilovich, E.; Heitz, G.; Horn, W.; Lao, N.: Knowledge vault: a web-scale approach to probabilistic knowledge fusion. In: International Conference on Knowledge Discovery and Data Mining, pp. 601–610. ACM (2014) Dong, X.; Gabrilovich, E.; Heitz, G.; Horn, W.; Lao, N.: Knowledge vault: a web-scale approach to probabilistic knowledge fusion. In: International Conference on Knowledge Discovery and Data Mining, pp. 601–610. ACM (2014)
28.
go back to reference Dettmers, T.; Minervini, P.; Stenetorp P.; Riedel, S.: Convolutional 2D knowledge graph embeddings. In: International AAAI Conference on Artificial Intelligence, pp. 1811–1818. AAAI (2018) Dettmers, T.; Minervini, P.; Stenetorp P.; Riedel, S.: Convolutional 2D knowledge graph embeddings. In: International AAAI Conference on Artificial Intelligence, pp. 1811–1818. AAAI (2018)
29.
go back to reference Nguyen, D. Q.; Nguyen, T. D.; Phung, D.: A novel embedding model for knowledge base completion based on convolutional neural network, In: Proceedings of the Association for Computational Linguistics, pp. 327–333. ACL (2018) Nguyen, D. Q.; Nguyen, T. D.; Phung, D.: A novel embedding model for knowledge base completion based on convolutional neural network, In: Proceedings of the Association for Computational Linguistics, pp. 327–333. ACL (2018)
30.
go back to reference Balazevic, I.; Allen, C.; Hospedales, T. M.: Hypernetwork knowledge graph embeddings. In: Proceedings of Artificial Neural Networks and Machine Learning, pp. 553–565. Springer (2019) Balazevic, I.; Allen, C.; Hospedales, T. M.: Hypernetwork knowledge graph embeddings. In: Proceedings of Artificial Neural Networks and Machine Learning, pp. 553–565. Springer (2019)
31.
go back to reference Schlichtkrull, M.; Kipf, T.N.; Bloem, P.; van den Berg, R.; Titov, I.: Modeling relational data with graph convolutional networks. In: Proceedings of Extended Semantic Web Conference, pp. 593–607. Springer (2018) Schlichtkrull, M.; Kipf, T.N.; Bloem, P.; van den Berg, R.; Titov, I.: Modeling relational data with graph convolutional networks. In: Proceedings of Extended Semantic Web Conference, pp. 593–607. Springer (2018)
32.
go back to reference Cai, L.; Yan, B.; Mai, G.; Janowicz, K.; Zhu, R.: TransGCN: coupling transformation assumptions with graph convolutional networks for link prediction. In: International Conference on Knowledge Capture, pp. 131–138. ACM (2019) Cai, L.; Yan, B.; Mai, G.; Janowicz, K.; Zhu, R.: TransGCN: coupling transformation assumptions with graph convolutional networks for link prediction. In: International Conference on Knowledge Capture, pp. 131–138. ACM (2019)
33.
go back to reference Nathani, D.; Chauhan, J.; Sharma, C.; Kaul, M.: Learning attention-based embeddings for relation prediction in knowledge graphs. In: Proceedings of the Association for Computational Linguistics, pp. 4710–4723. ACL (2019) Nathani, D.; Chauhan, J.; Sharma, C.; Kaul, M.: Learning attention-based embeddings for relation prediction in knowledge graphs. In: Proceedings of the Association for Computational Linguistics, pp. 4710–4723. ACL (2019)
34.
go back to reference Shang, C.; Tang, Y.; Huang, J.; Bi, J.; He, X.: End-to-end structure-aware convolutional networks for knowledge base completion. In: International AAAI Conference on Artificial Intelligence, pp. 3060–3067. AAAI (2019) Shang, C.; Tang, Y.; Huang, J.; Bi, J.; He, X.: End-to-end structure-aware convolutional networks for knowledge base completion. In: International AAAI Conference on Artificial Intelligence, pp. 3060–3067. AAAI (2019)
35.
go back to reference Mahdisoltani, F.; Biega, J.; Suchanek, F.M.: Yago3: A knowledge base from multilingual wikipedias. In: Conference on Innovative Data Systems Research. CIDR (2013) Mahdisoltani, F.; Biega, J.; Suchanek, F.M.: Yago3: A knowledge base from multilingual wikipedias. In: Conference on Innovative Data Systems Research. CIDR (2013)
Metadata
Title
Entity-Context and Relation-Context Combined Knowledge Graph Embeddings
Authors
Yong Wu
Wei Li
Xiaoming Fan
Binjun Wang
Publication date
15-07-2021
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 2/2022
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-021-05977-x

Other articles of this Issue 2/2022

Arabian Journal for Science and Engineering 2/2022 Go to the issue

Research Article-Computer Engineering and Computer Science

Multi-Colony Ant Optimization Based on Pheromone Fusion Mechanism of Cooperative Game

Research Article-Computer Engineering and Computer Science

Adiabatic Configurable Reversible Synthesizer for 5G Applications

Premium Partners