Skip to main content
Erschienen in: Computing 12/2020

06.10.2020 | Regular Paper

Enhancing knowledge graph embedding by composite neighbors for link prediction

verfasst von: Kai Wang, Yu Liu, Xiujuan Xu, Quan Z. Sheng

Erschienen in: Computing | Ausgabe 12/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Knowledge graph embedding (KGE) aims to represent entities and relations in a low-dimensional continuous vector space. Recent KGE works focus on incorporating additional information, such as local neighbors and textual descriptions, to learn valuable representations. However, the non-uniformity and redundancy hinder the effectiveness of entity features from those information sources. In this paper, we propose a novel end-to-end framework, called composite neighborhood embedding (CoNE), utilizing composite neighbors to enhance the existing KGE methods. To ease past problems, the new composite neighbors are gathered from both entity descriptions and local neighbors. We design a novel Graph Memory Networks to extract entity features from composite neighbors, and fulfill the entity representation in the target KGE method. The experimental results show that CoNE effectively enhances three different KGE methods, TransE, ConvE, and RotatE, and achieves the state-of-the-art results on four real-world large datasets. Furthermore, our approach outperforms the recent text-enhanced models with fewer parameters and calculation. The source code of our work can be obtained from https://​github.​com/​KyneWang/​CoNE.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bollacker KD, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD international conference on management of data, pp 1247–1250 Bollacker KD, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD international conference on management of data, pp 1247–1250
2.
Zurück zum Zitat Bordes A, Glorot X, Weston J, Bengio Y (2014) A semantic matching energy function for learning with multi-relational data. Mach Learn 94:233–259MathSciNetCrossRef Bordes A, Glorot X, Weston J, Bengio Y (2014) A semantic matching energy function for learning with multi-relational data. Mach Learn 94:233–259MathSciNetCrossRef
3.
Zurück zum Zitat Bordes A, Usunier N, García-Durán A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Proceedings of advances in neural information processing systems (NIPS 2013), pp 2787–2795 Bordes A, Usunier N, García-Durán A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Proceedings of advances in neural information processing systems (NIPS 2013), pp 2787–2795
4.
Zurück zum Zitat Dettmers T, Minervini P, Stenetorp P, Riedel S (2018) Convolutional 2D knowledge graph embeddings. In: Proceedings of the 32th AAAI conference on artificial intelligence, pp 1811–1818 Dettmers T, Minervini P, Stenetorp P, Riedel S (2018) Convolutional 2D knowledge graph embeddings. In: Proceedings of the 32th AAAI conference on artificial intelligence, pp 1811–1818
5.
Zurück zum Zitat Duvenaud DK, Maclaurin D, Aguilera-Iparraguirre J, Gómez-Bombarelli R, Hirzel T, Aspuru-Guzik A, Adams RP (2015) Convolutional networks on graphs for learning molecular fingerprints. In: Proceedings of advances in neural information processing systems (NIPS 2015), pp 2224–2232 Duvenaud DK, Maclaurin D, Aguilera-Iparraguirre J, Gómez-Bombarelli R, Hirzel T, Aspuru-Guzik A, Adams RP (2015) Convolutional networks on graphs for learning molecular fingerprints. In: Proceedings of advances in neural information processing systems (NIPS 2015), pp 2224–2232
6.
Zurück zum Zitat Fan M, Zhou Q, Zheng TF, Grishman R (2017) Distributed representation learning for knowledge graphs with entity descriptions. Pattern Recognit Lett 93:31–37CrossRef Fan M, Zhou Q, Zheng TF, Grishman R (2017) Distributed representation learning for knowledge graphs with entity descriptions. Pattern Recognit Lett 93:31–37CrossRef
7.
Zurück zum Zitat Feng J, Huang M, Yang Y, Zhu X (2016) Gake: Graph aware knowledge embedding. In: Proceedings of the 32th international conference on computational linguistics (COLING 2016), pp 641–651 Feng J, Huang M, Yang Y, Zhu X (2016) Gake: Graph aware knowledge embedding. In: Proceedings of the 32th international conference on computational linguistics (COLING 2016), pp 641–651
8.
Zurück zum Zitat Guo D, Tang D, Duan N, Zhou M, Yin J (2018) Dialog-to-action: conversational question answering over a large-scale knowledge base. In: Proceedings of advances in neural information processing systems (NIPS 2018), pp 2942–2951 Guo D, Tang D, Duan N, Zhou M, Yin J (2018) Dialog-to-action: conversational question answering over a large-scale knowledge base. In: Proceedings of advances in neural information processing systems (NIPS 2018), pp 2942–2951
9.
Zurück zum Zitat Ji G, He S, Xu L, Liu K, Zhao J (2015) Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing, pp 687–696 Ji G, He S, Xu L, Liu K, Zhao J (2015) Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing, pp 687–696
10.
Zurück zum Zitat Ji S, Pan S, Cambria E, Marttinen P, Yu PS (2020) A survey on knowledge graphs: Representation, acquisition and applications. CoRR arXiv:2002.00388 Ji S, Pan S, Cambria E, Marttinen P, Yu PS (2020) A survey on knowledge graphs: Representation, acquisition and applications. CoRR arXiv:​2002.​00388
11.
Zurück zum Zitat Kingma DP, Ba JL (2015) Adam: a method for stochastic optimization. In: Proceedings of international conference on learning representations (ICLR 2015) Kingma DP, Ba JL (2015) Adam: a method for stochastic optimization. In: Proceedings of international conference on learning representations (ICLR 2015)
12.
Zurück zum Zitat Lin Y, Liu Z, Sun M, Liu Y, Zhu X (2015) Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the 29th AAAI conference on artificial intelligence, pp 2181–2187 Lin Y, Liu Z, Sun M, Liu Y, Zhu X (2015) Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the 29th AAAI conference on artificial intelligence, pp 2181–2187
13.
Zurück zum Zitat Miller GA (1995) Wordnet: a lexical database for english. Commun ACM 38:39–41CrossRef Miller GA (1995) Wordnet: a lexical database for english. Commun ACM 38:39–41CrossRef
14.
Zurück zum Zitat Nathani D, Chauhan J, Sharma C, Kaul M (2019) Learning attention-based embeddings for relation prediction in knowledge graphs. In: Proceedings of the 57th conference of the association for computational linguistics, ACL 2019, pp 4710–4723 Nathani D, Chauhan J, Sharma C, Kaul M (2019) Learning attention-based embeddings for relation prediction in knowledge graphs. In: Proceedings of the 57th conference of the association for computational linguistics, ACL 2019, pp 4710–4723
15.
Zurück zum Zitat Nguyen DQ, Nguyen TD, Nguyen DQ, Phung DQ (2017) A novel embedding model for knowledge base completion based on convolutional neural network. In: Proceedings of the 2017 conference of the North American chapter of the Association for Computational Linguistics, vol 2, pp 327–333 Nguyen DQ, Nguyen TD, Nguyen DQ, Phung DQ (2017) A novel embedding model for knowledge base completion based on convolutional neural network. In: Proceedings of the 2017 conference of the North American chapter of the Association for Computational Linguistics, vol 2, pp 327–333
16.
Zurück zum Zitat Nguyen DQ, Vu T, Nguyen TD, Nguyen DQ, Phung DQ (2019) A capsule network-based embedding model for knowledge graph completion and search personalization. In: Proceedings of the 2019 conference of the North American chapter of the Association for Computational Linguistics, NAACL-HLT 2019, pp 2180–2189 Nguyen DQ, Vu T, Nguyen TD, Nguyen DQ, Phung DQ (2019) A capsule network-based embedding model for knowledge graph completion and search personalization. In: Proceedings of the 2019 conference of the North American chapter of the Association for Computational Linguistics, NAACL-HLT 2019, pp 2180–2189
17.
Zurück zum Zitat Nickel M, Tresp V, Kriegel HP (2011) A three-way model for collective learning on multi-relational data. In: Proceedings of the 28th international conference on machine learning, pp 809–816 Nickel M, Tresp V, Kriegel HP (2011) A three-way model for collective learning on multi-relational data. In: Proceedings of the 28th international conference on machine learning, pp 809–816
18.
Zurück zum Zitat Pujara J, Augustine E, Getoor L (2017) Sparsity and noise: where knowledge graph embeddings fall short. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp 1751–1756 Pujara J, Augustine E, Getoor L (2017) Sparsity and noise: where knowledge graph embeddings fall short. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp 1751–1756
19.
Zurück zum Zitat Schlichtkrull MS, Kipf TN, Bloem P, van den Berg R, Titov I, Titov I, Welling M, Welling M (2018) Modeling relational data with graph convolutional networks. In: Proceedings of extended semantic web conference, pp 593–607 Schlichtkrull MS, Kipf TN, Bloem P, van den Berg R, Titov I, Titov I, Welling M, Welling M (2018) Modeling relational data with graph convolutional networks. In: Proceedings of extended semantic web conference, pp 593–607
20.
Zurück zum Zitat Shi J, Gao H, Qi G, Zhou Z (2017) Knowledge graph embedding with triple context. In: Proceedings of the 2017 ACM on conference on information and knowledge management, pp 2299–2302 Shi J, Gao H, Qi G, Zhou Z (2017) Knowledge graph embedding with triple context. In: Proceedings of the 2017 ACM on conference on information and knowledge management, pp 2299–2302
21.
Zurück zum Zitat Socher R, Chen D, Manning CD, Ng AY (2013) Reasoning with neural tensor networks for knowledge base completion. In: Proceedings of advances in neural information processing systems (NIPS 2013), pp 926–934 Socher R, Chen D, Manning CD, Ng AY (2013) Reasoning with neural tensor networks for knowledge base completion. In: Proceedings of advances in neural information processing systems (NIPS 2013), pp 926–934
22.
Zurück zum Zitat Sukhbaatar S, Szlam A, Weston J, Fergus R (2015) End-to-end memory networks. In: Proceedings of advances in neural information processing systems (NIPS 2015), pp 2440–2448 Sukhbaatar S, Szlam A, Weston J, Fergus R (2015) End-to-end memory networks. In: Proceedings of advances in neural information processing systems (NIPS 2015), pp 2440–2448
23.
Zurück zum Zitat Sun Z, Deng Z, Nie J, Tang J (2019) Rotate: Knowledge graph embedding by relational rotation in complex space. In: 7th international conference on learning representations, ICLR 2019 Sun Z, Deng Z, Nie J, Tang J (2019) Rotate: Knowledge graph embedding by relational rotation in complex space. In: 7th international conference on learning representations, ICLR 2019
24.
Zurück zum Zitat Sun Z, Hu W, Zhang Q, Qu Y (2018) Bootstrapping entity alignment with knowledge graph embedding. In: Proceedings of the 26th international joint conference on artificial intelligence, pp 4396–4402 Sun Z, Hu W, Zhang Q, Qu Y (2018) Bootstrapping entity alignment with knowledge graph embedding. In: Proceedings of the 26th international joint conference on artificial intelligence, pp 4396–4402
25.
Zurück zum Zitat Toutanova K, Chen D (2015) Observed versus latent features for knowledge base and text inference. In: Proceedings of the 3rd workshop on continuous vector space models and their compositionality Toutanova K, Chen D (2015) Observed versus latent features for knowledge base and text inference. In: Proceedings of the 3rd workshop on continuous vector space models and their compositionality
26.
Zurück zum Zitat Trouillon T, Welbl J, Riedel S, Gaussier É, Bouchard G (2016) Complex embeddings for simple link prediction. In: Proceedings of the 33th international conference on machine learning, pp 2071–2080 Trouillon T, Welbl J, Riedel S, Gaussier É, Bouchard G (2016) Complex embeddings for simple link prediction. In: Proceedings of the 33th international conference on machine learning, pp 2071–2080
27.
Zurück zum Zitat Wang Q, Mao Z, Wang B, Guo L (2017) Knowledge graph embedding: a survey of approaches and applications. IEEE Trans Knowl Data Eng 29:2724–2743CrossRef Wang Q, Mao Z, Wang B, Guo L (2017) Knowledge graph embedding: a survey of approaches and applications. IEEE Trans Knowl Data Eng 29:2724–2743CrossRef
28.
Zurück zum Zitat Wang Z, Zhang J, Feng J, Chen Z (2014) Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the 28th AAAI conference on artificial intelligence, pp 1112–1119 Wang Z, Zhang J, Feng J, Chen Z (2014) Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the 28th AAAI conference on artificial intelligence, pp 1112–1119
29.
Zurück zum Zitat Weston J, Chopra S, Bordes A (2015) Memory networks. In: Proceedings of international conference on learning representations (ICLR 2015) Weston J, Chopra S, Bordes A (2015) Memory networks. In: Proceedings of international conference on learning representations (ICLR 2015)
30.
31.
Zurück zum Zitat Xie R, Liu Z, Jia J, Luan H, Sun M (2016) Representation learning of knowledge graphs with entity descriptions. In: Proceedings of the 30th AAAI conference on artificial intelligence, pp 2659–2665 Xie R, Liu Z, Jia J, Luan H, Sun M (2016) Representation learning of knowledge graphs with entity descriptions. In: Proceedings of the 30th AAAI conference on artificial intelligence, pp 2659–2665
32.
Zurück zum Zitat Xu J, Qiu X, Chen K, Huang X (2017) Knowledge graph representation with jointly structural and textual encoding. In: Proeedings of the 26th international joint conference on artificial intelligence, pp 1318–1324 Xu J, Qiu X, Chen K, Huang X (2017) Knowledge graph representation with jointly structural and textual encoding. In: Proeedings of the 26th international joint conference on artificial intelligence, pp 1318–1324
33.
Zurück zum Zitat Yang B, tau Yih W, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: Proceedings of international conference on learning representations (ICLR 2015) Yang B, tau Yih W, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: Proceedings of international conference on learning representations (ICLR 2015)
Metadaten
Titel
Enhancing knowledge graph embedding by composite neighbors for link prediction
verfasst von
Kai Wang
Yu Liu
Xiujuan Xu
Quan Z. Sheng
Publikationsdatum
06.10.2020
Verlag
Springer Vienna
Erschienen in
Computing / Ausgabe 12/2020
Print ISSN: 0010-485X
Elektronische ISSN: 1436-5057
DOI
https://doi.org/10.1007/s00607-020-00842-5

Weitere Artikel der Ausgabe 12/2020

Computing 12/2020 Zur Ausgabe

Premium Partner