Skip to main content
Top
Published in: World Wide Web 5/2023

30-03-2023

A performant and incremental algorithm for knowledge graph entity typing

Authors: Zepeng Li, Rikui Huang, Minyu Zhai, Zhenwen Zhang, Bin Hu

Published in: World Wide Web | Issue 5/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Knowledge Graph Entity Typing (KGET) is a subtask of knowledge graph completion, which aims at inferring missing entity types by utilizing existing type knowledge and triple knowledge of the knowledge graph. Previous knowledge graph embedding (KGE) algorithms infer entity types through trained entity embeddings. However, for new unseen entities, KGE models encounter obstacles in inferring their types. In addition, it is also difficult for KGE models to improve the performance incrementally with the increase of added data. In this paper, we propose a statistic-based KGET algorithm which aims to take both performance and incrementality into consideration. The algorithm aggregates the neighborhood information and type co-occurrence information of target entities to infer their types. Specifically, we first compute the type probability distribution of the target entity in the semantic context of given fact triple. Then the probability information of fact triples involved in the target entity is aggregated. In addition to local neighborhood information, we also consider capturing global type co-occurrence information for target entities to enhance inference performance. Extensive experiments show that our algorithm outperforms previous statistics-based KGET algorithms and even some KGE models. Finally, we design an incremental inference experiment, which verifies the superiority of our algorithm in predicting the types of new entities, and the experiment also verifies that our algorithm has excellent incremental property.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Guo, Q., Zhuang, F., Qin, C., Zhu, H., Xie, X., Xiong, H., He, Q.: A survey on knowledge graph-based recommender systems. IEEE Transactions on Knowledge and Data Engineering (Early Access) (2020) Guo, Q., Zhuang, F., Qin, C., Zhu, H., Xie, X., Xiong, H., He, Q.: A survey on knowledge graph-based recommender systems. IEEE Transactions on Knowledge and Data Engineering (Early Access) (2020)
2.
go back to reference Xiong, H., Wang, S., Tang, M., Wang, L., Lin, X.: Knowledge graph question answering with semantic oriented fusion model. Knowl.-Based Syst. 221, 106954 (2021)CrossRef Xiong, H., Wang, S., Tang, M., Wang, L., Lin, X.: Knowledge graph question answering with semantic oriented fusion model. Knowl.-Based Syst. 221, 106954 (2021)CrossRef
3.
go back to reference Ji, S., Pan, S., Cambria, E., Marttinen, P., Philip, S.Y.: A survey on knowledge graphs: Representation, acquisition, and applications. IEEE Trans. Neural Netw. Learn. Syst. 1–21 (2021) Ji, S., Pan, S., Cambria, E., Marttinen, P., Philip, S.Y.: A survey on knowledge graphs: Representation, acquisition, and applications. IEEE Trans. Neural Netw. Learn. Syst. 1–21 (2021)
4.
go back to reference Sun, Y., Wang, S., Feng, S., Ding, S., Pang, C., Shang, J., Liu, J., Chen, X., Zhao, Y., Lu, Y., Liu, W., Wu, Z., Gong, W., Liang, J., Shang, Z., Sun, P., Liu, W., Ouyang, X., Yu, D., Tian, H., Wu, H., Wang, H.: ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation (2021) Sun, Y., Wang, S., Feng, S., Ding, S., Pang, C., Shang, J., Liu, J., Chen, X., Zhao, Y., Lu, Y., Liu, W., Wu, Z., Gong, W., Liang, J., Shang, Z., Sun, P., Liu, W., Ouyang, X., Yu, D., Tian, H., Wu, H., Wang, H.: ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation (2021)
5.
go back to reference Hamilton, W. L., Ying, R., Leskovec, J.: Inductive representation learning on large graphs. In: Annual Conference on Neural Information Processing Systems (NeurIPS), pp. 1025–1035 (2017) Hamilton, W. L., Ying, R., Leskovec, J.: Inductive representation learning on large graphs. In: Annual Conference on Neural Information Processing Systems (NeurIPS), pp. 1025–1035 (2017)
6.
go back to reference Teru, K., Denis, E., Hamilton, W.: Inductive relation prediction by subgraph reasoning. In: International Conference on Machine Learning (ICML), pp. 9448–9457 (2020) Teru, K., Denis, E., Hamilton, W.: Inductive relation prediction by subgraph reasoning. In: International Conference on Machine Learning (ICML), pp. 9448–9457 (2020)
7.
go back to reference Zhang, Y., Wang, W., Chen, W., Xu, J., Liu, A., Zhao, L.: Meta-learning based hyper-relation feature modeling for out-of-knowledge-base embedding. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management (CIKM), pp. 2637–2646 (2021) Zhang, Y., Wang, W., Chen, W., Xu, J., Liu, A., Zhao, L.: Meta-learning based hyper-relation feature modeling for out-of-knowledge-base embedding. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management (CIKM), pp. 2637–2646 (2021)
8.
go back to reference Chen, M., Zhang, W., Zhu, Y., Zhou, H., Yuan, Z., Xu, C., Chen, H.: Meta-knowledge transfer for inductive knowledge graph embedding. arXiv:2110.14170 (2022) Chen, M., Zhang, W., Zhu, Y., Zhou, H., Yuan, Z., Xu, C., Chen, H.: Meta-knowledge transfer for inductive knowledge graph embedding. arXiv:2110.​14170 (2022)
9.
go back to reference Zhao, Y., Zhang, A., Xie, R., Liu, K., Wang, X.: Connecting embeddings for knowledge graph entity typing. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pp. 6419–6428 (2020) Zhao, Y., Zhang, A., Xie, R., Liu, K., Wang, X.: Connecting embeddings for knowledge graph entity typing. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pp. 6419–6428 (2020)
10.
go back to reference Kellou-Menouer, K., Kardoulakis, N., Troullinou, G., Kedad, Z., Plexousakis, D., Kondylakis, H.: A survey on semantic schema discovery. The VLDB J.,1–36 (2021) Kellou-Menouer, K., Kardoulakis, N., Troullinou, G., Kedad, Z., Plexousakis, D., Kondylakis, H.: A survey on semantic schema discovery. The VLDB J.,1–36 (2021)
11.
go back to reference Paulheim, H., Bizer, C.: Type inference on noisy RDF data. In: International Semantic Web Conference, pp. 510–525. Springer (2013) Paulheim, H., Bizer, C.: Type inference on noisy RDF data. In: International Semantic Web Conference, pp. 510–525. Springer (2013)
12.
go back to reference Krompaß, D., Baier, S., Tresp, V.: Type-constrained representation learning in knowledge graphs. In: Proceedings of the International Semantic Web Conference (ISWC), pp. 640–655 (2015) Krompaß, D., Baier, S., Tresp, V.: Type-constrained representation learning in knowledge graphs. In: Proceedings of the International Semantic Web Conference (ISWC), pp. 640–655 (2015)
13.
go back to reference Krompaß, D., Nickel, M., Tresp, V.: Large-scale factorization of type-constrained multi-relational data. In: Proceedings of the International Conference on Data Science and Advanced Analytics (DSAA), pp. 18–24 (2014) Krompaß, D., Nickel, M., Tresp, V.: Large-scale factorization of type-constrained multi-relational data. In: Proceedings of the International Conference on Data Science and Advanced Analytics (DSAA), pp. 18–24 (2014)
14.
go back to reference Fang, L., Miao, Q., Meng, Y.: Dbpedia entity type inference using categories. In: International Semantic Web Conference (Posters & Demos) (2016) Fang, L., Miao, Q., Meng, Y.: Dbpedia entity type inference using categories. In: International Semantic Web Conference (Posters & Demos) (2016)
15.
go back to reference Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. Adv. Neural Inf. Process. Syst. 26, 2787–2795 (2013) Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. Adv. Neural Inf. Process. Syst. 26, 2787–2795 (2013)
16.
go back to reference Nickel, M., Rosasco, L., Poggio, T.: Holographic embeddings of knowledge graphs. In: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), vol. 30, pp. 1955–1961 (2016) Nickel, M., Rosasco, L., Poggio, T.: Holographic embeddings of knowledge graphs. In: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), vol. 30, pp. 1955–1961 (2016)
17.
go back to reference Nickel, M., Tresp, V., Kriegel, H.-P.: A three-way model for collective learning on multi-relational data. In: Proceedings of the International Conference on Machine Learning (ICML), pp. 809–816 (2011) Nickel, M., Tresp, V., Kriegel, H.-P.: A three-way model for collective learning on multi-relational data. In: Proceedings of the International Conference on Machine Learning (ICML), pp. 809–816 (2011)
18.
go back to reference Dettmers, T., Minervini, P., Stenetorp, P., Riedel, S.: Convolutional 2D knowledge graph embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), vol. 32, pp. 1811–1818 (2018) Dettmers, T., Minervini, P., Stenetorp, P., Riedel, S.: Convolutional 2D knowledge graph embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), vol. 32, pp. 1811–1818 (2018)
19.
go back to reference Sun, Z., Deng, Z.-H., Nie, J.-Y., Tang, J.: Rotate: Knowledge graph embedding by relational rotation in complex space. In: International Conference on Learning Representations (ICLR) (2019) Sun, Z., Deng, Z.-H., Nie, J.-Y., Tang, J.: Rotate: Knowledge graph embedding by relational rotation in complex space. In: International Conference on Learning Representations (ICLR) (2019)
20.
go back to reference Moon, C., Jones, P., Samatova, N.F.: Learning entity type embeddings for knowledge graph completion. In: Proceedings of the International Conference on Information and Knowledge Management (CIKM), pp. 2215–2218 (2017) Moon, C., Jones, P., Samatova, N.F.: Learning entity type embeddings for knowledge graph completion. In: Proceedings of the International Conference on Information and Knowledge Management (CIKM), pp. 2215–2218 (2017)
21.
go back to reference Pan, W., Wei, W., Mao, X.-L.: Context-aware entity typing in knowledge graphs. In: Findings of the Association for Computational Linguistics: EMNLP 2021, pp. 2240–2250 (2021) Pan, W., Wei, W., Mao, X.-L.: Context-aware entity typing in knowledge graphs. In: Findings of the Association for Computational Linguistics: EMNLP 2021, pp. 2240–2250 (2021)
23.
go back to reference Zhuo, J., Zhu, Q., Yue, Y., Zhao, Y., Han, W.: A neighborhood-attention fine-grained entity typing for knowledge graph completion. In: Proceedings of the 15th ACM International Conference on Web Search and Data Mining. WSDM ’22, pp. 1525–1533. Association for Computing Machinery (2022) https://doi.org/10.1145/3488560.3498395 Zhuo, J., Zhu, Q., Yue, Y., Zhao, Y., Han, W.: A neighborhood-attention fine-grained entity typing for knowledge graph completion. In: Proceedings of the 15th ACM International Conference on Web Search and Data Mining. WSDM ’22, pp. 1525–1533. Association for Computing Machinery (2022) https://​doi.​org/​10.​1145/​3488560.​3498395
24.
go back to reference Zou, C., An, J., Li, G.: Knowledge graph entity type prediction with relational aggregation graph attention network. In: The Semantic Web: 19th International Conference, ESWC 2022, Hersonissos, Crete, Greece, May 29 – June 2, 2022, Proceedings, pp. 39–55. Springer (2022). https://doi.org/10.1007/978-3-031-06981-9_3 Zou, C., An, J., Li, G.: Knowledge graph entity type prediction with relational aggregation graph attention network. In: The Semantic Web: 19th International Conference, ESWC 2022, Hersonissos, Crete, Greece, May 29 – June 2, 2022, Proceedings, pp. 39–55. Springer (2022). https://​doi.​org/​10.​1007/​978-3-031-06981-9_​3
25.
go back to reference Kardoulakis, N., Kellou-Menouer, K., Troullinou, G., Kedad, Z., Plexousakis, D., Kondylakis, H.: Hint: Hybrid and incremental type discovery for large RDF data sources. In: 33rd International Conference on Scientific and Statistical Database Management, pp. 97–108 (2021) Kardoulakis, N., Kellou-Menouer, K., Troullinou, G., Kedad, Z., Plexousakis, D., Kondylakis, H.: Hint: Hybrid and incremental type discovery for large RDF data sources. In: 33rd International Conference on Scientific and Statistical Database Management, pp. 97–108 (2021)
26.
go back to reference Bollacker, K., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the International Conference on Management of Data (SIGMOD), pp. 1247–1250 (2008) Bollacker, K., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the International Conference on Management of Data (SIGMOD), pp. 1247–1250 (2008)
27.
go back to reference Suchanek, F.M., Kasneci, G., Weikum, G.: Yago: a core of semantic knowledge. In: Proceedings of the World Wide Web Conference (WWW), pp. 697–706 (2007) Suchanek, F.M., Kasneci, G., Weikum, G.: Yago: a core of semantic knowledge. In: Proceedings of the World Wide Web Conference (WWW), pp. 697–706 (2007)
Metadata
Title
A performant and incremental algorithm for knowledge graph entity typing
Authors
Zepeng Li
Rikui Huang
Minyu Zhai
Zhenwen Zhang
Bin Hu
Publication date
30-03-2023
Publisher
Springer US
Published in
World Wide Web / Issue 5/2023
Print ISSN: 1386-145X
Electronic ISSN: 1573-1413
DOI
https://doi.org/10.1007/s11280-023-01155-1

Other articles of this Issue 5/2023

World Wide Web 5/2023 Go to the issue

Premium Partner