Skip to main content
Top
Published in: World Wide Web 1/2023

15-02-2022

TransO: a knowledge-driven representation learning method with ontology information constraints

Authors: Zhao Li, Xin Liu, Xin Wang, Pengkai Liu, Yuxin Shen

Published in: World Wide Web | Issue 1/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Representation learning techniques for knowledge graphs (KGs) are crucial for constructing knowledge-driven decisions in complex network data application scenarios. Most existing methods focus mainly on structured information, ignoring the important value of rich ontology information constraints and complements, however, ontology information is the key for building knowledge-driven decision-making processes. In this paper, we propose a novel ontology information constrained knowledge representation learning model, TransO, which can efficiently model relations explicitly and seamlessly incorporate rich ontology information to improve model performance and maintain low model complexity. Moreover, specific constraint strategies are proposed for entity types, relations, and hierarchical information to effectively implement reasoning and completion of KGs and construct knowledge-driven decisions that are more consistent with the logic of human knowledge in complex network applications. The experimental tasks of link prediction and triple classification are performed on two public datasets. The experimental results demonstrate the effectiveness of our proposed method with better performance than state-of-the-art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bollacker, K., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: A collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, SIGMOD’08, pp. 1247–1250. Association for Computing Machinery (2008) Bollacker, K., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: A collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, SIGMOD’08, pp. 1247–1250. Association for Computing Machinery (2008)
2.
go back to reference Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, NIPS’13, pp. 2787—2795. Curran Associates Inc. (2013) Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, NIPS’13, pp. 2787—2795. Curran Associates Inc. (2013)
3.
go back to reference Cai, T., Li, J., Mian, A., Sellis, T., Yu, J.: Target-aware holistic influence maximization in spatial social networks. IEEE Transactions on Knowledge and Data Engineering (2020) Cai, T., Li, J., Mian, A., Sellis, T., Yu, J.: Target-aware holistic influence maximization in spatial social networks. IEEE Transactions on Knowledge and Data Engineering (2020)
4.
go back to reference Chen, J., Zhong, M., Li, J., Wang, D., Qian, T., Tu, H.: Effective deep attributed network representation learning with topology adapted smoothing. IEEE Transactions on Cybernetics PP (2021) Chen, J., Zhong, M., Li, J., Wang, D., Qian, T., Tu, H.: Effective deep attributed network representation learning with topology adapted smoothing. IEEE Transactions on Cybernetics PP (2021)
5.
go back to reference Fan, M., Zhou, Q., Chang, E., Zheng, F.: Transition-based knowledge graph embedding with relational mapping properties. In: Proceedings of the 28th Pacific Asia Conference on Language, Information and Computing, PACLIC’14, pp. 328–337. Department of Linguistics, Chulalongkorn University (2014) Fan, M., Zhou, Q., Chang, E., Zheng, F.: Transition-based knowledge graph embedding with relational mapping properties. In: Proceedings of the 28th Pacific Asia Conference on Language, Information and Computing, PACLIC’14, pp. 328–337. Department of Linguistics, Chulalongkorn University (2014)
6.
go back to reference Guo, S., Wang, Q., Wang, B., Wang, L., Guo, L.: Sse: Semantically smooth embedding for knowledge graphs. IEEE Transactions on Knowledge and Data Engineering 29(4), 884–897 (2017)CrossRef Guo, S., Wang, Q., Wang, B., Wang, L., Guo, L.: Sse: Semantically smooth embedding for knowledge graphs. IEEE Transactions on Knowledge and Data Engineering 29(4), 884–897 (2017)CrossRef
7.
go back to reference Han, X., Cao, S., Xin, L., Lin, Y., Liu, Z., Sun, M., Li, J.: Openke: An open toolkit for knowledge embedding. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP’18, pp. 139–144. Association for Computational Linguistics (2018) Han, X., Cao, S., Xin, L., Lin, Y., Liu, Z., Sun, M., Li, J.: Openke: An open toolkit for knowledge embedding. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP’18, pp. 139–144. Association for Computational Linguistics (2018)
8.
go back to reference Hao, J., Chen, M., Yu, W., Sun, Y., Wang, W.: Universal representation learning of knowledge bases by jointly embedding instances and ontological concepts. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD’19, pp. 1709–1719. Association for Computing Machinery (2019) Hao, J., Chen, M., Yu, W., Sun, Y., Wang, W.: Universal representation learning of knowledge bases by jointly embedding instances and ontological concepts. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD’19, pp. 1709–1719. Association for Computing Machinery (2019)
9.
go back to reference Huang, Y., Zhao, F., Gui, X., Jin, H.: Path-enhanced explainable recommendation with knowledge graphs. World Wide Web 24(5), 1769–1789 (2021)CrossRef Huang, Y., Zhao, F., Gui, X., Jin, H.: Path-enhanced explainable recommendation with knowledge graphs. World Wide Web 24(5), 1769–1789 (2021)CrossRef
10.
go back to reference Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, ACL’15, pp. 687–696. Association for Computational Linguistics (2015) Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, ACL’15, pp. 687–696. Association for Computational Linguistics (2015)
11.
go back to reference Ji, S., Pan, S., Cambria, E., Marttinen, P., Yu, P.S.: A survey on knowledge graphs: Representation, acquisition, and applications. IEEE Transactions on Neural Networks and Learning Systems pp. 1–21 (2021) Ji, S., Pan, S., Cambria, E., Marttinen, P., Yu, P.S.: A survey on knowledge graphs: Representation, acquisition, and applications. IEEE Transactions on Neural Networks and Learning Systems pp. 1–21 (2021)
12.
go back to reference Kazemi, S.M., Poole, D.: Simple embedding for link prediction in knowledge graphs. In: Proceedings of the 32nd Conference on Neural Information Processing Systems, NeurIPS’18, pp. 4284–4295. Curran Associates, Inc. (2018) Kazemi, S.M., Poole, D.: Simple embedding for link prediction in knowledge graphs. In: Proceedings of the 32nd Conference on Neural Information Processing Systems, NeurIPS’18, pp. 4284–4295. Curran Associates, Inc. (2018)
13.
go back to reference Li, Z., Wang, X., Li, J., Zhang, Q.: Deep attributed network representation learning of complex coupling and interaction. Knowledge-Based Systems 212, 106618 (2021)CrossRef Li, Z., Wang, X., Li, J., Zhang, Q.: Deep attributed network representation learning of complex coupling and interaction. Knowledge-Based Systems 212, 106618 (2021)CrossRef
14.
go back to reference Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, AAAI’15, pp. 2181–2187. AAAI Press (2015) Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, AAAI’15, pp. 2181–2187. AAAI Press (2015)
15.
go back to reference Lv, X., Hou, L., Li, J., Liu, Z.: Differentiating concepts and instances for knowledge graph embedding. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP’18, pp. 1971–1979. Association for Computational Linguistics, Brussels, Belgium (2018) Lv, X., Hou, L., Li, J., Liu, Z.: Differentiating concepts and instances for knowledge graph embedding. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP’18, pp. 1971–1979. Association for Computational Linguistics, Brussels, Belgium (2018)
16.
go back to reference Nickel, M., Rosasco, L., Poggio, T.: Holographic embeddings of knowledge graphs. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, AAAI’16, pp. 1955–1961. AAAI Press (2016) Nickel, M., Rosasco, L., Poggio, T.: Holographic embeddings of knowledge graphs. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, AAAI’16, pp. 1955–1961. AAAI Press (2016)
17.
go back to reference Nickel, M., Tresp, V., Kriegel, H.P.: A three-way model for collective learning on multi-relational data. In: Proceedings of the 28th International Conference on Machine Learning, ICML’11, pp. 809–816. Omnipress (2011) Nickel, M., Tresp, V., Kriegel, H.P.: A three-way model for collective learning on multi-relational data. In: Proceedings of the 28th International Conference on Machine Learning, ICML’11, pp. 809–816. Omnipress (2011)
18.
go back to reference Niu, L., Fu, C., Yang, Q., Li, Z., Chen, Z., Liu, Q., Zheng, K.: Open-world knowledge graph completion with multiple interaction attention. World Wide Web 24(1), 419–439 (2021)CrossRef Niu, L., Fu, C., Yang, Q., Li, Z., Chen, Z., Liu, Q., Zheng, K.: Open-world knowledge graph completion with multiple interaction attention. World Wide Web 24(1), 419–439 (2021)CrossRef
19.
go back to reference Shen, Y., Li, Z., Wang, X., Li, J., Zhang, X.: Datatype-aware knowledge graph representation learning in hyperbolic space. In: Proceedings of the 30th ACM International Conference On Information & Knowledge Management, CIKM’21, pp. 1630–1639. Association for Computing Machinery (2021) Shen, Y., Li, Z., Wang, X., Li, J., Zhang, X.: Datatype-aware knowledge graph representation learning in hyperbolic space. In: Proceedings of the 30th ACM International Conference On Information & Knowledge Management, CIKM’21, pp. 1630–1639. Association for Computing Machinery (2021)
20.
go back to reference Socher, R., Chen, D., Manning, C.D., Ng, A.Y.: Reasoning with neural tensor networks for knowledge base completion. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, NIPS’13, pp. 926–934. Curran Associates Inc. (2013) Socher, R., Chen, D., Manning, C.D., Ng, A.Y.: Reasoning with neural tensor networks for knowledge base completion. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, NIPS’13, pp. 926–934. Curran Associates Inc. (2013)
21.
go back to reference Trouillon, T., Welbl, J., Riedel, S., Gaussier, E., Bouchard, G.: Complex embeddings for simple link prediction. In: Proceedings of the 33rd International Conference on International Conference on Machine Learning, ICML’16, pp. 2071–2080. JMLR.org (2016) Trouillon, T., Welbl, J., Riedel, S., Gaussier, E., Bouchard, G.: Complex embeddings for simple link prediction. In: Proceedings of the 33rd International Conference on International Conference on Machine Learning, ICML’16, pp. 2071–2080. JMLR.org (2016)
22.
go back to reference Wan, G., Du, B., Pan, S., Wu, J.: Adaptive knowledge subgraph ensemble for robust and trustworthy knowledge graph completion. World Wide Web 23(1), 471–490 (2020)CrossRef Wan, G., Du, B., Pan, S., Wu, J.: Adaptive knowledge subgraph ensemble for robust and trustworthy knowledge graph completion. World Wide Web 23(1), 471–490 (2020)CrossRef
23.
go back to reference Wang, Q., Wang, B., Guo, L.: Knowledge base completion using embeddings and rules. In: Proceedings of the 24th International Conference on Artificial Intelligence, IJCAI’15, pp. 1859–1865. AAAI Press (2015) Wang, Q., Wang, B., Guo, L.: Knowledge base completion using embeddings and rules. In: Proceedings of the 24th International Conference on Artificial Intelligence, IJCAI’15, pp. 1859–1865. AAAI Press (2015)
24.
go back to reference Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, AAAI’14, pp. 1112–1119. AAAI Press (2014) Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, AAAI’14, pp. 1112–1119. AAAI Press (2014)
25.
go back to reference Wang, Q., Mao, Z., Wang, B., Guo, L.: Knowledge graph embedding: A survey of approaches and applications. IEEE Transactions on Knowledge and Data Engineering 29(12), 2724–2743 (2017)CrossRef Wang, Q., Mao, Z., Wang, B., Guo, L.: Knowledge graph embedding: A survey of approaches and applications. IEEE Transactions on Knowledge and Data Engineering 29(12), 2724–2743 (2017)CrossRef
26.
go back to reference Xie, R., Liu, Z., Sun, M.: Representation learning of knowledge graphs with hierarchical types. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence, IJCAI’16, pp. 2965–2971. International Joint Conferences on Artificial Intelligence Organization (2016) Xie, R., Liu, Z., Sun, M.: Representation learning of knowledge graphs with hierarchical types. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence, IJCAI’16, pp. 2965–2971. International Joint Conferences on Artificial Intelligence Organization (2016)
27.
go back to reference Xie, Y., Yu, B., Lv, S., Zhang, C., Wang, G., Gong, M.: A survey on heterogeneous network representation learning. Pattern Recognition 116, 107936 (2021)CrossRef Xie, Y., Yu, B., Lv, S., Zhang, C., Wang, G., Gong, M.: A survey on heterogeneous network representation learning. Pattern Recognition 116, 107936 (2021)CrossRef
29.
go back to reference Yang, Y., Guan, Z., Li, J., Zhao, W., Cui, J., Wang, Q.: Interpretable and efficient heterogeneous graph convolutional network. IEEE Transactions on Knowledge and Data Engineering (2021) Yang, Y., Guan, Z., Li, J., Zhao, W., Cui, J., Wang, Q.: Interpretable and efficient heterogeneous graph convolutional network. IEEE Transactions on Knowledge and Data Engineering (2021)
30.
go back to reference Yang, C., Xiao, Y., Zhang, Y., Sun, Y., Han, J.: Heterogeneous network representation learning: A unified framework with survey and benchmark. IEEE Transactions on Knowledge and Data Engineering pp. 1–1 (2020) Yang, C., Xiao, Y., Zhang, Y., Sun, Y., Han, J.: Heterogeneous network representation learning: A unified framework with survey and benchmark. IEEE Transactions on Knowledge and Data Engineering pp. 1–1 (2020)
31.
go back to reference Yang, B., Yih, S.W.t., He, X., Gao, J., Deng, L.: Embedding entities and relations for learning and inference in knowledge bases. In: Proceedings of the third International Conference on Learning Representations, ICLR’15, pp. 809–816 (2015) Yang, B., Yih, S.W.t., He, X., Gao, J., Deng, L.: Embedding entities and relations for learning and inference in knowledge bases. In: Proceedings of the third International Conference on Learning Representations, ICLR’15, pp. 809–816 (2015)
32.
go back to reference Zhang, F., Wang, X., Li, Z., Li, J.: Transrhs: A representation learning method for knowledge graphs with relation hierarchical structure. In: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI’20, pp. 2987–2993. International Joint Conferences on Artificial Intelligence Organization (2020) Zhang, F., Wang, X., Li, Z., Li, J.: Transrhs: A representation learning method for knowledge graphs with relation hierarchical structure. In: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI’20, pp. 2987–2993. International Joint Conferences on Artificial Intelligence Organization (2020)
33.
go back to reference Zhang, Z., Zhuang, F., Qu, M., Lin, F., He, Q.: Knowledge graph embedding with hierarchical relation structure. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP’18, pp. 3198–3207. Association for Computational Linguistics (2018) Zhang, Z., Zhuang, F., Qu, M., Lin, F., He, Q.: Knowledge graph embedding with hierarchical relation structure. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP’18, pp. 3198–3207. Association for Computational Linguistics (2018)
34.
go back to reference Zheng, S., Guan, D., Yuan, W.: Semantic-aware heterogeneous information network embedding with incompatible meta-paths. World Wide Web pp. 1–21 (2021) Zheng, S., Guan, D., Yuan, W.: Semantic-aware heterogeneous information network embedding with incompatible meta-paths. World Wide Web pp. 1–21 (2021)
Metadata
Title
TransO: a knowledge-driven representation learning method with ontology information constraints
Authors
Zhao Li
Xin Liu
Xin Wang
Pengkai Liu
Yuxin Shen
Publication date
15-02-2022
Publisher
Springer US
Published in
World Wide Web / Issue 1/2023
Print ISSN: 1386-145X
Electronic ISSN: 1573-1413
DOI
https://doi.org/10.1007/s11280-022-01016-3

Other articles of this Issue 1/2023

World Wide Web 1/2023 Go to the issue

Premium Partner