Skip to main content
Top
Published in: Data Mining and Knowledge Discovery 4/2023

01-07-2023

One-shot relational learning for extrapolation reasoning on temporal knowledge graphs

Authors: Ruixin Ma, Biao Mei, Yunlong Ma, Hongyan Zhang, Meihong Liu, Liang Zhao

Published in: Data Mining and Knowledge Discovery | Issue 4/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In recent years, temporal knowledge graph reasoning has been a critical task in natural language processing. Temporal knowledge graphs store temporal facts that model dynamic relationships or interactions between entities along the timeline. Most existing temporal knowledge graph reasoning methods need a large number of training instances (i.e. support entity facts) for each relation. However, the same as traditional knowledge graphs, temporal knowledge graphs also exhibit long-tailed relational frequency distribution, in which most relationships often do not have many support entity pairs for training. To address this problem, in this paper, we propose a one-shot learning framework (OSLT) applied to temporal knowledge graph link prediction, which aims to predict new relational facts with only one support instance. Specifically, OSLT employs an fact encoder based on Temporal Convolutional Network to encode historical information and model connection of facts at the same timestamp by the aggregator with an attention mechanism. After that, a matching network is employed to compute the similarity score between support fact and query fact. Experiments show that the proposed method outperforms the state-of-the-art baselines on two benchmark datasets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Abboud R, Ceylan I, Lukasiewicz T, Salvatori T (2020) Boxe: A box embedding model for knowledge base completion. In: Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H (eds) Advances in Neural Information Processing Systems, vol 33. Curran Associates, Canada, pp 9649–9661 Abboud R, Ceylan I, Lukasiewicz T, Salvatori T (2020) Boxe: A box embedding model for knowledge base completion. In: Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H (eds) Advances in Neural Information Processing Systems, vol 33. Curran Associates, Canada, pp 9649–9661
go back to reference Bai S, Kolter JZ, Koltun V (2018) An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. CoRR arXiv:1803.01271 Bai S, Kolter JZ, Koltun V (2018) An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. CoRR arXiv:​1803.​01271
go back to reference Bordes A, Usunier N, García-Durán A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013, Lake Tahoe, pp. 2787–2795 Bordes A, Usunier N, García-Durán A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013, Lake Tahoe, pp. 2787–2795
go back to reference Chen J, Chen J, Yu Z (2019) Incorporating structured commonsense knowledge in story completion. Proceedings of the AAAI Conference on Artificial Intelligence, 6244–6251 Chen J, Chen J, Yu Z (2019) Incorporating structured commonsense knowledge in story completion. Proceedings of the AAAI Conference on Artificial Intelligence, 6244–6251
go back to reference Chen M, Zhang W, Zhang W, Chen Q, Chen H (2019) Meta relational learning for few-shot link prediction in knowledge graphs. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp. 4216–4225. Association for Computational Linguistics, Hong Kong Chen M, Zhang W, Zhang W, Chen Q, Chen H (2019) Meta relational learning for few-shot link prediction in knowledge graphs. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp. 4216–4225. Association for Computational Linguistics, Hong Kong
go back to reference Dasgupta SS, Ray SN, Talukdar PP (2018) Hyte: Hyperplane-based temporally aware knowledge graph embedding. In: Riloff E, Chiang D, Hockenmaier J, Tsujii J (eds.) Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 2001–2011. Association for Computational Linguistics, Brussels Dasgupta SS, Ray SN, Talukdar PP (2018) Hyte: Hyperplane-based temporally aware knowledge graph embedding. In: Riloff E, Chiang D, Hockenmaier J, Tsujii J (eds.) Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 2001–2011. Association for Computational Linguistics, Brussels
go back to reference Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: Proceedings of the 34th International Conference on Machine Learning, ICML 2017. Proceedings of Machine Learning Research, vol. 70, pp. 1126–1135. PMLR, Sydney Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: Proceedings of the 34th International Conference on Machine Learning, ICML 2017. Proceedings of Machine Learning Research, vol. 70, pp. 1126–1135. PMLR, Sydney
go back to reference García-Durán A, Dumancic S, Niepert M (2018) Learning sequence encoders for temporal knowledge graph completion. In: Riloff E, Chiang D, Hockenmaier J, Tsujii J (eds.) Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 4816–4821. Association for Computational Linguistics, Brussels García-Durán A, Dumancic S, Niepert M (2018) Learning sequence encoders for temporal knowledge graph completion. In: Riloff E, Chiang D, Hockenmaier J, Tsujii J (eds.) Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 4816–4821. Association for Computational Linguistics, Brussels
go back to reference Hao J, Ju CJ-, Chen M, Sun Y, Zaniolo C, Wang W (2020) Bio-joie: Joint representation learning of biological knowledge bases. In: International Conference on Bioinformatics, Computational Biology and Health Informatics, pp. 42–14210. ACM, USA Hao J, Ju CJ-, Chen M, Sun Y, Zaniolo C, Wang W (2020) Bio-joie: Joint representation learning of biological knowledge bases. In: International Conference on Bioinformatics, Computational Biology and Health Informatics, pp. 42–14210. ACM, USA
go back to reference He H, Balakrishnan A, Eric M, Liang P (2017) Learning symmetric collaborative dialogue agents with dynamic knowledge graph embeddings. CoRR arXiv:1704.07130 He H, Balakrishnan A, Eric M, Liang P (2017) Learning symmetric collaborative dialogue agents with dynamic knowledge graph embeddings. CoRR arXiv:​1704.​07130
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778. IEEE Computer Society, Las Vegas He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778. IEEE Computer Society, Las Vegas
go back to reference Jiang T, Liu T, Ge T, Sha L, Chang B, Li S, Sui Z (2016) Towards time-aware knowledge graph completion. In: Calzolari N, Matsumoto Y, Prasad R (eds.) COLING 2016, 26th International Conference on Computational Linguistics, Proceedings of the Conference: Technical Papers, pp. 1715–1724. ACL, Osaka Jiang T, Liu T, Ge T, Sha L, Chang B, Li S, Sui Z (2016) Towards time-aware knowledge graph completion. In: Calzolari N, Matsumoto Y, Prasad R (eds.) COLING 2016, 26th International Conference on Computational Linguistics, Proceedings of the Conference: Technical Papers, pp. 1715–1724. ACL, Osaka
go back to reference Jin W, Zhang C, Szekely PA, Ren X (2019) Recurrent event network for reasoning over temporal knowledge graphs. CoRR Jin W, Zhang C, Szekely PA, Ren X (2019) Recurrent event network for reasoning over temporal knowledge graphs. CoRR
go back to reference Koren Y, Bell RM, Volinsky C (2018) Matrix factorization techniques for recommender systems. Comput. Inf. Sci. 11(2):1–10 Koren Y, Bell RM, Volinsky C (2018) Matrix factorization techniques for recommender systems. Comput. Inf. Sci. 11(2):1–10
go back to reference Leblay J, Chekol MW (2018) Deriving validity time in knowledge graph. In: Champin P, Gandon F, Lalmas M, Ipeirotis PG (eds) Companion of the The Web Conference 2018. ACM, Lyon, pp 1771–1776 Leblay J, Chekol MW (2018) Deriving validity time in knowledge graph. In: Champin P, Gandon F, Lalmas M, Ipeirotis PG (eds) Companion of the The Web Conference 2018. ACM, Lyon, pp 1771–1776
go back to reference Leetaru K, Schrodt PA (2013) Gdelt: Global data on events, location, and tone, 1979–2012. In: ISA Annual Convention, vol. 2, pp. 1–49. Citeseer Leetaru K, Schrodt PA (2013) Gdelt: Global data on events, location, and tone, 1979–2012. In: ISA Annual Convention, vol. 2, pp. 1–49. Citeseer
go back to reference Liu Z, Xiong C, Sun M, Liu Z (2018) Entity-duet neural ranking: Understanding the role of knowledge graph semantics in neural information retrieval. In: Gurevych I, Miyao Y (eds.) Proceedings of the 56th Annual Meeting of Th Association for Computational Linguistics, pp. 2395–2405. ACL, Melbourne Liu Z, Xiong C, Sun M, Liu Z (2018) Entity-duet neural ranking: Understanding the role of knowledge graph semantics in neural information retrieval. In: Gurevych I, Miyao Y (eds.) Proceedings of the 56th Annual Meeting of Th Association for Computational Linguistics, pp. 2395–2405. ACL, Melbourne
go back to reference Mirtaheri M, Rostami M, Ren X, Morstatter F, Galstyan A (2021) One-shot learning for temporal knowledge graphs. In: Chen D, Berant J, McCallum A, Singh S (eds) 3rd Conference on Automated Knowledge Base Construction. AKBC, Virtual Mirtaheri M, Rostami M, Ren X, Morstatter F, Galstyan A (2021) One-shot learning for temporal knowledge graphs. In: Chen D, Berant J, McCallum A, Singh S (eds) 3rd Conference on Automated Knowledge Base Construction. AKBC, Virtual
go back to reference Ravi S, Larochelle H (2017) Optimization as a model for few-shot learning. In: 5th International Conference on Learning Representations, ICLR 2017. OpenReview.net, Toulon Ravi S, Larochelle H (2017) Optimization as a model for few-shot learning. In: 5th International Conference on Learning Representations, ICLR 2017. OpenReview.net, Toulon
go back to reference Salimans T, Kingma DP (2016) Weight normalization: A simple reparameterization to accelerate training of deep neural networks. In: Lee DD, Sugiyama M, von Luxburg U, Guyon I, Garnett R (eds.) Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems, Barcelona, p. 901 Salimans T, Kingma DP (2016) Weight normalization: A simple reparameterization to accelerate training of deep neural networks. In: Lee DD, Sugiyama M, von Luxburg U, Guyon I, Garnett R (eds.) Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems, Barcelona, p. 901
go back to reference Schlichtkrull MS, Kipf TN, Bloem P, van den Berg R, Titov I, Welling M (2018) Modeling relational data with graph convolutional networks. The Semantic Web - 15th International Conference, ESWC 2018, vol 10843. Springer, Heraklion, pp 593–607 Schlichtkrull MS, Kipf TN, Bloem P, van den Berg R, Titov I, Welling M (2018) Modeling relational data with graph convolutional networks. The Semantic Web - 15th International Conference, ESWC 2018, vol 10843. Springer, Heraklion, pp 593–607
go back to reference Snell J, Swersky K, Zemel RS (2017) Prototypical networks for few-shot learning. In: Guyon I, von Luxburg U, Bengio S, Wallach HM, Fergus R, Vishwanathan SVN, Garnett R (eds.) Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, Long Beach, pp. 4077–4087 Snell J, Swersky K, Zemel RS (2017) Prototypical networks for few-shot learning. In: Guyon I, von Luxburg U, Bengio S, Wallach HM, Fergus R, Vishwanathan SVN, Garnett R (eds.) Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, Long Beach, pp. 4077–4087
go back to reference Sun Z, Deng Z, Nie J, Tang J (2019) Rotate: Knowledge graph embedding by relational rotation in complex space. In: 7th International Conference on Learning Representations, ICLR 2019. OpenReview.net, New Orleans Sun Z, Deng Z, Nie J, Tang J (2019) Rotate: Knowledge graph embedding by relational rotation in complex space. In: 7th International Conference on Learning Representations, ICLR 2019. OpenReview.net, New Orleans
go back to reference Trivedi R, Dai H, Wang Y, Song L (2017) Know-evolve: Deep temporal reasoning for dynamic knowledge graphs. In: Proceedings of the 34th International Conference on Machine Learning, vol. 70, pp. 3462–3471. PMLR, Sydney Trivedi R, Dai H, Wang Y, Song L (2017) Know-evolve: Deep temporal reasoning for dynamic knowledge graphs. In: Proceedings of the 34th International Conference on Machine Learning, vol. 70, pp. 3462–3471. PMLR, Sydney
go back to reference Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, Long Beach, pp. 5998–6008 Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, Long Beach, pp. 5998–6008
go back to reference Vinyals O, Blundell C, Lillicrap T, Kavukcuoglu K, Wierstra D (2016) Matching networks for one shot learning. In: Lee DD, Sugiyama M, von Luxburg U, Guyon I, Garnett R (eds.) Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems, Barcelona, pp. 3630–3638 Vinyals O, Blundell C, Lillicrap T, Kavukcuoglu K, Wierstra D (2016) Matching networks for one shot learning. In: Lee DD, Sugiyama M, von Luxburg U, Guyon I, Garnett R (eds.) Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems, Barcelona, pp. 3630–3638
go back to reference Xiong W, Yu M, Chang S, Guo X, Wang WY (2018) One-shot relational learning for knowledge graphs. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 1980–1990. Association for Computational Linguistics, Brussels Xiong W, Yu M, Chang S, Guo X, Wang WY (2018) One-shot relational learning for knowledge graphs. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 1980–1990. Association for Computational Linguistics, Brussels
go back to reference Yang B, Yih W, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: Bengio Y, LeCun Y (eds) 3rd International Conference on Learning Representations. ICLR, San Diego Yang B, Yih W, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: Bengio Y, LeCun Y (eds) 3rd International Conference on Learning Representations. ICLR, San Diego
go back to reference Zhang C, Yao H, Huang C, Jiang M, Li Z, Chawla NV (2020) Few-shot knowledge graph completion. Proceedings of the AAAI Conference on Artificial Intelligence 34(03):3041–3048CrossRef Zhang C, Yao H, Huang C, Jiang M, Li Z, Chawla NV (2020) Few-shot knowledge graph completion. Proceedings of the AAAI Conference on Artificial Intelligence 34(03):3041–3048CrossRef
Metadata
Title
One-shot relational learning for extrapolation reasoning on temporal knowledge graphs
Authors
Ruixin Ma
Biao Mei
Yunlong Ma
Hongyan Zhang
Meihong Liu
Liang Zhao
Publication date
01-07-2023
Publisher
Springer US
Published in
Data Mining and Knowledge Discovery / Issue 4/2023
Print ISSN: 1384-5810
Electronic ISSN: 1573-756X
DOI
https://doi.org/10.1007/s10618-023-00935-7

Other articles of this Issue 4/2023

Data Mining and Knowledge Discovery 4/2023 Go to the issue

Premium Partner