07-05-2025 | Original Article
Temporal knowledge graph representation learning with temporal feature and complex evolution
Authors: Qian Liu, Siling Feng, Mengxing Huang, Uzair Aslam Bhatti
Published in: International Journal of Machine Learning and Cybernetics
Log inActivate our intelligent search to find suitable subject content or patents.
Select sections of text to find matching patents with Artificial Intelligence. powered by
Select sections of text to find additional relevant content using AI-assisted search. powered by (Link opens in a new window)
Abstract
The article explores the critical advancements in temporal knowledge graph (TKG) representation learning, emphasizing the integration of temporal features and complex evolution. It begins by discussing the limitations of static knowledge graphs (SKGs) and the necessity of incorporating temporal dynamics to enhance reasoning capabilities. The article introduces the TFCE framework, which consists of a temporal feature module, a complex evolution module, and a temporally embedded decoder. The temporal feature module encodes entities and relations over time, capturing long-range dependencies and associations in time series data. The complex evolution module recursively models the sequence of knowledge graphs, learning the evolutionary representations of entities and relationships at each timestamp. This module employs multi-layer perception mechanisms and attention networks to mine structural features and capture key information in relational paths. The temporally embedded decoder handles incomplete time series data, ensuring robust inference and reducing errors caused by missing values. Experimental results on three real-world datasets demonstrate the superior performance of TFCE, outperforming baseline methods in both entity and relation prediction tasks. The article also includes detailed ablation studies and performance analyses, highlighting the contributions of each component in the TFCE framework. The discussion section outlines future research directions, including the exploration of diverse datasets and the adaptation of the model to different domains and applications.
AI Generated
This summary of the content was generated with the help of AI.
Abstract
Temporal knowledge graph (TKG) representation learning is a pivotal task aimed at transforming entities and relations within TKG from a high-dimensional vector space to a lower-dimensional vector space, while preserving the relational features inherent in TKG. TKG comprises a sequence of knowledge graphs (KGs) at various timestamps. Presently, existing methodologies tend to either focus solely on learning historical event characteristics or exclusively model time-dependent relationships. There is a notable dearth of research concerning incomplete data, posing significant challenges to comprehending and capturing the intricate relationship characteristics within TKG. In response to this challenge, a novel method named TFCE is introduced to address the challenges posed by temporal evolution and incomplete data in TKGs. TFCE encompasses three core components: a Temporal Feature Module, a Complex Evolution Module, and a Temporally Embedded Decoder. TFCE incorporates a temporal feature module, enabling the temporal encoding of entities and relations within KGs. This module seamlessly integrates temporal information into the representation learning process. By discerning patterns of entities and relations across time, TFCE facilitates the comprehension and discovery of temporal order relations within KGs. The complex evolution module adeptly learns the evolutionary representation of entities and relationships at each timestamp through recursive modeling of the KG sequence. By systematically analyzing the KG sequence, this module captures the nuanced evolution of entities and relationships over time, enhancing the understanding of temporal dependencies between events. To accommodate incomplete temporal data, TFCE employs a temporally embedded decoder. This decoder effectively processes incomplete temporal data, facilitating the inference of representation learning. Experimental validation conducted across three real-world datasets, namely ICEWS14s, ICEWS 05-15, and ICEWS18, underscores the superiority of TFCE over baseline methods. The TFCE framework demonstrates remarkable efficacy in capturing temporal relationships within TKG, thus showcasing its potential for advancing temporal knowledge graph representation learning methodologies.
Advertisement