TG-CENET: An improved reasoning model for temporal knowledge graphs based on contrastive history
Discuss this preprint
Start a discussion What are Sciety discussions?Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
With the rapid advancement of the Internet and artificial intelligence technologies, knowledge graphs have demonstrated significant potential in data structuring and knowledge reasoning. In particular, temporal knowledge graphs (TKGs), have attracted increasing attention for their applications in dynamic scenarios. However, traditional TKG representation learning methods often overlook the topological structure among entities and their interactions with neighboring nodes, resulting in limited capacity to model complex historical dependencies and perform global reasoning. To address these challenges, we propose TG-CENET (Transformer‑GNN‑Contrastive Event Network), an enhanced temporal knowledge graph reasoning model that builds upon the historical contrastive learning strategy of CENET. By incorporating a GNN and a Transformer module, TG-CENET improves both structural representation and temporal sequence modeling. Specifically, the GNN component captures structural information from the graph, improving the quality of entity representations by modeling neighborhood relationships. Meanwhile, the Transformer module captures long-term temporal dependencies, enabling the model to reason more effectively over both historical and non-historical events. The effectiveness and performance of the proposed method were evaluated in two representative public datasets, ICEWS14 and ICEWS18. The results demonstrate that TG-CENET consistently outperforms existing methods in multiple metrics, including Hit@1, Hit@3, and Hit@10. The proposed method achieves Hit@1, Hit@3, and Hit@10 scores of 0.31, 0.46, and 0.62 on the ICEWS14s dataset, and 0.19, 0.32, and 0.48 on the ICEWS18 dataset, respectively. Ablation studies further confirm the complementary benefits of GNN-based structural encoding, Transformer-based temporal reasoning, and contrastive learning. These results highlight the effectiveness and robustness of TG-CENET in modeling complex temporal dynamics, offering a promising direction for advancing TKG reasoning in real-world applications such as event forecasting, financial analysis, and urban disaster management.