Temporal Knowledge Graph (TKG) representation learning embeds entities and event types into a continuous low-dimensional vector space by integrating the temporal information, which is essential for downstream tasks, e.g., event prediction and question answering. Existing methods stack multiple graph convolution layers to model the influence of distant entities, leading to the over-smoothing problem. To alleviate the problem, recent studies infuse reinforcement learning to obtain paths that contribute to modeling the influence of distant entities. However, due to the limited number of hops, these studies fail to capture the correlation between entities that are far apart and even unreachable. To this end, we propose GTRL, an entity Group-aware Temporal knowledge graph Representation Learning method. GTRL is the first work that incorporates the entity group modeling to capture the correlation between entities by stacking only a finite number of layers. Specifically, the entity group mapper is proposed to generate entity groups from entities in a learning way. Based on entity groups, the implicit correlation encoder is introduced to capture implicit correlations between any pairwise entity groups. In addition, the hierarchical GCNs are exploited to accomplish the message aggregation and representation updating on the entity group graph and the entity graph. Finally, GRUs are employed to capture the temporal dependency in TKGs. Extensive experiments on three real-world datasets demonstrate that GTRL achieves the state-of-the-art performances on the event prediction task, outperforming the best baseline by an average of 13.44%, 9.65%, 12.15%, and 15.12% in MRR, Hits@1, Hits@3, and Hits@10, respectively.
翻译:时间知识图谱(TKG)表示学习通过整合时间信息,将实体和事件类型嵌入到连续的低维向量空间中,这对事件预测、问答等下游任务至关重要。现有方法堆叠多层图卷积层以建模远距离实体的影响,导致过度平滑问题。为缓解该问题,近期研究引入强化学习来获取有助于建模远距离实体影响的路径。然而,由于跳数限制,这些方法无法捕捉相距甚远甚至不可达实体之间的相关性。为此,我们提出GTRL——一种实体组感知的时间知识图谱表示学习方法。GTRL是首个纳入实体组建模、仅通过有限层数堆叠即可捕捉实体之间相关性的工作。具体而言,我们提出实体组映射器,以学习方式从实体中生成实体组。基于实体组,引入隐式相关性编码器来捕捉任意实体组对之间的隐式相关性。此外,利用分层GCN完成实体组图和实体图上的消息聚合与表示更新。最后,采用GRU捕获TKG中的时序依赖关系。在三个真实数据集上的大量实验表明,GTRL在事件预测任务上实现了最优性能,在MRR、Hits@1、Hits@3和Hits@10上分别平均超越最佳基线13.44%、9.65%、12.15%和15.12%。