Temporal Point Processes (TPPs) serve as the standard mathematical framework for modeling asynchronous event sequences in continuous time. However, classical TPP models are often constrained by strong assumptions, limiting their ability to capture complex real-world event dynamics. To overcome this limitation, researchers have proposed Neural TPPs, which leverage neural network parametrizations to offer more flexible and efficient modeling. While recent studies demonstrate the effectiveness of Neural TPPs, they often lack a unified setup, relying on different baselines, datasets, and experimental configurations. This makes it challenging to identify the key factors driving improvements in predictive accuracy, hindering research progress. To bridge this gap, we present a comprehensive large-scale experimental study that systematically evaluates the predictive accuracy of state-of-the-art neural TPP models. Our study encompasses multiple real-world and synthetic event sequence datasets, following a carefully designed unified setup. We thoroughly investigate the influence of major architectural components such as event encoding, history encoder, and decoder parametrization on both time and mark prediction tasks. Additionally, we delve into the less explored area of probabilistic calibration for neural TPP models. By analyzing our results, we draw insightful conclusions regarding the significance of history size and the impact of architectural components on predictive accuracy. Furthermore, we shed light on the miscalibration of mark distributions in neural TPP models. Our study aims to provide valuable insights into the performance and characteristics of neural TPP models, contributing to a better understanding of their strengths and limitations.
翻译:时序点过程(TPP)是建模连续时间中异步事件序列的标准数学框架。然而,经典TPP模型常受限于强假设条件,难以捕捉复杂真实世界的事件动态。为克服这一局限,研究者提出神经TPP,通过神经网络参数化实现更灵活高效的建模。尽管近期研究证明了神经TPP的有效性,但这些研究往往缺乏统一设置,依赖不同的基准模型、数据集和实验配置,导致难以识别提升预测准确性的关键因素,阻碍研究进展。为填补这一空白,我们开展了一项全面的大规模实验研究,系统评估了最先进神经TPP模型的预测准确性。本研究涵盖多个真实和合成事件序列数据集,遵循精心设计的统一实验框架。我们深入探究事件编码、历史编码器及解码器参数化等主要架构组件对时间预测和标记预测任务的影响。此外,我们探讨了神经TPP模型概率校准这一较少探索的领域。通过分析实验结果,我们得出了关于历史长度重要性及架构组件对预测准确性影响的深刻结论,同时揭示了神经TPP模型中标记分布校准偏差问题。本研究旨在为神经TPP模型的性能与特性提供重要见解,促进对其优势与局限性的深入理解。