Autoregressive neural networks within the temporal point process (TPP) framework have become the standard for modeling continuous-time event data. Even though these models can expressively capture event sequences in a one-step-ahead fashion, they are inherently limited for long-term forecasting applications due to the accumulation of errors caused by their sequential nature. To overcome these limitations, we derive ADD-THIN, a principled probabilistic denoising diffusion model for TPPs that operates on entire event sequences. Unlike existing diffusion approaches, ADD-THIN naturally handles data with discrete and continuous components. In experiments on synthetic and real-world datasets, our model matches the state-of-the-art TPP models in density estimation and strongly outperforms them in forecasting.
翻译:在时间点过程(TPP)框架下的自回归神经网络已成为连续时间事件数据建模的标准方法。尽管这些模型能够以逐步预测的方式表达性地捕捉事件序列,但由于其序列化特性导致的误差累积,它们在长期预测应用中本质受限。为克服这些限制,我们提出了ADD-THIN——一种针对TPP的基于原则的概率去噪扩散模型,该模型可直接对整个事件序列进行操作。与现有扩散方法不同,ADD-THIN能够自然处理同时包含离散和连续成分的数据。在合成数据集和真实世界数据集上的实验中,我们的模型在密度估计任务中与现有最优TPP模型性能持平,并在预测任务中显著优于它们。