Modeling the correlations among errors is closely associated with how accurately the model can quantify predictive uncertainty in probabilistic time series forecasting. Recent multivariate models have made significant progress in accounting for contemporaneous correlations among errors, while a common assumption on these errors is that they are temporally independent for the sake of statistical simplicity. However, real-world observations often deviate from this assumption, since errors usually exhibit substantial autocorrelation due to various factors such as the exclusion of temporally correlated covariates. In this work, we propose an efficient method, based on a low-rank-plus-diagonal parameterization of the covariance matrix, which can effectively characterize the autocorrelation of errors. The proposed method possesses several desirable properties: the complexity does not scale with the number of time series, the resulting covariance can be used for calibrating predictions, and it can seamlessly integrate with any model with Gaussian-distributed errors. We empirically demonstrate these properties using two distinct neural forecasting models-GPVar and Transformer. Our experimental results confirm the effectiveness of our method in enhancing predictive accuracy and the quality of uncertainty quantification on multiple real-world datasets.
翻译:在概率时间序列预测中,误差间的相关性建模与模型量化预测不确定性的准确性密切相关。近年来,多变量模型在刻画误差的同期相关性方面取得了显著进展,但为简化统计处理,这些误差通常被假设为时间独立。然而,由于缺失时间相关协变量等因素,真实观测中的误差往往表现出显著的自相关性,这与该假设相悖。本文提出一种基于协方差矩阵低秩加对角参数化的高效方法,能够有效表征误差的自相关性。该方法具备多项理想特性:计算复杂度不随时间序列数量增加、所得协方差可用于校准预测结果、且能无缝集成至任何具有高斯分布误差的模型中。我们通过GPVar和Transformer两种不同的神经预测模型进行实证验证,结果表明该方法在多个真实数据集上能有效提升预测精度与不确定性量化质量。