The distribution shift in Time Series Forecasting (TSF), indicating series distribution changes over time, largely hinders the performance of TSF models. Existing works towards distribution shift in time series are mostly limited in the quantification of distribution and, more importantly, overlook the potential shift between lookback and horizon windows. To address above challenges, we systematically summarize the distribution shift in TSF into two categories. Regarding lookback windows as input-space and horizon windows as output-space, there exist (i) intra-space shift, that the distribution within the input-space keeps shifted over time, and (ii) inter-space shift, that the distribution is shifted between input-space and output-space. Then we introduce, Dish-TS, a general neural paradigm for alleviating distribution shift in TSF. Specifically, for better distribution estimation, we propose the coefficient net (CONET), which can be any neural architectures, to map input sequences into learnable distribution coefficients. To relieve intra-space and inter-space shift, we organize Dish-TS as a Dual-CONET framework to separately learn the distribution of input- and output-space, which naturally captures the distribution difference of two spaces. In addition, we introduce a more effective training strategy for intractable CONET learning. Finally, we conduct extensive experiments on several datasets coupled with different state-of-the-art forecasting models. Experimental results show Dish-TS consistently boosts them with a more than 20% average improvement. Code is available.
翻译:时间序列预测(TSF)中的分布偏移,即序列分布随时间变化的现象,严重制约了TSF模型的性能。现有针对时间序列分布偏移的研究大多局限于分布的量化,更重要的是,忽略了回溯窗口与预测窗口之间的潜在偏移。为应对上述挑战,我们系统性地将TSF中的分布偏移归纳为两类。将回溯窗口视为输入空间,预测窗口视为输出空间,存在(i)空间内偏移,即输入空间内的分布随时间持续偏移,以及(ii)空间间偏移,即输入空间与输出空间之间的分布存在偏移。为此,我们提出Dish-TS——一种缓解TSF中分布偏移的通用神经范式。具体而言,为提升分布估计的准确性,我们设计了系数网络(CONET),该网络可采用任意神经架构,将输入序列映射为可学习的分布系数。为缓解空间内偏移与空间间偏移,我们将Dish-TS构建为双CONET框架,分别学习输入空间与输出空间的分布,从而自然捕获两个空间的分布差异。此外,我们引入了一种更有效的训练策略以应对CONET的复杂学习过程。最后,我们在多个数据集上结合不同最先进预测模型进行了广泛实验。实验结果表明,Dish-TS能够以超过20%的平均提升稳定增强这些模型。代码已开源。