The success of large language models (LLMs) for time series has been demonstrated in previous work. Utilizing a symbolic time series representation, one can efficiently bridge the gap between LLMs and time series. However, the remaining challenge is to exploit the semantic information hidden in time series by using symbols or existing tokens of LLMs, while aligning the embedding space of LLMs according to the hidden information of time series. The symbolic time series approximation (STSA) method called adaptive Brownian bridge-based symbolic aggregation (ABBA) shows outstanding efficacy in preserving salient time series features by modeling time series patterns in terms of amplitude and period while using existing tokens of LLMs. In this paper, we introduce a method, called LLM-ABBA, that integrates ABBA into large language models for various downstream time series tasks. By symbolizing time series, LLM-ABBA compares favorably to the recent state-of-the-art (SOTA) in UCR and three medical time series classification tasks. Meanwhile, a fixed-polygonal chain trick in ABBA is introduced to \kc{avoid obvious drifting} during prediction tasks by significantly mitigating the effects of cumulative error arising from misused symbols during the transition from symbols to numerical values. In time series regression tasks, LLM-ABBA achieves the new SOTA on Time Series Extrinsic Regression (TSER) benchmarks. LLM-ABBA also shows competitive prediction capability compared to recent SOTA time series prediction results. We believe this framework can also seamlessly extend to other time series tasks.
翻译:先前的研究已证明大语言模型(LLM)在时间序列任务中的成功。利用符号化时间序列表示,可以有效地弥合LLM与时间序列之间的鸿沟。然而,当前的挑战在于如何利用符号或LLM的现有词元来挖掘时间序列中隐藏的语义信息,同时根据时间序列的隐含信息调整LLM的嵌入空间。一种称为基于自适应布朗桥的符号聚合(ABBA)的符号化时间序列近似(STSA)方法,通过从振幅和周期角度建模时间序列模式,并利用LLM的现有词元,在保留关键时间序列特征方面表现出卓越的有效性。本文提出了一种名为LLM-ABBA的方法,它将ABBA集成到大语言模型中,以用于各种下游时间序列任务。通过对时间序列进行符号化处理,LLM-ABBA在UCR数据集和三个医学时间序列分类任务中表现优于近期的最先进(SOTA)方法。同时,我们在ABBA中引入了一种固定多边形链技巧,通过在从符号到数值的转换过程中显著减轻因误用符号而产生的累积误差影响,从而\kc{避免预测任务中明显的漂移现象}。在时间序列回归任务中,LLM-ABBA在时间序列外生回归(TSER)基准测试中达到了新的SOTA水平。与近期SOTA时间序列预测结果相比,LLM-ABBA也展现出具有竞争力的预测能力。我们相信该框架也能无缝扩展到其他时间序列任务中。