Large language models (LLMs) have been applied in many fields with rapid development in recent years. As a classic machine learning task, time series forecasting has recently received a boost from LLMs. However, there is a research gap in the LLMs' preferences in this field. In this paper, by comparing LLMs with traditional models, many properties of LLMs in time series prediction are found. For example, our study shows that LLMs excel in predicting time series with clear patterns and trends but face challenges with datasets lacking periodicity. We explain our findings through designing prompts to require LLMs to tell the period of the datasets. In addition, the input strategy is investigated, and it is found that incorporating external knowledge and adopting natural language paraphrases positively affects the predictive performance of LLMs for time series. Overall, this study contributes to insight into the advantages and limitations of LLMs in time series forecasting under different conditions.
翻译:近年来,大语言模型发展迅速,已广泛应用于多个领域。作为经典的机器学习任务,时间序列预测近期得益于大语言模型的发展。然而,关于大语言模型在该领域中的偏好尚存在研究空白。本文通过将大语言模型与传统模型进行比较,发现了大语言模型在时间序列预测中的诸多特性。例如,研究表明大语言模型擅长预测具有清晰模式和周期性的时间序列,但在处理缺乏周期性的数据集时面临挑战。我们通过设计提示要求大语言模型描述数据集的周期来解释这些发现。此外,研究还探讨了输入策略,发现引入外部知识并采用自然语言释义能对大语言模型的时间序列预测性能产生积极影响。总体而言,本研究有助于深入理解大语言模型在不同条件下进行时间序列预测的优势与局限性。