As the dependence on computer systems expands across various domains, focusing on personal, industrial, and large-scale applications, there arises a compelling need to enhance their reliability to sustain business operations seamlessly and ensure optimal user satisfaction. System logs generated by these devices serve as valuable repositories of historical trends and past failures. The use of machine learning techniques for failure prediction has become commonplace, enabling the extraction of insights from past data to anticipate future behavior patterns. Recently, large language models have demonstrated remarkable capabilities in tasks including summarization, reasoning, and event prediction. Therefore, in this paper, we endeavor to investigate the potential of large language models in predicting system failures, leveraging insights learned from past failure behavior to inform reasoning and decision-making processes effectively. Our approach involves leveraging data from the Intel Computing Improvement Program (ICIP) system crash logs to identify significant events and develop CrashEventLLM. This model, built upon a large language model framework, serves as our foundation for crash event prediction. Specifically, our model utilizes historical data to forecast future crash events, informed by expert annotations. Additionally, it goes beyond mere prediction, offering insights into potential causes for each crash event. This work provides the preliminary insights into prompt-based large language models for the log-based event prediction task.

翻译：随着计算机系统在个人、工业及大规模应用等各领域的依赖性日益增强，提升其可靠性以保障业务连续运行并确保最佳用户体验的需求变得尤为迫切。这些设备生成的系统日志是记录历史趋势与过往故障的宝贵信息库。利用机器学习技术进行故障预测已成为普遍做法，能够从历史数据中提取洞见以预测未来的行为模式。近年来，大语言模型在摘要生成、推理及事件预测等任务中展现出卓越能力。因此，本文致力于探究大语言模型在预测系统故障方面的潜力，通过从历史故障行为中学习到的知识，有效支撑推理与决策过程。我们的方法利用英特尔计算改进计划（ICIP）的系统崩溃日志数据，识别关键事件并构建CrashEventLLM。该模型基于大语言模型框架开发，构成了我们进行崩溃事件预测的基础。具体而言，我们的模型利用历史数据，结合专家标注信息，对未来崩溃事件进行预测。此外，它不仅限于预测功能，还能为每次崩溃事件提供潜在原因分析。本研究为基于提示的大语言模型在日志事件预测任务中的应用提供了初步探索。