Software and System logs record runtime information about processes executing within a system. These logs have become the most critical and ubiquitous forms of observability data that help developers understand system behavior, monitor system health and resolve issues. However, the volume of logs generated can be humongous (of the order of petabytes per day) especially for complex distributed systems, such as cloud, search engine, social media, etc. This has propelled a lot of research on developing AI-based log based analytics and intelligence solutions that can process huge volume of raw logs and generate insights. In order to enable users to perform multiple types of AI-based log analysis tasks in a uniform manner, we introduce LogAI (https://github.com/salesforce/logai), a one-stop open source library for log analytics and intelligence. LogAI supports tasks such as log summarization, log clustering and log anomaly detection. It adopts the OpenTelemetry data model, to enable compatibility with different log management platforms. LogAI provides a unified model interface and provides popular time-series, statistical learning and deep learning models. Alongside this, LogAI also provides an out-of-the-box GUI for users to conduct interactive analysis. With LogAI, we can also easily benchmark popular deep learning algorithms for log anomaly detection without putting in redundant effort to process the logs. We have opensourced LogAI to cater to a wide range of applications benefiting both academic research and industrial prototyping.

翻译：软件和系统日志记录了系统内进程执行的运行时信息。这些日志已成为最关键且无处不在的可观测数据形式，帮助开发人员了解系统行为、监控系统健康状况并解决问题。然而，日志生成的数据量可能非常庞大（每天可达PB级），尤其是在复杂分布式系统中，例如云、搜索引擎、社交媒体等。这推动了大量关于开发基于AI的日志分析与智能解决方案的研究，这些方案能够处理海量原始日志并生成洞察。为使开发者能以统一方式执行多种类型的AI日志分析任务，我们推出了LogAI（https://github.com/salesforce/logai），这是一站式开源日志分析与智能库。LogAI支持日志摘要、日志聚类和日志异常检测等任务。它采用OpenTelemetry数据模型，以实现与不同日志管理平台的兼容性。LogAI提供统一的模型接口，并集成了流行的时序模型、统计学习模型和深度学习模型。此外，LogAI还提供开箱即用的图形用户界面，供用户进行交互式分析。借助LogAI，研究者无需投入冗余的日志处理工作即可轻松对流行的深度学习算法进行日志异常检测基准测试。我们已开源LogAI，以服务于广泛的应用程序，惠及学术研究和工业原型设计。