With the advancement of Large Language Models (LLMs), the importance of accelerators that efficiently process LLM computations has been increasing. This paper discusses the necessity of LLM accelerators and provides a comprehensive analysis of the hardware and software characteristics of the main commercial LLM accelerators. Based on this analysis, we propose considerations for the development of next-generation LLM accelerators and suggest future research directions.

翻译：随着大型语言模型（LLMs）的发展，能够高效处理LLM计算的加速器的重要性日益凸显。本文探讨了LLM加速器的必要性，并对主要商用LLM加速器的硬件与软件特性进行了全面分析。基于此分析，我们提出了下一代LLM加速器开发的考量因素，并指出了未来的研究方向。