The relentless advancement of artificial intelligence (AI) and machine learning (ML) applications necessitates the development of specialized hardware accelerators capable of handling the increasing complexity and computational demands. Traditional computing architectures, based on the von Neumann model, are being outstripped by the requirements of contemporary AI/ML algorithms, leading to a surge in the creation of accelerators like the Graphcore Intelligence Processing Unit (IPU), Sambanova Reconfigurable Dataflow Unit (RDU), and enhanced GPU platforms. These hardware accelerators are characterized by their innovative data-flow architectures and other design optimizations that promise to deliver superior performance and energy efficiency for AI/ML tasks. This research provides a preliminary evaluation and comparison of these commercial AI/ML accelerators, delving into their hardware and software design features to discern their strengths and unique capabilities. By conducting a series of benchmark evaluations on common DNN operators and other AI/ML workloads, we aim to illuminate the advantages of data-flow architectures over conventional processor designs and offer insights into the performance trade-offs of each platform. The findings from our study will serve as a valuable reference for the design and performance expectations of research prototypes, thereby facilitating the development of next-generation hardware accelerators tailored for the ever-evolving landscape of AI/ML applications. Through this analysis, we aspire to contribute to the broader understanding of current accelerator technologies and to provide guidance for future innovations in the field.

翻译：人工智能（AI）与机器学习（ML）应用的持续进步，催生了能够应对日益增长的复杂性与计算需求的专用硬件加速器。基于冯·诺依曼模型构建的传统计算架构，正逐渐被当代AI/ML算法需求所超越，从而推动了Graphcore智能处理单元（IPU）、Sambanova可重构数据流单元（RDU）以及增强型GPU平台等加速器的涌现。这些硬件加速器凭借其创新性的数据流架构及其他设计优化，有望在AI/ML任务中展现卓越的性能与能效。本研究通过初步评估与比较这些商用AI/ML加速器，深入剖析其硬件与软件设计特征，以甄别各自优势与独特能力。我们对常见深度神经网络（DNN）算子及其他AI/ML工作负载开展了一系列基准测试评估，旨在揭示数据流架构相较于传统处理器设计的优势，并阐明各平台的性能权衡。研究结果将为研究原型的设计与性能预期提供宝贵参考，从而助力开发适应AI/ML领域不断演变格局的下一代硬件加速器。通过本分析，我们期望促进对当前加速器技术的更广泛理解，并为该领域的未来创新提供指导方向。