Large language models (LLMs) are becoming central to natural language processing education, yet materials showing their mechanics are sparse. We present AnimatedLLM, an interactive web application that provides step-by-step visualizations of a Transformer language model. AnimatedLLM runs entirely in the browser, using pre-computed traces of open LLMs applied on manually curated inputs. The application is available at https://animatedllm.github.io, both as a teaching aid and for self-educational purposes.
翻译:大语言模型(LLMs)正逐渐成为自然语言处理教育的核心内容,然而展示其内部机制的教学材料却十分匮乏。本文介绍AnimatedLLM——一个交互式网络应用程序,可提供Transformer语言模型的逐步可视化展示。AnimatedLLM完全在浏览器中运行,基于预先计算的开源大语言模型在人工筛选输入上的执行轨迹。该应用程序可通过https://animatedllm.github.io访问,既可作为教学辅助工具,也可用于自主学习。