Large Language Models (LLMs) are huge artificial neural networks which primarily serve to generate text, but also provide a very sophisticated probabilistic model of language use. Since generating a semantically consistent text requires a form of effective memory, we investigate the memory properties of LLMs and find surprising similarities with key characteristics of human memory. This result strongly suggests that the biological features of human memory leave an imprint on the way that we structure our textual narratives.
翻译:大型语言模型(LLMs)是规模庞大的人工神经网络,主要用于生成文本,同时也能提供一种高度精密的语言使用概率模型。由于生成语义连贯的文本需要某种形式的有效记忆,我们研究了LLMs的记忆特性,并发现其与人类记忆的关键特征存在惊人的相似性。这一结果强烈表明,人类记忆的生物学特征在我们构建文本叙事的方式上留下了烙印。