Test-time training (TTT) with KV binding as sequence modeling layer is commonly interpreted as a form of online meta-learning that memorizes a key-value mapping at test time. However, our analysis reveals multiple phenomena that contradict this memorization-based interpretation. Motivated by these findings, we revisit the formulation of TTT and show that a broad class of TTT architectures can be expressed as a form of learned linear attention operator. Beyond explaining previously puzzling model behaviors, this perspective yields multiple practical benefits: it enables principled architectural simplifications, admits fully parallel formulations that preserve performance while improving efficiency, and provides a systematic reduction of diverse TTT variants to a standard linear attention form. Overall, our results reframe TTT not as test-time memorization, but as learned linear attention with enhanced representational capacity.

翻译：测试时训练（TTT）采用KV绑定作为序列建模层，通常被解释为一种在线元学习形式，即在测试时记忆键值映射关系。然而，我们的分析揭示了多个与该记忆型解释相矛盾的现象。基于这些发现，我们重新审视了TTT的数学表述，证明一大类TTT架构可表达为一种学习型线性注意力算子。这一视角不仅能解释先前令人困惑的模型行为，还带来多重实际优势：它支持基于原理的架构简化，允许在保持性能的同时提升效率的完全并行化表述，并将多样化的TTT变体系统性地归结为标准线性注意力形式。总体而言，我们的研究将TTT重新定义为具有增强表征能力的学习型线性注意力机制，而非测试时记忆过程。