Self-attention weights and their transformed variants have been the main source of information for analyzing token-to-token interactions in Transformer-based models. But despite their ease of interpretation, these weights are not faithful to the models' decisions as they are only one part of an encoder, and other components in the encoder layer can have considerable impact on information mixing in the output representations. In this work, by expanding the scope of analysis to the whole encoder block, we propose Value Zeroing, a novel context mixing score customized for Transformers that provides us with a deeper understanding of how information is mixed at each encoder layer. We demonstrate the superiority of our context mixing score over other analysis methods through a series of complementary evaluations with different viewpoints based on linguistically informed rationales, probing, and faithfulness analysis.

翻译：自注意力权重及其变换形式一直是分析基于Transformer模型中词元间交互的主要信息来源。然而，尽管这些权重易于解释，但它们并不能真实反映模型的决策，因为它们仅是编码器的一部分，而编码器层中的其他组件对输出表示中的信息混合具有显著影响。通过将分析范围扩展至整个编码器块，我们提出了一种专为Transformer定制的全新上下文混合评分——归零值法（Value Zeroing），该方法能够深入理解每个编码器层中信息的混合方式。我们通过一系列基于语言学原理的理性分析、探针实验及忠实性评估等互补性评估，从不同视角证明了所提上下文混合评分相较于其他分析方法的优越性。