Mutual information between two random variables is a well-studied notion, whose understanding is fairly complete. Mutual information between one random variable and a pair of other random variables, however, is a far more involved notion. Specifically, Shannon's mutual information does not capture fine-grained interactions between those three variables, resulting in limited insights in complex systems. To capture these fine-grained interactions, in 2010 Williams and Beer proposed to decompose this mutual information to information atoms, called unique, redundant, and synergistic, and proposed several operational axioms that these atoms must satisfy. In spite of numerous efforts, a general formula which satisfies these axioms has yet to be found. Inspired by Judea Pearl's do-calculus, we resolve this open problem by introducing the do-operation, an operation over the variable system which sets a certain marginal to a desired value, which is distinct from any existing approaches. Using this operation, we provide the first explicit formula for calculating the information atoms so that Williams and Beer's axioms are satisfied, as well as additional properties from subsequent studies in the field.

翻译：两个随机变量之间的互信息是一个研究充分的概念，其理解已相当完备。然而，一个随机变量与另外两个随机变量之间的互信息则是一个复杂得多的概念。具体而言，香农互信息无法捕捉这三个变量之间的细粒度交互作用，导致对复杂系统的洞察有限。为捕捉这些细粒度交互作用，Williams和Beer于2010年提出将互信息分解为信息原子（称为唯一信息、冗余信息和协同信息），并提出了这些信息原子必须满足的若干操作性公理。尽管已付出大量努力，但目前尚未找到满足这些公理的通用公式。受Judea Pearl的do-演算启发，我们通过引入do-操作解决了这一开放问题——该操作对变量系统施加干预，将特定边际设定为目标值，这与现有所有方法截然不同。利用这一操作，我们首次给出了满足Williams和Beer公理及该领域后续研究中附加性质的信息原子显式计算显式公式。