We study dependence measures induced by $Φ$-divergence (also known as $ f$-divergence in the literature) for finite random variables. We define conditional $Φ$-mutual information through an exact chain rule and develop its structural properties and variational representations. But in general it lacks conditional symmetry and deterministic self-reduction. To tackle this, we introduce max-$Φ$-mutual information $\wIPhi$, a variational envelope obtained by optimizing over $\IPhi$ quantities containing auxiliary random variables, which restores both properties and satisfies a subadditive chain rule. Both quantities reduce to Shannon's mutual information when $Φ(t)=t\log t$. For smooth convex generators with $Φ(0)<\infty$ and concave $t\mapsto t^2Φ''(t)$, we establish an optimizer characterization and obtain a closed-form expression for the unconditional quantity in terms of $Φ$-self-information. For the same class, we show that its private-randomness-assisted version is either an affine function of Shannon's mutual information, with coefficients depending only on $Φ$, or identically infinite. This dichotomy is determined by the asymptotic growth of $Φ$ and clarifies the sensitivity of max-$Φ$-mutual information to local randomness. We further derive inner bounds on $Φ$-ribbons from prescribed independence structures and prove that these bounds are optimal when $Φ(t)=t\log t$. We also establish a multipartite $Φ$-generalization of the Zhang--Yeung inequality and derive corresponding ribbon regions. Finally, we give sufficient conditions for reducing the computation of $Φ$-strong data processing constants for Z-channel sources to a boundary optimization.
翻译:暂无翻译