We show that the essential properties of entropy (monotonicity, additivity and subadditivity) are consequences of entropy being a monoidal natural transformation from the under category functor $-/\mathsf{LProb}_{\rho}$ (where $\mathsf{LProb}_{\rho}$ is category of $\ell_{\rho}$ discrete probability spaces) to $\Delta_{\mathbb{R}}$. Moreover, the Shannon entropy can be characterized as the universal monoidal natural transformation from $-/\mathsf{LProb}_{\rho}$ to the category of "strongly regularly ordered" vector spaces (a reflective subcategory of the lax-slice 2-category over $\mathsf{MonCat}_{\ell}$ in the 2-category of monoidal categories), providing a succinct characterization of Shannon entropy as a reflection arrow. We can likewise define entropy for every category with a monoidal structure on its under categories (e.g. the category of finite abelian groups, the category of finite inhabited sets, the category of finite dimensional vector spaces, and the augmented simplex category) via the reflection arrow to the reflective subcategory of strongly regularly ordered vector spaces. This implies that all these entropies over different categories are components of a single natural transformation (the unit of the idempotent monad), allowing us to connect these entropies in a natural manner. We also provide a universal characterization of the conditional Shannon entropy based on the chain rule which, unlike the characterization of information loss by Baez, Fritz and Leinster, does not require any continuity assumption.
翻译:我们证明了熵的本质性质(单调性、可加性与次可加性)源于熵作为从下范畴函子$-/\mathsf{LProb}_{\rho}$(其中$\mathsf{LProb}_{\rho}$是$\ell_{\rho}$离散概率空间的范畴)到$\Delta_{\mathbb{R}}$的幺半自然变换。此外,香农熵可被特征化为从$-/\mathsf{LProb}_{\rho}$到"强正则有序"向量空间(该空间是幺半范畴2-范畴中$\mathsf{MonCat}_{\ell}$上的松弛切片2-范畴的一个反射子范畴)的泛幺半自然变换,从而为香农熵提供了一个简洁的反射态射刻画。通过向强正则有序向量空间的反射子范畴的反射态射,我们同样可以为每个下范畴具有幺半结构的范畴(例如有限阿贝尔群范畴、有限非空集合范畴、有限维向量空间范畴及增广单纯形范畴)定义熵。这意味着所有这些跨越不同范畴的熵都是单一自然变换(幂等单子的单位)的分量,使我们能够以自然方式连接这些熵。我们还基于链式法则给出了条件香农熵的泛性质刻画,与Baez、Fritz和Leinster对信息损失的表征不同,该刻画无需任何连续性假设。