Discretization of continuous probability distributions is an operation on the sample space, and the structure induced by this operation cannot generally be determined solely from information geometry. In our recent work on unavoidable canonical nonlinearity (UCN), we established a non-arbitrary connection between the transport cost associated with discretization and the information-geometric indistinguishability of continuous probability distributions. Through this transport-information correspondence, UCN quantifies the information-theoretic cost associated with discretization in terms of the expected Kullback-Leibler divergence between nearby continuous distributions characterized by the discretization geometry. In the original UCN construction, discretization is implemented by transporting the probability mass within each cell to its geometric centroid. The resulting transport-information correspondence, however, is derived under specific conditions involving the cell geometry, spatial coverage, and the vanishing-cell-scale limit. In this work, we generalize the local-map discretization framework by allowing an arbitrary representative point for each cell and establish an exact decomposition of the associated transport cost into contributions from the conditional covariance of the probability distribution and the displacement of the representative point from its probability-weighted centroid. Consequently, the resulting transport cost is exactly represented by the expectation of the associated Fisher-induced quadratic form, without requiring uniform cell geometry, complete coverage of the sample space, or an infinitesimal cell-scale limit. The proposed construction thus establishes an exact transport-information correspondence for finite-scale discretization using arbitrary collections of non-overlapping bounded sets.
翻译:暂无翻译