For linear inverse problems with Gaussian priors and Gaussian observation noise, the posterior is Gaussian, with mean and covariance determined by the conditioning formula. Using the Feldman-Hajek theorem, we analyse the prior-to-posterior update and its low-rank approximation for infinite-dimensional Hilbert parameter spaces and finite-dimensional observations. We show that the posterior distribution differs from the prior on a finite-dimensional subspace, and construct low-rank approximations to the posterior covariance, while keeping the mean fixed. Since in infinite dimensions, not all low-rank covariance approximations yield approximate posterior distributions which are equivalent to the posterior and prior distribution, we characterise the low-rank covariance approximations which do yield this equivalence, and their respective inverses, or `precisions'. For such approximations, a family of measure approximation problems is solved by identifying the low-rank approximations which are optimal for various losses simultaneously. These loss functions include the family of R\'enyi divergences, the Amari $\alpha$-divergences for $\alpha\in(0,1)$, the Hellinger metric and the Kullback-Leibler divergence. Our results extend those of Spantini et al. (SIAM J. Sci. Comput. 2015) to Hilbertian parameter spaces, and provide theoretical underpinning for the construction of low-rank approximations of discretised versions of the infinite-dimensional inverse problem, by formulating discretization independent results.
翻译:对于具有高斯先验和高斯观测噪声的线性反问题,其后验分布为高斯分布,其均值和协方差由条件公式确定。利用Feldman-Hajek定理,我们分析了无限维希尔伯特参数空间与有限维观测下的先验至后验更新及其低秩逼近。我们证明后验分布与先验分布在一个有限维子空间上存在差异,并构造了后验协方差的低秩逼近,同时保持均值不变。由于在无限维情形下,并非所有低秩协方差逼近都能产生与后验及先验分布等价的后验分布近似,我们刻画了能够实现这种等价的低秩协方差逼近及其相应的逆矩阵(或称“精度矩阵”)。对于此类逼近,我们通过识别在多种损失函数下同时最优的低秩逼近,解决了一类测度逼近问题。这些损失函数包括Rényi散度族、α∈(0,1)时的Amari α-散度、Hellinger距离以及Kullback-Leibler散度。我们的结果将Spantini等人(SIAM J. Sci. Comput. 2015)的研究推广至希尔伯特参数空间,并通过建立与离散化无关的理论结果,为无限维反问题离散化版本的低秩逼近构造提供了理论基础。