Past works have shown that the Bernstein-von Mises theorem, on the asymptotic normality of posterior distributions, holds if the parameter dimension $d$ grows slower than the cube root of sample size $n$. Here, we prove the first Bernstein-von Mises theorem in the regime $d^2\ll n$. We establish this result for 1) exponential families and 2) logistic regression with Gaussian design. The proof builds on our recent work on the accuracy of the Laplace approximation to posterior distributions, in which we showed the approximation error in TV distance scales as $d/\sqrt n$.
翻译:以往研究表明,关于后验分布渐近正态性的伯恩斯坦-冯·米塞斯定理,在参数维度$d$的增长速度低于样本量$n$的立方根时成立。本文首次证明了在$d^2\ll n$条件下该定理的成立。我们为以下两类模型建立了该结果:1)指数族分布;2)具有高斯设计的逻辑回归模型。该证明基于我们近期关于拉普拉斯近似后验分布准确性的工作,其中我们证明了全变差距离下的近似误差按$d/\sqrt n$量级缩放。