Deep learning algorithms have recently shown to be a successful tool in estimating parameters of statistical models for which simulation is easy, but likelihood computation is challenging. But the success of these approaches depends on simulating parameters that sufficiently reproduce the observed data, and, at present, there is a lack of efficient methods to produce these simulations. We develop new black-box procedures to estimate parameters of statistical models based only on weak parameter structure assumptions. For well-structured likelihoods with frequent occurrences, such as in time series, this is achieved by pre-training a deep neural network on an extensive simulated database that covers a wide range of data sizes. For other types of complex dependencies, an iterative algorithm guides simulations to the correct parameter region in multiple rounds. These approaches can successfully estimate and quantify the uncertainty of parameters from non-Gaussian models with complex spatial and temporal dependencies. The success of our methods is a first step towards a fully flexible automatic black-box estimation framework.
翻译:深度学习算法近期已被证明是估计统计模型参数的有效工具,其中仿真容易但似然计算困难。然而,这些方法的成功依赖于能够充分复现观测数据的参数模拟,而目前缺乏高效生成这类模拟的方法。我们开发了新的黑箱程序,仅基于弱参数结构假设即可估计统计模型的参数。对于具有良好结构且频繁出现的似然函数(如时间序列),通过在大规模模拟数据库上预训练深度神经网络来实现,该数据库覆盖广泛的数据规模。对于其他类型的复杂依赖关系,迭代算法通过多轮引导模拟进入正确的参数区域。这些方法能够成功估计具有复杂时空依赖的非高斯模型参数并量化其不确定性。我们的方法成功实现了向完全灵活的自适应黑箱估计框架迈出的第一步。