Uncertainty quantification is critical for deploying deep neural networks (DNNs) in real-world applications. An Auxiliary Uncertainty Estimator (AuxUE) is one of the most effective means to estimate the uncertainty of the main task prediction without modifying the main task model. To be considered robust, an AuxUE must be capable of maintaining its performance and triggering higher uncertainties while encountering Out-of-Distribution (OOD) inputs, i.e., to provide robust aleatoric and epistemic uncertainty. However, for vision regression tasks, current AuxUE designs are mainly adopted for aleatoric uncertainty estimates, and AuxUE robustness has not been explored. In this work, we propose a generalized AuxUE scheme for more robust uncertainty quantification on regression tasks. Concretely, to achieve a more robust aleatoric uncertainty estimation, different distribution assumptions are considered for heteroscedastic noise, and Laplace distribution is finally chosen to approximate the prediction error. For epistemic uncertainty, we propose a novel solution named Discretization-Induced Dirichlet pOsterior (DIDO), which models the Dirichlet posterior on the discretized prediction error. Extensive experiments on age estimation, monocular depth estimation, and super-resolution tasks show that our proposed method can provide robust uncertainty estimates in the face of noisy inputs and that it can be scalable to both image-level and pixel-wise tasks.
翻译:不确定性量化对于深度神经网络在现实应用中的部署至关重要。辅助不确定性估计器(AuxUE)是无需修改主任务模型即可估计主任务预测不确定性的最有效方法之一。为实现鲁棒性,AuxUE必须能够在遭遇分布外(OOD)输入时保持性能并触发更高水平的不确定性,即提供鲁棒的偶然不确定性和认知不确定性。然而,在视觉回归任务中,现有AuxUE设计主要针对偶然不确定性估计,其鲁棒性尚未得到探索。本文提出一种泛化AuxUE框架,用于回归任务中更鲁棒的不确定性量化。具体而言,为获得更鲁棒的偶然不确定性估计,我们针对异方差噪声考虑了不同分布假设,最终选用拉普拉斯分布近似预测误差。针对认知不确定性,我们提出一种名为"离散化诱导狄利克雷后验"(DIDO)的创新方案,该方案在离散化预测误差上建模狄利克雷后验。在年龄估计、单目深度估计和超分辨率任务上的大量实验表明,所提方法能在面对噪声输入时提供鲁棒的不确定性估计,并可扩展至图像级与像素级任务。