Neural radiance fields with stochasticity have garnered significant interest by enabling the sampling of plausible radiance fields and quantifying uncertainty for downstream tasks. Existing works rely on the independence assumption of points in the radiance field or the pixels in input views to obtain tractable forms of the probability density function. However, this assumption inadvertently impacts performance when dealing with intricate geometry and texture. In this work, we propose an independence-assumption-free probabilistic neural radiance field based on Flow-GAN. By combining the generative capability of adversarial learning and the powerful expressivity of normalizing flow, our method explicitly models the density-radiance distribution of the whole scene. We represent our probabilistic NeRF as a mean-shifted probabilistic residual neural model. Our model is trained without an explicit likelihood function, thereby avoiding the independence assumption. Specifically, We downsample the training images with different strides and centers to form fixed-size patches which are used to train the generator with patch-based adversarial learning. Through extensive experiments, our method demonstrates state-of-the-art performance by predicting lower rendering errors and more reliable uncertainty on both synthetic and real-world datasets.
翻译:随机性神经辐射场通过能够采样合理的辐射场并为下游任务量化不确定性,引起了广泛关注。现有方法依赖辐射场中点或输入视图中像素的独立性假设,以获得概率密度函数的可处理形式。然而,在处理复杂几何和纹理时,这一假设会不经意地影响性能。本文提出了一种基于Flow-GAN的无需独立假设的概率神经辐射场。通过结合对抗学习的生成能力和归一化流的强大表达能力,我们的方法显式建模了整个场景的密度-辐射分布。我们将概率NeRF表示为均值偏移的概率残差神经模型。该模型在没有显式似然函数的情况下进行训练,从而避免了独立性假设。具体而言,我们以不同步长和中心对训练图像进行下采样,形成固定大小的图像块,并利用基于图像块的对抗学习来训练生成器。通过大量实验,我们的方法在合成和真实数据集上预测出更低的渲染误差和更可靠的不确定性,展示了最先进的性能。