We present Surf-NeRF, a modified implementation of the recently introduced Shadow Neural Radiance Field (S-NeRF) model. This method is able to synthesize novel views from a sparse set of satellite images of a scene, while accounting for the variation in lighting present in the pictures. The trained model can also be used to accurately estimate the surface elevation of the scene, which is often a desirable quantity for satellite observation applications. S-NeRF improves on the standard Neural Radiance Field (NeRF) method by considering the radiance as a function of the albedo and the irradiance. Both these quantities are output by fully connected neural network branches of the model, and the latter is considered as a function of the direct light from the sun and the diffuse color from the sky. The implementations were run on a dataset of satellite images, augmented using a zoom-and-crop technique. A hyperparameter study for NeRF was carried out, leading to intriguing observations on the model's convergence. Finally, both NeRF and S-NeRF were run until 100k epochs in order to fully fit the data and produce their best possible predictions. The code related to this article can be found at https://github.com/fsemerar/surfnerf.
翻译:我们提出了Surf-NeRF,这是近期提出的阴影神经辐射场(S-NeRF)模型的一种改进实现。该方法能够从场景的稀疏卫星图像集合中合成新视角,同时兼顾图像中光照变化的影响。训练后的模型还可用于精确估计场景的表面高程,这通常是卫星观测应用中的期望量。S-NeRF通过将辐射度视为反照率和辐照度的函数,改进了标准神经辐射场(NeRF)方法。这两个量均由模型的全连接神经网络分支输出,其中辐照度被考虑为太阳直射光与天空漫射颜色的函数。实现基于卫星图像数据集运行,并通过缩放裁剪技术进行数据增强。我们针对NeRF开展了超参数研究,得出了关于模型收敛性的有趣观察。最后,NeRF和S-NeRF均训练至10万轮次,以充分拟合数据并生成最优预测。本文相关代码可从https://github.com/fsemerar/surfnerf获取。