We present Sat-NeRF, a modified implementation of the recently introduced Shadow Neural Radiance Field (S-NeRF) model. This method is able to synthesize novel views from a sparse set of satellite images of a scene, while accounting for the variation in lighting present in the pictures. The trained model can also be used to accurately estimate the surface elevation of the scene, which is often a desirable quantity for satellite observation applications. S-NeRF improves on the standard Neural Radiance Field (NeRF) method by considering the radiance as a function of the albedo and the irradiance. Both these quantities are output by fully connected neural network branches of the model, and the latter is considered as a function of the direct light from the sun and the diffuse color from the sky. The implementations were run on a dataset of satellite images, augmented using a zoom-and-crop technique. A hyperparameter study for NeRF was carried out, leading to intriguing observations on the model's convergence. Finally, both NeRF and S-NeRF were run until 100k epochs in order to fully fit the data and produce their best possible predictions. The code related to this article can be found at $\text{https://github.com/fsemerar/satnerf}$.
翻译:我们提出了Sat-NeRF,这是近期引入的阴影神经辐射场(S-NeRF)模型的一种改进实现。该方法能够从场景的稀疏卫星图像集合中合成新视角,同时兼顾图像中存在的光照变化。训练后的模型还可用于准确估计场景的表面高程,这通常是卫星观测应用中所需的量。S-NeRF通过将辐射度视为反照率和辐照度的函数,对标准神经辐射场(NeRF)方法进行了改进。这两个量均由模型的全连接神经网络分支输出,其中后者被视为太阳直射光和天空漫射颜色的函数。该实现在一组通过缩放裁剪技术增强的卫星图像数据集上运行。针对NeRF进行了超参数研究,得出了关于模型收敛性的有趣观察结果。最后,NeRF和S-NeRF均运行至10万轮以完全拟合数据并产生其最佳预测。与本文相关的代码可在$\text{https://github.com/fsemerar/satnerf}$处获取。