With the advent of Neural Radiance Field (NeRF), representing 3D scenes through multiple observations has shown remarkable improvements in performance. Since this cutting-edge technique is able to obtain high-resolution renderings by interpolating dense 3D environments, various approaches have been proposed to apply NeRF for the spatial understanding of robot perception. However, previous works are challenging to represent unobserved scenes or views on the unexplored robot trajectory, as these works do not take into account 3D reconstruction without observation information. To overcome this problem, we propose a method to generate flipped observation in order to cover unexisting observation for unexplored robot trajectory. To achieve this, we propose a data augmentation method for 3D reconstruction using NeRF by flipping observed images, and estimating flipped camera 6DOF poses. Our technique exploits the property of objects being geometrically symmetric, making it simple but fast and powerful, thereby making it suitable for robotic applications where real-time performance is important. We demonstrate that our method significantly improves three representative perceptual quality measures on the NeRF synthetic dataset.
翻译:随着神经辐射场(NeRF)的出现,通过多视角观测表示三维场景的性能得到了显著提升。由于这一前沿技术能够通过插值密集三维环境获得高分辨率渲染结果,研究者已提出多种方法将NeRF应用于机器人感知的空间理解。然而,现有方法难以在未探索的机器人轨迹上表示未观测场景或视角,因其未考虑缺乏观测信息的三维重建。为解决此问题,我们提出一种翻转观测生成方法,以覆盖未探索机器人轨迹上缺失的观测。具体而言,我们提出一种基于NeRF的三维重建数据增强方法,通过翻转观测图像并估计翻转相机的六自由度位姿实现。该技术利用物体几何对称性,具有简单、快速且强大的特性,因此适用于对实时性要求较高的机器人应用。在NeRF合成数据集上的实验表明,我们的方法显著提升了三项代表性感知质量指标。