The advances in the Neural Radiance Fields (NeRF) research offer extensive applications in diverse domains, but protecting their copyrights has not yet been researched in depth. Recently, NeRF watermarking has been considered one of the pivotal solutions for safely deploying NeRF-based 3D representations. However, existing methods are designed to apply only to implicit or explicit NeRF representations. In this work, we introduce an innovative watermarking method that can be employed in both representations of NeRF. This is achieved by fine-tuning NeRF to embed binary messages in the rendering process. In detail, we propose utilizing the discrete wavelet transform in the NeRF space for watermarking. Furthermore, we adopt a deferred back-propagation technique and introduce a combination with the patch-wise loss to improve rendering quality and bit accuracy with minimum trade-offs. We evaluate our method in three different aspects: capacity, invisibility, and robustness of the embedded watermarks in the 2D-rendered images. Our method achieves state-of-the-art performance with faster training speed over the compared state-of-the-art methods.
翻译:神经辐射场(NeRF)研究的进展在多个领域提供了广泛的应用,但其版权保护尚未得到深入研究。近期,NeRF水印技术被认为是在安全部署基于NeRF的三维表示中的关键解决方案之一。然而,现有方法仅适用于隐式或显式NeRF表示。在本工作中,我们提出了一种创新的水印方法,可同时应用于这两种NeRF表示形式。该方法通过微调NeRF在渲染过程中嵌入二进制消息实现。具体而言,我们提出在NeRF空间中利用离散小波变换进行水印嵌入。此外,我们采用延时反向传播技术,并结合逐块损失函数,以最小权衡实现渲染质量与比特精度的提升。我们从三个不同方面评估了该方法:2D渲染图像中嵌入水印的容量、不可见性和鲁棒性。与现有最优方法相比,我们的方法在更快训练速度下达到了最优性能。