Recent work on implicit neural representations (INRs) has evidenced their potential for efficiently representing and encoding conventional video content. In this paper we, for the first time, extend their application to immersive (multi-view) videos, by proposing MV-HiNeRV, a new INR-based immersive video codec. MV-HiNeRV is an enhanced version of a state-of-the-art INR-based video codec, HiNeRV, which was developed for single-view video compression. We have modified the model to learn a different group of feature grids for each view, and share the learnt network parameters among all views. This enables the model to effectively exploit the spatio-temporal and the inter-view redundancy that exists within multi-view videos. The proposed codec was used to compress multi-view texture and depth video sequences in the MPEG Immersive Video (MIV) Common Test Conditions, and tested against the MIV Test model (TMIV) that uses the VVenC video codec. The results demonstrate the superior performance of MV-HiNeRV, with significant coding gains (up to 72.33%) over TMIV. The implementation of MV-HiNeRV will be published for further development and evaluation.

翻译：近期关于隐式神经表示（INR）的研究已证明其在高效表示和编码传统视频内容方面的潜力。本文首次将其应用拓展至沉浸式（多视角）视频，提出了一种基于INR的新型沉浸式视频编解码器MV-HiNeRV。MV-HiNeRV是当前最先进的基于INR的单视角视频编解码器HiNeRV的增强版本。我们对模型进行了改造，使其为每个视角学习不同的特征网格组，并在所有视角间共享已学习的网络参数。这一设计使模型能够有效利用多视角视频中存在的时空冗余与视角间冗余。该编解码器被用于压缩MPEG沉浸式视频（MIV）通用测试条件下的多视角纹理与深度视频序列，并与采用VVenC视频编解码器的MIV测试模型（TMIV）进行了对比测试。结果表明，MV-HiNeRV展现出卓越性能，相较于TMIV实现了显著编码增益（最高达72.33%）。MV-HiNeRV的实现代码将公开发布，以支持后续开发与评估。