Light-field displays create an immersive experience by providing binocular depth sensation and motion parallax. Stacking light attenuating layers is one approach to implement a light field display with a broader depth of field, wide viewing angles and high resolution. Due to the transparent holographic optical element (HOE) layers, additive layered displays can be integrated into augmented reality (AR) wearables to overlay virtual objects onto the real world, creating a seamless mixed reality (XR) experience. This paper proposes a novel framework for light field representation and coding that utilizes Deep Belief Network (DBN) and weighted binary images suitable for additive layered displays. The weighted binary representation of layers makes the framework more flexible for adaptive bitrate encoding. The framework effectively captures intrinsic redundancies in the light field data, and thus provides a scalable solution for light field coding suitable for XR display applications. The latent code is encoded by H.265 codec generating a rate-scalable bit-stream. We achieve adaptive bitrate decoding by varying the number of weighted binary images and the H.265 quantization parameter, while maintaining an optimal reconstruction quality. The framework is tested on real and synthetic benchmark datasets, and the results validate the rate-scalable property of the proposed scheme.

翻译：光场显示通过提供双目深度感知和运动视差，营造出沉浸式体验。采用光衰减层堆叠的方式是实现宽景深、广视角和高分辨率光场显示的方法之一。由于透明全息光学元件层的存在，叠加式分层显示可集成到增强现实可穿戴设备中，将虚拟物体叠加到真实世界，从而创造无缝的混合现实体验。本文提出一种新型光场表示与编码框架，该框架利用深度信念网络及适用于叠加式分层显示的加权二值图像。层的加权二值表示使框架在自适应比特率编码中更具灵活性。该框架有效捕捉光场数据中的内在冗余，从而为适用于混合现实显示应用的光场编码提供可扩展解决方案。潜在码流经H.265编码器生成速率可扩展的比特流。通过调整加权二值图像数量及H.265量化参数，我们在保持最优重建质量的同时实现自适应比特率解码。该框架在真实与合成基准数据集上进行测试，结果验证了所提方案的速率可扩展特性。