Radiance fields, including their recent efficient forms such as 3D Gaussian Splatting and Sparse Voxels, have revolutionized photorealistic 3D scene visualization by enabling high-fidelity reconstruction of complex environments, making them a natural match for light field displays. However, integrating these technologies presents significant computational challenges, as light field displays require many high-resolution renderings from slightly shifted viewpoints, while radiance fields rely on computationally intensive volume rendering, which is intractable to achieve real-time speeds even with efficient scene representations. In this paper, we propose a unified and efficient framework for real-time radiance field rendering on light field displays. Rather than re-rendering each view independently, our method converts the input radiance field into shared intermediate sweeping planes that can be efficiently composited into dense light-field views in a single pass. Our method prioritizes shared, non-directional plane caching for real-time performance, trading fine view-dependent color effects for a modest increase in intermediate memory usage. Our framework generalizes across different scene representations without retraining and avoids repeated computation across views. We further demonstrate a real-time interactive application on a Looking Glass display, achieving 200+ FPS at 512p across 45 rendered views and enabling seamless, immersive 3D interactive viewing experiences. On standard benchmarks, our method achieves up to 22x speedup compared to independently rendering each view, while largely preserving image quality.

翻译：辐射场，包括其最近的高效形式如3D高斯泼溅和稀疏体素，通过实现复杂环境的高保真重建，彻底改变了逼真的三维场景可视化，使其成为光场显示的自然匹配。然而，整合这些技术面临着重大计算挑战，因为光场显示需要从略微偏移的视点进行多次高分辨率渲染，而辐射场依赖于计算密集的体渲染，即使采用高效的场景表示，也难以达到实时速度。在本文中，我们提出了一种统一且高效的框架，用于在光场显示上实现实时辐射场渲染。我们的方法并非独立重新渲染每个视图，而是将输入辐射场转换为共享的中间扫描平面，这些平面可以在单次通路中高效合成为密集的光场视图。我们方法优先采用共享的非方向性平面缓存以实现实时性能，以牺牲细微的视相关色彩效果为代价，换取中间内存使用量的适度增加。我们的框架无需重新训练即可泛化至不同的场景表示，并避免跨视图的重复计算。我们进一步在Looking Glass显示器上展示了一个实时交互应用，在45个渲染视图中以512p分辨率实现超过200 FPS的帧率，并提供无缝、沉浸式的三维交互观看体验。在标准基准测试中，与独立渲染每个视图相比，我们的方法实现了高达22倍的加速，同时很大程度上保持了图像质量。