Holography offers unique advantages for delivering perceptual realism while preserving compact form factors in VR/AR. Its perceptual quality, however, hinges on encoding rich wavefronts of photorealistic scenes into interference patterns and then incoherently multiplexing the resulting wave fields for perception. Existing CGH paradigms decouple radiance estimation from wave propagation by pre-rendering radiance on discretized scene sectors. This separation between radiometric and wave-optical computation inherently limits the range of focus cues and visual effects that can be faithfully reproduced, including depth- and view-continuity, and physically based material behaviors such as glossy or mirror-like reflection and refraction. We present a physically accurate yet computationally efficient wave optics rendering framework leveraging path tracing to encode full 3D visual cues into phase holograms. Specifically, we employ a Monte Carlo method to solve both the rendering equation and the Rayleigh--Sommerfeld integral simultaneously. Our algorithm is fully compatible with modern graphics techniques and can generate multiple time-multiplexed random holograms with minimal additional time cost via Path Reuse. By employing a fast approximation with an ambient radiance cache, we realize an order of magnitude convergence speed improvement. The resulting coherent wave fields that inherently encode comprehensive visual effects are converted into phase-only holograms under complex-amplitude supervision. Through extensive simulations and experimental validations on a spatial light modulator-based display prototype, we demonstrate faithful holographic reconstructions of natural 3D cues and complex materials, including realistic defocus blur, view-dependent effects, as well as appearance highlights and reflections.
翻译:全息术在VR/AR中能以紧凑的外形提供感知真实感,其独特优势取决于将真实感场景的丰富波前编码为干涉图案,再通过非相干复用所得波场实现感知。现有计算机生成全息图范式通过预渲染离散化场景扇区的辐射度,将辐射度估计与波传播解耦。这种辐射度计算与波动光学计算之间的分离从根本上限制了可忠实再现的聚焦线索和视觉效应的范围,包括深度与视角连续性,以及基于物理的材料行为(如光泽或镜面反射/折射)。我们提出一种物理精确且计算高效的波动光学渲染框架,利用路径追踪将完整3D视觉线索编码为相位全息图。具体而言,我们采用蒙特卡洛方法同时求解渲染方程与瑞利-索末菲积分。该算法与现代图形技术完全兼容,并可通过路径复用以极小的额外时间成本生成多个时间复用随机全息图。通过采用环境辐射缓存的快速近似,我们实现了数量级的收敛速度提升。由此生成的相干波场天然编码了综合视觉效果,在复振幅监督下转换为纯相位全息图。通过在基于空间光调制器的显示原型上进行广泛仿真与实验验证,我们展示了自然3D线索与复杂材料的忠实全息重建,包括真实散焦模糊、视角相关效应,以及外观高光与反射。