Computer generated holography has long been touted as the future of augmented and virtual reality (AR/VR) displays, but has yet to be realized in practice. Previous high-quality, color holographic displays have either made a 3$\times$ sacrifice on frame rate by using a sequential illumination scheme or have made use of multiple spatial light modulators (SLM) and/or bulky, complex optical setups. The reduced frame rate of sequential color introduces distracting judder and color fringing in the presence of head motion while the form factor of current simultaneous color systems is incompatible with a head-mounted display. In this work, we propose a framework for simultaneous color holography that allows the use of the full SLM frame rate while maintaining a compact and simple optical setup. State-of-the-art hologram quality is achieved through a perceptual loss function, a physics-based neural network wavefront propagator, and a camera-calibrated forward model. We measurably improve hologram quality compared to other simultaneous color methods and move one step closer to the realization of color holographic displays for AR/VR.

翻译：计算机生成全息术长期以来一直被誉为增强现实和虚拟现实（AR/VR）显示器的未来，但在实际应用中尚未实现。以往的高质量彩色全息显示器要么通过顺序照明方案在帧率上做出3倍的牺牲，要么使用多个空间光调制器（SLM）和/或笨重复杂的光学装置。顺序彩色方案的帧率降低会在头部运动时引入令人分心的抖动和彩色条纹，而当前同步彩色系统的外形因素则与头戴式显示器不兼容。在这项工作中，我们提出了一种同步彩色全息框架，该框架允许充分利用SLM的满帧率，同时保持紧凑且简单的光学装置。通过感知损失函数、基于物理的神经网络波前传播器以及相机校准的前向模型，实现了最先进的全息图质量。与其他同步彩色方法相比，我们可测量地提高了全息图质量，并向实现AR/VR彩色全息显示器迈出了更近一步。