Interactive volume visualization using a mixed reality (MR) system helps provide users with an intuitive spatial perception of volumetric data. Due to sophisticated requirements of user interaction and vision when using MR head-mounted display (HMD) devices, the conflict between the realisticness and efficiency of direct volume rendering (DVR) is yet to be resolved. In this paper, a new MR visualization framework that supports interactive realistic DVR is proposed. An efficient illumination estimation method is used to identify the high dynamic range (HDR) environment illumination captured using a panorama camera. To improve the visual quality of Monte Carlo-based DVR, a new spatio-temporal denoising algorithm is designed. Based on a reprojection strategy, it makes full use of temporal coherence between adjacent frames and spatial coherence between the two screens of an HMD to optimize MR rendering quality. Several MR development modules are also developed for related devices to efficiently and stably display the DVR results in an MR HMD. Experimental results demonstrate that our framework can better support immersive and intuitive user perception during MR viewing than existing MR solutions.

翻译：利用混合现实系统进行交互式体可视化，有助于为用户提供体数据的直观空间感知。由于使用混合现实头戴显示设备时对用户交互和视觉的复杂要求，直接体渲染的真实感与效率之间的矛盾尚未解决。本文提出一种支持交互式真实感直接体渲染的新型混合现实可视化框架。采用高效光照估计方法识别全景相机捕获的高动态范围环境光照。为改善基于蒙特卡洛的直接体渲染视觉质量，设计了一种新的时空去噪算法。该算法基于重投影策略，充分利用相邻帧间时间一致性与头戴显示设备双屏间空间一致性，优化混合现实渲染质量。针对相关设备开发了多个混合现实开发模块，以高效稳定地在混合现实头戴显示设备中显示直接体渲染结果。实验结果表明，与现有混合现实解决方案相比，本框架能更好地支持用户在混合现实观察中的沉浸式与直观感知。