This paper introduces RealityEffects, a desktop authoring interface designed for editing and augmenting 3D volumetric videos with object-centric annotations and visual effects. RealityEffects enhances volumetric capture by introducing a novel method for augmenting captured physical motion with embedded, responsive visual effects, referred to as object-centric augmentation. In RealityEffects, users can interactively attach various visual effects to physical objects within the captured 3D scene, enabling these effects to dynamically move and animate in sync with the corresponding physical motion and body movements. The primary contribution of this paper is the development of a taxonomy for such object-centric augmentations, which includes annotated labels, highlighted objects, ghost effects, and trajectory visualization. This taxonomy is informed by an analysis of 120 edited videos featuring object-centric visual effects. The findings from our user study confirm that our direct manipulation techniques lower the barriers to editing and annotating volumetric captures, thereby enhancing interactive and engaging viewing experiences of 3D volumetric videos.

翻译：本文介绍RealityEffects，一种专为编辑与增强三维体视频而设计的桌面创作界面，支持以对象为中心的标注与视觉效果叠加。该系统通过提出一种创新方法增强体视频捕捉效果，该方法可将嵌入式响应式视觉特效（称为以对象为中心增强）与捕捉到的物理运动相结合。在RealityEffects中，用户能够将多种视觉特效交互式地附着于捕捉到的三维场景内的物理对象上，使这些特效能够随着对应物理运动及肢体动作同步动态移动与动画化。本文的核心贡献在于建立了一套以对象为中心增强的分类体系，涵盖标注标签、高亮对象、残影效果与轨迹可视化四大类别。该分类体系基于对120段包含对象中心视觉特效的编辑视频的分析提炼而成。用户研究结果表明，我们的直接操作技术显著降低了体视频编辑与标注的技术门槛，从而提升了三维体视频的交互性与沉浸式观看体验。