Motion magnification helps us visualize subtle, imperceptible motion. However, prior methods only work for 2D videos captured with a fixed camera. We present a 3D motion magnification method that can magnify subtle motions from scenes captured by a moving camera, while supporting novel view rendering. We represent the scene with time-varying radiance fields and leverage the Eulerian principle for motion magnification to extract and amplify the variation of the embedding of a fixed point over time. We study and validate our proposed principle for 3D motion magnification using both implicit and tri-plane-based radiance fields as our underlying 3D scene representation. We evaluate the effectiveness of our method on both synthetic and real-world scenes captured under various camera setups.
翻译:运动放大有助于我们可视化细微、难以察觉的运动。然而,现有方法仅适用于固定相机拍摄的2D视频。我们提出了一种3D运动放大方法,能够从移动相机捕捉的场景中放大细微运动,同时支持新视角渲染。我们使用时变辐射场表示场景,并利用欧拉运动放大原理,提取并放大固定点嵌入随时间的变化。我们以隐式和基于三平面的辐射场作为底层3D场景表示,研究并验证了所提出的3D运动放大原理。通过对多种相机设置下合成场景和真实场景的评估,验证了方法的有效性。