We propose Point'n Move, a method that achieves interactive scene object manipulation with exposed region inpainting. Interactivity here further comes from intuitive object selection and real-time editing. To achieve this, we adopt Gaussian Splatting Radiance Field as the scene representation and fully leverage its explicit nature and speed advantage. Its explicit representation formulation allows us to devise a 2D prompt points to 3D mask dual-stage self-prompting segmentation algorithm, perform mask refinement and merging, minimize change as well as provide good initialization for scene inpainting and perform editing in real-time without per-editing training, all leads to superior quality and performance. We test our method by performing editing on both forward-facing and 360 scenes. We also compare our method against existing scene object removal methods, showing superior quality despite being more capable and having a speed advantage.
翻译:我们提出Point'n Move方法,该方法通过暴露区域修复实现交互式场景物体操控。其交互性进一步体现于直观的物体选择与实时编辑功能。为此,我们采用高斯散点辐射场作为场景表征,并充分利用其显式特性与速度优势。该显式表征公式使我们能够设计一种从2D提示点到3D掩码的双阶段自提示分割算法,执行掩码精化与合并、最小化场景变化、为场景修复提供良好初始化,且无需逐次编辑训练即可实现实时编辑——所有设计均带来卓越质量与性能。我们在前向场景与360度场景上对方法进行编辑测试,并对比现有场景物体移除方法。结果表明,尽管本方法功能更全面且具备速度优势,仍展现出更优的画质表现。