We present GSDeformer, a method that achieves free-form deformation on 3D Gaussian Splatting(3DGS) without requiring any architectural changes. Our method extends cage-based deformation, a traditional mesh deformation method, to 3DGS. This is done by converting 3DGS into a novel proxy point cloud representation, where its deformation can be used to infer the transformations to apply on the 3D gaussians making up 3DGS. We also propose an automatic cage construction algorithm for 3DGS to minimize manual work. Our method does not modify the underlying architecture of 3DGS. Therefore, any existing trained vanilla 3DGS can be easily edited by our method. We compare the deformation capability of our method against other existing methods, demonstrating the ease of use and comparable quality of our method, despite being more direct and thus easier to integrate with other concurrent developments on 3DGS.
翻译:我们提出了GSDeformer,一种无需修改任何架构即可在3D高斯溅射(3DGS)上实现自由变形的方法。我们的方法将传统的基于笼结构的网格变形技术扩展至3DGS。这是通过将3DGS转换为一种新颖的代理点云表示来实现的,该表示的变形可用于推导构成3DGS的3D高斯所需施加的变换。我们还提出了一种针对3DGS的自动笼构建算法,以最大限度地减少人工操作。我们的方法不改变3DGS的基础架构,因此任何已训练的标准3DGS模型均可通过本方法轻松编辑。我们与其他现有方法的变形能力进行了比较,结果表明我们的方法在保持使用便捷性和质量相当的同时,因其更直接的特性而更容易与3DGS的其他并行发展成果集成。