We propose Gaussian Frosting, a novel mesh-based representation for high-quality rendering and editing of complex 3D effects in real-time. Our approach builds on the recent 3D Gaussian Splatting framework, which optimizes a set of 3D Gaussians to approximate a radiance field from images. We propose first extracting a base mesh from Gaussians during optimization, then building and refining an adaptive layer of Gaussians with a variable thickness around the mesh to better capture the fine details and volumetric effects near the surface, such as hair or grass. We call this layer Gaussian Frosting, as it resembles a coating of frosting on a cake. The fuzzier the material, the thicker the frosting. We also introduce a parameterization of the Gaussians to enforce them to stay inside the frosting layer and automatically adjust their parameters when deforming, rescaling, editing or animating the mesh. Our representation allows for efficient rendering using Gaussian splatting, as well as editing and animation by modifying the base mesh. We demonstrate the effectiveness of our method on various synthetic and real scenes, and show that it outperforms existing surface-based approaches. We will release our code and a web-based viewer as additional contributions. Our project page is the following: https://anttwo.github.io/frosting/

翻译：我们提出Gaussian Frosting，一种新颖的基于网格的表示方法，用于高质量渲染和编辑复杂的3D效果，并支持实时操作。我们的方法建立在最近的3D高斯泼溅框架之上，该框架通过优化一组3D高斯函数从图像中逼近辐射场。我们提出在优化过程中首先从高斯函数提取基础网格，然后在网格周围构建并优化一层厚度可调的自适应高斯层，以更好地捕捉表面附近的精细细节和体积效应，例如毛发或草地。我们将这一层称为Gaussian Frosting，因为它类似于蛋糕上的糖霜涂层：材质越模糊，糖霜层越厚。我们还引入了一种高斯参数化方法，强制高斯成分保持在糖霜层内，并在变形、缩放、编辑或动画化网格时自动调整其参数。我们的表示方法既能够通过高斯泼溅实现高效渲染，也可以通过修改基础网格进行编辑和动画化。我们在多种合成场景和真实场景上验证了该方法的有效性，结果表明其性能优于现有的基于表面的方法。作为额外贡献，我们将发布代码和基于网页的查看器。我们的项目页面为：https://anttwo.github.io/frosting/