Recent advancements in radiance fields have opened new avenues for creating high-quality 3D assets and scenes. Style transfer can enhance these 3D assets with diverse artistic styles, transforming creative expression. However, existing techniques are often slow or unable to localize style transfer to specific objects. We introduce StyleSplat, a lightweight method for stylizing 3D objects in scenes represented by 3D Gaussians from reference style images. Our approach first learns a photorealistic representation of the scene using 3D Gaussian splatting while jointly segmenting individual 3D objects. We then use a nearest-neighbor feature matching loss to finetune the Gaussians of the selected objects, aligning their spherical harmonic coefficients with the style image to ensure consistency and visual appeal. StyleSplat allows for quick, customizable style transfer and localized stylization of multiple objects within a scene, each with a different style. We demonstrate its effectiveness across various 3D scenes and styles, showcasing enhanced control and customization in 3D creation.
翻译:近年来辐射场技术的进步为创建高质量三维资产与场景开辟了新途径。风格迁移能够为这些三维资产赋予多样化的艺术风格,从而拓展创意表达的可能性。然而,现有技术往往存在速度缓慢或无法将风格迁移局部应用于特定物体的问题。本文提出StyleSplat——一种轻量级方法,可通过参考风格图像对以三维高斯表示的场景中的物体进行风格化处理。我们的方法首先利用三维高斯泼溅技术学习场景的光照真实表示,同时联合分割出独立的三维物体。随后采用最近邻特征匹配损失对选定物体的高斯模型进行微调,将其球谐系数与风格图像对齐,以确保风格一致性与视觉吸引力。StyleSplat支持快速可定制的风格迁移,并能对场景中多个物体实现局部风格化(每个物体可采用不同风格)。我们通过多种三维场景与风格的实验验证了该方法的有效性,展现了其在三维创作中增强的控制力与可定制性。