3D stylization, the application of specific styles to three-dimensional objects, offers substantial commercial potential by enabling the creation of uniquely styled 3D objects tailored to diverse scenes. Recent advancements in artificial intelligence and text-driven manipulation methods have made the stylization process increasingly intuitive and automated. While these methods reduce human costs by minimizing reliance on manual labor and expertise, they predominantly focus on holistic stylization, neglecting the application of desired styles to individual components of a 3D object. This limitation restricts the fine-grained controllability. To address this gap, we introduce 3DStyleGLIP, a novel framework specifically designed for text-driven, part-tailored 3D stylization. Given a 3D mesh and a text prompt, 3DStyleGLIP utilizes the vision-language embedding space of the Grounded Language-Image Pre-training (GLIP) model to localize individual parts of the 3D mesh and modify their appearance to match the styles specified in the text prompt. 3DStyleGLIP effectively integrates part localization and stylization guidance within GLIP's shared embedding space through an end-to-end process, enabled by part-level style loss and two complementary learning techniques. This neural methodology meets the user's need for fine-grained style editing and delivers high-quality part-specific stylization results, opening new possibilities for customization and flexibility in 3D content creation. Our code and results are available at https://github.com/sj978/3DStyleGLIP.
翻译:三维风格化,即将特定风格应用于三维对象的技术,通过为不同场景定制独特风格的三维对象,展现出巨大的商业潜力。人工智能与文本驱动操控方法的最新进展,使得风格化过程日益直观与自动化。尽管这些方法通过减少对人工劳动和专业知识的依赖降低了人力成本,但它们主要关注整体风格化,忽略了将期望风格应用于三维对象各个独立部件的能力。这一局限制约了细粒度可控性。为弥补此不足,我们提出了3DStyleGLIP,一个专为文本驱动、部件定制的三维风格化设计的新颖框架。给定一个三维网格和一个文本提示,3DStyleGLIP利用基于语言的视觉-语言预训练(GLIP)模型的视觉-语言嵌入空间来定位三维网格的各个部件,并修改其外观以匹配文本提示中指定的风格。通过部件级风格损失和两种互补的学习技术,3DStyleGLIP在GLIP的共享嵌入空间中,以端到端的方式有效集成了部件定位与风格化引导。这一神经方法满足了用户对细粒度风格编辑的需求,并提供了高质量的部件特定风格化结果,为三维内容创作的自定义与灵活性开辟了新的可能性。我们的代码与结果可在 https://github.com/sj978/3DStyleGLIP 获取。