Apparel's significant role in human appearance underscores the importance of garment digitalization for digital human creation. Recent advances in 3D content creation are pivotal for digital human creation. Nonetheless, garment generation from text guidance is still nascent. We introduce a text-driven 3D garment generation framework, DressCode, which aims to democratize design for novices and offer immense potential in fashion design, virtual try-on, and digital human creation. For our framework, we first introduce SewingGPT, a GPT-based architecture integrating cross-attention with text-conditioned embedding to generate sewing patterns with text guidance. We also tailored a pre-trained Stable Diffusion for high-quality, tile-based PBR texture generation. By leveraging a large language model, our framework generates CG-friendly garments through natural language interaction. Our method also facilitates pattern completion and texture editing, streamlining the design process through user-friendly interaction. This framework fosters innovation by allowing creators to freely experiment with designs and incorporate unique elements into their work, thereby igniting new ideas and artistic possibilities. With comprehensive evaluations and comparisons with other state-of-the-art methods, our method showcases the best quality and alignment with input prompts. User studies further validate our high-quality rendering results, highlighting its practical utility and potential in production settings. Our project page is https://IHe-KaiI.github.io/DressCode/.
翻译:服装在人类外观中扮演着重要角色,其数字化对数字人创建至关重要。3D内容生成的最新进展为数字人创建提供了关键支撑,但基于文本引导的服装生成仍处于起步阶段。我们提出了一种文本驱动的3D服装生成框架DressCode,旨在让非专业用户也能轻松进行服装设计,并在时尚设计、虚拟试穿和数字人创建等领域具有巨大潜力。在该框架中,我们首先引入SewingGPT——一种基于GPT架构的模型,通过交叉注意力机制与文本条件嵌入相结合,实现文本引导下的服装纸样生成。同时,我们针对高质量、基于图块的PBR纹理生成任务,定制了预训练的Stable Diffusion模型。通过利用大型语言模型,我们的框架能够通过自然语言交互生成CG兼容的服装。该方法还支持纸样补全和纹理编辑,通过用户友好交互简化设计流程。该框架通过允许创作者自由实验设计方案并融入独特元素来激发创新,从而催生新的创意与艺术可能性。经过全面评估及与现有最优方法的对比,本方法在生成质量与输入提示的一致性方面均展现出最优性能。用户研究进一步验证了其高质量渲染结果,突显了在生产环境中的实用性与潜力。项目页面:https://IHe-KaiI.github.io/DressCode/。