Virtual try-on attracts increasing research attention as a promising way for enhancing the user experience for online cloth shopping. Though existing methods can generate impressive results, users need to provide a well-designed reference image containing the target fashion clothes that often do not exist. To support user-friendly fashion customization in full-body portraits, we propose a multi-modal interactive setting by combining the advantages of both text and texture for multi-level fashion manipulation. With the carefully designed fashion editing module and loss functions, FashionTex framework can semantically control cloth types and local texture patterns without annotated pairwise training data. We further introduce an ID recovery module to maintain the identity of input portrait. Extensive experiments have demonstrated the effectiveness of our proposed pipeline.

翻译：虚拟试衣作为提升线上服装购物用户体验的有效途径，正吸引越来越多的研究关注。尽管现有方法能够生成令人印象深刻的结果，但用户仍需提供包含目标时尚服装的精美参考图像，而这类图像往往并不存在。为支持全身人像中用户友好的时尚定制，我们提出一种多模态交互设定，结合文本与纹理的优势实现多层次的时尚操控。通过精心设计的时尚编辑模块与损失函数，FashionTex框架无需成对的标注训练数据，即可语义化控制服装类型与局部纹理图案。我们进一步引入身份恢复模块，以保持输入人像的身份特征。大量实验证明了所提方法的有效性。