This paper aims for a new generation task: non-stationary multi-texture synthesis, which unifies synthesizing multiple non-stationary textures in a single model. Most non-stationary textures have large scale variance and can hardly be synthesized through one model. To combat this, we propose a multi-scale generator to capture structural patterns of various scales and effectively synthesize textures with a minor cost. However, it is still hard to handle textures of different categories with different texture patterns. Therefore, we present a category-specific training strategy to focus on learning texture pattern of a specific domain. Interestingly, once trained, our model is able to produce multi-pattern generations with dynamic variations without the need to finetune the model for different styles. Moreover, an objective evaluation metric is designed for evaluating the quality of texture expansion and global structure consistency. To our knowledge, ours is the first scheme for this challenging task, including model, training, and evaluation. Experimental results demonstrate the proposed method achieves superior performance and time efficiency. The code will be available after the publication.
翻译:本文旨在解决一项新生成任务:非平稳多纹理合成,即通过单一模型统一合成多种非平稳纹理。大多数非平稳纹理具有较大的尺度变化,难以通过单模型生成。为此,我们提出一种多尺度生成器,以捕获不同尺度的结构模式,并以较低成本有效合成纹理。然而,不同类别的纹理具有不同的纹理模式,仍难以统一处理。因此,我们提出一种类别特定的训练策略,专注于学习特定域的纹理模式。有趣的是,训练后的模型无需针对不同风格进行微调,即可生成具有动态变化的多模式纹理。此外,我们设计了一种客观评估指标,用于评估纹理扩展质量及全局结构一致性。据我们所知,该方法是为这一挑战性任务设计的首个完整方案,涵盖模型、训练与评估。实验结果表明,所提方法在性能和时间效率上均表现出优越性。代码将在论文发表后公开。