Texturing is a crucial step in the 3D asset production workflow, which enhances the visual appeal and diversity of 3D assets. Despite recent advancements in Text-to-Texture (T2T) generation, existing methods often yield subpar results, primarily due to local discontinuities, inconsistencies across multiple views, and their heavy dependence on UV unwrapping outcomes. To tackle these challenges, we propose a novel generation-refinement 3D texturing framework called MVPaint, which can generate high-resolution, seamless textures while emphasizing multi-view consistency. MVPaint mainly consists of three key modules. 1) Synchronized Multi-view Generation (SMG). Given a 3D mesh model, MVPaint first simultaneously generates multi-view images by employing an SMG model, which leads to coarse texturing results with unpainted parts due to missing observations. 2) Spatial-aware 3D Inpainting (S3I). To ensure complete 3D texturing, we introduce the S3I method, specifically designed to effectively texture previously unobserved areas. 3) UV Refinement (UVR). Furthermore, MVPaint employs a UVR module to improve the texture quality in the UV space, which first performs a UV-space Super-Resolution, followed by a Spatial-aware Seam-Smoothing algorithm for revising spatial texturing discontinuities caused by UV unwrapping. Moreover, we establish two T2T evaluation benchmarks: the Objaverse T2T benchmark and the GSO T2T benchmark, based on selected high-quality 3D meshes from the Objaverse dataset and the entire GSO dataset, respectively. Extensive experimental results demonstrate that MVPaint surpasses existing state-of-the-art methods. Notably, MVPaint could generate high-fidelity textures with minimal Janus issues and highly enhanced cross-view consistency.

翻译：纹理化是三维资产生产流程中的关键步骤，能够增强三维资产的视觉吸引力和多样性。尽管文本到纹理生成技术近期取得了进展，但现有方法往往产生次优结果，主要归因于局部不连续性、多视角间的不一致性以及对UV展开结果的严重依赖。为应对这些挑战，我们提出了一种新颖的生成-优化三维纹理化框架MVPaint，该框架能够生成高分辨率、无缝的纹理，同时强调多视角一致性。MVPaint主要包含三个关键模块：1）同步多视角生成：给定三维网格模型，MVPaint首先通过采用SMG模型同步生成多视角图像，由于观测缺失，这会导致存在未绘制区域的粗略纹理化结果。2）空间感知三维修复：为确保完整的三维纹理化，我们引入了S3I方法，专门设计用于有效纹理化先前未观测到的区域。3）UV优化：此外，MVPaint采用UVR模块在UV空间中提升纹理质量，该模块首先执行UV空间超分辨率，随后采用空间感知接缝平滑算法来修正由UV展开导致的空间纹理不连续性。此外，我们基于从Objaverse数据集中精选的高质量三维网格以及完整的GSO数据集，分别建立了两个T2T评估基准：Objaverse T2T基准和GSO T2T基准。大量实验结果表明，MVPaint超越了现有的最先进方法。值得注意的是，MVPaint能够生成高保真纹理，其Janus问题最小化，且跨视角一致性得到显著增强。