High-fidelity 3D Gaussian head avatar generation is critical for applications such as AR/VR, telepresence, and digital humans. Existing methods depend on multi-view datasets, 3D captures, or intermediate 2D view synthesis. In contrast, we learn both conditional and unconditional 3D head models from randomly sampled 2D images alone, without using multi-view data, 3D supervision, or intermediate view generation. We introduce MVCHead, a single-shot state space model that enforces multi-view consistency (MVC) directly in the 3D representation while regressing 3D Gaussians under these constraints. At its core, we propose a Hierarchical State Space (HiSS) block that progressively refines Gaussians from coarse to fine, while capturing long-range dependencies. Within each HiSS block, we modify Mamba's standard unidirectional scan with the proposed Hierarchical Bi-directional State Scan (HiBiSS) that aligns recurrence with the axes along which multi-view inconsistencies are strongest. Finally, we design an SE(3) Multi-view Critic that judges whether a set of self-renders arises from a single underlying 3D configuration, rewarding cross-view pixel alignment without observing real multi-view pairs. MVCHead achieves state-of-the-art perceptual quality, surpasses prior methods in both texture and geometric consistency, and maintains comparable shape consistency. To demonstrate scalability, we release FaceGS-10K, the first large-scale dataset of ready-to-use 3D Gaussian head assets for training and evaluation of 3D head models. Project Page and code: https://humansensinglab.github.io/MVCHead/
翻译:高保真三维高斯人头模型生成对于AR/VR、远程临场和数字人等应用至关重要。现有方法依赖于多视角数据集、三维捕捉或中间二维视角合成。相比之下,我们仅从随机采样的二维图像中学习条件和非条件的三维人头模型,无需使用多视角数据、三维监督或中间视角生成。我们提出MVCHead,一种单次状态空间模型,该模型直接在三维表示中强制执行多视角一致性(MVC),同时在这些约束下回归三维高斯参数。其核心是提出层次化状态空间(HiSS)块,该块从粗到细逐步优化高斯参数,并捕获长距离依赖关系。在每个HiSS块中,我们将Mamba的标准单向扫描修改为所提出的层次化双向状态扫描(HiBiSS),使循环方向与多视角不一致性最强的坐标轴对齐。最后,我们设计了一个SE(3)多视角评判器,用于判断一组自渲染图像是否源于单一底层三维配置,从而在不观察真实多视角对的情况下奖励跨视角像素对齐。MVCHead在感知质量上达到最优水平,在纹理和几何一致性上均超越先前方法,并保持相当的外形一致性。为展示可扩展性,我们发布了FaceGS-10K,这是首个包含可直接使用的三维高斯人头资产的大规模数据集,用于训练和评估三维人头模型。项目页面及代码:https://humansensinglab.github.io/MVCHead/