Blind face restoration is highly ill-posed under severe degradation, where identity-critical details may be missing from the degraded input. Same-identity references reduce this ambiguity, but mismatched pose, expression, illumination, age, makeup, or local facial states can lead to overuse of reference appearance. We propose \textbf{IConFace}, a unified reference-aware and no-reference framework with identity--structure asymmetric conditioning. References are distilled into a norm-weighted global AdaFace identity anchor for image-only modulation, while the degraded image is reinforced as the spatial structure anchor through low-rank residuals and block-wise degraded cross-attention with two-route memory. The resulting single checkpoint exploits references when available and falls back to no-reference restoration when absent, improving identity consistency, fine-detail recovery, and degraded-only restoration quality in a unified model.
翻译:盲人脸修复在严重退化条件下具有高度病态性,退化输入可能缺失身份关键细节。同身份参考可降低此模糊性,但姿势、表情、光照、年龄、妆容或局部面部状态的不匹配会导致参考外观过度使用。我们提出IConFace,一种具有身份-结构非对称条件的统一参考感知与无参考框架。参考被提炼为仅用于图像调制的范数加权全局AdaFace身份锚点,而退化图像通过低秩残差和双路记忆的逐块退化交叉注意力增强为空间结构锚点。所得单一检查点在存在参考时加以利用,在缺失参考时退化为无参考修复,从而在统一模型中提升身份一致性、细节恢复质量及仅退化输入下的修复效果。