Creating the photo-realistic version of people sketched portraits is useful to various entertainment purposes. Existing studies only generate portraits in the 2D plane with fixed views, making the results less vivid. In this paper, we present Stereoscopic Simplified Sketch-to-Portrait (SSSP), which explores the possibility of creating Stereoscopic 3D-aware portraits from simple contour sketches by involving 3D generative models. Our key insight is to design sketch-aware constraints that can fully exploit the prior knowledge of a tri-plane-based 3D-aware generative model. Specifically, our designed region-aware volume rendering strategy and global consistency constraint further enhance detail correspondences during sketch encoding. Moreover, in order to facilitate the usage of layman users, we propose a Contour-to-Sketch module with vector quantized representations, so that easily drawn contours can directly guide the generation of 3D portraits. Extensive comparisons show that our method generates high-quality results that match the sketch. Our usability study verifies that our system is greatly preferred by user.

翻译：从手绘肖像生成逼真照片在娱乐领域具有广泛应用。现有研究仅在二维平面上生成固定视角的肖像，导致结果缺乏生动性。本文提出立体简化素描-肖像生成方法（Stereoscopic Simplified Sketch-to-Portrait, SSSP），通过引入三维生成模型，探索从简单轮廓素描创建立体三维感知肖像的可能性。核心思想是设计素描感知约束，充分挖掘基于三平面（tri-plane）的三维感知生成模型的先验知识。具体而言，我们提出的区域感知体渲染策略与全局一致性约束进一步增强了素描编码过程中的细节对应关系。此外，为方便非专业用户使用，我们设计了基于矢量量化表示的轮廓-素描模块（Contour-to-Sketch），使易于绘制的轮廓可直接引导三维肖像生成。大量对比实验表明，我们的方法可生成与素描高度匹配的高质量结果。可用性研究证实，用户对本系统具有显著偏好。