We present a system to create Mobile Realistic Fullbody (MoRF) avatars. MoRF avatars are rendered in real-time on mobile devices, learned from monocular videos, and have high realism. We use SMPL-X as a proxy geometry and render it with DNR (neural texture and image-2-image network). We improve on prior work, by overfitting per-frame warping fields in the neural texture space, allowing to better align the training signal between different frames. We also refine SMPL-X mesh fitting procedure to improve the overall avatar quality. In the comparisons to other monocular video-based avatar systems, MoRF avatars achieve higher image sharpness and temporal consistency. Participants of our user study also preferred avatars generated by MoRF.

翻译：摘要： 我们提出了一套系统，用于创建移动端逼真全身（MoRF）虚拟化身。MoRF虚拟化身可在移动设备上实时渲染，基于单目视频学习生成，并具备高度逼真性。我们采用SMPL-X作为代理几何体，并结合DNR（神经纹理与图像到图像网络）进行渲染。通过对神经纹理空间中的逐帧形变场进行过拟合，我们改进了先前工作，从而更好地对齐不同帧之间的训练信号。同时，我们优化了SMPL-X网格拟合流程，以提升虚拟化身的整体质量。与其他基于单目视频的虚拟化身系统相比，MoRF虚拟化身在图像清晰度和时间一致性上表现更优。用户研究中的参与者也更偏好由MoRF生成的虚拟化身。