We propose IntegratedPIFu, a new pixel aligned implicit model that builds on the foundation set by PIFuHD. IntegratedPIFu shows how depth and human parsing information can be predicted and capitalised upon in a pixel-aligned implicit model. In addition, IntegratedPIFu introduces depth oriented sampling, a novel training scheme that improve any pixel aligned implicit model ability to reconstruct important human features without noisy artefacts. Lastly, IntegratedPIFu presents a new architecture that, despite using less model parameters than PIFuHD, is able to improves the structural correctness of reconstructed meshes. Our results show that IntegratedPIFu significantly outperforms existing state of the arts methods on single view human reconstruction. Our code has been made available online.
翻译:我们提出了IntegratedPIFu,一种基于PIFuHD基础构建的新型像素对齐隐式模型。IntegratedPIFu展示了如何在像素对齐隐式模型中预测并有效利用深度与人体解析信息。此外,IntegratedPIFu引入了深度导向采样这一新颖的训练方案,该方案能提升任何像素对齐隐式模型重建重要人体特征的能力,同时避免产生噪声伪影。最后,IntegratedPIFu提出了一种新架构,尽管使用的模型参数少于PIFuHD,却能提高重建网格的结构正确性。我们的实验结果表明,IntegratedPIFu在单视角人体重建任务上显著优于现有的先进方法。我们的代码已在线公开。