Point-Based Neural Rendering (PBNR) is emerging as a promising class of rendering techniques, which are permeating all aspects of society, driven by a growing demand for real-time, photorealistic rendering in AR/VR and digital twins. Achieving real-time PBNR on mobile devices is challenging. This paper proposes MetaSapiens, a PBNR system that for the first time delivers real-time neural rendering on mobile devices while maintaining human visual quality. MetaSapiens combines three techniques. First, we present an efficiency-aware pruning technique to optimize rendering speed. Second, we introduce a Foveated Rendering (FR) method for PBNR, leveraging humans' low visual acuity in peripheral regions to relax rendering quality and improve rendering speed. Finally, we propose an accelerator design for FR, addressing the load imbalance issue in (FR-based) PBNR. Our evaluation shows that our system achieves an order of magnitude speedup over existing PBNR models without sacrificing subjective visual quality, as confirmed by a user study. The code and demo are available at: https://horizon-lab.org/metasapiens/.

翻译：基于点的神经绘制（PBNR）正逐渐成为一类前景广阔的绘制技术。在增强现实/虚拟现实（AR/VR）与数字孪生领域对实时、照片级真实感绘制日益增长的需求驱动下，该技术正渗透至社会的各个方面。在移动设备上实现实时PBNR仍面临挑战。本文提出MetaSapiens系统，首次在移动设备上实现了保持人类视觉质量的实时神经绘制。MetaSapiens融合了三种关键技术：首先，我们提出一种效率感知剪枝技术以优化绘制速度；其次，我们针对PBNR引入注视点渲染（FR）方法，利用人类在视觉外围区域分辨率较低的特性，适当降低绘制质量以提升渲染速度；最后，我们设计了面向FR的专用加速器，以解决基于FR的PBNR系统中负载不均衡的问题。实验评估表明，在用户研究确认未损失主观视觉质量的前提下，本系统相比现有PBNR模型实现了数量级的速度提升。代码与演示详见：https://horizon-lab.org/metasapiens/。