Facial optical flow supports a wide range of tasks in facial motion analysis. However, the lack of high-resolution facial optical flow datasets has hindered progress in this area. In this paper, we introduce Splatting Rasterization Flow (SRFlow), a high-resolution facial optical flow dataset, and Splatting Rasterization Guided FlowNet (SRFlowNet), a facial optical flow model with tailored regularization losses. These losses constrain flow predictions using masks and gradients computed via difference or Sobel operator. This effectively suppresses high-frequency noise and large-scale errors in texture-less or repetitive-pattern regions, enabling SRFlowNet to be the first model explicitly capable of capturing high-resolution skin motion guided by Gaussian splatting rasterization. Experiments show that training with the SRFlow dataset improves facial optical flow estimation across various optical flow models, reducing end-point error (EPE) by up to 42% (from 0.5081 to 0.2953). Furthermore, when coupled with the SRFlow dataset, SRFlowNet achieves up to a 48% improvement in F1-score (from 0.4733 to 0.6947) on a composite of three micro-expression datasets. These results demonstrate the value of advancing both facial optical flow estimation and micro-expression recognition.
翻译:面部光流为面部运动分析中的多种任务提供了支持。然而,高分辨率面部光流数据集的缺乏阻碍了该领域的进展。本文介绍了溅射光栅化光流数据集(SRFlow)——一个高分辨率面部光流数据集,以及溅射光栅化引导光流网络(SRFlowNet)——一种配备了定制化正则化损失的面部光流模型。这些损失利用通过差分或Sobel算子计算得到的掩码和梯度来约束光流预测。该方法有效地抑制了在缺乏纹理或具有重复图案区域中出现的高频噪声和大尺度误差,使得SRFlowNet成为首个明确能够捕获由高斯溅射光栅化引导的高分辨率皮肤运动的模型。实验表明,使用SRFlow数据集进行训练能提升多种光流模型的面部光流估计性能,将端点误差(EPE)最高降低42%(从0.5081降至0.2953)。此外,当结合SRFlow数据集使用时,SRFlowNet在三个微表情数据集的复合评估中,F1分数最高提升了48%(从0.4733提升至0.6947)。这些结果证明了在推进面部光流估计和微表情识别两方面的价值。