Remote photoplethysmography (rPPG) transformers achieve low heart-rate error on benchmarks, yet their decisions remain opaque--a growing concern as rPPG moves toward clinical heart rate estimation. Existing rPPG XAI is dominated by qualitative heatmap inspection without quantitative faithfulness metrics or physiology-grounded validation, leaving a gap between visual plausibility and auditable evidence. We address this gap. First, we adapt four attribution methods (raw attention, rollout, flow, Beyond Intuition) to RhythmFormer's bi-level routing attention with top-$k$ selection. Second, we introduce a skin coverage metric quantifying how much attribution mass falls on skin regions. Third, we adapt the SaCo faithfulness coefficient from its original classification setting to rPPG regression by using the MAE between original and perturbed predicted rPPG waveforms as the perturbation impact. Applying these tools, we quantify a multi-hop leakage effect under sparse top-$k$ routing: attention rollout and flow almost completely restores the connections that individual refined-attention layers explicitly set to zero. Beyond Intuition mitigates this via its value-projection-weighted rollout and gradient-supported mask, attaining the highest median refined skin coverage ($0.83$ vs. $0.57$ for vanilla rollout) and faithfulness ($F=0.92$) among the evaluated methods on UBFC-rPPG. Validation across diverse datasets and model variants is needed. A case study on a low-SaCo outlier further shows all four methods recovering consistently once an artefactual region is replaced, suggesting consistent SaCo behavior across attribution families in this illustrative case. Together, these metrics move XAI for rPPG toward auditable numerical evidence about spatial alignment and perturbation faithfulness, i.e. trustworthy rPPG XAI.
翻译:远程光电容积描记法(rPPG)Transformer在基准测试中实现了低心率误差,但其决策过程仍不透明——随着rPPG向临床心率估计迈进,这一问题日益受到关注。现有rPPG可解释人工智能(XAI)主要依赖定性热力图分析,缺乏定量保真度指标或基于生理学的验证,导致视觉合理性与可审计证据之间存在差距。我们致力于填补这一空白。首先,我们将四种归因方法(原始注意力、展开、传播、超越直觉)适配到RhythmFormer的带有top-$k$选择的双层路由注意力上。其次,我们引入皮肤覆盖度指标,量化归因质量在皮肤区域的分布情况。第三,我们将SaCo保真度系数从原始的分类场景调整为rPPG回归场景,通过使用原始与扰动后预测rPPG波形之间的平均绝对误差(MAE)作为扰动影响度量。应用这些工具,我们量化了稀疏top-$k$路由下的多跳泄漏效应:注意力展开和传播几乎完全恢复了各精炼注意力层显式设置为零的连接。超越直觉方法通过其值投影加权的展开和梯度支持的掩码缓解了这一问题,在UBFC-rPPG数据集上取得了评估方法中最高的中位精炼皮肤覆盖度($0.83$对比原始展开的$0.57$)和保真度($F=0.92$)。需要跨不同数据集和模型变体进行验证。对低SaCo离群点的案例研究表明,当伪影区域被替换后,所有四种方法的表现均恢复一致,这表明在此示例案例中,不同归因家族的SaCo行为具有一致性。综合来看,这些指标将rPPG的XAI推向涉及空间对齐和扰动保真度的可审计数值证据,即可信的rPPG XAI。