Ear occlusions (arising from the presence of ear accessories such as earrings and earphones) can negatively impact performance in ear-based biometric recognition systems, especially in unconstrained imaging circumstances. In this study, we assess the effectiveness of a diffusion-based ear inpainting technique as a pre-processing aid to mitigate the issues of ear accessory occlusions in transformer-based ear recognition systems. Given an input ear image and an automatically derived accessory mask, the inpainting model reconstructs clean and anatomically plausible ear regions by synthesizing missing pixels while preserving local geometric coherence along key ear structures, including the helix, antihelix, concha, and lobule. We evaluate the effectiveness of this pre-processing aid in transformer-based recognition systems for several vision transformer models and different patch sizes for a range of benchmark datasets. Experiments show that diffusion-based inpainting can be a useful pre-processing aid to alleviate ear accessory occlusions to improve overall recognition performance.
翻译:耳部遮挡(由耳环、耳机等耳部配饰的存在引起)会对基于耳部的生物特征识别系统性能产生负面影响,尤其是在非受控成像条件下。本研究评估了一种基于扩散的耳部修复技术作为预处理辅助手段的有效性,旨在缓解基于Transformer的耳部识别系统中耳部配饰遮挡问题。给定输入耳部图像及自动生成的配饰掩码,修复模型通过合成缺失像素来重建清洁且解剖结构合理的耳部区域,同时保持沿关键耳部结构(包括耳轮、对耳轮、耳甲腔和耳垂)的局部几何一致性。我们在多个基准数据集上,针对不同的视觉Transformer模型及不同补丁尺寸,评估了该预处理辅助手段在基于Transformer的识别系统中的有效性。实验表明,基于扩散的修复技术可作为有效的预处理辅助手段,缓解耳部配饰遮挡问题,从而提升整体识别性能。