Like face recognition, speaker recognition is widely used for voice-based biometric identification in a broad range of industries, including banking, education, recruitment, immigration, law enforcement, healthcare, and well-being. However, while dataset evaluations and audits have improved data practices in computer vision and face recognition, the data practices in speaker recognition have gone largely unquestioned. Our research aims to address this gap by exploring how dataset usage has evolved over time and what implications this has on bias and fairness in speaker recognition systems. Previous studies have demonstrated the presence of historical, representation, and measurement biases in popular speaker recognition benchmarks. In this paper, we present a longitudinal study of speaker recognition datasets used for training and evaluation from 2012 to 2021. We survey close to 700 papers to investigate community adoption of datasets and changes in usage over a crucial time period where speaker recognition approaches transitioned to the widespread adoption of deep neural networks. Our study identifies the most commonly used datasets in the field, examines their usage patterns, and assesses their attributes that affect bias, fairness, and other ethical concerns. Our findings suggest areas for further research on the ethics and fairness of speaker recognition technology.
翻译:与面部识别类似,说话人识别被广泛应用于银行、教育、招聘、移民、执法、医疗健康及福祉等多个行业的语音生物特征识别中。然而,尽管数据集评估与审计已改善了计算机视觉和面部识别领域的数据实践,但说话人识别中的数据实践在很大程度上仍未受到质疑。本研究旨在通过探讨数据集使用如何随时间演变及其对说话人识别系统中偏见与公平性的影响来填补这一空白。此前研究已证实主流说话人识别基准中存在历史性、表征性和测量性偏见。本文对2012年至2021年间用于训练与评估的说话人识别数据集进行了纵向研究。我们调查了近700篇论文,以考察在说话人识别方法逐渐转向深度神经网络广泛采用的关键时期内,数据集在学术界的采用情况及其使用变化。本研究识别出该领域最常用的数据集,分析其使用模式,并评估影响偏见、公平性及其他伦理问题的数据集属性。我们的发现为说话人识别技术伦理与公平性的进一步研究指明了方向。