Reproducibility is a key aspect for scientific advancement across disciplines, and reducing barriers for open science is a focus area for the theme of Interspeech 2023. Availability of source code is one of the indicators that facilitates reproducibility. However, less is known about the rates of reproducibility at Interspeech conferences in comparison to other conferences in the field. In order to fill this gap, we have surveyed 27,717 papers at seven conferences across speech and language processing disciplines. We find that despite having a close number of accepted papers to the other conferences, Interspeech has up to 40% less source code availability. In addition to reporting the difficulties we have encountered during our research, we also provide recommendations and possible directions to increase reproducibility for further studies.
翻译:可复现性是跨学科科学进步的关键因素,降低开放科学的障碍是Interspeech 2023会议主题的重点领域。源代码的可得性是可复现性的促进指标之一。然而,相较于该领域其他会议,Interspeech会议的可复现率尚不明朗。为填补这一空白,我们对语音与语言处理领域七个会议的27,717篇论文进行了调查。我们发现,尽管接收论文数量与其他会议相近,但Interspeech会议的源代码可得性低至40%。除报告研究中遇到的困难外,我们还提出建议及可能的研究方向,以提升未来研究的可复现性。