I analyze the evolution of papers certified by the Graphics Replicability Stamp Initiative (GRSI) to be reproducible, with a specific focus on the subset of publications that address visualization-related topics. With this analysis I show that, while the number of papers is increasing overall and within the visualization field, we still have to improve quite a bit to escape the replication crisis. I base my analysis on the data published by the GRSI as well as publication data for the different venues in visualization and lists of journal papers that have been presented at visualization-focused conferences. I also analyze the differences between the involved journals as well as the percentage of reproducible papers in the different presentation venues. Furthermore, I look at the authors of the publications and, in particular, their affiliation countries to see where most reproducible papers come from. Finally, I discuss potential reasons for the low reproducibility numbers and suggest possible ways to overcome these obstacles. This paper is reproducible itself, with source code and data available from github.com/tobiasisenberg/Visualization-Reproducibility as well as a free paper copy and all supplemental materials at osf.io/mvnbj.

翻译：本文分析了经图形学可复现性认证计划（GRSI）认证的可复现论文的发展趋势，特别关注涉及可视化主题的出版物子集。通过分析表明，尽管整体及可视化领域内的认证论文数量持续增长，但我们仍需大幅改进才能摆脱可复现性危机。本分析基于GRSI发布的数据、各可视化会议出版物数据，以及在可视化专题会议上发表的期刊论文清单。同时，我考察了相关期刊之间的差异，以及不同发表平台中可复现论文的比例。此外，通过分析论文作者及其所属国家/地区，揭示了高可复现性论文的地域分布特征。最后，本文探讨了可复现性比例偏低的原因，并提出克服这些障碍的潜在途径。本文本身具有可复现性，源代码和数据可通过github.com/tobiasisenberg/Visualization-Reproducibility获取，免费论文副本及所有补充材料存放于osf.io/mvnbj。