In the last decade, replication and reproducibility crises have shaken the scientific landscape. As potential solutions, open science practices were heavily discussed and have been implemented with varying success in different disciplines. We argue, however, that the binary definition of reproducibility, specifically for computational-X disciplines such as computational social science, is insufficient since it is not explicit about the agents and conditions under which results can be reproduced. We expand the definition to avoid "open washing", the practice of fabricating theoretical reproducibility but not supporting practical or verified reproducibility, and introduce a tier system of computational reproducibility based on the concept of verifiability. We identify common barriers to verifiable computational reproducibility, specifically in the field of computational social science, and provide suggestions on how to circumvent common access and computational barriers.
翻译:在过去十年中,复制与可复现性危机动摇了科学界的根基。作为潜在解决方案,开放科学实践得到广泛讨论,并在不同学科中以不同程度的成效得以实施。然而我们认为,当前对可复现性的二元定义——尤其是针对计算社会科学等计算交叉学科而言——存在不足,因其未能明确定义结果可被复现的行为主体与条件。为避免"开放洗白"现象(即制造理论上的可复现性却未支持实践或可验证的可复现性),我们扩展了可复现性定义,并基于可验证性概念引入计算可复现性的层级体系。我们识别了实现可验证计算可复现性的常见障碍(特别是计算社会科学领域),并就如何规避常见的访问与计算障碍提出建议。