Storage experiments are vital to advancing storage research, but creating extensible and reproducible storage artifacts can be a challenging task. Our research has shown that only 1% of SSD simulator-based experiences are packaged and 0.5% of them can be easily reproduced. The lack of such artifacts without proper reproducibility can significantly impede the advancement of storage research. The biggest challenges in these types of experiments are ensuring that we have the correct environment to conduct them and creating extensible experiments that can be built upon in future research. To address this issue, we introduce StorRep, a thorough study that provides six extensible and reproducible storage experiment artifacts that serve as the foundation for further storage research, utilizing the Chameleon infrastructure. Our study offers experiment patterns and guidelines that can help researchers create transparent and dependable storage experiments. We have successfully integrated our methods in several experiments in multiple community and educational events over several years and produced publicly accessible artifacts that can be extended and fully reproduced without any restrictions.
翻译:存储实验对推动存储研究至关重要,但构建可扩展且可复现的存储实验制品是一项挑战性任务。我们的研究表明,仅1%的基于SSD模拟器的实验被打包,其中仅0.5%可被轻松复现。缺乏具备适当可复现性的实验制品将显著阻碍存储研究的进展。此类实验面临的最大挑战在于:确保拥有正确的实验环境,以及构建可被未来研究扩展的实验方案。为解决这一问题,我们提出StorRep——一项系统性研究,基于Chameleon基础设施提供六个可扩展、可复现的存储实验制品,为后续存储研究奠定基础。本研究提出的实验范式与指导原则,能够帮助研究者创建透明可靠的存储实验。我们已在多年间通过多个社区及教育活动成功将方法应用于多项实验,并生成了无任何限制的可公开访问实验制品,支持自由扩展与完全复现。