Security especially in the fields of IoT, industrial automation and critical infrastructure is paramount nowadays and a hot research topic. In order to ensure confidence in research results they need to be reproducible. In the past we reported [18] that in many publications important information such as details about the equipment used are missing. In this paper we report on our own experiments that we run to verify the parameters reported in the datasheets that came along with our experimental equipment. Our results show that there are significant discrepancies between the datasheets and the real world data. These deviations concern accuracy of positions, movements, duration of laser shots etc. In order to improve reproducibility of results we therefore argue on the one hand that research groups verify the data given in datasheets of equipment they use and on the other hand that they provide measurement set-up parameters in globally accepted units such as cm, seconds, etc.
翻译:当前,物联网、工业自动化及关键基础设施等领域的安全至关重要,已成为研究热点。为确保研究结果的可信度,实验结果必须具备可复现性。我们先前的研究[18]指出,许多已发表论文中缺失了关键信息(如实验设备的具体参数)。本文报告了我们为验证实验设备附带数据手册中参数而进行的自主实验。结果表明,数据手册参数与实际测量数据存在显著差异,涉及定位精度、运动轨迹、激光脉冲持续时间等方面。为提高结果可复现性,我们主张研究团队应做到以下两点:其一,对所用设备数据手册中的参数进行实际验证;其二,使用厘米、秒等国际通用单位提供测量系统参数。