Research reproducibility - i.e., rerunning analyses on original data to replicate the results - is paramount for guaranteeing scientific validity. However, reproducibility is often very challenging, especially in research fields where multi-disciplinary teams are involved, such as child-robot interaction (CRI). This paper presents a systematic review of the last three years (2020-2022) of research in CRI under the lens of reproducibility, by analysing the field for transparency in reporting. Across a total of 325 studies, we found deficiencies in reporting demographics (e.g. age of participants), study design and implementation (e.g. length of interactions), and open data (e.g. maintaining an active code repository). From this analysis, we distill a set of guidelines and provide a checklist to systematically report CRI studies to help and guide research to improve reproducibility in CRI and beyond.
翻译:研究可重复性——即对原始数据重新进行分析以重现结果——对于保证科学有效性至关重要。然而,可重复性往往极具挑战性,尤其是在涉及多学科团队的研究领域,例如儿童-机器人交互。本文通过分析报告透明度,对过去三年(2020-2022年)儿童-机器人交互领域的研究进行了可重复性视角下的系统综述。在共计325项研究中,我们发现报告人口统计学信息(如参与者年龄)、研究设计与实施(如互动时长)以及开放数据(如维护活跃的代码库)方面存在不足。基于此分析,我们提炼出一套指南,并提供了一份系统报告儿童-机器人交互研究的清单,以帮助和指导研究提升儿童-机器人交互及其他领域的可重复性。