The importance of replication is often discussed and advocated -- not only in the domains of visualization and HCI, but in all scientific areas. When replicating a study, design decisions need to be made with regards which aspects of the original study will remain the same and which will be altered. We present a supporting multi-dimensional design space framework within which such decisions can be identified, categorized, compared and analyzed. The framework treats replication experimental design as a pairwise comparison problem, and represents the design by four practical dimensions defined by three comparison levels. The design space is therefore a framework that can be used for both retrospective characterization and prospective planning. We provide worked examples, and relate our framework to other attempts at describing the scope of replication studies.

翻译：复制的重要性不仅在可视化与人机交互领域，更在所有的科学领域中常被探讨与倡导。当进行一项研究的复制时，需要就原始研究的哪些方面保持不变、哪些方面将被修改做出设计决策。我们提出了一个支持性的多维设计空间框架，在此框架内可以识别、分类、比较和分析这些决策。该框架将复制实验设计视为一个成对比较问题，并通过三个比较层级定义的四个实用维度来表征设计。因此，该设计空间是一个既可用于回顾性特征描述，也可用于前瞻性规划的框架。我们提供了具体示例，并将我们的框架与其他描述复制研究范围的尝试联系起来。