The importance of replication is often discussed and advocated -- not only in the domains of visualization and HCI, but in all scientific areas. When replicating a study, design decisions need to be made with regards which aspects of the original study will remain the same and which will be altered. We present a supporting multi-dimensional design space framework within which such decisions can be identified, categorized, compared and analyzed. The framework treats replication experimental design as a pairwise comparison problem, and represents the design by four practical dimensions defined by three comparison levels. The design space is therefore a framework that can be used for both retrospective characterization and prospective planning. We provide worked examples, and relate our framework to other attempts at describing the scope of replication studies.

翻译：复制的重要性常常被讨论和倡导——不仅在可视化和人机交互领域，而且在所有科学领域。当复制一项研究时，需要决定原始研究的哪些方面保持不变，哪些方面将进行改变。我们提出了一个多维设计空间框架，用以支持此类决策的识别、分类、比较和分析。该框架将复制实验设计视为成对比较问题，并通过由三个比较层次定义的四个实用维度来表示设计。因此，该设计空间是一个可用于回顾性描述和前瞻性规划的框架。我们提供了具体示例，并将我们的框架与其他描述复制研究范围的尝试进行了关联。