Experiments on online marketplaces and social networks suffer from interference, where the outcome of a unit is impacted by the treatment status of other units. We propose a framework for modeling interference using a ubiquitous deployment mechanism for experiments, staggered roll-out designs, which slowly increase the fraction of units exposed to the treatment to mitigate any unanticipated adverse side effects. Our main idea is to leverage the temporal variations in treatment assignments introduced by roll-outs to model the interference structure. Since there are often multiple competing models of interference in practice we first develop a model selection method that evaluates models based on their ability to explain outcome variation observed along the roll-out. Through simulations, we show that our heuristic model selection method, Leave-One-Period-Out, outperforms other baselines. Next, we present a set of model identification conditions under which the estimation of common estimands is possible and show how these conditions are aided by roll-out designs. We conclude with a set of considerations, robustness checks, and potential limitations for practitioners wishing to use our framework.

翻译：在线市场和社交网络中的实验会遭受干扰，即一个单元的结果会受到其他单元处理状态的影响。我们提出了一种利用广泛使用的实验部署机制——分阶段展开设计——来建模干扰的框架，该设计逐步增加接受处理的单元比例，以减轻任何未预料到的不良副作用。我们的核心思想是利用展开过程引入的处理分配的时间变化来建模干扰结构。由于实践中常存在多种相互竞争的干扰模型，我们首先开发了一种模型选择方法，该方法根据模型解释沿展开过程观察到的结果变化的能力进行评估。通过模拟实验，我们展示了我们的启发式模型选择方法——留一期验证法——优于其他基线方法。接下来，我们提出了一组模型识别条件，在这些条件下可以估计常见的估计量，并展示了展开设计如何促进这些条件的实现。最后，我们为希望使用该框架的实践者提供了一系列考量、稳健性检验和潜在局限性。