A/B testing is widexly used in the industry to optimize customer facing websites. Many companies employ experimentation specialists to facilitate and improve the process of A/B testing. Here, we present the application of A/B testing to this improvement effort itself, by running experiments on the experimentation process, which we call 'meta-experiments'. We discuss the challenges of this approach using the example of one of our meta-experiments, which helped experimenters to run more sufficiently powered A/B tests. We also point out the benefits of 'dog fooding' for the experimentation specialists when running their own experiments.

翻译：A/B测试在业界被广泛用于优化面向客户的网站。许多公司聘请实验专家来促进和改进A/B测试流程。本文提出将A/B测试应用于这一改进工作本身，即对实验过程进行实验，我们称之为“元实验”。我们以一项帮助实验者运行更具统计功效的A/B测试的元实验为例，探讨了这种方法的挑战。同时，我们也指出了实验专家在亲自运行实验时“自食其果”的益处。