Social and behavioral science runs thousands of experiments each year, yet their findings rarely accumulate into a coherent map of what is known, what conflicts, and what remains missing. We introduce ExAtlas, a framework for turning an archive of experiments into an atlas: a structured map in which studies link, conflict, or leave bridgeable gaps. Given a target study, ExAtlas searches for prior studies that are locally close in treatment and outcome space and asks whether their observed effects can be composed to predict the target effect. This yields three cases. If the composition succeeds and agrees with the observed result, ExAtlas links the target to consistent prior evidence. If composition succeeds but disagrees, ExAtlas reconciles the conflict and proposes candidate moderators or higher-level theories that could explain it. If composition fails, ExAtlas proposes bridge experiments to close the gap. We provide an error bound for composition under local smoothness of the treatment-effect surface. On held-out targets certified as locally supported, ExAtlas recovers effect direction in 98.6% of cases. Human evaluations further suggest that its proposed bridge experiments are plausible and exhibit connectedness, and that its conflict explanations are useful for theory generation. These results suggest that the archive of social experiments contains more latent structure than current practice extracts -- and that making this structure explicit can guide both future theory and future experimentation.
翻译:社会与行为科学每年开展数千次实验,但研究结果极少能系统整合为关于已知发现、矛盾结论及缺失环节的连贯图谱。本文提出ExAtlas框架,旨在将实验档案转化为图集:一种结构化图谱,其中研究间可建立关联、呈现矛盾或留下可弥合的缺口。针对目标实验,ExAtlas在治疗变量与结果变量空间中搜索局部邻近的既往研究,并检验其观测效应是否可组合形成对目标效应的预测。该过程产生三种情形:若组合成功且与观测结果一致,ExAtlas将目标研究关联至一致的既有证据;若组合成功但存在分歧,ExAtlas则调和矛盾,并提出可能的调节变量或更高阶理论作为解释;若组合失败,ExAtlas则提出桥接实验以弥合缺口。我们推导了治疗效应曲面局部平滑条件下的组合误差界。在确认为局部支撑的保留测试目标上,ExAtlas在98.6%的案例中正确恢复了效应方向。人类评估进一步表明:其提出的桥接实验具有合理性和连通性,矛盾解释亦有助于理论生成。这些结果表明,社会实验档案蕴含的潜在结构远超当前实践所能提取的范围——而将这一结构显性化,可同时指导未来理论与实验设计。