Directed acyclic graph (DAG) learning is a central task in structure discovery and causal inference. Although the field has witnessed remarkable advances over the past few years, it remains statistically and computationally challenging to learn a single (point estimate) DAG from data, let alone provide uncertainty quantification. We address the difficult task of quantifying graph uncertainty by developing a Bayesian variational inference framework based on novel, provably valid distributions that have support directly on the space of sparse DAGs. These distributions, which we use to define our prior and variational posterior, are induced by a projection operation that maps an arbitrary continuous distribution onto the space of sparse weighted acyclic adjacency matrices. While this projection is combinatorial, it can be solved efficiently using recent continuous reformulations of acyclicity constraints. We empirically demonstrate that our method, ProDAG, can outperform state-of-the-art alternatives in both accuracy and uncertainty quantification.
翻译:有向无环图学习是结构发现与因果推断中的核心任务。尽管该领域在过去几年取得了显著进展,但从数据中学习单一(点估计)DAG 在统计与计算上仍具挑战性,更遑论提供不确定性量化。我们通过建立一种基于新型可证明有效分布的贝叶斯变分推断框架,来解决图不确定性量化的难题——该分布直接以稀疏 DAG 空间为支撑集。我们利用该分布定义先验与变分后验,其通过投影操作导出:该操作将任意连续分布映射至稀疏加权无环邻接矩阵空间。虽然该投影属于组合优化问题,但借助近期对无环约束的连续化重构,可高效求解。实验表明,我们的方法 ProDAG 在准确性与不确定性量化方面均能优于当前最先进的替代方法。