We develop variational search distributions (VSD), a method for finding discrete, combinatorial designs of a rare desired class in a batch sequential manner with a fixed experimental budget. We formalize the requirements and desiderata for this problem and formulate a solution via variational inference. In particular, VSD uses off-the-shelf gradient based optimization routines, can learn powerful generative models for designs, and can take advantage of scalable predictive models. We derive asymptotic convergence rates for learning the true conditional generative distribution of designs with certain configurations of our method. After illustrating the generative model on images, we empirically demonstrate that VSD can outperform existing baseline methods on a set of real sequence-design problems in various biological systems.
翻译:本文提出变分搜索分布(VSD),一种在固定实验预算下以批量顺序方式寻找稀有目标类别的离散组合设计的方法。我们形式化了该问题的要求与期望,并通过变分推断构建解决方案。具体而言,VSD利用现成的基于梯度的优化流程,能够学习强大的设计生成模型,并可借助可扩展的预测模型。我们推导了在特定方法配置下学习真实条件生成设计分布的渐近收敛速率。通过在图像数据上展示生成模型后,我们通过实验证明,在多种生物系统的真实序列设计问题集中,VSD能够超越现有基线方法。