This paper develops projection-free algorithms for online convex optimization with stochastic constraints. We design an online primal-dual projection-free framework that can take any projection-free algorithms developed for online convex optimization with no long-term constraint. With this general template, we deduce sublinear regret and constraint violation bounds for various settings. Moreover, for the case where the loss and constraint functions are smooth, we develop a primal-dual conditional gradient method that achieves $O(\sqrt{T})$ regret and $O(T^{3/4})$ constraint violations. Furthermore, for the setting where the loss and constraint functions are stochastic and strong duality holds for the associated offline stochastic optimization problem, we prove that the constraint violation can be reduced to have the same asymptotic growth as the regret.
翻译:本文针对具有随机约束的在线凸优化问题,提出了无投影算法。我们设计了一个在线原始-对偶无投影框架,该框架可兼容任何为无长期约束的在线凸优化所开发的无投影算法。通过这一通用模板,我们在多种场景下推导出次线性遗憾与约束违反界。此外,当损失函数与约束函数光滑时,我们开发了一种原始-对偶条件梯度方法,实现了$O(\sqrt{T})$的遗憾与$O(T^{3/4})$的约束违反。进一步地,针对损失函数与约束函数为随机函数且相关离线随机优化问题满足强对偶性的场景,我们证明约束违反可被降至与遗憾具有相同的渐近增长阶数。