While first-order stationary points (FOSPs) are the traditional targets of non-convex optimization, they often correspond to undesirable strict saddle points. To circumvent this, attention has shifted towards second-order stationary points (SOSPs). In unconstrained settings, finding approximate SOSPs is PLS-complete (Kontogiannis et al.), matching the complexity of finding unconstrained FOSPs (Hollender and Zampetakis). However, the complexity of finding SOSPs in constrained settings remained notoriously unclear and was highlighted as an important open question by both aforementioned works. Under one strict definition, even verifying whether a point is an approximate SOSP is NP-hard (Murty and Kabadi). Under another widely adopted, relaxed definition where non-negative curvature is required only along the null space of the active constraints, the problem lies in TFNP, and algorithms with O(poly(1/epsilon)) running times have been proposed (Lu et al.). In this work, we settle the complexity of constrained SOSP by proving that computing an epsilon-approximate SOSP under the tractable definition is PLS-complete. We demonstrate that our result holds even in the 2D unit square [0,1]^2, and remarkably, even when stationary points are isolated at a distance of Omega(1) from the domain's boundary. Our result establishes a fundamental barrier: unless PLS is a subset of PPAD (implying PLS = CLS), no deterministic, iterative algorithm with an efficient, continuous update rule can exist for finding approximate SOSPs. This contrasts with the constrained first-order counterpart, for which Fearnley et al. showed that finding an approximate KKT point is CLS-complete. Finally, our result yields the first problem defined in a compact domain to be shown PLS-complete beyond the canonical Real-LocalOpt (Daskalakis and Papadimitriou)."
翻译:虽然一阶稳定点(FOSP)是非凸优化的传统目标,但它们往往对应不理想的严格鞍点。为规避这一问题,研究重点已转向二阶稳定点(SOSP)。在无约束设定下,寻找近似SOSP是PLS完全的(Kontogiannis等人),这与寻找无约束FOSP的复杂性相匹配(Hollender和Zampetakis)。然而,约束设定下寻找SOSP的复杂性长期未明,并被上述两篇文献列为重要开放问题。在一种严格定义下,即使验证某点是否为近似SOSP也是NP困难的(Murty和Kabadi)。在另一种被广泛采用的宽松定义下(仅要求在有效约束零空间内具有非负曲率),该问题属于TFNP,且已有时间复杂度为O(poly(1/ε))的算法提出(Lu等人)。本文通过证明在可处理定义下计算ε-近似SOSP是PLS完全的,解决了约束SOSP的复杂性。我们证明即使在二维单位正方形[0,1]^2中,且稳定点与域边界距离为Omega(1)时孤立存在,该结果依然成立。这一结论揭示了根本性障碍:除非PLS是PPAD的子集(这意味着PLS=CLS),否则不存在具有高效连续更新规则的确定性迭代算法来寻找近似SOSP。这与约束一阶情形形成对比——Fearnley等人已证明寻找近似KKT点是CLS完全的。最后,我们的结果首次证明除经典问题Real-LocalOpt(Daskalakis和Papadimitriou)外,存在定义在紧致域上的PLS完全问题。