LLM-guided evolutionary search has emerged as a promising paradigm for automated algorithm discovery, yet most systems track search progress primarily through executable programs and scalar fitness. Even when natural-language reflection is used, it is often used locally in mutation prompts or stored without an explicit population-level organization of strategic directions. As a result, evolutionary search can struggle to distinguish syntactically different implementations of the same idea, preserve lower-fitness but strategically promising directions, or detect when an entire family of strategies has saturated. We introduce \model, a modular strategy-space layer that elevates natural-language strategy descriptions from transient prompt context to first-class population-level evolutionary state in LLM-driven program search. \model augments each candidate program with an explicit natural language strategy description and uses this representation in three ways: Strategy Articulation turns mutation into a diagnose-direct-implement process; Stratified Experience Retrieval organizes the archive into strategy clusters and selects inspirations by behavioral complementarity; and Strategic Landscape Navigation periodically summarizes effective, saturated, and underexplored strategy families to guide future mutations. Across mathematical algorithm discovery, systems optimization, and agent-scaffold benchmarks, \model improves the underlying evolutionary backbones in most settings, with particularly large gains (21% relative improvement) on open-ended system optimization tasks. These results suggest that persistent strategy representations provide a practical mechanism for improving the robustness and efficiency of LLM-guided evolutionary search, suggesting a path toward compound AI systems that accumulate algorithmic knowledge over time.
翻译:基于大语言模型引导的进化搜索已成为自动化算法发现的前沿范式,然而现有系统主要通过可执行程序与标量适应度追踪搜索进程。即使采用自然语言反思机制,其应用也往往局限于变异提示中的局部场景,或缺乏显式的种群级策略方向组织。这种缺陷导致进化搜索难以区分同一思想的不同语法实现,难以保留低适应度但具有战略价值的方向,更难以检测整个策略族是否已趋于饱和。本文提出\model模块化策略空间层,将自然语言策略描述从瞬态提示上下文提升为大语言模型驱动程序搜索中首要的种群级进化状态表征。\model为每个候选程序附加显式自然语言策略描述,并通过三重机制实现效能提升:策略表达将变异转化为诊断-定向-实施流程;分层经验检索将存档组织为策略簇,依据行为互补性选择启发性样本;策略空间导航周期性地总结有效、饱和及未充分探索的策略族以指导后续变异。在数学算法发现、系统优化及智能体框架基准测试中,\model在多数场景下显著提升了底层进化搜索框架的性能,尤其在开放式系统优化任务中实现21%的相对性能提升。实验结果表明,持久化策略表征为提升大语言模型引导进化搜索的鲁棒性与效率提供了切实可行的机制,揭示了构建持续积累算法知识的复合型人工智能系统的发展路径。