LLM-based agents have shown increasing potential in automating scientific discovery. Given an optimizable metric and an execution environment, they can propose, validate, and iterate scientific solutions, and have produced results that outperform human-designed approaches. As model capabilities continue to improve, we argue that the bottleneck for autonomous scientific discovery is shifting from prescribing agent workflows to designing agent environments: the resources, constraints, and interfaces that shape agent behavior. We frame this as environment engineering: building environments that amplify productive behaviors, such as open-ended exploration, systematic artifact management, and inter-agent collaboration, while suppressing harmful behaviors, such as reward hacking and high-friction human oversight. We present EurekAgent, an environment-engineered agent system for metric-driven autonomous scientific discovery. EurekAgent engineers the environment along four dimensions: permissions engineering for bounded agent execution and isolated evaluation; artifact engineering for filesystem and Git-based collaboration; budget engineering for budget-aware exploration; and human-in-the-loop engineering for easy human supervision and intervention. EurekAgent sets new state-of-the-art results on multiple mathematics, kernel engineering, and machine learning tasks, including new state-of-the-art 26-circle packing results discovered with less than $11 in total API cost. We open-source our code and results, and call for environment engineering as a core research direction for developing reliable autonomous research agents.
翻译:基于大语言模型的智能体在自动化科学发现方面展现出日益增长的潜力。给定一个可优化的指标和执行环境,它们能够提出、验证并迭代科学解决方案,并且已经产生了超越人类设计方法的结果。随着模型能力的持续提升,我们认为自主科学发现的瓶颈正从规定智能体工作流程转向设计智能体环境:即塑造智能体行为的资源、约束和接口。我们将此定义为环境工程:构建能够放大有益行为(如开放式探索、系统性工件管理和智能体间协作),同时抑制有害行为(如奖励黑客和高摩擦的人工监督)的环境。我们提出了EurekAgent,一个面向度量驱动型自主科学发现的环境工程化智能体系统。EurekAgent从四个维度对环境进行工程化设计:用于限定智能体执行和隔离评估的权限工程;用于基于文件系统和Git协作的工件工程;用于预算感知探索的预算工程;以及用于便捷人工监督和干预的人机交互工程。EurekAgent在多个数学、内核工程和机器学习任务上取得了新的最优结果,包括以不到11美元的总API成本发现了新的26圆填充最优解。我们开源了代码和结果,并呼吁将环境工程作为开发可靠自主研究智能体的核心研究方向。