The foundation of reproducible science lies in protocols that are precise, logically ordered, and executable. The autonomous generation of these protocols through natural language queries could greatly improve the efficiency of the reproduction process. However, current leading large language models (LLMs) often generate incomplete or inconsistent protocols, limiting their utility. To address this limitation, we first introduce SciRecipe, a large-scale dataset of over 12K structured protocols spanning 27 biological subfields and encompassing both comprehension and problem-solving tasks. To further improve protocol generation, we propose the "Sketch-and-Fill" paradigm, which separates analysis, structuring, and expression to ensure each step is explicit and verifiable. Complementing this, the structured component-based reward mechanism evaluates step granularity, action order, and semantic fidelity, aligning model optimization with experimental reliability. Building on these components, we develop Thoth, trained through a staged Knowledge-to-Action process that progresses from knowledge acquisition to operational reasoning and ultimately to robust, executable protocol generation. Across multiple benchmarks, Thoth consistently surpasses both proprietary and open-source LLMs, achieving significant improvements in step alignment, logical sequencing, and semantic accuracy. Our approach paves the way for reliable scientific assistants that bridge knowledge with experimental execution. All data, code, and models will be released publicly.
翻译:可重复科学的基础在于精确、逻辑有序且可执行的实验方案。通过自然语言查询自主生成这些方案可极大提升实验复现过程的效率。然而,当前主流大语言模型(LLMs)生成的方案常存在不完整或不一致的问题,限制了其实用性。为解决这一局限,我们首先引入SciRecipe数据集——一个涵盖27个生物子领域、包含理解与问题解决任务的大规模结构化方案数据集,规模超过12,000条。为进一步提升方案生成质量,我们提出"草图-填充"范式,将分析、结构化与表达解耦,确保每个步骤显式化且可验证。与此互补的结构化组件奖励机制通过评估步骤粒度、操作顺序与语义保真度,使模型优化与实验可靠性对齐。基于这些组件,我们开发了Thoth模型,通过分阶段的"知识到行动"训练流程进行训练——该流程从知识获取渐进至操作推理,最终实现稳健可执行的方案生成。在多个基准测试中,Thoth持续超越专有及开源大语言模型,在步骤对齐、逻辑序列与语义准确性方面取得显著提升。我们的研究为构建连接知识与实验执行的可靠科学助手开辟了新路径。所有数据、代码与模型将公开发布。