Deep Research Systems (DRS) aim to help users search the web, synthesize information, and deliver comprehensive investigative reports. However, how to rigorously evaluate these systems remains under-explored. Existing deep-research benchmarks often fall into two failure modes. Some do not adequately test a system's ability to analyze evidence and write coherent reports. Others rely on evaluation criteria that are either overly coarse or directly defined by LLMs (or both), leading to scores that can be biased relative to human experts and are hard to verify or interpret. To address these issues, we introduce Deep Research Bench II, a new benchmark for evaluating DRS-generated reports. It contains 132 grounded research tasks across 22 domains; for each task, a system must produce a long-form research report that is evaluated by a set of 9430 fine-grained binary rubrics in total, covering three dimensions: information recall, analysis, and presentation. All rubrics are derived from carefully selected expert-written investigative articles and are constructed through a four-stage LLM+human pipeline that combines automatic extraction with over 400 human-hours of expert review, ensuring that the criteria are atomic, verifiable, and aligned with human expert judgment. We evaluate several state-of-the-art deep-research systems on Deep Research Bench II and find that even the strongest models satisfy fewer than 50% of the rubrics, revealing a substantial gap between current DRSs and human experts.

翻译：深度研究系统旨在帮助用户搜索网络、整合信息并生成全面的调查报告。然而，如何严格评估此类系统仍缺乏深入探索。现有的深度研究基准常陷入两种失效模式：一些基准未能充分测试系统分析证据与撰写连贯报告的能力；另一些则依赖过于粗略或完全由大语言模型定义的评估标准（或两者兼有），导致评分相对于人类专家可能存在偏差且难以验证或解释。为解决这些问题，我们提出Deep Research Bench II——一个用于评估深度研究系统生成报告的新基准。该基准涵盖22个领域的132项基础研究任务；针对每项任务，系统需生成一份长篇幅研究报告，并通过总计9430条细粒度二元量规进行评估，覆盖信息回溯、分析与呈现三个维度。所有量规均源自精心筛选的专家撰写的调查性文章，并通过包含自动提取与超过400小时专家评审的四阶段“大语言模型+人工”流程构建，确保评估标准具备原子性、可验证性且与人类专家判断保持一致。我们在Deep Research Bench II上评估了多个前沿深度研究系统，发现即使最强模型也仅满足不足50%的量规要求，揭示了当前深度研究系统与人类专家水平之间存在显著差距。