Dr. Bench: A Multidimensional Evaluation for Deep Research Agents, from Answers to Reports
As an embodiment of intelligence evolution toward interconnected architectures, Deep Research Agents (DRAs) systematically exhibit the capabilities in task decomposition, cross-source retrieval, multi-stage reasoning, information integration, and structured output, which markedly enhance performance on complex and open-ended tasks. However, existing benchmarks remain deficient in evaluation dimensions, response format, and scoring mechanisms, limiting their effectiveness in assessing such agents. This paper introduces Dr. Bench, a multidimensional evaluation framework tailored to DRAs and long-form report-style responses. The benchmark comprises 214 expert-curated challenging tasks across 10 broad domains, each accompanied by manually constructed reference bundles to support composite evaluation. This framework incorporates metrics for semantic quality, topical focus, and retrieval trustworthiness, enabling a comprehensive evaluation of long reports generated by DRAs. Extensive experimentation confirms the superior performance of mainstream DRAs over web-search-tool-augmented reasoning models, yet reveals considerable scope for further improvement. This study provides a robust foundation for capability assessment, architectural refinement, and paradigm advancement of DRAs.
68df3194df49fb0df1e03c4e
Yang Yao
claimed_verified
2025-10-09T06:52:15.818Z
68e673f5f7b5b87f952b8568
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/RvG3sSBXmWjVuGNwcvDGT.png
YANG YAO
EVIGBYEN
user
EVIGBYEN
68df3194df49fb0df1e03c4f
Yixu Wang
claimed_verified
2025-10-09T12:49:18.138Z
64576c37900b28f784111822
/avatars/88aae11cb2bd7f138b266d82a951508d.svg
yxwang
yxwang
user
yxwang
68df3194df49fb0df1e03c50
Yuxuan Zhang
claimed_verified
2025-10-05T12:47:11.461Z
63b908d0e3c78740d8e950d0
/avatars/3e80075e92aebdfea712f70b00d5ec7d.svg
Yuxuan Zhang
Reacherx
user
Reacherx
68df3194df49fb0df1e03c51
Yi Lu
claimed_verified
2025-10-05T12:47:15.969Z
65095591cc02352e1e106d0a
https://cdn-avatars.huggingface.co/v1/production/uploads/65095591cc02352e1e106d0a/QgNhKBItxxHY927pBVBai.jpeg
Tom Lu
eigentom
user
eigentom
68df3194df49fb0df1e03c52
Tianle Gu
claimed_verified
2026-01-09T08:38:13.678Z
6346361c5efccdc07f179cae
/avatars/217818114a4c19ea4f3e5cdafefb625e.svg
Gu Tianle
Carol0110
user
Carol0110
68df3194df49fb0df1e03c53
Lingyu Li
68df3194df49fb0df1e03c54
Dingyi Zhao
68df3194df49fb0df1e03c55
Keming Wu
claimed_verified
2025-10-11T14:05:46.529Z
66bf00ca5b4e241fe266059d
https://cdn-avatars.huggingface.co/v1/production/uploads/66bf00ca5b4e241fe266059d/VoWPC_C4zoeT6dS699t7L.png
Keming Wu
wukeming11
user
wukeming11
68df3194df49fb0df1e03c56
Haozhe Wang
claimed_verified
2026-04-16T20:23:29.077Z
65bf52f0259bc6caeb74f8bf
/avatars/b38392e954466df784a5760ded5df804.svg
Haozhe Wang
JasperHaozhe
user
JasperHaozhe
68df3194df49fb0df1e03c57
Ping Nie
claimed_verified
2025-10-05T12:47:13.768Z
65358802a920f38780b3248a
/avatars/9415510b598079973c2b0436ad12db9c.svg
Ping Nie
pingnieuk
user
pingnieuk
68df3194df49fb0df1e03c58
Yan Teng
68df3194df49fb0df1e03c59
Yingchun Wang
Dr. Bench: A Multidimensional Evaluation for Deep Research Agents, from Answers to Reports
As an embodiment of intelligence evolution toward interconnected architectures, Deep Research Agents (DRAs) systematically exhibit the capabilities in task decomposition, cross-source retrieval, multi-stage reasoning, information integration, and structured output, which markedly enhance performance on complex and open-ended tasks. However, existing benchmarks remain deficient in evaluation dimensions, response format, and scoring mechanisms, limiting their effectiveness in assessing such agents. This paper introduces Dr. Bench, a multidimensional evaluation framework tailored to DRAs and long-form report-style responses. The benchmark comprises 214 expert-curated challenging tasks across 10 broad domains, each accompanied by manually constructed reference bundles to support composite evaluation. This framework incorporates metrics for semantic quality, topical focus, and retrieval trustworthiness, enabling a comprehensive evaluation of long reports generated by DRAs. Extensive experimentation confirms the superior performance of mainstream DRAs over web-search-tool-augmented reasoning models, yet reveals considerable scope for further improvement. This study provides a robust foundation for capability assessment, architectural refinement, and paradigm advancement of DRAs.
Deep Research Agents demonstrate advanced capabilities in complex task handling but lack comprehensive evaluation benchmarks, leading to the introduction of Dr. Bench for multidimensional assessment of long-form responses.
Deep Research Agents task decomposition cross-source retrieval multi-stage reasoning information integration structured output long-form report-style responses multidimensional evaluation framework expert-curated tasks reference bundles semantic quality topical focus retrieval trustworthiness