Video-BrowseComp: Benchmarking Agentic Video Research on Open Web
The evolution of autonomous agents is redefining information seeking, transitioning from passive retrieval to proactive, open-ended web research. However, while textual and static multimodal agents have seen rapid progress, a significant modality gap remains in processing the web's most dynamic modality: video. Existing video benchmarks predominantly focus on passive perception, feeding curated clips to models without requiring external retrieval. They fail to evaluate agentic video research, which necessitates actively interrogating video timelines, cross-referencing dispersed evidence, and verifying claims against the open web. To bridge this gap, we present Video-BrowseComp, a challenging benchmark comprising 210 questions tailored for open-web agentic video reasoning. Unlike prior benchmarks, Video-BrowseComp enforces a mandatory dependency on temporal visual evidence, ensuring that answers cannot be derived solely through text search but require navigating video timelines to verify external claims. Our evaluation of state-of-the-art models reveals a critical bottleneck: even advanced search-augmented models like GPT-5.1 (w/ Search) achieve only 15.24\% accuracy. Our analysis reveals that these models largely rely on textual proxies, excelling in metadata-rich domains (e.g., TV shows with plot summaries) but collapsing in metadata-sparse, dynamic environments (e.g., sports, gameplay) where visual grounding is essential. As the first open-web video research benchmark, Video-BrowseComp advances the field beyond passive perception toward proactive video reasoning.
695354a689916ff627aa4013
Zhengyang Liang
claimed_verified
2026-01-04T20:31:59.883Z
642d26c4c5f19fe0da07284a
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/xJwh9iTDJcHLxaRT0t8OV.png
Zhengyang Liang
chr1ce
user
chr1ce
695354a689916ff627aa4014
Yan Shu
claimed_verified
2025-12-31T20:56:36.143Z
65c4f99b27736b5b86c2cbda
/avatars/8789b231ec16073ea0229c28f1f1dd06.svg
Yan Shu
sy1998
user
sy1998
695354a689916ff627aa4015
Xiangrui Liu
695354a689916ff627aa4016
Minghao Qin
695354a689916ff627aa4017
Kaixin Liang
695354a689916ff627aa4018
Paolo Rota
695354a689916ff627aa4019
Nicu Sebe
695354a689916ff627aa401a
Zheng Liu
695354a689916ff627aa401b
Lizi Liao
Video-BrowseComp: Benchmarking Agentic Video Research on Open Web
The evolution of autonomous agents is redefining information seeking, transitioning from passive retrieval to proactive, open-ended web research. However, while textual and static multimodal agents have seen rapid progress, a significant modality gap remains in processing the web's most dynamic modality: video. Existing video benchmarks predominantly focus on passive perception, feeding curated clips to models without requiring external retrieval. They fail to evaluate agentic video research, which necessitates actively interrogating video timelines, cross-referencing dispersed evidence, and verifying claims against the open web. To bridge this gap, we present Video-BrowseComp, a challenging benchmark comprising 210 questions tailored for open-web agentic video reasoning. Unlike prior benchmarks, Video-BrowseComp enforces a mandatory dependency on temporal visual evidence, ensuring that answers cannot be derived solely through text search but require navigating video timelines to verify external claims. Our evaluation of state-of-the-art models reveals a critical bottleneck: even advanced search-augmented models like GPT-5.1 (w/ Search) achieve only 15.24\% accuracy. Our analysis reveals that these models largely rely on textual proxies, excelling in metadata-rich domains (e.g., TV shows with plot summaries) but collapsing in metadata-sparse, dynamic environments (e.g., sports, gameplay) where visual grounding is essential. As the first open-web video research benchmark, Video-BrowseComp advances the field beyond passive perception toward proactive video reasoning.
The paper addresses the modality gap in autonomous agents for video processing by introducing a benchmark requiring proactive, open-web video reasoning, revealing limitations of current models in metadata-sparse, dynamic video domains.
autonomous agents temporal visual evidence Video-BrowseComp search-augmented models metadata-rich domains metadata-sparse environments visual grounding proactive video reasoning passive perception GPT-5.1 (w/ Search)