Benchmarking Scientific Understanding and Reasoning for Video Generation using VideoScience-Bench
The next frontier for video generation lies in developing models capable of zero-shot reasoning, where understanding real-world scientific laws is crucial for accurate physical outcome modeling under diverse conditions. However, existing video benchmarks are physical commonsense-based, offering limited insight into video models' scientific reasoning capability. We introduce VideoScience-Bench, a benchmark designed to evaluate undergraduate-level scientific understanding in video models. Each prompt encodes a composite scientific scenario that requires understanding and reasoning across multiple scientific concepts to generate the correct phenomenon. The benchmark comprises 200 carefully curated prompts spanning 14 topics and 103 concepts in physics and chemistry. We conduct expert-annotated evaluations across seven state-of-the-art video models in T2V and I2V settings along five dimensions: Prompt Consistency, Phenomenon Congruency, Correct Dynamism, Immutability, and Spatio-Temporal Continuity. Using a VLM-as-a-Judge to assess video generations, we observe strong correlation with human assessments. To the best of our knowledge, VideoScience-Bench is the first benchmark to evaluate video models not only as generators but also as reasoners, requiring their generations to demonstrate scientific understanding consistent with expected physical and chemical phenomena. Our data and evaluation code are available at: https://github.com/hao-ai-lab/VideoScience{github.com/hao-ai-lab/VideoScience}.
692fa4dd26742347f61daaf1
Lanxiang Hu
claimed_verified
2025-12-22T11:01:23.561Z
6301d6455e305a35cb0846a7
https://cdn-avatars.huggingface.co/v1/production/uploads/6301d6455e305a35cb0846a7/aT2AtzRMSY_T3y02MIUap.jpeg
Lanxiang Hu
Snyhlxde
user
Snyhlxde
692fa4dd26742347f61daaf2
Abhilash Shankarampeta
claimed_verified
2026-03-18T08:47:20.307Z
60f44d791da5b7c98684c411
/avatars/98d82d4349980c1b4a9ef00c061db3e7.svg
Abhilash Shankarampeta
sizzle53
user
sizzle53
692fa4dd26742347f61daaf3
Yixin Huang
claimed_verified
2025-12-31T20:58:25.166Z
658a5f0c15b65eb9ba288642
https://cdn-avatars.huggingface.co/v1/production/uploads/658a5f0c15b65eb9ba288642/wRFQT_1g7Fxp-0oWef0Ya.jpeg
Yixin Huang
yixinhuang48
user
yixinhuang48
692fa4dd26742347f61daaf4
Zilin Dai
claimed_verified
2026-01-14T10:13:16.044Z
6752850dc282618862db5b7e
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/ohHelaDcOvtu28rHqgady.png
Forrest Dai
marshmallow64
user
marshmallow64
692fa4dd26742347f61daaf5
Haoyang Yu
692fa4dd26742347f61daaf6
Yujie Zhao
692fa4dd26742347f61daaf7
Haoqiang Kang
692fa4dd26742347f61daaf8
Daniel Zhao
692fa4dd26742347f61daaf9
Tajana Rosing
692fa4dd26742347f61daafa
Hao Zhang
Benchmarking Scientific Understanding and Reasoning for Video Generation using VideoScience-Bench
The next frontier for video generation lies in developing models capable of zero-shot reasoning, where understanding real-world scientific laws is crucial for accurate physical outcome modeling under diverse conditions. However, existing video benchmarks are physical commonsense-based, offering limited insight into video models' scientific reasoning capability. We introduce VideoScience-Bench, a benchmark designed to evaluate undergraduate-level scientific understanding in video models. Each prompt encodes a composite scientific scenario that requires understanding and reasoning across multiple scientific concepts to generate the correct phenomenon. The benchmark comprises 200 carefully curated prompts spanning 14 topics and 103 concepts in physics and chemistry. We conduct expert-annotated evaluations across seven state-of-the-art video models in T2V and I2V settings along five dimensions: Prompt Consistency, Phenomenon Congruency, Correct Dynamism, Immutability, and Spatio-Temporal Continuity. Using a VLM-as-a-Judge to assess video generations, we observe strong correlation with human assessments. To the best of our knowledge, VideoScience-Bench is the first benchmark to evaluate video models not only as generators but also as reasoners, requiring their generations to demonstrate scientific understanding consistent with expected physical and chemical phenomena. Our data and evaluation code are available at: https://github.com/hao-ai-lab/VideoScience{github.com/hao-ai-lab/VideoScience}.
VideoScience-Bench evaluates video models' scientific reasoning by assessing their ability to generate phenomena consistent with undergraduate-level physics and chemistry concepts.
zero-shot reasoning scientific reasoning VideoScience-Bench prompts scientific concepts T2V I2V Prompt Consistency Phenomenon Congruency Correct Dynamism Immutability Spatio-Temporal Continuity VLM-as-a-Judge