Thinking in Frames: How Visual Context and Test-Time Scaling Empower Video Reasoning
Vision-Language Models have excelled at textual reasoning, but they often struggle with fine-grained spatial understanding and continuous action planning, failing to simulate the dynamics required for complex visual reasoning. In this work, we formulate visual reasoning by means of video generation models, positing that generated frames can act as intermediate reasoning steps between initial states and solutions. We evaluate their capacity in two distinct regimes: Maze Navigation for sequential discrete planning with low visual change and Tangram Puzzle for continuous manipulation with high visual change. Our experiments reveal three critical insights: (1) Robust Zero-Shot Generalization: In both tasks, the model demonstrates strong performance on unseen data distributions without specific finetuning. (2) Visual Context: The model effectively uses visual context as explicit control, such as agent icons and tangram shapes, enabling it to maintain high visual consistency and adapt its planning capability robustly to unseen patterns. (3) Visual Test-Time Scaling: We observe a test-time scaling law in sequential planning; increasing the generated video length (visual inference budget) empowers better zero-shot generalization to spatially and temporally complex paths. These findings suggest that video generation is not merely a media tool, but a scalable, generalizable paradigm for visual reasoning.
6985af2b4ad556f294b7ed58
Chengzu Li
6985af2b4ad556f294b7ed59
Zanyi Wang
6985af2b4ad556f294b7ed5a
Jiaang Li
claimed_verified
2026-02-13T09:37:50.828Z
6686658221f096c7fb4e0b24
/avatars/581f5d56b393b95c74f38a06f6bb4f69.svg
Jiaang Li
jaagli
user
jaagli
6985af2b4ad556f294b7ed5b
Yi Xu
claimed_verified
2026-04-09T08:08:11.333Z
644d55bd53ad80c659395473
https://cdn-avatars.huggingface.co/v1/production/uploads/644d55bd53ad80c659395473/Jdff2RyL6ZGhFSY8kab1L.jpeg
Yi Xu
yixu1
user
yixu1
6985af2b4ad556f294b7ed5c
Han Zhou
6985af2b4ad556f294b7ed5d
Huanyu Zhang
6985af2b4ad556f294b7ed5e
Ruichuan An
6985af2b4ad556f294b7ed5f
Dengyang Jiang
claimed_verified
2026-03-25T10:52:00.942Z
662a0f2d4bab737c1a279843
https://cdn-avatars.huggingface.co/v1/production/uploads/662a0f2d4bab737c1a279843/fC2p3mjMHkVpDQdEqkuR4.png
Dengyang Jiang
DyJiang
user
DyJiang
6985af2b4ad556f294b7ed60
Zhaochong An
claimed_verified
2026-03-30T09:11:42.813Z
65e5eae6958b39864e8b683e
/avatars/b6a857e7b725767197dd95bc876f8ad1.svg
Zhaochong An
ZhaochongAn
user
ZhaochongAn
6985af2b4ad556f294b7ed61
Ivan Vulić
6985af2b4ad556f294b7ed62
Serge Belongie
6985af2b4ad556f294b7ed63
Anna Korhonen
Thinking in Frames: How Visual Context and Test-Time Scaling Empower Video Reasoning
Vision-Language Models have excelled at textual reasoning, but they often struggle with fine-grained spatial understanding and continuous action planning, failing to simulate the dynamics required for complex visual reasoning. In this work, we formulate visual reasoning by means of video generation models, positing that generated frames can act as intermediate reasoning steps between initial states and solutions. We evaluate their capacity in two distinct regimes: Maze Navigation for sequential discrete planning with low visual change and Tangram Puzzle for continuous manipulation with high visual change. Our experiments reveal three critical insights: (1) Robust Zero-Shot Generalization: In both tasks, the model demonstrates strong performance on unseen data distributions without specific finetuning. (2) Visual Context: The model effectively uses visual context as explicit control, such as agent icons and tangram shapes, enabling it to maintain high visual consistency and adapt its planning capability robustly to unseen patterns. (3) Visual Test-Time Scaling: We observe a test-time scaling law in sequential planning; increasing the generated video length (visual inference budget) empowers better zero-shot generalization to spatially and temporally complex paths. These findings suggest that video generation is not merely a media tool, but a scalable, generalizable paradigm for visual reasoning.
Video generation models demonstrate robust zero-shot generalization for visual reasoning tasks through explicit visual context utilization and test-time scaling capabilities.
vision-language models video generation models visual reasoning maze navigation tangram puzzle zero-shot generalization visual context test-time scaling