Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models
Video--based world models have emerged along two dominant paradigms: video generation and 3D reconstruction. However, existing evaluation benchmarks either focus narrowly on visual fidelity and text--video alignment for generative models, or rely on static 3D reconstruction metrics that fundamentally neglect temporal dynamics. We argue that the future of world modeling lies in 4D generation, which jointly models spatial structure and temporal evolution. In this paradigm, the core capability is interactive response: the ability to faithfully reflect how interaction actions drive state transitions across space and time. Yet no existing benchmark systematically evaluates this critical dimension. To address this gap, we propose Omni--WorldBench, a comprehensive benchmark specifically designed to evaluate the interactive response capabilities of world models in 4D settings. Omni--WorldBench comprises two key components: Omni--WorldSuite, a systematic prompt suite spanning diverse interaction levels and scene types; and Omni--Metrics, an agent-based evaluation framework that quantifies world modeling capabilities by measuring the causal impact of interaction actions on both final outcomes and intermediate state evolution trajectories. We conduct extensive evaluations of 18 representative world models across multiple paradigms. Our analysis reveals critical limitations of current world models in interactive response, providing actionable insights for future research. Omni-WorldBench will be publicly released to foster progress in interactive 4D world modeling.
69c20900c105f45cb0481eee
Meiqi Wu
69c20900c105f45cb0481eef
Zhixin Cai
69c20900c105f45cb0481ef0
Fufangchen Zhao
69c20900c105f45cb0481ef1
Xiaokun Feng
69c20900c105f45cb0481ef2
Rujing Dang
69c20900c105f45cb0481ef3
Bingze Song
69c20900c105f45cb0481ef4
Ruitian Tian
69c20900c105f45cb0481ef5
Jiashu Zhu
69c20900c105f45cb0481ef6
Jiachen Lei
69c20900c105f45cb0481ef7
Hao Dou
69c20900c105f45cb0481ef8
Jing Tang
69c20900c105f45cb0481ef9
Lei Sun
69c20900c105f45cb0481efa
Jiahong Wu
69c20900c105f45cb0481efb
Xiangxiang Chu
69c20900c105f45cb0481efc
Zeming Liu
69c20900c105f45cb0481efd
Kaiqi Huang
Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models
Video--based world models have emerged along two dominant paradigms: video generation and 3D reconstruction. However, existing evaluation benchmarks either focus narrowly on visual fidelity and text--video alignment for generative models, or rely on static 3D reconstruction metrics that fundamentally neglect temporal dynamics. We argue that the future of world modeling lies in 4D generation, which jointly models spatial structure and temporal evolution. In this paradigm, the core capability is interactive response: the ability to faithfully reflect how interaction actions drive state transitions across space and time. Yet no existing benchmark systematically evaluates this critical dimension. To address this gap, we propose Omni--WorldBench, a comprehensive benchmark specifically designed to evaluate the interactive response capabilities of world models in 4D settings. Omni--WorldBench comprises two key components: Omni--WorldSuite, a systematic prompt suite spanning diverse interaction levels and scene types; and Omni--Metrics, an agent-based evaluation framework that quantifies world modeling capabilities by measuring the causal impact of interaction actions on both final outcomes and intermediate state evolution trajectories. We conduct extensive evaluations of 18 representative world models across multiple paradigms. Our analysis reveals critical limitations of current world models in interactive response, providing actionable insights for future research. Omni-WorldBench will be publicly released to foster progress in interactive 4D world modeling.
Omni-WorldBench addresses the lack of comprehensive evaluation for interactive 4D world models by introducing a benchmark that assesses temporal dynamics and causal interaction effects across diverse scenarios.
world models 4D generation interactive response causal impact temporal evolution state transitions agent-based evaluation video generation 3D reconstruction visual fidelity text-video alignment