INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling
Building world models with spatial consistency and real-time interactivity remains a fundamental challenge in computer vision. Current video generation paradigms often struggle with a lack of spatial persistence and insufficient visual realism, making it difficult to support seamless navigation in complex environments. To address these challenges, we propose INSPATIO-WORLD, a novel real-time framework capable of recovering and generating high-fidelity, dynamic interactive scenes from a single reference video. At the core of our approach is a Spatiotemporal Autoregressive (STAR) architecture, which enables consistent and controllable scene evolution through two tightly coupled components: Implicit Spatiotemporal Cache aggregates reference and historical observations into a latent world representation, ensuring global consistency during long-horizon navigation; Explicit Spatial Constraint Module enforces geometric structure and translates user interactions into precise and physically plausible camera trajectories. Furthermore, we introduce Joint Distribution Matching Distillation (JDMD). By using real-world data distributions as a regularizing guide, JDMD effectively overcomes the fidelity degradation typically caused by over-reliance on synthetic data. Extensive experiments demonstrate that INSPATIO-WORLD significantly outperforms existing state-of-the-art (SOTA) models in spatial consistency and interaction precision, ranking first among real-time interactive methods on the WorldScore-Dynamic benchmark, and establishing a practical pipeline for navigating 4D environments reconstructed from monocular videos.
69d7098ec6ed9968ac5c6940
InSpatio Team
69d7098ec6ed9968ac5c6941
Donghui Shen
69d7098ec6ed9968ac5c6942
Guofeng Zhang
69d7098ec6ed9968ac5c6943
Haomin Liu
69d7098ec6ed9968ac5c6944
Haoyu Ji
69d7098ec6ed9968ac5c6945
Hujun Bao
69d7098ec6ed9968ac5c6946
Hongjia Zhai
69d7098ec6ed9968ac5c6947
Jialin Liu
69d7098ec6ed9968ac5c6948
Jing Guo
69d7098ec6ed9968ac5c6949
Nan Wang
69d7098ec6ed9968ac5c694a
Siji Pan
69d7098ec6ed9968ac5c694b
Weihong Pan
69d7098ec6ed9968ac5c694c
Weijian Xie
69d7098ec6ed9968ac5c694d
Xianbin Liu
69d7098ec6ed9968ac5c694e
Xiaojun Xiang
69d7098ec6ed9968ac5c694f
Xiaoyu Zhang
69d7098ec6ed9968ac5c6950
Xinyu Chen
69d7098ec6ed9968ac5c6951
Yifu Wang
69d7098ec6ed9968ac5c6952
Yipeng Chen
69d7098ec6ed9968ac5c6953
Zhenzhou Fan
69d7098ec6ed9968ac5c6954
Zhewen Le
69d7098ec6ed9968ac5c6955
Zhichao Ye
69d7098ec6ed9968ac5c6956
Ziqiang Zhao
INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling
Building world models with spatial consistency and real-time interactivity remains a fundamental challenge in computer vision. Current video generation paradigms often struggle with a lack of spatial persistence and insufficient visual realism, making it difficult to support seamless navigation in complex environments. To address these challenges, we propose INSPATIO-WORLD, a novel real-time framework capable of recovering and generating high-fidelity, dynamic interactive scenes from a single reference video. At the core of our approach is a Spatiotemporal Autoregressive (STAR) architecture, which enables consistent and controllable scene evolution through two tightly coupled components: Implicit Spatiotemporal Cache aggregates reference and historical observations into a latent world representation, ensuring global consistency during long-horizon navigation; Explicit Spatial Constraint Module enforces geometric structure and translates user interactions into precise and physically plausible camera trajectories. Furthermore, we introduce Joint Distribution Matching Distillation (JDMD). By using real-world data distributions as a regularizing guide, JDMD effectively overcomes the fidelity degradation typically caused by over-reliance on synthetic data. Extensive experiments demonstrate that INSPATIO-WORLD significantly outperforms existing state-of-the-art (SOTA) models in spatial consistency and interaction precision, ranking first among real-time interactive methods on the WorldScore-Dynamic benchmark, and establishing a practical pipeline for navigating 4D environments reconstructed from monocular videos.
INSPATIO-WORLD presents a real-time framework for generating high-fidelity dynamic scenes from single videos using spatiotemporal autoregressive architecture and joint distribution matching distillation.
Spatiotemporal Autoregressive implicit spatiotemporal cache explicit spatial constraint module joint distribution matching distillation 4D environment navigation monocular video reconstruction real-time interactive methods WorldScore-Dynamic benchmark