OmniRoam: World Wandering via Long-Horizon Panoramic Video Generation
Modeling scenes using video generation models has garnered growing research interest in recent years. However, most existing approaches rely on perspective video models that synthesize only limited observations of a scene, leading to issues of completeness and global consistency. We propose OmniRoam, a controllable panoramic video generation framework that exploits the rich per-frame scene coverage and inherent long-term spatial and temporal consistency of panoramic representation, enabling long-horizon scene wandering. Our framework begins with a preview stage, where a trajectory-controlled video generation model creates a quick overview of the scene from a given input image or video. Then, in the refine stage, this video is temporally extended and spatially upsampled to produce long-range, high-resolution videos, thus enabling high-fidelity world wandering. To train our model, we introduce two panoramic video datasets that incorporate both synthetic and real-world captured videos. Experiments show that our framework consistently outperforms state-of-the-art methods in terms of visual quality, controllability, and long-term scene consistency, both qualitatively and quantitatively. We further showcase several extensions of this framework, including real-time video generation and 3D reconstruction. Code is available at https://github.com/yuhengliu02/OmniRoam.
69cce5443f84a0971be66cee
Yuheng Liu
claimed_verified
2026-04-01T12:42:53.965Z
6719d7b6248e67e1a915d9b8
https://cdn-avatars.huggingface.co/v1/production/uploads/6719d7b6248e67e1a915d9b8/XcxMnbh_y-yZ-eH3au6LW.jpeg
YuhengLiu
Yuheng02
user
Yuheng02
69cce5443f84a0971be66cef
Xin Lin
69cce5443f84a0971be66cf0
Xinke Li
69cce5443f84a0971be66cf1
Baihan Yang
claimed_verified
2026-04-07T08:46:50.104Z
65f9810533f524e4044b123f
/avatars/f599a724f1d50bea5983b7958f88a0ab.svg
Yang Baihan
WhiteYC
user
WhiteYC
69cce5443f84a0971be66cf2
Chen Wang
69cce5443f84a0971be66cf3
Kalyan Sunkavalli
69cce5443f84a0971be66cf4
Yannick Hold-Geoffroy
69cce5443f84a0971be66cf5
Hao Tan
69cce5443f84a0971be66cf6
Kai Zhang
69cce5443f84a0971be66cf7
Xiaohui Xie
69cce5443f84a0971be66cf8
Zifan Shi
69cce5443f84a0971be66cf9
Yiwei Hu
OmniRoam: World Wandering via Long-Horizon Panoramic Video Generation
Modeling scenes using video generation models has garnered growing research interest in recent years. However, most existing approaches rely on perspective video models that synthesize only limited observations of a scene, leading to issues of completeness and global consistency. We propose OmniRoam, a controllable panoramic video generation framework that exploits the rich per-frame scene coverage and inherent long-term spatial and temporal consistency of panoramic representation, enabling long-horizon scene wandering. Our framework begins with a preview stage, where a trajectory-controlled video generation model creates a quick overview of the scene from a given input image or video. Then, in the refine stage, this video is temporally extended and spatially upsampled to produce long-range, high-resolution videos, thus enabling high-fidelity world wandering. To train our model, we introduce two panoramic video datasets that incorporate both synthetic and real-world captured videos. Experiments show that our framework consistently outperforms state-of-the-art methods in terms of visual quality, controllability, and long-term scene consistency, both qualitatively and quantitatively. We further showcase several extensions of this framework, including real-time video generation and 3D reconstruction. Code is available at https://github.com/yuhengliu02/OmniRoam.
OmniRoam enables long-horizon panoramic video generation with improved scene completeness and consistency through a two-stage approach combining trajectory-controlled preview and refinement stages.
panoramic video generation trajectory-controlled video generation video generation models scene modeling long-horizon scene wandering temporal extension spatial upsampling panoramic video datasets 3D reconstruction