Captain Safari: A World Engine
World engines aim to synthesize long, 3D-consistent videos that support interactive exploration of a scene under user-controlled camera motion. However, existing systems struggle under aggressive 6-DoF trajectories and complex outdoor layouts: they lose long-range geometric coherence, deviate from the target path, or collapse into overly conservative motion. To this end, we introduce Captain Safari, a pose-conditioned world engine that generates videos by retrieving from a persistent world memory. Given a camera path, our method maintains a dynamic local memory and uses a retriever to fetch pose-aligned world tokens, which then condition video generation along the trajectory. This design enables the model to maintain stable 3D structure while accurately executing challenging camera maneuvers. To evaluate this setting, we curate OpenSafari, a new in-the-wild FPV dataset containing high-dynamic drone videos with verified camera trajectories, constructed through a multi-stage geometric and kinematic validation pipeline. Across video quality, 3D consistency, and trajectory following, Captain Safari substantially outperforms state-of-the-art camera-controlled generators. It reduces MEt3R from 0.3703 to 0.3690, improves AUC@30 from 0.181 to 0.200, and yields substantially lower FVD than all camera-controlled baselines. More importantly, in a 50-participant, 5-way human study where annotators select the best result among five anonymized models, 67.6% of preferences favor our method across all axes. Our results demonstrate that pose-conditioned world memory is a powerful mechanism for long-horizon, controllable video generation and provide OpenSafari as a challenging new benchmark for future world-engine research.
692d10e04397b1ec214f6835
Yu-Cheng Chou
admin_assigned
2025-12-01T10:16:40.879Z
66631978126013dc6a1fe62d
https://cdn-avatars.huggingface.co/v1/production/uploads/66631978126013dc6a1fe62d/PK0ZA6ic_iMuC230ZzWeh.png
Yu-Cheng Chou
Johnson111788
user
Johnson111788
692d10e04397b1ec214f6836
Xingrui Wang
claimed_verified
2025-12-03T09:18:52.082Z
64d8ab7a887f55fb6e5629da
https://cdn-avatars.huggingface.co/v1/production/uploads/64d8ab7a887f55fb6e5629da/KKr2_-pMUNfqTSgWlD9ZO.jpeg
Xingrui Wang
RyanWW
user
RyanWW
692d10e04397b1ec214f6837
Yitong Li
692d10e04397b1ec214f6838
Jiahao Wang
692d10e04397b1ec214f6839
Hanting Liu
admin_assigned
2025-12-01T10:17:08.100Z
688c1d60b6a6fc13e2899790
/avatars/83b2fc86b39d30ab5dc771de9915f392.svg
Hanting Liu
HantingL
user
HantingL
692d10e04397b1ec214f683a
Cihang Xie
692d10e04397b1ec214f683b
Alan Yuille
692d10e04397b1ec214f683c
Junfei Xiao
admin_assigned
2025-12-01T10:16:54.752Z
64b5ba6060274cbb296d6288
/avatars/67e0343954dda6e92ed3f6e7976f9f87.svg
Junfei Xiao
lambertxiao
user
lambertxiao
Captain Safari: A World Engine
World engines aim to synthesize long, 3D-consistent videos that support interactive exploration of a scene under user-controlled camera motion. However, existing systems struggle under aggressive 6-DoF trajectories and complex outdoor layouts: they lose long-range geometric coherence, deviate from the target path, or collapse into overly conservative motion. To this end, we introduce Captain Safari, a pose-conditioned world engine that generates videos by retrieving from a persistent world memory. Given a camera path, our method maintains a dynamic local memory and uses a retriever to fetch pose-aligned world tokens, which then condition video generation along the trajectory. This design enables the model to maintain stable 3D structure while accurately executing challenging camera maneuvers. To evaluate this setting, we curate OpenSafari, a new in-the-wild FPV dataset containing high-dynamic drone videos with verified camera trajectories, constructed through a multi-stage geometric and kinematic validation pipeline. Across video quality, 3D consistency, and trajectory following, Captain Safari substantially outperforms state-of-the-art camera-controlled generators. It reduces MEt3R from 0.3703 to 0.3690, improves AUC@30 from 0.181 to 0.200, and yields substantially lower FVD than all camera-controlled baselines. More importantly, in a 50-participant, 5-way human study where annotators select the best result among five anonymized models, 67.6% of preferences favor our method across all axes. Our results demonstrate that pose-conditioned world memory is a powerful mechanism for long-horizon, controllable video generation and provide OpenSafari as a challenging new benchmark for future world-engine research.
Captain Safari, a pose-conditioned world engine using a dynamic local memory and retriever for pose-aligned world tokens, generates high-quality, 3D-consistent long videos with accurate camera maneuvers, outperforming existing methods across quality, consistency, and trajectory following.
pose-conditioned world engine world memory dynamic local memory retriever pose-aligned world tokens video generation FPV dataset geometric validation kinematic validation MEt3R AUC@30 FVD human study