WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
This paper presents WorldPlay, a streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency, resolving the trade-off between speed and memory that limits current methods. WorldPlay draws power from three key innovations. 1) We use a Dual Action Representation to enable robust action control in response to the user's keyboard and mouse inputs. 2) To enforce long-term consistency, our Reconstituted Context Memory dynamically rebuilds context from past frames and uses temporal reframing to keep geometrically important but long-past frames accessible, effectively alleviating memory attenuation. 3) We also propose Context Forcing, a novel distillation method designed for memory-aware model. Aligning memory context between the teacher and student preserves the student's capacity to use long-range information, enabling real-time speeds while preventing error drift. Taken together, WorldPlay generates long-horizon streaming 720p video at 24 FPS with superior consistency, comparing favorably with existing techniques and showing strong generalization across diverse scenes. Project page and online demo can be found: https://3d-models.hunyuan.tencent.com/world/ and https://3d.hunyuan.tencent.com/sceneTo3D.
694219f25d5b2dc1052747ff
Wenqiang Sun
claimed_verified
2025-12-17T10:08:38.348Z
64897b1f0ec897cfe579a399
https://cdn-avatars.huggingface.co/v1/production/uploads/64897b1f0ec897cfe579a399/ICR_75b877BaSE94gjBuj.jpeg
wenq
wenqsun
user
wenqsun
694219f25d5b2dc105274800
Haiyu Zhang
694219f25d5b2dc105274801
Haoyuan Wang
694219f25d5b2dc105274802
Junta Wu
694219f25d5b2dc105274803
Zehan Wang
694219f25d5b2dc105274804
Zhenwei Wang
claimed_verified
2025-12-22T11:01:04.247Z
6305e9471e731505a76b9099
https://cdn-avatars.huggingface.co/v1/production/uploads/6305e9471e731505a76b9099/w9csjXIEUzrd0sa1FxIXm.jpeg
Zhenwei WANG (Zavier)
ZhenweiWang
user
ZhenweiWang
694219f25d5b2dc105274805
Yunhong Wang
694219f25d5b2dc105274806
Jun Zhang
694219f25d5b2dc105274807
Tengfei Wang
694219f25d5b2dc105274808
Chunchao Guo
WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
This paper presents WorldPlay, a streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency, resolving the trade-off between speed and memory that limits current methods. WorldPlay draws power from three key innovations. 1) We use a Dual Action Representation to enable robust action control in response to the user's keyboard and mouse inputs. 2) To enforce long-term consistency, our Reconstituted Context Memory dynamically rebuilds context from past frames and uses temporal reframing to keep geometrically important but long-past frames accessible, effectively alleviating memory attenuation. 3) We also propose Context Forcing, a novel distillation method designed for memory-aware model. Aligning memory context between the teacher and student preserves the student's capacity to use long-range information, enabling real-time speeds while preventing error drift. Taken together, WorldPlay generates long-horizon streaming 720p video at 24 FPS with superior consistency, comparing favorably with existing techniques and showing strong generalization across diverse scenes. Project page and online demo can be found: https://3d-models.hunyuan.tencent.com/world/ and https://3d.hunyuan.tencent.com/sceneTo3D.
WorldPlay is a streaming video diffusion model that achieves real-time, interactive world modeling with long-term geometric consistency by using a Dual Action Representation, Reconstituted Context Memory, and Context Forcing.
Dual Action Representation Reconstituted Context Memory temporal reframing Context Forcing memory-aware model long-horizon streaming video