Solaris: Building a Multiplayer Video World Model in Minecraft
Existing action-conditioned video generation models (video world models) are limited to single-agent perspectives, failing to capture the multi-agent interactions of real-world environments. We introduce Solaris, a multiplayer video world model that simulates consistent multi-view observations. To enable this, we develop a multiplayer data system designed for robust, continuous, and automated data collection on video games such as Minecraft. Unlike prior platforms built for single-player settings, our system supports coordinated multi-agent interaction and synchronized videos + actions capture. Using this system, we collect 12.64 million multiplayer frames and propose an evaluation framework for multiplayer movement, memory, grounding, building, and view consistency. We train Solaris using a staged pipeline that progressively transitions from single-player to multiplayer modeling, combining bidirectional, causal, and Self Forcing training. In the final stage, we introduce Checkpointed Self Forcing, a memory-efficient Self Forcing variant that enables a longer-horizon teacher. Results show our architecture and training design outperform existing baselines. Through open-sourcing our system and models, we hope to lay the groundwork for a new generation of multi-agent world models.
699fb974ebfce7fbcca91b04
Georgy Savva
699fb974ebfce7fbcca91b05
Oscar Michel
699fb974ebfce7fbcca91b06
Daohan Lu
claimed_verified
2026-03-05T09:59:05.487Z
634eb33baae4bde2c8df5660
/avatars/327281827cc7632f5f5615cffa7abe7d.svg
Daohan Lu
daohanlu
user
daohanlu
699fb974ebfce7fbcca91b07
Suppakit Waiwitlikhit
699fb974ebfce7fbcca91b08
Timothy Meehan
699fb974ebfce7fbcca91b09
Dhairya Mishra
699fb974ebfce7fbcca91b0a
Srivats Poddar
699fb974ebfce7fbcca91b0b
Jack Lu
699fb974ebfce7fbcca91b0c
Saining Xie
Solaris: Building a Multiplayer Video World Model in Minecraft
Existing action-conditioned video generation models (video world models) are limited to single-agent perspectives, failing to capture the multi-agent interactions of real-world environments. We introduce Solaris, a multiplayer video world model that simulates consistent multi-view observations. To enable this, we develop a multiplayer data system designed for robust, continuous, and automated data collection on video games such as Minecraft. Unlike prior platforms built for single-player settings, our system supports coordinated multi-agent interaction and synchronized videos + actions capture. Using this system, we collect 12.64 million multiplayer frames and propose an evaluation framework for multiplayer movement, memory, grounding, building, and view consistency. We train Solaris using a staged pipeline that progressively transitions from single-player to multiplayer modeling, combining bidirectional, causal, and Self Forcing training. In the final stage, we introduce Checkpointed Self Forcing, a memory-efficient Self Forcing variant that enables a longer-horizon teacher. Results show our architecture and training design outperform existing baselines. Through open-sourcing our system and models, we hope to lay the groundwork for a new generation of multi-agent world models.
Solaris is a multiplayer video world model that simulates consistent multi-view observations through a novel data collection system and staged training approach.
video world models multiplayer multi-agent interactions data collection staged pipeline bidirectional causal Self Forcing checkpointed Self Forcing