WorldGen: From Text to Traversable and Interactive 3D Worlds
We introduce WorldGen, a system that enables the automatic creation of large-scale, interactive 3D worlds directly from text prompts. Our approach transforms natural language descriptions into traversable, fully textured environments that can be immediately explored or edited within standard game engines. By combining LLM-driven scene layout reasoning, procedural generation, diffusion-based 3D generation, and object-aware scene decomposition, WorldGen bridges the gap between creative intent and functional virtual spaces, allowing creators to design coherent, navigable worlds without manual modeling or specialized 3D expertise. The system is fully modular and supports fine-grained control over layout, scale, and style, producing worlds that are geometrically consistent, visually rich, and efficient to render in real time. This work represents a step towards accessible, generative world-building at scale, advancing the frontier of 3D generative AI for applications in gaming, simulation, and immersive social environments.
6923c56fb5612535ed9558f1
Dilin Wang
6923c56fb5612535ed9558f2
Hyunyoung Jung
6923c56fb5612535ed9558f3
Tom Monnier
6923c56fb5612535ed9558f4
Kihyuk Sohn
6923c56fb5612535ed9558f5
Chuhang Zou
6923c56fb5612535ed9558f6
Xiaoyu Xiang
6923c56fb5612535ed9558f7
Yu-Ying Yeh
6923c56fb5612535ed9558f8
Di Liu
6923c56fb5612535ed9558f9
Zixuan Huang
6923c56fb5612535ed9558fa
Thu Nguyen-Phuoc
6923c56fb5612535ed9558fb
Yuchen Fan
6923c56fb5612535ed9558fc
Sergiu Oprea
6923c56fb5612535ed9558fd
Ziyan Wang
6923c56fb5612535ed9558fe
Roman Shapovalov
6923c56fb5612535ed9558ff
Nikolaos Sarafianos
6923c56fb5612535ed955900
Thibault Groueix
6923c56fb5612535ed955901
Antoine Toisoul
6923c56fb5612535ed955902
Prithviraj Dhar
6923c56fb5612535ed955903
Xiao Chu
6923c56fb5612535ed955904
Minghao Chen
6923c56fb5612535ed955905
Geon Yeong Park
6923c56fb5612535ed955906
Mahima Gupta
6923c56fb5612535ed955907
Yassir Azziz
6923c56fb5612535ed955908
Rakesh Ranjan
6923c56fb5612535ed955909
Andrea Vedaldi
WorldGen: From Text to Traversable and Interactive 3D Worlds
We introduce WorldGen, a system that enables the automatic creation of large-scale, interactive 3D worlds directly from text prompts. Our approach transforms natural language descriptions into traversable, fully textured environments that can be immediately explored or edited within standard game engines. By combining LLM-driven scene layout reasoning, procedural generation, diffusion-based 3D generation, and object-aware scene decomposition, WorldGen bridges the gap between creative intent and functional virtual spaces, allowing creators to design coherent, navigable worlds without manual modeling or specialized 3D expertise. The system is fully modular and supports fine-grained control over layout, scale, and style, producing worlds that are geometrically consistent, visually rich, and efficient to render in real time. This work represents a step towards accessible, generative world-building at scale, advancing the frontier of 3D generative AI for applications in gaming, simulation, and immersive social environments.
WorldGen converts text prompts into interactive 3D environments using LLM-driven reasoning, procedural generation, diffusion-based 3D generation, and object-aware decomposition, enabling creators to build coherent, navigable worlds efficiently.
LLM-driven scene layout reasoning procedural generation diffusion-based 3D generation object-aware scene decomposition 3D generative AI