FlowInOne:Unifying Multimodal Generation as Image-in, Image-out Flow Matching
Multimodal generation has long been dominated by text-driven pipelines where language dictates vision but cannot reason or create within it. We challenge this paradigm by asking whether all modalities, including textual descriptions, spatial layouts, and editing instructions, can be unified into a single visual representation. We present FlowInOne, a framework that reformulates multimodal generation as a purely visual flow, converting all inputs into visual prompts and enabling a clean image-in, image-out pipeline governed by a single flow matching model. This vision-centric formulation naturally eliminates cross-modal alignment bottlenecks, noise scheduling, and task-specific architectural branches, unifying text-to-image generation, layout-guided editing, and visual instruction following under one coherent paradigm. To support this, we introduce VisPrompt-5M, a large-scale dataset of 5 million visual prompt pairs spanning diverse tasks including physics-aware force dynamics and trajectory prediction, alongside VP-Bench, a rigorously curated benchmark assessing instruction faithfulness, spatial precision, visual realism, and content consistency. Extensive experiments demonstrate that FlowInOne achieves state-of-the-art performance across all unified generation tasks, surpassing both open-source models and competitive commercial systems, establishing a new foundation for fully vision-centric generative modeling where perception and creation coexist within a single continuous visual space.
69d709d6c6ed9968ac5c695a
Junchao Yi
claimed_verified
2026-04-09T08:06:55.734Z
67ee16793431887c4ddeeb25
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/qYNhJKGo5oZCegA97dk9R.png
Junchao Yi
Junc1i
user
Junc1i
69d709d6c6ed9968ac5c695b
Rui Zhao
claimed_verified
2026-04-15T12:08:49.442Z
652b83b73b5997ed71a310f2
https://cdn-avatars.huggingface.co/v1/production/uploads/652b83b73b5997ed71a310f2/ipCpdeHUp4-0OmRz5z8IW.png
Rui Zhao
ruizhaocv
user
ruizhaocv
69d709d6c6ed9968ac5c695c
Jiahao Tang
69d709d6c6ed9968ac5c695d
Weixian Lei
69d709d6c6ed9968ac5c695e
Linjie Li
69d709d6c6ed9968ac5c695f
Qisheng Su
69d709d6c6ed9968ac5c6960
Zhengyuan Yang
69d709d6c6ed9968ac5c6961
Lijuan Wang
69d709d6c6ed9968ac5c6962
Xiaofeng Zhu
69d709d6c6ed9968ac5c6963
Alex Jinpeng Wang
FlowInOne:Unifying Multimodal Generation as Image-in, Image-out Flow Matching
Multimodal generation has long been dominated by text-driven pipelines where language dictates vision but cannot reason or create within it. We challenge this paradigm by asking whether all modalities, including textual descriptions, spatial layouts, and editing instructions, can be unified into a single visual representation. We present FlowInOne, a framework that reformulates multimodal generation as a purely visual flow, converting all inputs into visual prompts and enabling a clean image-in, image-out pipeline governed by a single flow matching model. This vision-centric formulation naturally eliminates cross-modal alignment bottlenecks, noise scheduling, and task-specific architectural branches, unifying text-to-image generation, layout-guided editing, and visual instruction following under one coherent paradigm. To support this, we introduce VisPrompt-5M, a large-scale dataset of 5 million visual prompt pairs spanning diverse tasks including physics-aware force dynamics and trajectory prediction, alongside VP-Bench, a rigorously curated benchmark assessing instruction faithfulness, spatial precision, visual realism, and content consistency. Extensive experiments demonstrate that FlowInOne achieves state-of-the-art performance across all unified generation tasks, surpassing both open-source models and competitive commercial systems, establishing a new foundation for fully vision-centric generative modeling where perception and creation coexist within a single continuous visual space.
FlowInOne presents a vision-centric multimodal generation framework that unifies diverse input modalities into a single visual representation, enabling coherent image generation and editing through a unified flow matching model.
multimodal generation visual representation flow matching model image-in image-out pipeline cross-modal alignment vision-centric formulation visual prompt pairs instruction faithfulness spatial precision visual realism content consistency