Best of Both Worlds: Multimodal Reasoning and Generation via Unified Discrete Flow Matching
We propose UniDFlow, a unified discrete flow-matching framework for multimodal understanding, generation, and editing. It decouples understanding and generation via task-specific low-rank adapters, avoiding objective interference and representation entanglement, while a novel reference-based multimodal preference alignment optimizes relative outcomes under identical conditioning, improving faithfulness and controllability without large-scale retraining. UniDFlpw achieves SOTA performance across eight benchmarks and exhibits strong zero-shot generalization to tasks including inpainting, in-context image generation, reference-based editing, and compositional generation, despite no explicit task-specific training.
698ea111cace060ff123ae50
Onkar Susladkar
698ea111cace060ff123ae51
Tushar Prakash
698ea111cace060ff123ae52
Gayatri Deshmukh
698ea111cace060ff123ae53
Kiet A. Nguyen
698ea111cace060ff123ae54
Jiaxun Zhang
698ea111cace060ff123ae55
Adheesh Juvekar
698ea111cace060ff123ae56
Tianshu Bao
698ea111cace060ff123ae57
Lin Chai
698ea111cace060ff123ae58
Sparsh Mittal
698ea111cace060ff123ae59
Inderjit S Dhillon
698ea111cace060ff123ae5a
Ismini Lourentzou
claimed_verified
2026-02-17T15:51:09.410Z
678ac3b31cbaa0b4bc295885
/avatars/1244fc1b305c9c6383df9bb5e4707347.svg
Ismini Lourentzou
isminoula
user
isminoula
Best of Both Worlds: Multimodal Reasoning and Generation via Unified Discrete Flow Matching
We propose UniDFlow, a unified discrete flow-matching framework for multimodal understanding, generation, and editing. It decouples understanding and generation via task-specific low-rank adapters, avoiding objective interference and representation entanglement, while a novel reference-based multimodal preference alignment optimizes relative outcomes under identical conditioning, improving faithfulness and controllability without large-scale retraining. UniDFlpw achieves SOTA performance across eight benchmarks and exhibits strong zero-shot generalization to tasks including inpainting, in-context image generation, reference-based editing, and compositional generation, despite no explicit task-specific training.
UniDFlow is a unified discrete flow-matching framework that decouples understanding and generation through low-rank adapters and uses reference-based alignment to improve multimodal tasks without retraining.
discrete flow-matching multimodal understanding generation editing task-specific low-rank adapters reference-based multimodal preference alignment zero-shot generalization inpainting in-context image generation reference-based editing compositional generation