TUNA: Taming Unified Visual Representations for Native Unified Multimodal Models
Unified multimodal models (UMMs) aim to jointly perform multimodal understanding and generation within a single framework. We present TUNA, a native UMM that builds a unified continuous visual representation by cascading a VAE encoder with a representation encoder. This unified representation space allows end-to-end processing of images and videos for both understanding and generation tasks. Compared to prior UMMs with decoupled representations, TUNA's unified visual space avoids representation format mismatches introduced by separate encoders, outperforming decoupled alternatives in both understanding and generation. Moreover, we observe that stronger pretrained representation encoders consistently yield better performance across all multimodal tasks, highlighting the importance of the representation encoder. Finally, in this unified setting, jointly training on both understanding and generation data allows the two tasks to benefit from each other rather than interfere. Our extensive experiments on multimodal understanding and generation benchmarks show that TUNA achieves state-of-the-art results in image and video understanding, image and video generation, and image editing, demonstrating the effectiveness and scalability of its unified representation design.
692e56a137312eaa83fd8761
Zhiheng Liu
692e56a137312eaa83fd8762
Weiming Ren
claimed_verified
2025-12-02T16:50:25.022Z
64405a9d518271b0d1beea38
/avatars/b702474588fd7090773320422417a582.svg
Weiming Ren
wren93
user
wren93
692e56a137312eaa83fd8763
Haozhe Liu
692e56a137312eaa83fd8764
Zijian Zhou
claimed_verified
2025-12-09T10:34:26.475Z
62e0fcfe4db2175cd2710063
/avatars/0f8d1b5ba3e3eba2af18f98f65f0b180.svg
Zijian Zhou
franciszzj
user
franciszzj
692e56a137312eaa83fd8765
Shoufa Chen
claimed_verified
2025-12-03T09:18:33.774Z
6412a33900634c4fe9873652
https://cdn-avatars.huggingface.co/v1/production/uploads/6412a33900634c4fe9873652/Nmn_yRA1gGD2VO1YbSOYF.jpeg
Shoufa Chen
ShoufaChen
user
ShoufaChen
692e56a137312eaa83fd8766
Haonan Qiu
692e56a137312eaa83fd8767
Xiaoke Huang
claimed_verified
2026-02-26T10:04:29.216Z
63318b2349a9563915469f3b
https://cdn-avatars.huggingface.co/v1/production/uploads/63318b2349a9563915469f3b/zlbeB2997i8YkoyOTb9FL.jpeg
Xiaoke Huang
xk-huang
user
xk-huang
692e56a137312eaa83fd8768
Zhaochong An
claimed_verified
2026-03-30T09:12:43.365Z
65e5eae6958b39864e8b683e
/avatars/b6a857e7b725767197dd95bc876f8ad1.svg
Zhaochong An
ZhaochongAn
user
ZhaochongAn
692e56a137312eaa83fd8769
Fanny Yang
692e56a137312eaa83fd876a
Aditya Patel
692e56a137312eaa83fd876b
Viktar Atliha
692e56a137312eaa83fd876c
Tony Ng
692e56a137312eaa83fd876d
Xiao Han
692e56a137312eaa83fd876e
Chuyan Zhu
692e56a137312eaa83fd876f
Chenyang Zhang
692e56a137312eaa83fd8770
Ding Liu
692e56a137312eaa83fd8771
Juan-Manuel Perez-Rua
692e56a137312eaa83fd8772
Sen He
692e56a137312eaa83fd8773
Jürgen Schmidhuber
692e56a137312eaa83fd8774
Wenhu Chen
692e56a137312eaa83fd8775
Ping Luo
692e56a137312eaa83fd8776
Wei Liu
692e56a137312eaa83fd8777
Tao Xiang
692e56a137312eaa83fd8778
Jonas Schult
692e56a137312eaa83fd8779
Yuren Cong
claimed_verified
2025-12-02T08:40:47.564Z
62f8040c47d782a6e286ea8e
/avatars/f45224b851ae79fff9912f6e67159e52.svg
Yuren Cong
Yuren
user
Yuren
TUNA: Taming Unified Visual Representations for Native Unified Multimodal Models
Unified multimodal models (UMMs) aim to jointly perform multimodal understanding and generation within a single framework. We present TUNA, a native UMM that builds a unified continuous visual representation by cascading a VAE encoder with a representation encoder. This unified representation space allows end-to-end processing of images and videos for both understanding and generation tasks. Compared to prior UMMs with decoupled representations, TUNA's unified visual space avoids representation format mismatches introduced by separate encoders, outperforming decoupled alternatives in both understanding and generation. Moreover, we observe that stronger pretrained representation encoders consistently yield better performance across all multimodal tasks, highlighting the importance of the representation encoder. Finally, in this unified setting, jointly training on both understanding and generation data allows the two tasks to benefit from each other rather than interfere. Our extensive experiments on multimodal understanding and generation benchmarks show that TUNA achieves state-of-the-art results in image and video understanding, image and video generation, and image editing, demonstrating the effectiveness and scalability of its unified representation design.
TUNA, a unified multimodal model, uses a cascaded VAE and representation encoder for end-to-end multimodal understanding and generation, outperforming decoupled models and achieving state-of-the-art results across various benchmarks.
Unified multimodal models UMMs TUNA VAE encoder representation encoder unified visual representation multimodal understanding multimodal generation representation format mismatches image understanding video understanding image generation video generation image editing