TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training
Recent advances in unified multimodal models (UMMs) have led to a proliferation of architectures capable of understanding, generating, and editing across visual and textual modalities. However, developing a unified framework for UMMs remains challenging due to the diversity of model architectures and the heterogeneity of training paradigms and implementation details. In this paper, we present TorchUMM, the first unified codebase for comprehensive evaluation, analysis, and post-training across diverse UMM backbones, tasks, and datasets. TorchUMM supports a broad spectrum of models covering a wide range of scales and design paradigms. Our benchmark encompasses three core task dimensions: multimodal understanding, generation, and editing, and integrates both established and novel datasets to evaluate perception, reasoning, compositionality, and instruction-following abilities. By providing a unified interface and standardized evaluation protocols, TorchUMM enables fair and reproducible comparisons across heterogeneous models and fosters deeper insights into their strengths and limitations, facilitating the development of more capable unified multimodal systems. Code is available at: https://github.com/AIFrontierLab/TorchUMM.
69ddac6daea31e227c22c4cc
Yinyi Luo
69ddac6daea31e227c22c4cd
Wenwen Wang
claimed_verified
2026-04-15T12:07:56.027Z
686f70772dad47efb8f5398d
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/XrM1cL2EAWuGreqAZBMdn.jpeg
Wang
wenwenw945
user
wenwenw945
69ddac6daea31e227c22c4ce
Hayes Bai
69ddac6daea31e227c22c4cf
Hongyu Zhu
69ddac6daea31e227c22c4d0
Hao Chen
69ddac6daea31e227c22c4d1
Pan He
69ddac6daea31e227c22c4d2
Marios Savvides
69ddac6daea31e227c22c4d3
Sharon Li
69ddac6daea31e227c22c4d4
Jindong Wang
TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training
Recent advances in unified multimodal models (UMMs) have led to a proliferation of architectures capable of understanding, generating, and editing across visual and textual modalities. However, developing a unified framework for UMMs remains challenging due to the diversity of model architectures and the heterogeneity of training paradigms and implementation details. In this paper, we present TorchUMM, the first unified codebase for comprehensive evaluation, analysis, and post-training across diverse UMM backbones, tasks, and datasets. TorchUMM supports a broad spectrum of models covering a wide range of scales and design paradigms. Our benchmark encompasses three core task dimensions: multimodal understanding, generation, and editing, and integrates both established and novel datasets to evaluate perception, reasoning, compositionality, and instruction-following abilities. By providing a unified interface and standardized evaluation protocols, TorchUMM enables fair and reproducible comparisons across heterogeneous models and fosters deeper insights into their strengths and limitations, facilitating the development of more capable unified multimodal systems. Code is available at: https://github.com/AIFrontierLab/TorchUMM.
TorchUMM presents a unified codebase for evaluating and analyzing multimodal models across understanding, generation, and editing tasks with standardized protocols and diverse datasets.
unified multimodal models multimodal understanding multimodal generation multimodal editing benchmark standardized evaluation protocols