Mobile-O: Unified Multimodal Understanding and Generation on Mobile Device
Unified multimodal models can both understand and generate visual content within a single architecture. Existing models, however, remain data-hungry and too heavy for deployment on edge devices. We present Mobile-O, a compact vision-language-diffusion model that brings unified multimodal intelligence to a mobile device. Its core module, the Mobile Conditioning Projector (MCP), fuses vision-language features with a diffusion generator using depthwise-separable convolutions and layerwise alignment. This design enables efficient cross-modal conditioning with minimal computational cost. Trained on only a few million samples and post-trained in a novel quadruplet format (generation prompt, image, question, answer), Mobile-O jointly enhances both visual understanding and generation capabilities. Despite its efficiency, Mobile-O attains competitive or superior performance compared to other unified models, achieving 74% on GenEval and outperforming Show-O and JanusFlow by 5% and 11%, while running 6x and 11x faster, respectively. For visual understanding, Mobile-O surpasses them by 15.3% and 5.1% averaged across seven benchmarks. Running in only ~3s per 512x512 image on an iPhone, Mobile-O establishes the first practical framework for real-time unified multimodal understanding and generation on edge devices. We hope Mobile-O will ease future research in real-time unified multimodal intelligence running entirely on-device with no cloud dependency. Our code, models, datasets, and mobile application are publicly available at https://amshaker.github.io/Mobile-O/
699d14864e37ec6dfa1bc503
Abdelrahman Shaker
699d14864e37ec6dfa1bc504
Ahmed Heakl
claimed_verified
2026-02-24T09:50:34.835Z
656864e12d73834278a8dea7
https://cdn-avatars.huggingface.co/v1/production/uploads/656864e12d73834278a8dea7/sfAWS2eyPtFHb_2GZIypp.jpeg
Ahmed Heakl
ahmedheakl
user
ahmedheakl
699d14864e37ec6dfa1bc505
Jaseel Muhammad
699d14864e37ec6dfa1bc506
Ritesh Thawkar
claimed_verified
2026-03-09T10:39:36.600Z
664cec3ba016876f526afe7a
/avatars/69007f7e7f7ff78069101deb4b354e37.svg
Ritesh Thawkar
Ritesh-hf
user
Ritesh-hf
699d14864e37ec6dfa1bc507
Omkar Thawakar
699d14864e37ec6dfa1bc508
Senmao Li
699d14864e37ec6dfa1bc509
Hisham Cholakkal
699d14864e37ec6dfa1bc50a
Ian Reid
699d14864e37ec6dfa1bc50b
Eric P. Xing
699d14864e37ec6dfa1bc50c
Salman Khan
699d14864e37ec6dfa1bc50d
Fahad Shahbaz Khan
Mobile-O: Unified Multimodal Understanding and Generation on Mobile Device
Unified multimodal models can both understand and generate visual content within a single architecture. Existing models, however, remain data-hungry and too heavy for deployment on edge devices. We present Mobile-O, a compact vision-language-diffusion model that brings unified multimodal intelligence to a mobile device. Its core module, the Mobile Conditioning Projector (MCP), fuses vision-language features with a diffusion generator using depthwise-separable convolutions and layerwise alignment. This design enables efficient cross-modal conditioning with minimal computational cost. Trained on only a few million samples and post-trained in a novel quadruplet format (generation prompt, image, question, answer), Mobile-O jointly enhances both visual understanding and generation capabilities. Despite its efficiency, Mobile-O attains competitive or superior performance compared to other unified models, achieving 74% on GenEval and outperforming Show-O and JanusFlow by 5% and 11%, while running 6x and 11x faster, respectively. For visual understanding, Mobile-O surpasses them by 15.3% and 5.1% averaged across seven benchmarks. Running in only ~3s per 512x512 image on an iPhone, Mobile-O establishes the first practical framework for real-time unified multimodal understanding and generation on edge devices. We hope Mobile-O will ease future research in real-time unified multimodal intelligence running entirely on-device with no cloud dependency. Our code, models, datasets, and mobile application are publicly available at https://amshaker.github.io/Mobile-O/
A compact vision-language-diffusion model called Mobile-O enables efficient unified multimodal understanding and generation on mobile devices through specialized architecture design and optimized training methodology.
vision-language-diffusion model Mobile Conditioning Projector depthwise-separable convolutions layerwise alignment cross-modal conditioning diffusion generator unified multimodal intelligence real-time processing edge devices visual understanding visual generation