BabyVision: Visual Reasoning Beyond Language
While humans develop core visual skills long before acquiring language, contemporary Multimodal LLMs (MLLMs) still rely heavily on linguistic priors to compensate for their fragile visual understanding. We uncovered a crucial fact: state-of-the-art MLLMs consistently fail on basic visual tasks that humans, even 3-year-olds, can solve effortlessly. To systematically investigate this gap, we introduce BabyVision, a benchmark designed to assess core visual abilities independent of linguistic knowledge for MLLMs. BabyVision spans a wide range of tasks, with 388 items divided into 22 subclasses across four key categories. Empirical results and human evaluation reveal that leading MLLMs perform significantly below human baselines. Gemini3-Pro-Preview scores 49.7, lagging behind 6-year-old humans and falling well behind the average adult score of 94.1. These results show despite excelling in knowledge-heavy evaluations, current MLLMs still lack fundamental visual primitives. Progress in BabyVision represents a step toward human-level visual perception and reasoning capabilities. We also explore solving visual reasoning with generation models by proposing BabyVision-Gen and automatic evaluation toolkit. Our code and benchmark data are released at https://github.com/UniPat-AI/BabyVision for reproduction.
6965c124fc8c4ecc02c7f930
Liang Chen
6965c124fc8c4ecc02c7f931
Weichu Xie
6965c124fc8c4ecc02c7f932
Yiyan Liang
claimed_verified
2026-01-14T09:53:18.432Z
68748c034185ace792c89c45
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/Bwo4BZXUx8ue_zklPqKpM.png
Yiyan Liang
NinePity
user
NinePity
6965c124fc8c4ecc02c7f933
Hongfeng He
6965c124fc8c4ecc02c7f934
Hans Zhao
6965c124fc8c4ecc02c7f935
Zhibo Yang
6965c124fc8c4ecc02c7f936
Zhiqi Huang
6965c124fc8c4ecc02c7f937
Haoning Wu
6965c124fc8c4ecc02c7f938
Haoyu Lu
6965c124fc8c4ecc02c7f939
Y. charles
6965c124fc8c4ecc02c7f93a
Yiping Bao
6965c124fc8c4ecc02c7f93b
Yuantao Fan
6965c124fc8c4ecc02c7f93c
Guopeng Li
6965c124fc8c4ecc02c7f93d
Haiyang Shen
6965c124fc8c4ecc02c7f93e
Xuanzhong Chen
claimed_verified
2026-01-13T08:23:52.086Z
65e6970d135c27ea806526fe
/avatars/4aced113d9cab055ae06f3945869a280.svg
Xuanzhong Chen
chenxz
user
chenxz
6965c124fc8c4ecc02c7f93f
Wendong Xu
claimed_verified
2026-03-23T11:02:02.689Z
65437ef98f84f869869cb698
https://cdn-avatars.huggingface.co/v1/production/uploads/65437ef98f84f869869cb698/xRFcyXwQq7szB-GfAeoHu.png
Wendong XU
kirailol
user
kirailol
6965c124fc8c4ecc02c7f940
Shuzheng Si
claimed_verified
2026-01-13T15:45:32.968Z
637c99bbfe115289cfedfb44
https://cdn-avatars.huggingface.co/v1/production/uploads/637c99bbfe115289cfedfb44/p4uSY0TKufJfcHpvEb_ZQ.jpeg
ssz
ssz1111
user
ssz1111
6965c124fc8c4ecc02c7f941
Zefan Cai
6965c124fc8c4ecc02c7f942
Wenhao Chai
6965c124fc8c4ecc02c7f943
Ziqi Huang
claimed_verified
2026-01-13T08:23:50.242Z
60efe7fa0d920bc7805cada5
https://cdn-avatars.huggingface.co/v1/production/uploads/60efe7fa0d920bc7805cada5/2LBrJBjSCOP5ilZIpWLHl.png
Ziqi Huang
Ziqi
user
Ziqi
6965c124fc8c4ecc02c7f944
Fangfu Liu
claimed_verified
2026-01-13T15:45:35.158Z
6505a02f9310ce8c400edc63
/avatars/bbf781594fc8c812316711aa8e2797aa.svg
Fangfu Liu
Liuff23
user
Liuff23
6965c124fc8c4ecc02c7f945
Tianyu Liu
6965c124fc8c4ecc02c7f946
Baobao Chang
6965c124fc8c4ecc02c7f947
Xiaobo Hu
6965c124fc8c4ecc02c7f948
Kaiyuan Chen
6965c124fc8c4ecc02c7f949
Yixin Ren
6965c124fc8c4ecc02c7f94a
Yang Liu
6965c124fc8c4ecc02c7f94b
Yuan Gong
6965c124fc8c4ecc02c7f94c
Kuan Li
BabyVision: Visual Reasoning Beyond Language
While humans develop core visual skills long before acquiring language, contemporary Multimodal LLMs (MLLMs) still rely heavily on linguistic priors to compensate for their fragile visual understanding. We uncovered a crucial fact: state-of-the-art MLLMs consistently fail on basic visual tasks that humans, even 3-year-olds, can solve effortlessly. To systematically investigate this gap, we introduce BabyVision, a benchmark designed to assess core visual abilities independent of linguistic knowledge for MLLMs. BabyVision spans a wide range of tasks, with 388 items divided into 22 subclasses across four key categories. Empirical results and human evaluation reveal that leading MLLMs perform significantly below human baselines. Gemini3-Pro-Preview scores 49.7, lagging behind 6-year-old humans and falling well behind the average adult score of 94.1. These results show despite excelling in knowledge-heavy evaluations, current MLLMs still lack fundamental visual primitives. Progress in BabyVision represents a step toward human-level visual perception and reasoning capabilities. We also explore solving visual reasoning with generation models by proposing BabyVision-Gen and automatic evaluation toolkit. Our code and benchmark data are released at https://github.com/UniPat-AI/BabyVision for reproduction.
Current multimodal large language models exhibit significant gaps in fundamental visual understanding compared to human children, as demonstrated by the BabyVision benchmark.
Multimodal LLMs visual reasoning core visual skills BabyVision benchmark visual perception visual primitives