ChartNet: A Million-Scale, High-Quality Multimodal Dataset for Robust Chart Understanding
Understanding charts requires models to jointly reason over geometric visual patterns, structured numerical data, and natural language -- a capability where current vision-language models (VLMs) remain limited. We introduce ChartNet, a high-quality, million-scale multimodal dataset designed to advance chart interpretation and reasoning. ChartNet leverages a novel code-guided synthesis pipeline to generate 1.5 million diverse chart samples spanning 24 chart types and 6 plotting libraries. Each sample consists of five aligned components: plotting code, rendered chart image, data table, natural language summary, and question-answering with reasoning, providing fine-grained cross-modal alignment. To capture the full spectrum of chart comprehension, ChartNet additionally includes specialized subsets encompassing human annotated data, real-world data, safety, and grounding. Moreover, a rigorous quality-filtering pipeline ensures visual fidelity, semantic accuracy, and diversity across chart representations. Fine-tuning on ChartNet consistently improves results across benchmarks, demonstrating its utility as large-scale supervision for multimodal models. As the largest open-source dataset of its kind, ChartNet aims to support the development of foundation models with robust and generalizable capabilities for data visualization understanding. The dataset is publicly available at https://huggingface.co/datasets/ibm-granite/ChartNet
69cb325922f9e9dce3fe1f52
Jovana Kondic
69cb325922f9e9dce3fe1f53
Pengyuan Li
69cb325922f9e9dce3fe1f54
Dhiraj Joshi
69cb325922f9e9dce3fe1f55
Isaac Sanchez
claimed_verified
2026-04-13T19:25:00.100Z
69b992805ef0fbc06d35d34e
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/NRvpcKGXEv0KEJXuwMzi2.png
Isaac Sanchez
sanchy-ibm
user
sanchy-ibm
69cb325922f9e9dce3fe1f56
Ben Wiesel
69cb325922f9e9dce3fe1f57
Shafiq Abedin
69cb325922f9e9dce3fe1f58
Amit Alfassy
69cb325922f9e9dce3fe1f59
Eli Schwartz
69cb325922f9e9dce3fe1f5a
Daniel Caraballo
69cb325922f9e9dce3fe1f5b
Yagmur Gizem Cinar
69cb325922f9e9dce3fe1f5c
Florian Scheidegger
69cb325922f9e9dce3fe1f5d
Steven I. Ross
69cb325922f9e9dce3fe1f5e
Daniel Karl I. Weidele
69cb325922f9e9dce3fe1f5f
Hang Hua
claimed_verified
2026-04-01T08:36:15.516Z
639f8277beb95d698de007dd
/avatars/57f223ccd9d3cb03166ccf0e41361c58.svg
HangHua
hhua2
user
hhua2
69cb325922f9e9dce3fe1f60
Ekaterina Arutyunova
69cb325922f9e9dce3fe1f61
Roei Herzig
69cb325922f9e9dce3fe1f62
Zexue He
69cb325922f9e9dce3fe1f63
Zihan Wang
69cb325922f9e9dce3fe1f64
Xinyue Yu
69cb325922f9e9dce3fe1f65
Yunfei Zhao
69cb325922f9e9dce3fe1f66
Sicong Jiang
69cb325922f9e9dce3fe1f67
Minghao Liu
claimed_verified
2026-04-07T08:47:16.003Z
6417d9ea8f689506e7148417
https://cdn-avatars.huggingface.co/v1/production/uploads/6417d9ea8f689506e7148417/bAYcruWNw4WvmuQcGgcwC.jpeg
minghao
Liam-Liu
user
Liam-Liu
69cb325922f9e9dce3fe1f68
Qunshu Lin
69cb325922f9e9dce3fe1f69
Peter Staar
69cb325922f9e9dce3fe1f6a
Luis Lastras
69cb325922f9e9dce3fe1f6b
Aude Oliva
69cb325922f9e9dce3fe1f6c
Rogerio Feris
ChartNet: A Million-Scale, High-Quality Multimodal Dataset for Robust Chart Understanding
Understanding charts requires models to jointly reason over geometric visual patterns, structured numerical data, and natural language -- a capability where current vision-language models (VLMs) remain limited. We introduce ChartNet, a high-quality, million-scale multimodal dataset designed to advance chart interpretation and reasoning. ChartNet leverages a novel code-guided synthesis pipeline to generate 1.5 million diverse chart samples spanning 24 chart types and 6 plotting libraries. Each sample consists of five aligned components: plotting code, rendered chart image, data table, natural language summary, and question-answering with reasoning, providing fine-grained cross-modal alignment. To capture the full spectrum of chart comprehension, ChartNet additionally includes specialized subsets encompassing human annotated data, real-world data, safety, and grounding. Moreover, a rigorous quality-filtering pipeline ensures visual fidelity, semantic accuracy, and diversity across chart representations. Fine-tuning on ChartNet consistently improves results across benchmarks, demonstrating its utility as large-scale supervision for multimodal models. As the largest open-source dataset of its kind, ChartNet aims to support the development of foundation models with robust and generalizable capabilities for data visualization understanding. The dataset is publicly available at https://huggingface.co/datasets/ibm-granite/ChartNet
ChartNet is a large-scale multimodal dataset featuring 1.5 million chart samples with aligned visual, textual, and numerical components, designed to enhance chart interpretation and reasoning capabilities in multimodal models.
multimodal dataset chart interpretation vision-language models code-guided synthesis cross-modal alignment data visualization understanding foundation models