SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligence
We introduce SciEvalKit, a unified benchmarking toolkit designed to evaluate AI models for science across a broad range of scientific disciplines and task capabilities. Unlike general-purpose evaluation platforms, SciEvalKit focuses on the core competencies of scientific intelligence, including Scientific Multimodal Perception, Scientific Multimodal Reasoning, Scientific Multimodal Understanding, Scientific Symbolic Reasoning, Scientific Code Generation, Science Hypothesis Generation and Scientific Knowledge Understanding. It supports six major scientific domains, spanning from physics and chemistry to astronomy and materials science. SciEvalKit builds a foundation of expert-grade scientific benchmarks, curated from real-world, domain-specific datasets, ensuring that tasks reflect authentic scientific challenges. The toolkit features a flexible, extensible evaluation pipeline that enables batch evaluation across models and datasets, supports custom model and dataset integration, and provides transparent, reproducible, and comparable results. By bridging capability-based evaluation and disciplinary diversity, SciEvalKit offers a standardized yet customizable infrastructure to benchmark the next generation of scientific foundation models and intelligent agents. The toolkit is open-sourced and actively maintained to foster community-driven development and progress in AI4Science.
695e0748c03d6d81e439a027
Yiheng Wang
claimed_verified
2026-01-07T09:25:26.201Z
67d2a001919e3b981ad45066
https://cdn-avatars.huggingface.co/v1/production/uploads/67d2a001919e3b981ad45066/KxaYKOGgLVbVhN6EsYGRG.jpeg
wyh
naonaowyh
user
naonaowyh
695e0748c03d6d81e439a028
Yixin Chen
admin_assigned
2026-01-07T14:25:35.753Z
64c396def6fe448b1ad553d6
/avatars/b2ce4739f42dc00ee974fff7ee1cb301.svg
Yixin Chen
YixinChen
user
YixinChen
695e0748c03d6d81e439a029
Shuo Li
695e0748c03d6d81e439a02a
Yifan Zhou
claimed_verified
2026-01-07T09:25:19.089Z
659d2dff20cf0b934bbee513
https://cdn-avatars.huggingface.co/v1/production/uploads/659d2dff20cf0b934bbee513/9e9R852Zr2R82h64eUUQl.jpeg
Yifan Zhou
yingmanji
user
yingmanji
695e0748c03d6d81e439a02b
Bo Liu
695e0748c03d6d81e439a02c
Hengjian Gao
claimed_verified
2026-01-07T09:25:28.254Z
66d19399b26010e571b1fcf0
/avatars/9d0998fc38f6659305bcbcecaf0a1c96.svg
Hengjian Gao
Talthy
user
Talthy
695e0748c03d6d81e439a02d
Jiakang Yuan
admin_assigned
2026-01-07T14:25:23.256Z
64a3d1ddb3239f3e3892b24b
/avatars/7ce585f5fc1d077fb1d70cc18c4da2c1.svg
Jiakang Yuan
JiakangYuan
user
JiakangYuan
695e0748c03d6d81e439a02e
Jia Bu
695e0748c03d6d81e439a02f
Wanghan Xu
claimed_verified
2026-01-07T09:25:21.127Z
65f3f43fc9940817ca9a427b
https://cdn-avatars.huggingface.co/v1/production/uploads/65f3f43fc9940817ca9a427b/02NN3XjSsbgWDhjrJWtVL.jpeg
Wanghan Xu
CoCoOne
user
CoCoOne
695e0748c03d6d81e439a030
Yuhao Zhou
admin_assigned
2026-01-07T13:18:03.373Z
63bab9c1bb6a2fabd14421bd
/avatars/c47030cf167072bf6ce3421f025c7746.svg
Yuhao Zhou
Soptq
user
Soptq
695e0748c03d6d81e439a031
Xiangyu Zhao
695e0748c03d6d81e439a032
Zhiwang Zhou
695e0748c03d6d81e439a033
Fengxiang Wang
695e0748c03d6d81e439a034
Haodong Duan
admin_assigned
2026-01-07T13:18:16.943Z
63ee1379190ddd6214efd73a
https://cdn-avatars.huggingface.co/v1/production/uploads/1676546883247-noauth.png
HAODONG DUAN
KennyUTC
user
KennyUTC
695e0748c03d6d81e439a035
Songyang Zhang
695e0748c03d6d81e439a036
Jun Yao
695e0748c03d6d81e439a037
Han Deng
695e0748c03d6d81e439a038
Yizhou Wang
695e0748c03d6d81e439a039
Jiabei Xiao
admin_assigned
2026-01-07T14:25:59.280Z
650d2f798ffe1f53bdd4ae71
/avatars/4c733681f8301d801023105c0b3aba38.svg
Xiao Jiabei
Xiao-Youth
user
Xiao-Youth
695e0748c03d6d81e439a03a
Jiaqi Liu
695e0748c03d6d81e439a03b
Encheng Su
admin_assigned
2026-01-07T13:18:31.162Z
6784a79c5ffcc118504ed99c
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/eL4kAIp_oi9Q7si5--uVl.png
Encheng Su
EncSU
user
EncSU
695e0748c03d6d81e439a03c
Yujie Liu
695e0748c03d6d81e439a03d
Weida Wang
claimed_verified
2026-01-07T09:25:23.748Z
661b9d96c153e4a0a25adc3e
https://cdn-avatars.huggingface.co/v1/production/uploads/661b9d96c153e4a0a25adc3e/VRt7kCQ0KdJp-lhPLOajO.jpeg
Weida Wang
weidawang
user
weidawang
695e0748c03d6d81e439a03e
Junchi Yao
695e0748c03d6d81e439a03f
Shenghe Zheng
695e0748c03d6d81e439a040
Haoran Sun
695e0748c03d6d81e439a041
Runmin Ma
695e0748c03d6d81e439a042
Xiangchao Yan
695e0748c03d6d81e439a043
Bo Zhang
695e0748c03d6d81e439a044
Dongzhan Zhou
695e0748c03d6d81e439a045
Shufei Zhang
admin_assigned
2026-01-07T13:18:24.428Z
68f8924f4278c8968587dfea
/avatars/b48d7899881a14ca68cc9feb2643ad8c.svg
shufei zhang
ShufeiZhang
user
ShufeiZhang
695e0748c03d6d81e439a046
Peng Ye
695e0748c03d6d81e439a047
Xiaosong Wang
695e0748c03d6d81e439a048
Shixiang Tang
695e0748c03d6d81e439a049
Wenlong Zhang
695e0748c03d6d81e439a04a
Lei Bai
SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligence
We introduce SciEvalKit, a unified benchmarking toolkit designed to evaluate AI models for science across a broad range of scientific disciplines and task capabilities. Unlike general-purpose evaluation platforms, SciEvalKit focuses on the core competencies of scientific intelligence, including Scientific Multimodal Perception, Scientific Multimodal Reasoning, Scientific Multimodal Understanding, Scientific Symbolic Reasoning, Scientific Code Generation, Science Hypothesis Generation and Scientific Knowledge Understanding. It supports six major scientific domains, spanning from physics and chemistry to astronomy and materials science. SciEvalKit builds a foundation of expert-grade scientific benchmarks, curated from real-world, domain-specific datasets, ensuring that tasks reflect authentic scientific challenges. The toolkit features a flexible, extensible evaluation pipeline that enables batch evaluation across models and datasets, supports custom model and dataset integration, and provides transparent, reproducible, and comparable results. By bridging capability-based evaluation and disciplinary diversity, SciEvalKit offers a standardized yet customizable infrastructure to benchmark the next generation of scientific foundation models and intelligent agents. The toolkit is open-sourced and actively maintained to foster community-driven development and progress in AI4Science.
SciEvalKit is a unified benchmarking toolkit for evaluating AI models across diverse scientific disciplines, focusing on core scientific intelligence capabilities and supporting customizable, reproducible assessments.
AI models scientific intelligence scientific multimodal perception scientific multimodal reasoning scientific multimodal understanding scientific symbolic reasoning scientific code generation science hypothesis generation scientific knowledge understanding scientific foundation models intelligent agents domain-specific datasets expert-grade benchmarks evaluation pipeline batch evaluation custom model integration reproducible results