BizFinBench.v2: A Unified Dual-Mode Bilingual Benchmark for Expert-Level Financial Capability Alignment
Large language models have undergone rapid evolution, emerging as a pivotal technology for intelligence in financial operations. However, existing benchmarks are often constrained by pitfalls such as reliance on simulated or general-purpose samples and a focus on singular, offline static scenarios. Consequently, they fail to align with the requirements for authenticity and real-time responsiveness in financial services, leading to a significant discrepancy between benchmark performance and actual operational efficacy. To address this, we introduce BizFinBench.v2, the first large-scale evaluation benchmark grounded in authentic business data from both Chinese and U.S. equity markets, integrating online assessment. We performed clustering analysis on authentic user queries from financial platforms, resulting in eight fundamental tasks and two online tasks across four core business scenarios, totaling 29,578 expert-level Q&A pairs. Experimental results demonstrate that ChatGPT-5 achieves a prominent 61.5% accuracy in main tasks, though a substantial gap relative to financial experts persists; in online tasks, DeepSeek-R1 outperforms all other commercial LLMs. Error analysis further identifies the specific capability deficiencies of existing models within practical financial business contexts. BizFinBench.v2 transcends the limitations of current benchmarks, achieving a business-level deconstruction of LLM financial capabilities and providing a precise basis for evaluating efficacy in the widespread deployment of LLMs within the financial domain. The data and code are available at https://github.com/HiThink-Research/BizFinBench.v2.
6965aac3fc8c4ecc02c7f857
Xin Guo
6965aac3fc8c4ecc02c7f858
Rongjunchen Zhang
claimed_verified
2026-01-13T08:24:24.722Z
6555df426947208b7741b637
https://cdn-avatars.huggingface.co/v1/production/uploads/6555df426947208b7741b637/b7ply-HyaPKXrPvRNh21K.jpeg
Rongjunchen Zhang
Tinker250
user
Tinker250
6965aac3fc8c4ecc02c7f859
Guilong Lu
6965aac3fc8c4ecc02c7f85a
Xuntao Guo
6965aac3fc8c4ecc02c7f85b
Shuai Jia
6965aac3fc8c4ecc02c7f85c
Zhi Yang
claimed_verified
2026-01-16T15:28:44.313Z
64aa645404e7b379feccc490
https://cdn-avatars.huggingface.co/v1/production/uploads/64aa645404e7b379feccc490/4m8qcdy2OGK8visR5Jjl5.png
Zhi Yang
yangzhi1
user
yangzhi1
6965aac3fc8c4ecc02c7f85d
Liwen Zhang
claimed_verified
2026-01-16T14:38:04.192Z
64d4aa25263aa362d4644737
https://cdn-avatars.huggingface.co/v1/production/uploads/64d4aa25263aa362d4644737/XB4VybeUyLpz1qVtqXHbp.png
Liwen Zhang
SUFE-AIFLM-Lab
user
SUFE-AIFLM-Lab
BizFinBench.v2: A Unified Dual-Mode Bilingual Benchmark for Expert-Level Financial Capability Alignment
Large language models have undergone rapid evolution, emerging as a pivotal technology for intelligence in financial operations. However, existing benchmarks are often constrained by pitfalls such as reliance on simulated or general-purpose samples and a focus on singular, offline static scenarios. Consequently, they fail to align with the requirements for authenticity and real-time responsiveness in financial services, leading to a significant discrepancy between benchmark performance and actual operational efficacy. To address this, we introduce BizFinBench.v2, the first large-scale evaluation benchmark grounded in authentic business data from both Chinese and U.S. equity markets, integrating online assessment. We performed clustering analysis on authentic user queries from financial platforms, resulting in eight fundamental tasks and two online tasks across four core business scenarios, totaling 29,578 expert-level Q&A pairs. Experimental results demonstrate that ChatGPT-5 achieves a prominent 61.5% accuracy in main tasks, though a substantial gap relative to financial experts persists; in online tasks, DeepSeek-R1 outperforms all other commercial LLMs. Error analysis further identifies the specific capability deficiencies of existing models within practical financial business contexts. BizFinBench.v2 transcends the limitations of current benchmarks, achieving a business-level deconstruction of LLM financial capabilities and providing a precise basis for evaluating efficacy in the widespread deployment of LLMs within the financial domain. The data and code are available at https://github.com/HiThink-Research/BizFinBench.v2.
BizFinBench.v2 presents the first large-scale financial evaluation benchmark using authentic business data from Chinese and U.S. equity markets, featuring online assessment and expert-level Q&A pairs across multiple financial scenarios.
large language models financial operations benchmarks authentic business data online assessment clustering analysis expert-level Q&A pairs financial capabilities financial domain