Add community evaluation results for GPQA, MMLU-PRO, SWE-BENCH_VERIFIED, HLE, TERMINAL-BENCH-2.0
#11
by nielsr HF Staff - opened
YAML Metadata Error:Invalid content in Eval Result file .eval_results/hle.yaml
Check out the documentation for more information.
Show details
Task ID "hle" does not match any task in dataset "cais/hle". Available: none
YAML Metadata Error:Invalid content in Eval Result file .eval_results/mmlu-pro.yaml
Check out the documentation for more information.
Show details
Task ID "mmlu_pro" does not match any task in dataset "TIGER-Lab/MMLU-Pro". Available: none
.eval_results/gpqa.yaml
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: Idavidrein/gpqa
|
| 3 |
+
task_id: diamond
|
| 4 |
+
value: 88.1
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash
|
| 7 |
+
name: Model Card
|
.eval_results/hle.yaml
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: cais/hle
|
| 3 |
+
task_id: hle
|
| 4 |
+
value: 34.8
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash
|
| 7 |
+
name: Model Card
|
.eval_results/mmlu-pro.yaml
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: TIGER-Lab/MMLU-Pro
|
| 3 |
+
task_id: mmlu_pro
|
| 4 |
+
value: 86.4
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash
|
| 7 |
+
name: Model Card
|
.eval_results/swe-bench_verified.yaml
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: SWE-bench/SWE-bench_Verified
|
| 3 |
+
task_id: swe_bench_%_resolved
|
| 4 |
+
value: 79
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash
|
| 7 |
+
name: Model Card
|
.eval_results/terminal-bench-2.0.yaml
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: harborframework/terminal-bench-2.0
|
| 3 |
+
task_id: terminalbench_2
|
| 4 |
+
value: 56.9
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash
|
| 7 |
+
name: Model Card
|