Add community evaluation results for GPQA, GSM8K, HLE, MMLU-PRO, SWE-BENCH_PRO, SWE-BENCH_VERIFIED, TERMINAL-BENCH-2.0
Browse filesThis PR adds community-provided evaluation results for the following benchmarks:
- **[GPQA](https://huggingface.co/datasets/Idavidrein/gpqa)**
- **[GSM8K](https://huggingface.co/datasets/openai/gsm8k)**
- **[HLE](https://huggingface.co/datasets/cais/hle)**
- **[MMLU-PRO](https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro)**
- **[SWE-BENCH_PRO](https://huggingface.co/datasets/ScaleAI/SWE-bench_Pro)**
- **[SWE-BENCH_VERIFIED](https://huggingface.co/datasets/SWE-bench/SWE-bench_Verified)**
- **[TERMINAL-BENCH-2.0](https://huggingface.co/datasets/harborframework/terminal-bench-2.0)**
These results were extracted from the model card. This is based on the new [evaluation results feature](https://huggingface.co/docs/hub/eval-results).
*Note: This is an automated PR. Please review the evaluation results before merging.*
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: Idavidrein/gpqa
|
| 3 |
+
task_id: diamond
|
| 4 |
+
value: 66.7
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
|
| 7 |
+
name: Model Card
|
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: openai/gsm8k
|
| 3 |
+
task_id: gsm8k
|
| 4 |
+
value: 99.6
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
|
| 7 |
+
name: Model Card
|
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: cais/hle
|
| 3 |
+
task_id: hle
|
| 4 |
+
value: 48
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
|
| 7 |
+
name: Model Card
|
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: TIGER-Lab/MMLU-Pro
|
| 3 |
+
task_id: mmlu_pro
|
| 4 |
+
value: 68.5
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
|
| 7 |
+
name: Model Card
|
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: ScaleAI/SWE-bench_Pro
|
| 3 |
+
task_id: SWE_Bench_Pro
|
| 4 |
+
value: 57.2
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
|
| 7 |
+
name: Model Card
|
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: SWE-bench/SWE-bench_Verified
|
| 3 |
+
task_id: swe_bench_%_resolved
|
| 4 |
+
value: 78.9
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
|
| 7 |
+
name: Model Card
|
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: harborframework/terminal-bench-2.0
|
| 3 |
+
task_id: terminalbench_2
|
| 4 |
+
value: 68.4
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
|
| 7 |
+
name: Model Card
|