nielsr HF Staff commited on
Commit
07a6615
·
verified ·
1 Parent(s): 7208274

Add community evaluation results for GPQA, GSM8K, HLE, MMLU-PRO, SWE-BENCH_PRO, SWE-BENCH_VERIFIED, TERMINAL-BENCH-2.0

Browse files

This PR adds community-provided evaluation results for the following benchmarks:

- **[GPQA](https://huggingface.co/datasets/Idavidrein/gpqa)**
- **[GSM8K](https://huggingface.co/datasets/openai/gsm8k)**
- **[HLE](https://huggingface.co/datasets/cais/hle)**
- **[MMLU-PRO](https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro)**
- **[SWE-BENCH_PRO](https://huggingface.co/datasets/ScaleAI/SWE-bench_Pro)**
- **[SWE-BENCH_VERIFIED](https://huggingface.co/datasets/SWE-bench/SWE-bench_Verified)**
- **[TERMINAL-BENCH-2.0](https://huggingface.co/datasets/harborframework/terminal-bench-2.0)**

These results were extracted from the model card. This is based on the new [evaluation results feature](https://huggingface.co/docs/hub/eval-results).

*Note: This is an automated PR. Please review the evaluation results before merging.*

.eval_results/gpqa.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: Idavidrein/gpqa
3
+ task_id: diamond
4
+ value: 66.7
5
+ source:
6
+ url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
7
+ name: Model Card
.eval_results/gsm8k.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: openai/gsm8k
3
+ task_id: gsm8k
4
+ value: 99.6
5
+ source:
6
+ url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
7
+ name: Model Card
.eval_results/hle.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: cais/hle
3
+ task_id: hle
4
+ value: 48
5
+ source:
6
+ url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
7
+ name: Model Card
.eval_results/mmlu-pro.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: TIGER-Lab/MMLU-Pro
3
+ task_id: mmlu_pro
4
+ value: 68.5
5
+ source:
6
+ url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
7
+ name: Model Card
.eval_results/swe-bench_pro.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: ScaleAI/SWE-bench_Pro
3
+ task_id: SWE_Bench_Pro
4
+ value: 57.2
5
+ source:
6
+ url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
7
+ name: Model Card
.eval_results/swe-bench_verified.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: SWE-bench/SWE-bench_Verified
3
+ task_id: swe_bench_%_resolved
4
+ value: 78.9
5
+ source:
6
+ url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
7
+ name: Model Card
.eval_results/terminal-bench-2.0.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: harborframework/terminal-bench-2.0
3
+ task_id: terminalbench_2
4
+ value: 68.4
5
+ source:
6
+ url: https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro
7
+ name: Model Card