Skip to content

Commit 8a78500

Browse files
committed
Add openllm task group
1 parent 2621363 commit 8a78500

File tree

1 file changed

+20
-0
lines changed

1 file changed

+20
-0
lines changed
Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,20 @@
1+
group: openllm
2+
group_alias: Open LLM Leaderboard
3+
task:
4+
- task: arc_challenge
5+
fewshot_split: train
6+
num_fewshot: 25
7+
- task: hellaswag
8+
fewshot_split: train
9+
num_fewshot: 10
10+
- task: truthfulqa
11+
num_fewshot: 0
12+
- task: mmlu
13+
num_fewshot: 5
14+
- task: winogrande
15+
fewshot_split: train
16+
num_fewshot: 5
17+
- task: gsm8k
18+
num_fewshot: 5
19+
metadata:
20+
version: 2

0 commit comments

Comments
 (0)