Skip to content

Actions: huggingface/lighteval

Actions

Slow end to end tests

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
slow_tests.yaml
1,203 workflow runs
1,203 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Upgrade vLLM from 0.10.1.1 to 0.14.1 Slow end to end tests #1386: Pull request #1173 synchronize by NathanHB
17m 14s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
17m 14s
Upgrade vLLM from 0.10.1.1 to 0.14.1 Slow end to end tests #1385: Pull request #1173 synchronize by NathanHB
18m 57s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
18m 57s
Upgrade vLLM from 0.10.1.1 to 0.14.1 Slow end to end tests #1384: Pull request #1173 synchronize by NathanHB
14m 29s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
14m 29s
Upgrade vLLM from 0.10.1.1 to 0.14.1 Slow end to end tests #1383: Pull request #1173 synchronize by NathanHB
14m 31s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
14m 31s
Upgrade vLLM from 0.10.1.1 to 0.14.1 Slow end to end tests #1382: Pull request #1173 synchronize by NathanHB
17m 4s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
17m 4s
Upgrade vLLM from 0.10.1.1 to 0.14.1 Slow end to end tests #1381: Pull request #1173 synchronize by NathanHB
9m 33s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
9m 33s
Upgrade vLLM from 0.10.1.1 to 0.14.1 Slow end to end tests #1380: Pull request #1173 synchronize by NathanHB
12m 3s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
12m 3s
Upgrade vLLM from 0.10.1.1 to 0.14.1 Slow end to end tests #1379: Pull request #1173 synchronize by NathanHB
11m 15s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
11m 15s
Upgrade vLLM from 0.10.1.1 to 0.14.1 Slow end to end tests #1378: Pull request #1173 synchronize by NathanHB
12m 17s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
12m 17s
Upgrade vLLM from 0.10.1.1 to 0.14.1 Slow end to end tests #1377: Pull request #1173 synchronize by NathanHB
11m 44s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
11m 44s
Upgrade vLLM from 0.10.1.1 to 0.14.1 Slow end to end tests #1376: Pull request #1173 opened by NathanHB
9m 4s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
9m 4s
Fix: pass through custom_tasks and enable multilingual in eval command Slow end to end tests #1375: Pull request #1172 opened by dzautner
Action required dzautner:fix/eval-custom-tasks-multilingual
dzautner:fix/eval-custom-tasks-multilingual
Action required
Fix IndexError in LogProbTokenNorm when choices_tokens is shorter than choices_logprob Slow end to end tests #1374: Pull request #1171 opened by worksbyfriday
Action required worksbyfriday:fix/logprobtokennorm-length-mismatch
worksbyfriday:fix/logprobtokennorm-length-mismatch
Action required
Add jfinqa: Japanese Financial Numerical Reasoning QA Slow end to end tests #1373: Pull request #1169 opened by ajtgjmdjp
Action required ajtgjmdjp:add-jfinqa
ajtgjmdjp:add-jfinqa
Action required
fix: restore task list display logic Slow end to end tests #1372: Pull request #1166 opened by s1eeping-king
Action required s1eeping-king:fix/print-all-tasks-after-suite-removal
s1eeping-king:fix/print-all-tasks-after-suite-removal
Action required
fix: Transformers Model no template cast stop_sequences to list Slow end to end tests #1371: Pull request #1165 opened by mrsndmn
Action required mrsndmn:no_template_stop_sequences_tuple
mrsndmn:no_template_stop_sequences_tuple
Action required
fix(tasks): print also tasks not prefixed by the suite name Slow end to end tests #1370: Pull request #1087 synchronize by bram-pramono
Action required bram-pramono:main
bram-pramono:main
Action required
fix(tasks): print also tasks not prefixed by the suite name Slow end to end tests #1369: Pull request #1087 synchronize by bram-pramono
Action required bram-pramono:main
bram-pramono:main
Action required
Fix specific error in truthfulqa Slow end to end tests #1340: Pull request #1127 opened by ChenZiHong-Gavin
15m 10s ChenZiHong-Gavin:main
ChenZiHong-Gavin:main
15m 10s
add eval results tip (#1126) Slow end to end tests #1339: Commit 06aee5b pushed by NathanHB
14m 43s main
main
14m 43s
add eval results tip Slow end to end tests #1338: Pull request #1126 synchronize by burtenshaw
12m 24s burtenshaw:add-eval-results
burtenshaw:add-eval-results
12m 24s
add eval results tip Slow end to end tests #1337: Pull request #1126 opened by burtenshaw
13m 18s burtenshaw:add-eval-results
burtenshaw:add-eval-results
13m 18s
Fix typo in few_shots_select option error message. ('fbalanced' -> 'b… Slow end to end tests #1334: Commit 6ce93d5 pushed by NathanHB
11m 51s main
main
11m 51s
bbeh (#1124) Slow end to end tests #1333: Commit f888858 pushed by NathanHB
12m 21s main
main
12m 21s
bbeh Slow end to end tests #1332: Pull request #1124 synchronize by NathanHB
16m 2s nathan-bbeh
nathan-bbeh
16m 2s