Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
2,500+ workflow runs
2,500+ workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
[Feature] tool_calls and reasoning: Tracking and evaluation Tasks Modified #6203: Pull request #3685 synchronize by RawthiL
36s pnyxai:feature-tool-calls-evaluation
pnyxai:feature-tool-calls-evaluation
36s
[Feature] tool_calls and reasoning: Tracking and evaluation Unit Tests #6176: Pull request #3685 synchronize by RawthiL
2m 30s pnyxai:feature-tool-calls-evaluation
pnyxai:feature-tool-calls-evaluation
2m 30s
fix(vllm): fix dp with ray. remove mp distribution Tasks Modified #6202: Pull request #3725 synchronize by baberabb
9s vllmdp
vllmdp
9s
fix(vllm): fix dp with ray. remove mp distribution Unit Tests #6175: Pull request #3725 synchronize by baberabb
5m 3s vllmdp
vllmdp
5m 3s
fix(vllm): fix dp with ray. remove mp distribution Tasks Modified #6201: Pull request #3725 opened by baberabb
9s vllmdp
vllmdp
9s
fix(vllm): fix dp with ray. remove mp distribution Unit Tests #6174: Pull request #3725 opened by baberabb
5m 23s vllmdp
vllmdp
5m 23s
Add diagnostic columns for answer-not-found and invalid-filter tracking Tasks Modified #6200: Pull request #3709 synchronize by baberabb
9s fxmarty-amd:upstream-diagnostic-samples
fxmarty-amd:upstream-diagnostic-samples
9s
Add diagnostic columns for answer-not-found and invalid-filter tracking Unit Tests #6173: Pull request #3709 synchronize by baberabb
4m 22s fxmarty-amd:upstream-diagnostic-samples
fxmarty-amd:upstream-diagnostic-samples
4m 22s
feat: Add [ LiteLLM AI gateway ] as model backend Tasks Modified #6199: Pull request #3721 synchronize by RheagalFire
Action required RheagalFire:feat/add-litellm-provider
RheagalFire:feat/add-litellm-provider
Action required
feat: Add [ LiteLLM AI gateway ] as model backend Unit Tests #6172: Pull request #3721 synchronize by RheagalFire
Action required RheagalFire:feat/add-litellm-provider
RheagalFire:feat/add-litellm-provider
Action required
Guard vLLM tok_encode against prefix_token_id being None Unit Tests #6171: Pull request #3724 opened by Chessing234
Action required Chessing234:fix/vllm-prefix-token-id-none
Chessing234:fix/vllm-prefix-token-id-none
Action required
Guard vLLM tok_encode against prefix_token_id being None Tasks Modified #6198: Pull request #3724 opened by Chessing234
Action required Chessing234:fix/vllm-prefix-token-id-none
Chessing234:fix/vllm-prefix-token-id-none
Action required
Fix dataset_path for truthfulqa_gen Unit Tests #6170: Pull request #3723 opened by zhngstl
Action required zhngstl:patch-1
zhngstl:patch-1
Action required
Fix dataset_path for truthfulqa_gen Tasks Modified #6197: Pull request #3723 opened by zhngstl
Action required zhngstl:patch-1
zhngstl:patch-1
Action required
Allow --include_path / --include_module to import external LM subclasses (#1457) Tasks Modified #6196: Pull request #3722 opened by FazeelUsmani
Action required FazeelUsmani:feat/1457-include-path-imports-models
FazeelUsmani:feat/1457-include-path-imports-models
Action required
Allow --include_path / --include_module to import external LM subclasses (#1457) Unit Tests #6169: Pull request #3722 opened by FazeelUsmani
Action required FazeelUsmani:feat/1457-include-path-imports-models
FazeelUsmani:feat/1457-include-path-imports-models
Action required
feat: Add [ LiteLLM AI gateway ] as model backend Unit Tests #6168: Pull request #3721 opened by RheagalFire
Action required RheagalFire:feat/add-litellm-provider
RheagalFire:feat/add-litellm-provider
Action required
feat: Add [ LiteLLM AI gateway ] as model backend Tasks Modified #6195: Pull request #3721 opened by RheagalFire
Action required RheagalFire:feat/add-litellm-provider
RheagalFire:feat/add-litellm-provider
Action required
.3493622109966576:cef1087b5402b4f502910bbc2a5b745d_69e61621e46af4f7d61e5e56.69e63309e46af4f7d61e61c2.69e63308275d924c87815d1c:Trae CN.T(2026/4/20 22:07:05) Unit Tests #6167: Pull request #3720 opened by zilvya
Action required zilvya:ta1
zilvya:ta1
Action required
.3493622109966576:cef1087b5402b4f502910bbc2a5b745d_69e61621e46af4f7d61e5e56.69e63309e46af4f7d61e61c2.69e63308275d924c87815d1c:Trae CN.T(2026/4/20 22:07:05) Tasks Modified #6194: Pull request #3720 opened by zilvya
Action required zilvya:ta1
zilvya:ta1
Action required
Fix french_bench_topic_based_nli doc_to_decontamination_query pointing at nonexistent 'texte' field Tasks Modified #6193: Pull request #3719 opened by Chessing234
Action required Chessing234:fix/french-bench-topic-nli-decontamination-texte-typo
Chessing234:fix/french-bench-topic-nli-decontamination-texte-typo
Action required
Fix french_bench_topic_based_nli doc_to_decontamination_query pointing at nonexistent 'texte' field Unit Tests #6166: Pull request #3719 opened by Chessing234
Action required Chessing234:fix/french-bench-topic-nli-decontamination-texte-typo
Chessing234:fix/french-bench-topic-nli-decontamination-texte-typo
Action required
Fix headqa doc_to_decontamination_query pointing at nonexistent 'query' field Unit Tests #6165: Pull request #3718 opened by Chessing234
Action required Chessing234:fix/headqa-decontamination-query-wrong-field
Chessing234:fix/headqa-decontamination-query-wrong-field
Action required
Fix headqa doc_to_decontamination_query pointing at nonexistent 'query' field Tasks Modified #6192: Pull request #3718 opened by Chessing234
Action required Chessing234:fix/headqa-decontamination-query-wrong-field
Chessing234:fix/headqa-decontamination-query-wrong-field
Action required
Fix RACE doc_to_text keeping blank marker and dropping the question body Unit Tests #6164: Pull request #3716 opened by Chessing234
Action required Chessing234:fix/race-preprocess-slice-direction
Chessing234:fix/race-preprocess-slice-direction
Action required