[ci] Migrate microbenchmark, benchmark-worker-startup, and rllib compute configs to new schema#62604
Conversation
…ute configs to new schema Co-Authored-By: Claude Opus 4.6 <[email protected]> Signed-off-by: sai.miduthuri <[email protected]>
There was a problem hiding this comment.
Code Review
This pull request migrates several release test configuration files to a new schema, involving field renames such as "cloud_id" to "cloud" and "head_node_type" to "head_node", and standardizing resource keys to uppercase. It also adds the "anyscale_sdk_2026" flag to various test definitions. A logical inconsistency was identified in "only_head_node_1gpu_64cpu.yaml" where the resource definition specifies 64 GPUs, contradicting the filename and physical instance capacity.
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes and found 1 potential issue.
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, have a team admin enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit 2c4bba4. Configure here.
…ished pattern Co-Authored-By: Claude Opus 4.6 <[email protected]> Signed-off-by: sai.miduthuri <[email protected]>
The g5.16xlarge has 1 physical GPU but the benchmark script uses --num_gpus_in_cluster 64 to test resource scheduling with 64 logical GPU slots. Co-Authored-By: Claude Opus 4.6 <[email protected]> Signed-off-by: sai.miduthuri <[email protected]>

Summary
cloud_id->cloud,head_node_type->head_node,worker_node_types->worker_nodes, etc.)anyscale_sdk_2026: trueflag to 12 test cluster blocks inrelease_tests.yamlConfig files migrated
release/microbenchmark/tpl_64.yaml(AWS, head-only)release/microbenchmark/tpl_64_gce.yaml(GCE, head-only)release/microbenchmark/experimental/compute_t4_gpu.yaml(AWS, head-only GPU)release/microbenchmark/experimental/compute_gpu_2x1_aws.yaml(AWS, head+worker GPU)release/microbenchmark/experimental/compute_a100_gpu.yaml(AWS, head-only GPU)release/microbenchmark/experimental/compute_l4_gpu.yaml(AWS, head-only GPU)release/microbenchmark/experimental/compute_l4_gpu_2x1_aws.yaml(AWS, head+worker GPU)release/benchmark-worker-startup/only_head_node_1gpu_64cpu.yaml(AWS, head-only GPU)release/benchmark-worker-startup/only_head_node_1gpu_64cpu_gce.yaml(GCE, head-only)release/rllib_tests/1gpu_16cpus.yaml(AWS, head-only GPU)Tests updated with
anyscale_sdk_2026: truemicrobenchmark(base + GCE variation)compiled_graphscompiled_graphs_GPUcompiled_graphs_GPU_multinodecompiled_graphs_GPU_cu130compiled_graphs_GPU_multinode_cu130rdt_single_node_T4_microbenchmarkrdt_single_node_A100_microbenchmarkbenchmark_worker_startup(base + GCE variation)rllib_learning_tests_pong_appo_torchTest plan
ComputeConfig.from_yaml()🤖 Generated with Claude Code