Put a placeholder where the example carried a real secret - #137
Conversation
example_eval_cfg.yaml and the README both shipped a working team_secret. A credential does not belong in an example, and a competitor has to replace it with their own anyway, so the file now says what to paste instead of shipping something that already works. No behaviour changes. The secret is only ever copied into the packed submission, and nothing reads its value. Signed-off-by: thc1006 <84045975+thc1006@users.noreply.github.com>
|
@zuorenchen a question about timing, since #137 does not do anything until it reaches TLDR: the secret is still on the repo's front page, because the fix is on I checked with the API rather than assuming, on the default branch: So the pair is as discoverable now as it was this morning. Merging to
Nobody's score moves. I checked rather than assuming:
So a competitor re-running the same agent on the same seed gets the same number. Two ways I can see: Cut v0.1.2 now. It is four small changes, none of them physics, and the secret leaves the front page today. Or leave it for whenever the next release is due anyway. It has been public since v0.0.2 on 2026-05-30, so a few more days is not a change of kind, and you have already signed one release today. I lean towards the first, but you are the one who names releases and you know what else is coming. Say which and I will open the PR. The rotation itself is still separate and still yours to time. Notes in ARRC-Rocket/BalloonPoppingLeaderboard#8. |
|
I kind of did this on purpose: provide an example secret so users can test the evaluate & submit procedure. It also helps us debug when a user can't upload their results |
|
That is a good reason and I did not know it, sorry for taking it out without asking first. TLDR: you make a stronger point on the private side and I think it wins. Say the word and I will revert this. Being able to run the whole submit path without registering is worth something to a competitor evaluating whether to enter, and being able to reproduce an upload failure yourself is worth more than that. You also asked, over on the leaderboard issue, whether removing the example pair helps at all given that every team already holds one. It mostly does not, and I have answered there rather than here. This is on |
example_eval_cfg.yamland the README both carry a workingteam_secret. This replaces both with a placeholder.A credential does not belong in an example, and the README already tells competitors the organizers will email them their own, so the placeholder says what to paste rather than shipping something that works as it stands.
No behaviour change.
team_secretis only copied into the packed submission; nothing reads its value, and no test refers to it. Local CI is green: ruff,uv lock --check, 557 passed and 0 skipped withBPC_RUN_SLOW_TESTS=1.@zuorenchen there is more to this than the diff, and it belongs on the private side. See ARRC-Rocket/BalloonPoppingLeaderboard#8, where I have put the details and a suggested order of doing things. This PR is the part that is safe to do while the round is running.