From 7d5093edb92c5613c117962855f1c9fba17622e8 Mon Sep 17 00:00:00 2001 From: djankov Date: Mon, 17 Aug 2026 20:11:06 -0400 Subject: [PATCH] Name the repositories the flip covers, and the one it must not MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit `VERSIONING.md` §6.1 said "the seven repositories become public". That was written this morning and is now wrong twice. **`.repo-template` was deleted**, not flipped. It existed to scaffold a per-component repository, which the four-distribution model retired; publishing an empty template for a layout the project no longer uses would be publishing a wrong instruction. Mirrored to the local backup first, with its one pull request exported, the same way RM-DIST-05 handled the nineteen. **`astro-mine/embargo` must stay private, and no document said so.** It holds the sealed held-out benchmark seed sets Bench discloses only at evaluation time -- the anti-gaming property the leaderboard rests on. Publishing it destroys that property permanently: unlike a leaked credential, a disclosed held-out seed cannot be rotated into safety, because the value of the secret *is* that nobody has trained against it. Before this commit the repository was invisible to the spec. `bench.md` described embargoed held-out seeds as a concept without saying where they live, `$ASTRO_MINE_BENCH_EMBARGO_ROOT` appeared only in code, and the string "embargo" did not occur in `src/docs` at all. The one place the exclusion was recorded was the repository's own GitHub description, which is not a document anyone reads before a flip. So §6.1 now enumerates the six repositories that become public rather than counting them, and `bench.md` names where the sealed sets live and why that one stays behind. --- VERSIONING.md | 15 +++++++++++++-- architecture/bench.md | 6 +++++- 2 files changed, 18 insertions(+), 3 deletions(-) diff --git a/VERSIONING.md b/VERSIONING.md index 4d5b479..21b89fe 100644 --- a/VERSIONING.md +++ b/VERSIONING.md @@ -257,8 +257,19 @@ heading — so a reader arriving the day after the flip would reasonably conclud ### 6.1 Repository visibility — what the flip itself does -The seven repositories become public. That is the whole of it, and it is enough to unlock three -things that are unavailable while private: +**Six repositories become public** — `astro-mine-platform`, `astro-mine-cli`, `astro-mine-api`, +`astro-mine-ui`, `docs` and `.github`. Two qualifications, because "make the org public" is not the +same act: + +- **`astro-mine/embargo` stays private, permanently.** It holds the sealed held-out benchmark seed + sets that Bench discloses only at evaluation time (§`bench.md`). Publishing it would destroy the + anti-gaming property the leaderboard depends on, and no amount of later rotation undoes a + disclosure. It is not part of the flip and never becomes part of it. +- **`.repo-template` was deleted rather than flipped.** It existed to scaffold a per-component + repository, which the four-distribution model retired; publishing an empty template for a layout + the project no longer uses would be publishing a wrong instruction. + +Visibility on those six is enough to unlock three things that are unavailable while private: - **Secret scanning, push protection and branch rulesets** (`conventions.md` §9). These are not deferred by choice: the API refuses them outright for a private repository on the current plan. diff --git a/architecture/bench.md b/architecture/bench.md index a651a13..d330080 100644 --- a/architecture/bench.md +++ b/architecture/bench.md @@ -316,7 +316,11 @@ REST/OpenAPI (conventions.md §3, §4). rather than trusting reported numbers, eliminating the largest class of fabrication. - **Held-out seeds** and **hidden test scenarios**: each spec carries a public seed set for development and an embargoed held-out set disclosed only at evaluation time, so methods are - scored on instances they could not have overfit. + scored on instances they could not have overfit. The sealed sets live in the private + **`astro-mine/embargo`** repository, read at evaluation time via + `$ASTRO_MINE_BENCH_EMBARGO_ROOT`; it is the one repository that **stays private after the + public flip** (`VERSIONING.md` §6.1), because disclosure is irreversible in a way rotation + cannot repair. - **Determinism enforcement**: a sampled fraction of submissions is **re-executed** from the provenance bundle; mismatching the recorded result flags the entry (non-determinism or tampering).