Skip to content

calibrate: --search has no --json form #219

Description

@samkeen

crates/b2-embed/examples/calibrate.rs deliberately hard-errors on --search --json ("--search has no JSON form yet") — the right call at the time (better than a silently incomplete object), but it leaves the search half of process rule 5's transfer check unscriptable. The discovery replay already prints one JSON object precisely so a sweep (the A7 population-size harness) needn't scrape the table; the search-side bench — the evidence bar's title/nonsense verdicts and the per-hit tail family edges (#201/#206) — can only be scraped.

Concretely blocked: sweeping the evidence bar or the tail families across several real vaults and joining the readings with the corpus windows from make eval (the cross-bench join the tail bake-off prints for the two corpora, extended to vault benches).

Ask

Add the search block to the --json object, following the discovery_fold re-derivability convention: per probe (title and nonsense) the query, coverage, best-cos, the engine's vouched, its own-note rank, and the served rows' per-hit provenance (path, bm25_rank, cos); plus the derived tail-family edges. Keys additive beside the existing discovery object, never redefined.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions