Skip to content

build(bench): pin GDC identities and evidence contracts #960

Description

@DecisionNerd

Objective

Provide shared benchmark-owned manifests, dataset provenance, reference handling, and evidence schemas for independent GDC suites.

Requirements

  • Pin GDC/spec, generator, and driver versions or commits.
  • Verify checksums and record licenses/acquisition without committing bulk data.
  • Keep every suite independently selectable and reported.
  • Sanitize evidence and preserve reproducibility metadata.

Acceptance criteria

  • Validation rejects incomplete provenance.
  • Fixtures cover checksum mismatch, missing assets, reference mismatch, and drift.
  • Adapters share contracts without sharing workload semantics.

BDD completion scenario

Given a GDC profile
When inputs are acquired
Then every generator, driver, dataset, and reference has an immutable recorded identity.

Metadata

Metadata

Assignees

No one assigned

    Labels

    testingTest coverage and testing infrastructure

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions