-
Notifications
You must be signed in to change notification settings - Fork 1
Pull requests: Exgentic/eval-containers
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
fix(automationbench): record the harness's exit status on the k8s surface too
#554
opened Sep 10, 2026 by
yoavkatz
Collaborator
Loading…
feat(cli): list what the fleet publishes, and --local what the checkout has
#553
opened Sep 10, 2026 by
elronbandel
Contributor
Loading…
rules(cli): a listing answers from the published index, and never multiplies
#552
opened Sep 10, 2026 by
elronbandel
Contributor
Loading…
fix(chart): an index of a dataset sweep fails alone
#550
opened Sep 10, 2026 by
elronbandel
Contributor
Loading…
8 of 15 tasks
fix(automationbench): bound the harness and record its exit status
#549
opened Sep 10, 2026 by
elronbandel
Contributor
Loading…
7 of 14 tasks
fix(release): stitch per-task combo :TAG from the shards artifact
#544
opened Sep 10, 2026 by
yoavkatz
Collaborator
Loading…
fix(release): let a dispatch publish the :latest channel
#539
opened Sep 10, 2026 by
yoavkatz
Collaborator
Loading…
feat(walle): add MoonshotAI/walle structured-output conformance benchmark
#534
opened Sep 9, 2026 by
gitMichal
Collaborator
Loading…
bfcl: convert to model-only native-harness benchmark (0% → verified 10/10)
#527
opened Sep 9, 2026 by
gitMichal
Collaborator
Loading…
release: stamp the agent's eval.agent.* labels on every combo image
#520
opened Sep 9, 2026 by
elronbandel
Contributor
Loading…
feat(output): one task directory per run — reused, retried, forced, or refused (#358, #136)
#518
opened Sep 9, 2026 by
elronbandel
Contributor
•
Draft
Store replay fixtures zstd-compressed
#510
opened Sep 9, 2026 by
yoavkatz
Collaborator
Loading…
6 tasks done
build(deps): Bump the github-actions group across 1 directory with 4 updates
dependencies
Pull requests that update a dependency file
github_actions
Pull requests that update GitHub Actions code
#505
opened Sep 8, 2026 by
dependabot
Bot
Loading…
fix(kind): cap Helm release names at 53 chars; add EVAL_HELM_SET escape hatch
#487
opened Sep 7, 2026 by
yoavkatz
Collaborator
Loading…
fix(kind): route around Docker Hub's anonymous pull-rate limit
#486
opened Sep 7, 2026 by
yoavkatz
Collaborator
Loading…
rules(compose): output lifecycle — where runs write, when results are reused, retried, forced, or refused (#467)
#468
opened Sep 6, 2026 by
elronbandel
Contributor
•
Draft
feat(kind): add --eval-model-api to force the gateway upstream wire
#410
opened Aug 25, 2026 by
yoavkatz
Collaborator
Loading…
fix(kind): route docker.io through mirror.gcr.io to dodge Docker Hub 429s
#409
opened Aug 25, 2026 by
yoavkatz
Collaborator
Loading…
fix(build): wire per-task benchmarks as OCI-layout contexts, not registry refs
#408
opened Aug 25, 2026 by
gitMichal
Collaborator
Loading…
fix(tau-bench): use an accessible model and make images usable on kind
#400
opened Aug 19, 2026 by
yoavkatz
Collaborator
Loading…
Benchmark-declared MCP for all 16 capable agents
#396
opened Aug 18, 2026 by
elronbandel
Contributor
•
Draft
fix(appworld): grade via persistent session + isolate bridge.py's ground_truth access
#395
opened Aug 18, 2026 by
elronbandel
Contributor
Loading…
fix(chart): RFC-1123 Job names, and refuse a dataset Job that needs helpers
#393
opened Aug 18, 2026 by
elronbandel
Contributor
Loading…
fix(tau-bench): evaluate the task the run is running, not always task 0
#392
opened Aug 18, 2026 by
elronbandel
Contributor
Loading…
feat(cli): --platform flag on eval-containers build
#386
opened Aug 18, 2026 by
drbwa
Contributor
Loading…
Previous Next
ProTip!
Adding no:label will show everything without a label.