Skip to content

Pull requests: AISBench/benchmark

New pull request New
31 Open 275 Closed
31 Open 275 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[CI/CD] add docker buildx in base dockerfile no_issue PR 未关联任何 Issue，合入前必须关联 Issue no_review PR 未包含任何检视意见，合入前必须包含检视意见
#534 opened Sep 11, 2026 by SJTUyh Collaborator Loading…
1 of 15 tasks
1
Fix link to dataset configuration in README
#532 opened Sep 11, 2026 by Keithwwa Collaborator Loading…
15 tasks
1
6
feat: 新增 agent-runtime 镜像（harbor-only）与双模式拉起脚本 large_pr PR 新增代码超过 1000 行，建议拆分为更小的 PR
#531 opened Sep 10, 2026 by Huafubing Loading…
3 tasks done
8
bugfix: cmmlu数据集请求模板和答案判定的pattern不一致的问题修复 bugfix no_review PR 未包含任何检视意见，合入前必须包含检视意见
#524 opened Sep 9, 2026 by ytlds Loading…
5 of 15 tasks
6
fix(livecodebench): expose .buffer on mocked stdin/stdout no_issue PR 未关联任何 Issue，合入前必须关联 Issue no_review PR 未包含任何检视意见，合入前必须包含检视意见
#518 opened Sep 6, 2026 by yqy003 Loading…
15 tasks
2
fix: skip id: lines in streaming response parsing bugfix no_issue PR 未关联任何 Issue，合入前必须关联 Issue no_review PR 未包含任何检视意见，合入前必须包含检视意见
#481 opened Aug 21, 2026 by navtrade Loading…
1 of 9 tasks
1
1
0819 fix itl no_issue PR 未关联任何 Issue，合入前必须关联 Issue no_review PR 未包含任何检视意见，合入前必须包含检视意见
#479 opened Aug 19, 2026 by jschen069 Collaborator Loading…
15 tasks
1
mv ifbench pkg bugfix no_issue PR 未关联任何 Issue，合入前必须关联 Issue no_review PR 未包含任何检视意见，合入前必须包含检视意见
#462 opened Aug 12, 2026 by jschen069 Collaborator Loading…
1 of 15 tasks
1
1
Add din_integration/: SWE-bench DinD evaluation pipeline integration large_pr PR 新增代码超过 1000 行，建议拆分为更小的 PR no_issue PR 未关联任何 Issue，合入前必须关联 Issue no_review PR 未包含任何检视意见，合入前必须包含检视意见 other
#456 opened Aug 12, 2026 by Huafubing Loading…
1 of 2 tasks
4
feat(acc): add gpqa 5-shot-prompt feature
#450 opened Aug 11, 2026 by ivanbao9783 Collaborator Loading…
1 of 15 tasks
feat: add aa_lcr unit test
#420 opened Jul 24, 2026 by jschen069 Collaborator Loading…
15 tasks
1
fix: add cross-platform file locking and background progress thread bugfix
#414 opened Jul 23, 2026 by jschen069 Collaborator Loading…
1 of 15 tasks
9
feat: add ifbench unit test test-cases
#413 opened Jul 23, 2026 by jschen069 Collaborator Loading…
1 of 15 tasks
1
[Feature][CI/CD] Support agent runtime env auto deploy feature
#410 opened Jul 23, 2026 by SJTUyh Collaborator Loading…
2 of 15 tasks
1
1
【WIP】 control Prefill con in aisbench
#396 opened Jul 14, 2026 by vasede Loading…
15 tasks
5
bugfix: Support for extracting answers expressed in thousand separato… bugfix
#360 opened Jun 24, 2026 by yejj710 Collaborator Loading…
1 of 9 tasks
2
test ai
#352 opened Jun 23, 2026 by wenba0 Collaborator Loading…
15 tasks
3
Update answer pattern for COT chat prompt
#347 opened Jun 18, 2026 by F0undLinks Loading…
7 tasks
4
Update cmmlu_gen_5_shot_cot_chat_prompt.py
#346 opened Jun 18, 2026 by F0undLinks Loading…
7 tasks
4
增加用户自定义mcq数据0-shot&5-shot的语言模型精度评测功能，增加README
#345 opened Jun 16, 2026 by F0undLinks Loading…
14 tasks
8
【Feature】Supports rerunning specified use cases on SWE dataset
#331 opened Jun 8, 2026 by yejj710 Collaborator Loading…
6 tasks
4
[bugfix]: fix answer extraction regex and evaluator bugs in MMLU-Pro bugfix
#269 opened May 2, 2026 by lvhua6352 Loading…
1 of 15 tasks
1
3
[Bugfix] Add pred and choices parsing to fix the issue of score=0 for… bugfix no_UT feature / bugfix 类型 PR 缺少 tests/UT 下的单元测试新增或修改 review_opened PR 中存在未闭环的检视意见，所有检视意见必须闭环后才能合入
#258 opened Apr 20, 2026 by Yanguan619 Loading…
1 of 15 tasks
1
13
Fix max_out_len handling for multi-turn ShareGPT conversations bugfix
#243 opened Apr 12, 2026 by Shadowless-ly Loading…
6 of 15 tasks
1
10
Fix the issue where TTFT and TPOT have no data when running Kimi2.5 i…
#210 opened Mar 21, 2026 by GaoHuaZhang Collaborator Loading…
15 tasks
4
ProTip! Updated in the last three days: updated:>2026-09-08.