-
Notifications
You must be signed in to change notification settings - Fork 65
All issues
Issue creation is restricted in this repository
- #431 · Libotry opened
on Aug 3, 2026 3
Issues
is:issue state:open
is:issue state:open
Search results
[文档] readme数据集跳转链接失效
content_check_passedissue content check passedissue content check passeddocumentationImprovements or additions to documentationImprovements or additions to documentationStatus: Open.#533 In AISBench/benchmark;[Bug] cmmlu模板pattern和答案判定pattern不一致
bugSomething isn't workingSomething isn't workingcontent_check_passedissue content check passedissue content check passedStatus: Open.#525 In AISBench/benchmark;[主动优化] Agent数据集结果可视化解析+Badcase分类归因
content_check_passedissue content check passedissue content check passedenhancementNew feature or requestNew feature or requestStatus: Open.#523 In AISBench/benchmark;[Bug] livecodebench数据集,如果模型输出sys.stdin.buffer程序直接判错
bugSomething isn't workingSomething isn't workingcontent_check_passedissue content check passedissue content check passedStatus: Open.#517 In AISBench/benchmark;[Bug] 精度测评livecodebench数据集,最终精度结果打屏中出现很多冗余打屏内容
bugSomething isn't workingSomething isn't workingcontent_check_passedissue content check passedissue content check passedStatus: Open.#507 In AISBench/benchmark;[文档] run_custom_config.md文档中引用已经删除的文件,performance_benchmark.md服务化性能测评快速入门章节内容冗余,需要修改
content_check_failedissue content check failedissue content check faileddocumentationImprovements or additions to documentationImprovements or additions to documentationnot_fixedissue not fixedissue not fixedStatus: Open.#505 In AISBench/benchmark;[Bug] 纯模型评测场景不支持常用模型参数使用命令行直接配置,但拉起命令使用--batch-size 2仍生效,需要修改
bugSomething isn't workingSomething isn't workingcontent_check_passedissue content check passedissue content check passednot_fixedissue not fixedissue not fixedStatus: Open.#504 In AISBench/benchmark;[Bug] 推理响应异常检测的打屏日志、落盘文件中的参数需要优化
bugSomething isn't workingSomething isn't workingcontent_check_passedissue content check passedissue content check passednot_fixedissue not fixedissue not fixedStatus: Open.#501 In AISBench/benchmark;[文档] 用户配置参数文档的推理响应异常检测配置介绍为功能介绍,应单独写一个md文件对其功能进行描述
content_check_passedissue content check passedissue content check passeddocumentationImprovements or additions to documentationImprovements or additions to documentationnot_fixedissue not fixedissue not fixedStatus: Open.#500 In AISBench/benchmark;[需求] 希望能够支持现网流量会放的方式验证agent场景推理的处理能力
content_check_failedissue content check failedissue content check failedenhancementNew feature or requestNew feature or requestStatus: Open.#498 In AISBench/benchmark;[Bug] 性能测试报错 Error encoding input data: No module named 'encoding_dsv4',导致 InputTokens 全部为 0
content_check_passedissue content check passedissue content check passedStatus: Open.#497 In AISBench/benchmark;[Bug] math500评测结束后卡了半小时没出结果
bugSomething isn't workingSomething isn't workingcontent_check_passedissue content check passedissue content check passedStatus: Open.#494 In AISBench/benchmark;