Skip to content

Add BenchExec run comparison command - #43

Closed
k0lja wants to merge 1 commit into
devfrom
issue/40-benchdiff
Closed

Add BenchExec run comparison command#43
k0lja wants to merge 1 commit into
devfrom
issue/40-benchdiff

Conversation

@k0lja

@k0lja k0lja commented Aug 3, 2026

Copy link
Copy Markdown

Summary

  • add svcomp analyze benchdiff for comparing BenchExec XML files or run directories
  • report per-task category/status changes with text, Markdown, and JSON output
  • document the new analysis command in the SV-COMP scripts README

Verification

  • python3 -m compileall targets/sv-comp/scripts/lib/benchexec_comparison.py targets/sv-comp/scripts/commands/analyze.py
  • synthetic BenchExec XML smoke test via compare_benchexec_results, format_benchexec_diff, and diff_to_json

Fixes #40

@k0lja

k0lja commented Aug 4, 2026

Copy link
Copy Markdown
Author

Closing this because it was opened while working on the wrong task. The changes address issue #40, but the intended current task is issue #7 (fetch Z3 instead of packaging it). We'll keep issue #7 separate.

@k0lja k0lja closed this Aug 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant