Stop ranking queues on payload size; publish CPU instead - #31
Merged
Conversation
Size is a leftover serializer score. Every library in a cell moves the same already-built payload, so “most compact” and speed-vs-size Pareto were a horizontal line. Keep Size on the CSV as fixture metadata, treat fidelity as a validity gate, and rank on handoff plus messages per CPU-second (spin vs block). Dashboard, analysis, and experiment tables follow that contract.
Write the terminology rule into improve-docs STYLE.md: the catalog payload is a data type, not a fixture. Rename dashboard and analysis identifiers to match. Remove Size, SizeGzip, SizeZstd, and median_size_bytes from new CSV writes, stats, and experiment tables. Old logs may still contain Size; analysis ignores it.
Re-ran full benches for C, C#, JavaScript, Python, and Rust with the new CSV header (no Size/gzip/zstd). Analysis now emits msgs_per_cpu_sec and no median_size_bytes. Experiment summaries keep write/read/handoff only.
leo-gan
force-pushed
the
refactor-queue-metrics
branch
from
September 1, 2026 21:43
d070fa5 to
d87047c
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Size/SizeGzip/SizeZstd/median_size_bytesfrom new CSV writes, stats, and experiment tables.Validation
c csharp javascript python rust, stems2026-09-01-144022/143923/144029/143936/144004uv run analyze-benchmarks(210/310/270/160/140 groups)sync-data.py→ new*_latest.json.gzwithoutmedian_size_bytesNotes