Skip to content

Publish the suite on two payload sizes: 256 B and 4 KiB - #33

Merged
leo-gan merged 5 commits into
masterfrom
refactor-size-dimension
Sep 1, 2026
Merged

Publish the suite on two payload sizes: 256 B and 4 KiB#33
leo-gan merged 5 commits into
masterfrom
refactor-size-dimension

Conversation

@leo-gan

@leo-gan leo-gan commented Sep 1, 2026

Copy link
Copy Markdown
Owner

Summary

  • Experiment 13 showed that SPSC ranking only changes at 256 B and 4 KiB.
  • The default matrix and smoke path now use size_256 and size_4096.
  • The dashboard filter is payload size, labelled 256 B and 4 KiB.
  • event / telemetry / strings stay in the catalog for older experiments; they are not on the published matrix.
  • Item count is still [100, 1000]. That is how many items move in one repetition, not a third size.

This branch also contains Experiment 13 (#32). Merging this PR lands both the finding and the matrix change.

Validation

  • Tests: analysis 97 passed; python 14 passed (project venv); javascript 3 passed; dashboard 22 passed.
  • Benchmarks: full, all five languages. Stems: csharp 2026-09-01-153914, python 2026-09-01-153922, rust 2026-09-01-153934, c 2026-09-01-153943, javascript 2026-09-01-153947.
  • Error CSVs: clean (0 error rows).
  • Analysis: 124 / 108 / 84 / 64 / 56 stat groups (python / rust / csharp / c / javascript), types size_256 and size_4096 only.
  • Dashboard: sync-data.py updated *_latest.json.gz.
  • Experiments 01–12 were not re-timed. They use their own run.yaml (message / document) and do not read the default matrix.

How to read

  • 256 B is the small-message cell. The queue usually stores a short reference to bytes already in memory, so making the message a little larger does not change who is first.
  • 4 KiB is the large-message cell. Some queues copy every byte, so the handoff takes longer and the order can change (Rust).

SPSC ranking is a size question, not a named data-type question.
Sweep 1 B / 64 B / 256 B / 4 KiB / 64 KiB at n=100 with full reps.
Finding: default matrix needs 256 B and 4 KiB; 64 KiB is research-only.
Voice in STYLE.md now covers replies to the user. Experiment findings
must follow that section instead of restating a shorter rule.
Experiment 13 showed that only these lengths change SPSC ranking.
The default matrix and smoke path now use size_256 and size_4096.
The dashboard filter is payload size. Older experiment folders still
use message and document for the same lengths.
Full runs for C, C#, JavaScript, Python, and Rust. Only size_256 and
size_4096 remain on the published payloads.
@leo-gan
leo-gan merged commit 44b658f into master Sep 1, 2026
7 checks passed
@leo-gan
leo-gan deleted the refactor-size-dimension branch September 1, 2026 22:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant