Two theorems from running the network - #835
Merged
Merged
Conversation
T43 - a proxy gate must yield to the task metric it stands in for. The
1%-flushed gate was a hypothesis about perplexity; perplexity
disagreed, so the gate was retracted rather than kept beside it.
T44 - at 8 bits the golden-section split ties the deployed e4m3 split
(first on gpt2 and opt-125m, second by 0.1% on pythia-160m) and
consistently beats e5m2. At 16 bits nothing is distinguished; at
32 no task measurement exists.
T44's refusal is the important one: a tie is not a win, three models
under 500M is not a survey, and weights-only says nothing about the
regime E5M2 exists for.
Language audits run locally before pushing: RU and EN PASS, 27 routes.
github-actions Bot
added a commit
that referenced
this pull request
Aug 18, 2026
Two theorems from running the network (#835) T43 - a proxy gate must yield to the task metric it stands in for. The 1%-flushed gate was a hypothesis about perplexity; perplexity disagreed, so the gate was retracted rather than kept beside it. T44 - at 8 bits the golden-section split ties the deployed e4m3 split (first on gpt2 and opt-125m, second by 0.1% on pythia-160m) and consistently beats e5m2. At 16 bits nothing is distinguished; at 32 no task measurement exists. T44's refusal is the important one: a tie is not a win, three models under 500M is not a survey, and weights-only says nothing about the regime E5M2 exists for. Language audits run locally before pushing: RU and EN PASS, 27 routes.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Two theorems from trinity-fpga#588, which finally ran the network the earlier benchmarks kept refusing to claim anything about.
T43 — a proxy gate must yield to the task metric it stands in for. The 1%-flushed feasibility gate introduced in #587 was a hypothesis about perplexity. Perplexity disagreed:
e3m4zeroes 1.75% of GPT-2's weights on average and gives the lowest perplexity of four candidates, whilee2m5zeroes 12.65% and costs 16%. The gate was retracted to a reported number rather than kept beside the contradicting result — a repository holding two verdicts on one question holds none.T44 — at 8 bits the golden-section split ties the deployed one.
First on two models, second by 0.1% on the third. That is a tie, not a win — and
0.998×is quantisation slightly beating the baseline, which is the noise floor these comparisons sit on. At 16 bits every candidate is lossless, so the rule is not distinguished; at 32 bits no task measurement exists and the proxies place it far from optimal.T44's refusal is the one that matters: three models under 500M parameters is not a survey, and weights-only says nothing about the regime E5M2 exists for — activations carry outliers ~100× typical.
Ratchet: 179 errors across 26 files against baseline 184 across 27, no file gained. Language audits run locally before pushing:
RU PASS (27 маршрутов),EN PASS (27 маршрутов).