Publishes the three gate records behind the layer-streaming feature as
benchmarks/, so the numbers in the docs and in the accompanying paper can
be checked rather than taken on trust.
These are the working records written while each item was built, not a
report assembled afterwards: they carry the failures, the assumptions that
turned out wrong and the numbers that were measured and then discarded, in
the order those things happened.
- gate-v0.72.0-layer-streaming.md - the streaming path and its bit-exactness
reference
- gate-v0.72.2-nf4.md - NF4 quantised streaming; Llama-3.1-8B at 119.6 tok/s
in a 3.32 GB peak
- gate-v0.72.3-breadth.md - nine architectures, batching, accumulation,
resume, disk tier; peak-VRAM predictor at 0.85% worst-case error
The README states the hardware once, explains why Windows/WDDM spilling
rather than raising OOM means a completed run is not evidence of fit, and
why any fraction-of-ceiling is quoted only with the SM clock it was taken
at. References to internal planning documents were rewritten for a reader
outside the repository.
Alpamys