Reproduction
This protocol separates reproduction into two acceptance levels. Offline evidence verification runs on any machine. A host matching the fixed hardware and software controls can continue with a performance replay that emits a new environment receipt. Both levels use the same model, prompt, ACL, and output identities.
The current untouched-Q6_K capture records a clean source revision and exact binary identities. A replay from a newer revision is still a new experiment and must retain its own Git revision, binary hashes, and environment receipt. Older mixed-artifact captures that disclose a dirty worktree remain historical evidence.
Acceptance baseline
1. Acquire the source and freeze experiment identity
Run in Windows PowerShell:
The latest peak capture records clean source revision da2c1dd5a2c6a573ef8be7789de4a67fdb2a0eb0; the active quality matrix records 64aef15ddff7232c6261385700c8a912d1ed0963. Replaying from a newer clean revision is valid, but it is a new experiment and must retain its own evidence.
2. Run the model-free offline verifiers first
The active Q6_K-only verifier does not load the 22.88 GB model and does not require an NVIDIA GPU. It pins the full compact payload and recomputes the clean 600-request quality matrix:
It recomputes 23.642 versus 41.035 request-wide token/s. Exact output parity is
50/100 and strict scoring has two losses, so --require-lossless fails and the
MTP mode remains opt-in.
Verify archived peak and mixed-artifact evidence
The historical verifier checks 14 file SHA-256 values and recomputes the older peak and mixed-artifact records:
A passing process exits with code 0 and includes:
Any changed evidence byte or statistic produces a nonzero exit code and names the mismatched field.
3. Match the acceptance host
These token/s values are boundaries on this host, not cross-hardware promises:
The same protocol can run after changing the GPU, driver, clock, display load, or CPU topology, but label that result as a new platform. Do not copy an inapplicable affinity mask merely to pass the gate.
4. Build the pinned CUDA profile
The patch tool must confirm that the binding and embedded llama.cpp patches are applied. The runner rejects any backend other than exclusive llama.cpp.
5. Verify the model and inputs
Register the untouched Q6_K artifact as qwen3.8-27b-q6-k, then select its Power data directory. These three repository inputs must match exactly:
6. Replay the prefix-FR8192 peak end to end
Close GPU-consuming applications and run in a terminal allowed to lock the GPU clock:
The runner restores the GPU clock in finally and retains failed reports, so environment contention can be distinguished from a real performance regression.
7. Accept the new result
Retain these files under $benchmarkRoot:
pure-q6-fr8192-k7s6-replay.json: nine raw samples, statistics, and output digest;pure-q6-fr8192-k7s6-replay.environment.json: Git, binary, model, ACL, prompt, GPU, process, and power identities;- matching stdout and stderr logs: backend initialization and failure diagnosis.
The replay passes only when all nine requests generate 1,024 tokens, the steady median is at least 175 token/s, every output SHA-256 is identical, model identity matches exactly, the backend is exclusive, the worktree is clean, and the requested host controls actually took effect.
8. Verify the Q6_K-only native DFlash2 capture
Both modes use the same 22.88 GB Q6_K target. The 1.14 GB Q4 DFlash2 artifact is an auxiliary proposer, never the target. Recompute the native comparison without a model or GPU:
It verifies 33.075 versus 144.453 token/s median decode, a 4.367x speedup,
and exact output parity. Median end-to-end throughput is 25.744 versus 63.182
token/s. The complete DFlash2 guide
pins clean source commit 72a1ecd, artifact and binary hashes,
A3S_POWER_HOME registration, host controls, quality evidence, and exact
replay commands.
9. Reproduce the native DSpark gate
The external-DSpark package is a separate paired experiment. It keeps the same
22,884,408,288-byte Q6_K target and binds the 1,104,594,816-byte DSpark Q4
artifact with SHA-256
12003c7f2642e2e87e979729e16947a913e2213d82136cb5024a36ec4871fef2.
Run its model-free verifier first:
The accepted context-512, batch-12 capture reports 32.249 token/s target-only and 169.324 token/s with DSpark K10/S6, with a 167.102 token/s minimum. All three 256-token outputs and receipts match exactly. Peak VRAM is 23,847 MiB, so a quiet device and adequate free memory are required even when GPU utilization is low.
The second verifier authenticates the context-1024, batch-12, 600-request
quality capture. It recomputes the 22.618 versus 32.678 token/s workload rates,
1.445x speedup, fixed-task scores, replay telemetry, and all 100 paired task
vectors. Adding --require-production-default is expected to fail because only
54/100 complete outputs match; the published K10/S6 matrix is diagnostic, not
a lossless default.
Use the DSpark reproduction package for the typed registration body, target-only and DSpark ACL files, raw reports, artifact revisions, and exact paired runner commands. DFlash is not part of that result: DFlash and DSpark are alternative artifact contracts, and no compatible DFlash GGUF has completed this gate.
The complete Windows/CUDA guide also covers the paired full-vocabulary control, the 12-task pure-Q6_K calibration, and the previous mixed-artifact gates. The quality-matrix protocol explains how to rerun the existing 100-task × 3-run evaluation.
