Downloaded: 2026-07-03 (resumable size-verified fetch,
tools/fetch_gpt_oss_120b.sh; sizes pinned from HF API; no upstream
SHA256 available - xet-backed repo - so these locally computed values
are the provenance record)
Quant: native MXFP4 MoE (non-expert tensors Q8_0). Community
reference tables label this artefact family "Q8" - divergence noted in
docs/PHASE-A-LOG.md step 4c entry.
Licence: Apache-2.0 (per repo card)
Chat template: embedded (harmony format); not exercised by
llama-bench; must be validated before any eval use.
Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf
Role: Discovery-matrix "Qwen mid-MoE workhorse" (WORKPLAN 4.4) -
production-relevant instant-tier candidate; benchmarked FIRST in step 6
per matrix order set by Alastair 2026-07-03.
Selection rationale (names versioned at execution, per 4.4): Qwen
publishes no official GGUF of the 2507 refresh (their A3B GGUF repos:
original hybrid 30B-A3B, VL variants, and 80B Qwen3-Next - wrong class).
The Instruct-2507 refresh is the current instruct-tuned 30B-A3B and the
non-thinking variant fits instant-tier structured output. Chosen source:
unsloth (high-trust quantizer; 511k downloads - the artefact the
community actually benches). Thinking-2507 is a separate model,
evaluated separately if ever needed.
SHA256 (upstream LFS oid - this repo publishes one, unlike the
xet-backed gpt-oss repo):
6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0
local verification on arrival (2026-07-03): size exact match
(18,556,686,752 bytes) AND local sha256sum identical to upstream oid.
VERIFIED.
Quant: Q4_K_M
Licence: Apache-2.0 (per repo card)
Chat template: embedded GGUF chat template (Qwen3 ChatML variant,
instruct/non-thinking - no reasoning toggle in the 2507 Instruct line).
Serve with --jinja; not exercised by llama-bench.
GLM-4.5-Air-Q4_K_M (2 shards)
Role: Discovery-matrix "quality-leaning middle" (WORKPLAN 4.4);
matrix order #2 per Alastair 2026-07-03. Thinking and non-thinking
modes evaluated SEPARATELY at eval time (llama-bench does not exercise
templates, so throughput rows are per-artefact).
Selection rationale (names versioned at execution, per 4.4): no
official zai-org GGUF exists; unsloth is the high-trust leader (12.3k
downloads). Execution-time check for a newer Air-class occupant: none -
GLM-4.6/4.7 are 355B-class, GLM-4.7-Flash (2026-01) is 31B-class (a
potential rival for the Qwen workhorse row, noted for Alastair, not an
Air successor). Quant Q4_K_M chosen for first-pass comparability with
the rest of the matrix (4.4 allows Q4-Q6; a richer quant is a later
refinement if the model earns it).
Source URL: https://huggingface.co/unsloth/GLM-4.5-Air-GGUF/resolve/main/Q4_K_M/GLM-4.5-Air-Q4_K_M-0000{1,2}-of-00002.gguf
(repo stores shards in a Q4_K_M/ subfolder; staged FLAT in staging root)
local verification on arrival (2026-07-03): sizes exact match
(50,000,746,752 / 22,975,001,632 bytes) AND local sha256sums identical
to upstream oids for both shards. VERIFIED.
Quant: Q4_K_M
Licence: MIT (per repo card)
Chat template: embedded (GLM-4.5 template, thinking toggle). Serve
with --jinja; validate before eval use.
gpt-oss-20b-mxfp4.gguf
Role: Step 7 Row A efficiency control (pre-registered fork in
PHASE-A-LOG 2026-07-03: isolates whether gpt-oss-120b's 67%-of-ceiling
is model-specific overhead or an MXFP4 quant tax on this box).
Size (HF API authority): 12,109,566,560 bytes (~11.3 GiB)
SHA256 (upstream LFS oid - available for this repo, unlike the
xet-backed 120b at its download time):
be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935
local verification on arrival (2026-07-03): size exact match
(12,109,566,560 bytes) AND local sha256sum identical to upstream
oid. VERIFIED.
Quant: native MXFP4 MoE (same artefact family as the 120b
reference row)
Licence: Apache-2.0 (per repo card; API tags do not surface it)
Chat template: embedded (harmony format); not exercised by
llama-bench; validate before any eval use.
Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf
Role: Step 7 Row B workhorse challenger (35B total / 3B active
hybrid MoE: Gated DeltaNet + Gated Attention, 256 experts, 8 routed +
1 shared; multimodal - TEXT BENCH ONLY). Pre-registered in PHASE-A-LOG
2026-07-03: tg128 d0 ~80-90 t/s; pp512 deliberately not predicted
(Vulkan DeltaNet kernel-maturity measurement); default ubatch 512.
Selection rationale (names versioned at execution, per 4.4): brief
names the unsloth UD-Q4_K_XL as community standard; Q4_K family for
matrix comparability. Non-MTP repo chosen (unsloth/Qwen3.6-35B-A3B-
GGUF, 874k downloads) over the -MTP variant (734k) - the MTP head is a
speculative-decoding artefact, not the matrix row.
local verification on arrival (2026-07-03): size exact match
(22,360,456,160 bytes) AND local sha256sum identical to upstream
oid. VERIFIED.
Quant: UD-Q4_K_XL (unsloth dynamic Q4_K family)
Licence: Apache-2.0 (per API)
Chat template: embedded; thinking on by default is an eval-time
concern, not llama-bench's. Multimodal projector not exercised.
GLM-4.7-Flash-Q4_K_M.gguf
Role: Step 7 Row C workhorse hedge (31.2B total / ~3-3.6B active
pure-transformer MoE - no hybrid-kernel risk). Pre-registered in
PHASE-A-LOG 2026-07-03: tg128 d0 ~75-90 t/s; pp512 expected in
pure-MoE class (weak pp here is a genuine anomaly).
DATE GATE (scoring_func softmax->sigmoid fix, llama.cpp
2026-01-21): file lastCommit 2026-02-12T20:09:42Z per HF tree API -
post-dates the fix, PASS. House build 067de937 (2026-07-03) also
post-dates it; no rebuild needed.
local verification on arrival (2026-07-03): size exact match
(18,312,339,808 bytes) AND local sha256sum identical to upstream
oid. VERIFIED.
Quant: Q4_K_M. Optional second data point in same repo (NOT the
matrix row, per brief): GLM-4.7-Flash-MXFP4_MOE.gguf
(16,968,499,296 bytes, oid ecf4f3fd9448e45d01e1cacb54d9feaf30825
3d77e97893fac22b78bd9d04c4e, same-dated) - becomes interesting if
Row A's fork lands on "MXFP4 quant tax".
Licence: MIT (per API)
Chat template: embedded; validate before eval use.
GLM-4.7-Flash-MXFP4_MOE.gguf
Role: Step 7 addendum - quant-isolation pair, second leg (same
model as Row C, quant varied). Pre-registered fork in PHASE-A-LOG
2026-07-03: resolves whether the MXFP4 tax (Row A fork) is
quant-intrinsic or gpt-oss-family overhead. Green-lit under the
dual-purpose research reframe. NOT a matrix row.
Chat template: embedded GGUF chat template (Qwen3 ChatML variant,
thinking/non-thinking toggle). Served with --jinja; modes must be
evaluated separately per WORKPLAN 4.4.
Chat template: embedded GGUF chat template (Qwen3 ChatML variant;
supports enable_thinking toggle). Smoke test uses raw completion, no
template exercise.
Qwen3-4B-Instruct-2507-Q4_K_M.gguf
Role: Step 8 Block 2a - dense boundary case for the instant-tier
"~4B active or fewer" claim (registered band tg128 d0 75-85; the 8K
badge is a registered QUESTION). Newest instruct variant (2507
refresh, non-thinking). Fetch doubles as the Block 3c contamination
source, declared in PHASE-A-LOG step 8.
local verification on arrival (2026-07-04): size exact match
(2,497,281,120 bytes) AND local sha256sum identical to upstream
oid. VERIFIED.
Quant: Q4_K_M
Licence: Apache-2.0 (per repo card)
Chat template: embedded; validate before eval use.
Qwen3-8B-Q4_K_M.gguf
Role: Step 8 Block 2b - second dense point within the Qwen
family (registered band tg128 d0 37-43). No 2507 refresh exists for
the 8B; base Qwen3-8B artefact.
local verification on arrival (2026-07-04): size exact match
(5,027,784,512 bytes) AND local sha256sum identical to upstream
oid. VERIFIED.
Quant: Q4_K_M
Licence: Apache-2.0 (per repo card)
Chat template: embedded; validate before eval use.
Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf
Role: Step 8 Block 2c - dense FAMILY CONTROL (registered band
tg128 d0 38-44; a result well off the Qwen 8B number flags the dense
constant as family-contaminated). meta-llama origin repos are
HF-gated; ungated community GGUF used per the step 8 pre-registration
correction 6 (substitution rule).
local verification on arrival (2026-07-04): size exact match
(4,920,739,232 bytes) AND local sha256sum identical to upstream
oid. VERIFIED.
Quant: Q4_K_M
Licence: Llama 3.1 Community License (per upstream model card)
Chat template: embedded; validate before eval use.
DeepSeek-V2-Lite-Chat.Q4_K_M.gguf
Role: Step 8 Block 2d - second MLA point (FINDINGS F12 fork:
is MLA-MoE ~0.66 a constant class or Flash-specific?). SUBSTITUTION
declared: the brief's implied bartowski repo does not exist (HF API
401); mradermacher static-quant mirror is the highest-download
ungated Q4_K_M of this model. Older model - support problems mean
log and skip, no unattended debugging.
local verification on arrival (2026-07-04): size exact match
(18,556,689,568 bytes) AND local sha256sum identical to upstream
oid. VERIFIED.
Quant: Q4_K_M
Licence: Apache-2.0 (per repo card)
Chat template: embedded; Coder tool-call format - validate
before Phase B eval use.
Llama-4-Scout-17B-16E-Instruct-Q4_K_M (2 shards)
Role: Capability survey Tier 1 #2 (briefing v2, 2026-07-04) -
"Can I run Llama locally?" is the most common client question.
MoE 109B total / 17B active, interleaved-attention (iRoPE) arch.
Registered band: tg128 d0 15-20 (naive ~21.5 from 0.602 B/param x
17B active; pure-MoE 0.84 central ~18; outside band = arch-factor
finding per F9/F10). NOTE: ~60.9 GiB weights - AT the F6
split-invocation line; bench with split -d invocations.
Repo: unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF (briefing's
bartowski URL does not exist - 401; bartowski's org-prefixed repo
exists but is 2GB larger; unsloth chosen for house-source
consistency. Substitution logged.)
Size (HF API): 26,441,533,376 B | SHA256 (upstream oid):
9193684683657e90707087bd1ed19fd0b277ab66358d19edeadc26d6fdec4f53
local verification on arrival (2026-07-04): size exact match
(26,441,533,376 bytes) AND local sha256sum identical to upstream
oid. VERIFIED.
STATUS: DOES NOT LOAD at llama.cpp 067de937 ("failed to load
model") - Dec-2023 GGUF predates the modern MoE tensor layout. The
pre-declared vintage risk fired. KEPT per retention rule as
evidence ("GGUF archives age; re-conversion required"). Superseded
by the mradermacher re-conversion below.
Size (HF API): 2,491,874,272 B | SHA256 (upstream oid):
88c00229914083cd112853aab84ed51b87bdf6b9ce42f532d8c85c7c63b1730a
local verification on arrival (2026-07-04): size exact match
(2,491,874,272 bytes) AND local sha256sum identical to upstream
oid. VERIFIED.
Quant: Q4_K_M | Licence: MIT
Mistral-Small-3.1-24B quant ladder (Part 4; same repo/revision as the Q4_K_M entry, rev d63ca941)
Role: speed/size tradeoff curve on ONE model. Registered
predictions (corridor, dense ~0.98 x 220/GB): Q5_K_M (16,763,985,472 B,
oid cb86d837...) -> ~12.9 t/s; Q6_K (19,345,940,032 B, oid
4a2c8bec...) -> ~11.1 t/s; Q8_0 (25,054,780,992 B, oid 6e237297...)
-> ~8.6 t/s.
Q5_K_M verified 2026-07-04: size exact, local sha256 identical
to oid (hashed directly; chain-level hash prints only at invocation
end). Q6_K verified 2026-07-04 same method. Q8_0 verified
2026-07-04 same method - all three rungs size-exact + oid-matched.
Role: Local text-to-speech engine for the minisite audio (podcast +
narrations), adopted after human testing found Piper-medium too flat
(see results/audio-quality-verdict.md). British voices bm_george /
bm_lewis (male), bf_emma (female); all synthesis stays on the box.
Origin: github.com/thewh1teagle/kokoro-onnx release
model-files-v1.0 (Kokoro-82M by hexgrad). No upstream checksum is
published, so per the download-integrity rule the locally computed
SHA256 at verified-fetch time IS the provenance record.
kokoro-v1.0.onnx: 325,532,387 B | sha256
7d5df8ecf7d4b1878015a32686053fd0eebe2bc377234608764cc0ef3636a6c5
voices-v1.0.bin: 28,214,398 B | sha256
bca610b8308e8d99f32e6fe4197e7ec01679264efed0cac9140fe9c29f1fbf7d
verified on arrival 2026-07-06: both byte counts exact-match the
origin Content-Length; SHA256 computed locally via
kokoro-tts/fetch_kokoro.py. VERIFIED.
Licence: Apache-2.0. Model files gitignored (kokoro-tts/models/ +
the global *.onnx rule); engine venv at kokoro-tts/venv (gitignored).
