regolith by ptr.pet · Tangled

strata but optimized for m5 (and maybe more later)

Commits on main

persona: fix what the persona/ move broke, and add the gates that would have caught

committed 1w ago

status: derive the pair->category map from the pack instead of hardcoding a window

committed 1w ago

census: report the longest run of near-tie margins - a contiguous block is a different finding from a scattered tail

committed 1w ago

scripts: detached colab keepalive - holds the ssh tunnel when the exclusive slot is free, and polls the runtime proxy every 60s when it is not

committed 1w ago

persona: simulate PLC-DPO posterior routing on our logged margins - warns that flip fires on 4/5 correct-direction pairs

committed 1w ago

census: split margins by unit (6A/6B single logit pair vs 6C per-token mean) - pooling them compared values ~95x apart; add adpo_dilution_check

committed 1w ago

scripts: colab_status census reported epoch-1's max window as epoch 2's position

committed 1w ago

scripts: colab_status.py - ssh-free training status via the runtime proxy (log tail + checkpoint inventory)

committed 1w ago

audits: r45 colab ssh-slot refusal - ColabSshSessionError + HTTP recovery helpers (patch in dawn's albedo checkout, uncommitted)

committed 1w ago

scripts: pull Colab files over the HTTP runtime proxy - ssh is locked to one session per runtime and a killed bridge strands it with 429 already-active-session

committed 1w ago

audits: archive r44 chunk-0 MoCE measurement (reconstructed; 47/64 KL rows unrecoverable, hashes null)

committed 1w ago

metal: revert chunk-0 prompt MoCE affinity to unboosted; keep prompt counters past window_reset_stats; add arena_preflight guard

committed 1w ago

docs: rewrite trap #44 - seven measurement traps from re-measuring chunk-0 MoCE (control shares no mechanism, n=2 is not reproducibility, KL/damage disjoint, corpus-dependent metric power, PPL cannot resolve KL, prefill counters need TRACE, no sweeps)

committed 1w ago

docs: correct Round-38 prefill read accounting - the 375.2 MB line is one decode step; prefill counters require STRATA_METAL_TRACE=1

committed 1w ago

docs: trap #44 - teacher-forced decode noise floor (base-vs-base KLD 0.0012 / top-1 95.3%) and prefill sweep ordering confound

committed 1w ago

docs: add Oct 2026 arXiv preprints and traps #42-#43 (GDN state quant & DuoRate frequency cancellation)

committed 1w ago

metal prompt: enable soft MoCE cache-affinity (300.85f) on chunk 0 and fix Metal 3.2 xs lambda address space in gdn_prompt.metal

committed 1w ago

README & Metal engine: default STRATA_METAL_PHASE_TRADE=1 (+0.00 GB prefill scratch) and update M5 memory/optimization tables

committed 1w ago

keep 00-..04- docs and non-persona engine/pruning files at top level; keep only persona/anti-slop in persona/

committed 1w ago

separate persona/ subproject (docs, scripts, data, results, audits) from root engine

committed 1w ago

docs & root cleanup: split PLAN.md into 00-..04-, move mine_llm_isms to scripts/, remove superseded blueprint files

committed 1w ago

round 43: port rocm adaptive-kv-stream opts to Metal (WY GDN prefill, MTP defer_catchup, GDN ring rollback, 1-sg qsa_prep, delayed-softmax topk, coalesced lazy mmap)

committed 1w ago

round 42: add elastic Metal vision (strata-vision + mmproj BF16 + 2D M-RoPE GENI)

committed 1w ago

round 41d: clm frequent mid-prompt edit hardening (2-pass non-overlapping scr_relocate, lcp>=0, max_runs=64, active_path replacement)

committed 1w ago

round 41c: preserve prefix-share delta across scr suffix splices + restore post-suffix gdn checkpoint

committed 1w ago

round 41b: port bonsai prefix-share (8906fd8) zero-copy delta .kvc storage against pinned prefixes

committed 1w ago

round 41: bonsai-style nvme .kvc prompt/conversation cache + 2-prompt prefix pinning + mtp session persistence

committed 1w ago

default to 128k context (131072) and add 32k/128k memory columns to README

committed 1w ago

README: add model credits, upstream repos, and main papers

committed 1w ago

README: drop k256 mentions and link ukisai Swift-1.5 GGUF under M5 perf section

committed 1w ago

README: name regolith and add M5 24GB perf + memory breakdown tables

committed 1w ago

round 40: add apple silicon README, setup script, and complete strata metal diff

committed 1w ago

document paired-run review limits and baseline provenance

committed 1w ago

round 39: port serving fixes and PLE reuse; verify parity, record perf uncertainty

committed 1w ago

PLAN.md: record Round 38 benchmark results (35.47 tok/s @10.2K decode, 473.80 tok/s @10.2K prefill, 42.57 tok/s @2K decode, 37.20 tok/s reasoning)

committed 1w ago

Round 38: hold_region layer-0 allow_hot=false + prompt/decode bytes_read_/reads_ split + mtp_prefill tail_cap sync with MTP_WIN -> 35.47 tok/s @10.2K decode, 473.80 tok/s @10.2K prefill, 42.57 tok/s @2K decode, 37.20 tok/s reasoning

committed 1w ago

PLAN.md: record Round 37 benchmark results (34.01-34.74 tok/s @10.2K decode, 42.49 tok/s @2K decode, 633.28 tok/s GPU prefill)

committed 1w ago

Round 37: multi-chunk prompt hot-expert LRU & scratch pool preservation (stream.cpp, window.cpp) -> 34.01-34.74 tok/s @10.2K decode (+34.6-37.5%) & 458-473 tok/s @10.2K prefill, 42.49 tok/s @2K decode

committed 1w ago

PLAN.md: record Round 36 benchmark results (predL_/predL2_ token-0 fast path -16% hot / -6.8% cold, hc_down/swiglu_up TM>32 row-tail trim, mtp_ms 190.62ms)

committed 1w ago

Round 36 blitz: predL_/predL2_ token-0 fast path when PREFETCH_DRAFT<=0 (-16.0% hot / -6.8% cold), TM>32 row-tail trim in gemm_hc_down (-4.7% @ T=1025) & gemm_swiglu_up (-1.4% @ T=1025, -0.8% @ T=1987) -> mtp_ms 190.62ms, 42.26 tok/s decode

committed 1w ago

PLAN.md: record Round 35 benchmark results (629.05 tok/s GPU prefill, 2,047 dispatches, 25.26 tok/s @10.2K decode, 128.14 tok/s persona_chat prefill, mtp_ms 192.17ms)

committed 1w ago

Round 35 blitz: Wr/Wr2 router dq reuse (-47 dispatches/chunk), gemm_f16_16_96_2 Walbe (-13.6%), M%128<=64 64_128_4 (1.14x @ M=306), hc_up_tile row-tail trim (-2.5% @ T=289), mtp_rms_xprep (-37.5%) & mtp_embed (-21.8%) & mtp_slop_pen (-96.5%) -> 629.05 tok/s GPU prefill, 25.26 tok/s @10.2K decode, mtp_ms 192.17/355.15ms

committed 1w ago

PLAN.md: record Round 34 benchmark results (432.78 tok/s 2K prefill, 42.27 tok/s decode, 25.04 tok/s @10.2K, gemm_hc_down TN=96 tail -7.18%, mtp_ms 322.48/374.22/374.58ms)

committed 1w ago

Round 34 blitz: gemm_hc_down TN=96 tail (-5.0..-7.2%), grd_acc ROLL=true at KS=4 (-1.9..-4.6% on _r2), W8<T_IQ3_S>::block + half4 HS store + IQ2_XS sboff -> 432.78 tok/s 2K prefill, 42.27 tok/s decode, 25.04 tok/s @10.2K

committed 1w ago

PLAN.md: record Round 33 benchmark results (628.51 tok/s GPU prefill, gdn_step_t kl split + pre-barrier3 state commit, gr_norm hoist, GrdUnit<T_Q8_0,2>, mtp_ms 323.71ms reasoning / 383.38ms persona_chat)

committed 1w ago

Round 33 blitz: gdn_step_t kl split + pre-barrier3 state commit (-1.1..-4.1%), gr_norm hoist (-6..-11%), GrdUnit<T_Q8_0,2> packed char4 (-10..-16%) -> 628.51 tok/s GPU prefill, mtp_ms 124.20/193.49/323.71ms

committed 1w ago

PLAN.md: record Round 32 benchmark results (3175.30 ms / 624.51 tok/s GPU prefill, 408.75 tok/s end-to-end prefill, 42.16 tok/s decode)

committed 1w ago

Round 32 blitz: qsa_flash sp[4] 3->1 barrier & ko[j] offset + unroll (-4.0..-5.5% / -6.1 ms in kprof), mm_gu3 T_IQ2_S half4 HS store (-9.0 ms in kprof -> 3175.3 ms / 624.5 tok/s GPU prefill!), deq uint2 grid loads + deq_iq_packed (-> 408.75 tok/s prefill & 42.16 tok/s decode!)

committed 1w ago

PLAN.md: record Round 31 benchmark results (mm_gu3 IQ2_S/IQ2_XXS -57.9 ms in kprof, moe_down Q2_0R -7.6..-16.9%, mtp_ms 126.51 ms @10.2K)

committed 1w ago

Round 31 blitz: mm_gu3 IQ2_S/IQ2_XXS/IQ2_XS/IQ3_S tab+hh & shift (+6.8..+8.2% / -57.9 ms in kprof), moe_down/gemv Q2_0R 0x6400 half-mantissa decode (-7.6..-17.4%), dq_f16 IQ4 tab init & perm=4 inverse contiguous write

committed 1w ago

PLAN.md: record Round 30 benchmark results (610.75 tok/s GPU prefill, 406.98 tok/s 2K prefill, 446.59 tok/s 11K prefill, mm_down3 -11.9%)

committed 1w ago

Round 30 blitz: W4<T_Q2_0>::dec FP16 0x6400 exponent trick (-10.5% mm_down3 / -37 ms in kprof -> 610.75 tok/s GPU prefill) + gdn_pre/post float4 simd_sum

committed 1w ago

PLAN.md: record Round 29 benchmark results (mm_gu3 T_IQ2_S -10.0% in kprof, moe_route -26.4%, deq<T_IQ2_S/XXS> -1.1..-6.9%, 24.95 tok/s @10.2K decode)

committed 1w ago

Round 29 blitz: mm_gu3 T_IQ2_S scale caching (-86.2 ms / -10% in kprof) & T_IQ2_XXS byte loads (-6.5%), moe_route e512/res_mask (-20.6..-26.4%) + deq<T_IQ2_S/XXS> (-1.1..-6.9%)

committed 1w ago

PLAN.md: record Round 28 benchmark results (mtp.fc_hidden [t][c] stream batching -52.1%, ple.metal tg_sum barrier halving, sample.metal unroll)

committed 1w ago

Round 28 blitz: mtp.fc_hidden [t][c] stream batching (-52.1% n=2 / -29.3% n=3), ple.metal tg_sum barrier halving (-1.5..-5.8%), sample.metal tg_argmax unroll + router_route_8

committed 1w ago

PLAN.md: record Round 27 benchmark results (gdn_step_t 5->4 barriers, qsa_merge2 float2(m,l) + simd_max, gemv_tile n_out=512 32,2,4,1)

committed 1w ago

Round 27 blitz: gdn_step_t 5->4 barriers + dt/ssm_a hoist + red2[IB-1] (-3.0..-7.9%), qsa_merge2/qsa_merge float2(m,l) + simd_max (-8..-20%), gemv_tile n_out=512 32,2,4,1 (-3.2..-25.5%) + Q2_0 640->2560 8,2,4,1

committed 1w ago

PLAN.md: record Round 26 benchmark results (qsa_attn_mm -23..-30%, gemv IQ4_XS packed_uint4, DW<IQ4_XS/IQ4_NL/Q6_K> unroll)

committed 1w ago

Round 26 blitz: qsa_attn_mm 32-bit ko/vo + float4 loads (-23.3..-29.9%), gemv IQ4_XS packed_uint4 5-reg codes (-1.5..-5% cold DRAM), DW<IQ4_XS/IQ4_NL/Q6_K> unroll + MM_V3_ONLY fast compile

committed 1w ago