Federated training of an NTK-Mirror
gate controller — K = 5 000 signed log-gates on the residual streams
of a frozen Qwen2.5-0.5B-Instruct. The base model runs FORWARD
in your browser tab via onnxruntime-web; only the K = 5 000
gate values are trained, federated via the SPSA tournament from
Phase 36-39 (DeComFL fusion + symmetric AIMD adaptive η + post-apply
byzantine defense via Phase 40-3's audit loop).
Protocol: SPSA tournament (DeComFL fusion, Phase 36+).
Each round, this tab runs 2 SPSA trials on a fixed 4-example math
corpus; each trial = 3 Qwen-0.5B forward passes with different
gate values; submits the trial with the most-negative claimed Δloss
as a 20-byte proposal (seed, scalar_g, delta) plus a 4-byte
audit_loss_before (Phase 40-3). Server picks the best
across all workers, applies θ ← θ − η · g · u(seed) to
the K = 5 000 gate values, broadcasts the applied flip.
What this is, in one line: federated training of a real LLM
(a tiny part of one — the gate controller, P = 5 000 = ~0.001% of
Qwen-0.5B's parameters) across browser tabs of strangers, with
byzantine tolerance, ~20-byte wire format, no install, free.