ML Systems Desk Archive 2 articles 2026-10-11 Shrinking What the Accelerator Reads: Preconditioner-Space Rounding, Value-Cache Folding, and Decode-Aware Pruning 2026-08-21 Production Inference Architecture: Latency, Speculative Decoding, and Quantization Tradeoffs at Scale
