Local inference hardware, models, and techniques in September 2026
A dated map of what current hardware can hold, which low-precision paths it exposes, and which techniques change the result.
Posts
What limits local LLM inference
A practical way to reason about model size, number formats, memory bandwidth, compute, and the software between them.
Starting this site
A place to keep notes on systems, experiments, and small projects.