Local inference hardware, models, and techniques in September 2026
A dated map of what current hardware can hold, which low-precision paths it exposes, and which techniques change the result.
I work with large systems and build small projects to understand how things work. This is where I write down (by hand, mostly) what I’ve learned or what has caught my attention.
Latest
All postsWhat limits local LLM inference
A practical way to reason about model size, number formats, memory bandwidth, compute, and the software between them.
Starting this site
A place to keep notes on systems, experiments, and small projects.