Choosing hardware for local LLM inference
A reproducible decision procedure that turns documented quality, measured throughput, wall power, and dated price into intelligence per dollar and per kilowatt.
Posts
Capacity and throughput bounds for local LLM inference
A reproducible model of checkpoint size, KV cache, memory tiers, arithmetic intensity, and runtime support.
Starting this site
A place to keep notes on systems, experiments, and small projects.