quantization

Capacity and throughput bounds for local LLM inference

A reproducible model of checkpoint size, KV cache, memory tiers, arithmetic intensity, and runtime support.

• inference
• hardware
• quantization