What is headroom?
Headroom is the spare memory left after a model's weights are loaded. You need it for the KV cache, the operating system, the inference app and anything else you have open. A model that only barely fits can fail to load, be limited to short contexts, or slow the system down. A 70B model at Q4 takes roughly 40 GB. On the Mac mini (M4 Pro, 64GB), that leaves around 20 GB before system overhead. macOS also reserves part of unified memory for itself by default. Machines with 128 GB, such as the GMKtec EVO-X2 or the NVIDIA DGX Spark, leave far more room for long contexts or a second model. Because memory is soldered on all of these machines, it cannot be upgraded later. Plan your headroom when you buy.