LocalLLM Rigs

What is a mini PC?

A mini PC is a compact desktop computer, often small enough to sit beside or under a monitor. Mini PCs built for local AI usually rely on a single chip with unified (shared) memory instead of a separate graphics card. In our catalog, unified memory ranges from 16 GB in the Mac mini (M4, 16GB), which has a 5x5-inch footprint, to 128 GB in machines such as the GMKtec EVO-X2 and the NVIDIA DGX Spark. Memory bandwidth ranges from 120 to 819 GB/s. The advantages are low noise, small size and a large memory pool. The trade-off is that memory is usually soldered and cannot be upgraded. On a 70B model, generation speed in our catalog ranges from 0 tok/s (the model does not fit) to 14 tok/s. Large models often run slower than on high-end discrete GPUs.