I/O explained
I/O stands for input/output. It covers how a computer exchanges data with the outside world: USB-C and Thunderbolt ports, display outputs, Ethernet, Wi-Fi and storage. For a local LLM machine, I/O affects how quickly you can load models from disk or download them, connect external drives, and link machines into a cluster. The dual 10GbE ports on the Minisforum MS-S1 Max are one example. A fast PCIe 4.0 NVMe SSD reads at up to roughly 7 GB/s, so a 40 GB model can load in seconds. Once a model is in memory, I/O barely affects tokens per second. Generation speed then depends on memory bandwidth, such as 819 GB/s on the Mac Studio (M3 Ultra). Choose a machine for its I/O if you need its ports or storage, not to make generation faster.