LocalLLM Rigs

Ethernet explained

Ethernet is the standard wired networking technology, used through an RJ45 port or, at higher speeds, SFP+ cages. Common link speeds are 1 Gbit/s, 2.5 Gbit/s and 10 Gbit/s (10GbE). A wired link is usually more stable than Wi-Fi for serving a model to other devices or copying large model files. For example, a 10 Gbit/s link moves about 1.25 GB per second at best, so a 40 GB model file transfers in well under a minute. Ethernet speed becomes important when you cluster machines and split one model across several units. The Minisforum MS-S1 Max has dual 10GbE for multi-unit clustering. It needs this because a 235B model at Q4 requires two units. Even 10GbE is far slower than memory bandwidth (256 GB/s on that machine), so clustering lets larger models fit but does not make them faster.