What is Thunderbolt?
Thunderbolt is a high-speed interface developed by Intel. Versions 3, 4 and 5 use the USB-C connector. Thunderbolt 3 and 4 run at 40 Gbit/s. Thunderbolt 5 runs at 80 Gbit/s, with up to 120 Gbit/s in one direction for displays. Thunderbolt carries PCIe data, DisplayPort video and power over one cable, so it is used for fast external SSDs, docks and monitors. Thunderbolt ports are standard on Apple's Mac mini and Mac Studio. In the local LLM world, Thunderbolt cables are sometimes used to network Macs together to split a model across machines. Even 80 Gbit/s is only about 10 GB/s. That is far below the Mac Studio (M4 Max)'s 546 GB/s memory bandwidth. Clustering this way helps larger models fit, but it will not speed up a model that already fits.