Mesh LLM

A tool that links several machines into one network and shards a big LLM's inference across multiple devices.

Buzz uses it to build Buzz Mesh.

Handy when you need to run a model that won't fit on a single device.