# Mesh LLM: distributed AI computing on iroh

_Saturday, July 11, 2026 at 8:00 AM EDT · AI · Latest · Tier 2 — Notable_

![Mesh LLM: distributed AI computing on iroh — Primary](https://www.iroh.computer/api/og?title=Blog&subtitle=Mesh%20LLM:%20distributed%20AI%20computing%20on%20iroh)

Mesh LLM announced a distributed AI computing system that pools GPUs and memory across multiple machines using the iroh networking protocol. The system exposes a single OpenAI-compatible API at localhost:9337/v1, allowing users to run larger models without purchasing larger GPUs by splitting models across several machines in a pipeline mode called Skippy. The architecture uses iroh endpoints for authenticated QUIC connections with NAT traversal and relay fallback, eliminating the need for a central server. A gossip layer controls mesh admission, version compatibility, and peer trust. The lightweight software is about 18 MB and includes a catalog of over 40 models ranging from half-a-billion-parameter models to 235B mixture-of-experts models. Users can join a public mesh or configure private deployments. A mobile app built on iroh's Swift SDK is planned to support the emerging ACP agent standard. The project aims to provide more peer-to-peer computing, fewer closed servers, and no vendor lock-in.

## Sources

- [iroh.computer](https://www.iroh.computer/blog/mesh-llm)

---
Canonical: https://techandbusiness.org/newswire/PGyO8GOXYxu6ZJgc2m9W8p
Retrieved: 2026-07-12T04:31:37.458Z
Publisher: Tech & Business (techandbusiness.org)