# Meta details Prometheus training capacity across hundreds of thousands of GPUs

_Published Monday, October 19, 2026 at 9:29 AM EDT · AI, Infrastructure · Latest · Tier 2 — Notable_

![Meta details Prometheus training capacity across hundreds of thousands of GPUs — Primary](https://engineering.fb.com/wp-content/uploads/2026/10/Prometheus-NAO_-5-1.jpg)

Meta says its Prometheus supercluster in New Albany, Ohio, now connects hundreds of thousands of GPUs across multiple buildings and has trained its Muse foundational models. Its first phase is complete, and the company is working toward roughly 1 million GPUs at full scale.

A dedicated Ethernet network connects GPUs within and between buildings, allowing the site to operate as a single training system. Meta says the capacity supports larger models and longer context windows than were previously practical.

The design also reserves hardware for failures: each 72-GPU domain runs a 64-GPU training slice and keeps eight GPUs as spares. Meta says a 32,768-active-GPU training run requires provisioning 37,656 GPUs.

## Sources

- [Engineering at Meta](https://engineering.fb.com/2026/10/19/data-center-engineering/inside-prometheus-meta-gigawatt-scale-supercluster/)

---
Canonical: https://techandbusiness.org/newswire/WzMWSI6KOfMu9qSuK9yvta
Published: 2026-10-19T13:29:51.071Z
Story chronology: 2026-10-19T13:00:10.000Z
Retrieved: 2026-10-19T16:10:06.569Z
Publisher: Tech & Business (techandbusiness.org)