# PyTorch reports faster Muse Spark Open inference on four TPU v7 chips

_Published Tuesday, November 10, 2026 at 12:06 PM EST · AI, Infrastructure · Latest · Tier 2 — Notable_

![PyTorch reports faster Muse Spark Open inference on four TPU v7 chips — Primary](https://pytorch.org/wp-content/uploads/2026/11/All-PyTorch-Blog-Social-Images-2.png)

PyTorch reports serving Meta's 816B-parameter Muse Spark Open model on one four-chip TPU v7 host, with an optimized execution path delivering 1.94× faster output per token for a single request than its previous path.

The system runs all 62 model layers in one program per device, overlapping weight loads, cached context reads and transfers between devices with computation. It uses SGLang's serving software through the TorchTPU backend.

The single-request comparison measured 1.95 ms per output token against 3.78 ms, with both paths using speculative decoding, which checks several proposed tokens together. Those measurements used an earlier Muse Spark checkpoint; the improvement narrows as concurrent requests increase.

## Sources

- [PyTorch](https://pytorch.org/blog/optimizing-muse-spark-open-on-tpu-v7-with-sglang-torchtpu/)

---
Canonical: https://techandbusiness.org/newswire/SgqLebRNmVnWSMFPsrZ7MV
Published: 2026-11-10T17:06:56.721Z
Story chronology: 2026-11-10T16:45:24.000Z
Retrieved: 2026-11-10T19:09:12.946Z
Publisher: Tech & Business (techandbusiness.org)