# RPEG preprint reports faster reasoning-model training across 256 GPUs

_Published Monday, November 9, 2026 at 8:38 AM EST · AI, Science · Latest · Tier 2 — Notable_

Researchers report that a distributed runtime called RPEG improved reasoning-model training performance by up to 2x over ReaL in tests on systems with up to 256 GH200 GPUs. Their preprint also reports up to 2.48x lower step latency than verl and up to 30% higher hardware utilization.

RPEG represents a reinforcement-learning training pipeline as a graph, allowing the system to optimize both its structure and execution. It combines choices about asynchronous work and model sharing with stage fusion, scheduling and model parallelism.

An analytical performance model accounts for computation, communication and memory across racks, nodes and GPUs. The reported gains come from the tested systems and comparisons in the preprint.

## Sources

- [cs.CL updates on arXiv.org](https://arxiv.org/abs/2611.09207)

---
Canonical: https://techandbusiness.org/newswire/uGcp64Rvioy4jSxMCrRniT
Published: 2026-11-09T13:38:27.733Z
Story chronology: 2026-11-09T05:00:00.000Z
Retrieved: 2026-11-09T16:56:48.761Z
Publisher: Tech & Business (techandbusiness.org)