# Dust researchers report competitive transformer training without backpropagation

_Published Monday, October 5, 2026 at 9:18 PM EDT · AI, Science · Latest · Tier 2 — Notable_

Researchers at qlabs.sh report that Dust, a method for training transformer language models without backpropagation, matched and sometimes exceeded that standard training method in experiments using large populations of trials. Achieving those results required substantially more computation.

Dust adds independent noise to internal model outputs at each token, then rewards changes that reduce prediction errors. This lets a single forward pass evaluate many trials in parallel, rather than evaluating a separate altered set of model weights for each trial.

The researchers tested alignment with backpropagation's training signals up to 1B tokens. They explicitly do not aim to make Dust efficient enough to replace backpropagation today.

## Sources

- [qlabs.sh](https://qlabs.sh/research/dust)

---
Canonical: https://techandbusiness.org/newswire/pGWvP6sLrBOzdxgqzkJAxy
Published: 2026-10-06T01:18:12.646Z
Story chronology: 2026-10-05T21:15:07.000Z
Retrieved: 2026-10-06T05:07:04.440Z
Publisher: Tech & Business (techandbusiness.org)