# LaProx researchers report preserving model performance with 5% of inference cache

_Published Monday, November 9, 2026 at 12:05 PM EST · AI, Science · Latest · Tier 2 — Notable_

Researchers introducing LaProx report that their method preserved language model performance while retaining only 5% of the cache used to process long inputs. The preprint reports experiments across 19 datasets on the LongBench and Needle-In-A-Haystack benchmarks.

The cache stores intermediate information used during inference. LaProx selects which tokens to retain by estimating their contributions to model outputs and comparing importance across the model, rather than making separate decisions within individual attention heads. The researchers report up to 2× reduction in accuracy loss against existing leading methods under extreme compression; the findings concern benchmark experiments.

## Sources

- [cs.CL updates on arXiv.org](https://arxiv.org/abs/2605.07234)

---
Canonical: https://techandbusiness.org/newswire/fzhWc2TqS8GrB3wPEJVOpi
Published: 2026-11-09T17:05:40.896Z
Story chronology: 2026-11-09T05:00:00.000Z
Retrieved: 2026-11-09T19:00:00.256Z
Publisher: Tech & Business (techandbusiness.org)