# Researchers report 2-bit LLaMA2-70B compression with 1% accuracy drop

_Published Monday, November 2, 2026 at 9:22 PM EST · AI, Science · Latest · Tier 2 — Notable_

Researchers propose a method for compressing language models that achieved 2-bit quantization of LLaMA2-70B with a 1% accuracy drop on popular question-answering benchmarks, according to their arXiv preprint. The method, called TVQ, trains compressed model weights to recover quality lost during compression.

Vector quantization reduces the memory needed to store model weights, but its discrete parameters make further optimization difficult. TVQ introduces trainable latent weights that allow gradient-based optimization and uses block-wise knowledge distillation to balance quality and training efficiency. The reported accuracy result applies to the named model and benchmark category.

## Sources

- [cs.LG updates on arXiv.org](https://arxiv.org/abs/2610.41822)

---
Canonical: https://techandbusiness.org/newswire/KAWojRGuVW3ce31jrTbY6V
Published: 2026-11-03T02:22:56.262Z
Story chronology: 2026-11-02T05:00:00.000Z
Retrieved: 2026-11-03T05:06:43.492Z
Publisher: Tech & Business (techandbusiness.org)