# Rubricon preprint reports gains from automatically generated scoring criteria

_Published Saturday, October 31, 2026 at 9:06 PM EDT · AI, Science · Latest · Tier 2 — Notable_

A preprint introduces Rubricon, a system that generates and refines criteria for scoring AI answers without human preference labels, annotated rubrics or training the model that generates them. Across five benchmarks, its scores showed 9% greater alignment with expert-authored rubrics than the best competing synthetic method.

The system samples candidate rubrics, selects one, adds missing criteria and removes shallow or misaligned criteria, using observed pass rates to guide refinement. On HealthBench, training Qwen3.5-9B with its rubrics produced 4.5% better performance than training with rubrics from RRD, the strongest alternative tested.

## Sources

- [cs.AI updates on arXiv.org](https://arxiv.org/abs/2610.38220)

---
Canonical: https://techandbusiness.org/newswire/J0TdVGWgYC20lXEOPNMgKY
Published: 2026-11-01T01:06:48.027Z
Story chronology: 2026-10-31T04:00:00.000Z
Retrieved: 2026-11-01T03:51:29.475Z
Publisher: Tech & Business (techandbusiness.org)