# Preprint reports 4.5-point accuracy gain for AI annotation framework

_Published Monday, October 26, 2026 at 10:13 AM EDT · AI, Science · Latest · Tier 2 — Notable_

Researchers report that ANT-OR, a framework using multiple AI agents to label data, improves agreement@>=2 accuracy by 4.5 points over the strongest baseline in their experiments. The preprint introduces ANT-A, a benchmark spanning 7 datasets with task-specific guidelines and 5 independent human labels per instance.

ANT-OR refines prompts by extracting contrasting decision rules from positive and negative feedback. The evaluation measures alignment with human labeling distributions, accommodating cases where human annotators reasonably disagree. Code and the benchmark are available.

## Sources

- [cs.CL updates on arXiv.org](https://arxiv.org/abs/2610.32415)

---
Canonical: https://techandbusiness.org/newswire/MMflW7ZK9X-XNXVXCPRSfM
Published: 2026-10-26T14:13:40.110Z
Story chronology: 2026-10-26T04:00:00.000Z
Retrieved: 2026-10-26T16:57:44.900Z
Publisher: Tech & Business (techandbusiness.org)