# Separate claim checks improve an AI vulnerability auditor in preprint test

_Published Monday, October 26, 2026 at 12:30 PM EDT · Science, Security · Latest · Tier 2 — Notable_

Researchers report that checking tool claims in a separate model call improved an AI vulnerability auditor's accuracy by 12 points when it received false assurances. The preprint tested how models use evidence from static analysis, which examines code without running it.

Across 16,572 audits, fabricated assurances that safety checks existed reduced detection of real vulnerabilities by up to 19 points relative to true notes. Fabricated alarms did not significantly reduce accuracy. Prompt instructions did not reliably curb this deference.

Showing the auditor refuted claims produced the 12-point gain without reducing accuracy under true evidence, but a second model's smaller improvement was not statistically significant.

## Sources

- [cs.CR updates on arXiv.org](https://arxiv.org/abs/2610.32876)

---
Canonical: https://techandbusiness.org/newswire/wZ-2twHcva3uKeZlGW7hY8
Published: 2026-10-26T16:30:05.735Z
Story chronology: 2026-10-26T04:00:00.000Z
Retrieved: 2026-10-26T18:56:48.444Z
Publisher: Tech & Business (techandbusiness.org)