Skip to main content

Share story

Science AI

Value Probes preprint reports roughly 50% higher peak AI audit scores

A preprint reports that a method called Value Probes raises peak language-model audit scores by roughly 50% against standard approaches using matched token budgets, across 18 target behaviors and 3 model scales. The method searches multiple conversation paths and uses signals from the target model's internal activations to estimate which paths could lead to problematic behavior. The researchers also report that probes can be trained with data from smaller models. The measured improvement concerns peak audit scores, rather than a demonstrated reduction in harmful behavior after deployment.
Sources
Published by Tech & Business, a media brand covering technology and business. This story was sourced from cs.AI updates on arXiv.org and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Science AI
Science AI

WorldFlow preprint reports lower errors in predicting 3D motion

WorldFlow, a model that jointly predicts future video and three-dimensional motion, achieved a 54.2% reduction in average displacement error against the strongest external baseline on the SpatialCog evaluation set, its authors report in an arXiv preprint.

AI Science
AI Science

GAAC preprint reports lossless cache compression and higher inference throughput

Researchers report in a preprint that GAAC, a system for compressing the stored attention data used by language models, reduces resident cache memory by approximately 26% and increases aggregate serving throughput by 13-29% under comparable cache-memory budgets.

AI Science
AI Science

Preprint finds hiding system labels improves AI judges of entity matches

A preprint reports that hiding a system's decision label improves how reliably AI judges assess whether records in different knowledge graphs refer to the same entity. The study tested three frontier models, three datasets and four entity alignment systems.