Skip to main content

Share story

Science AI

Preprint reports fewer AI agent violations with live monitoring and revocation

An arXiv preprint reports that live monitoring with permanent revocation reduced security violations from 12.00 to 3.81 per 24 assigned task opportunities against an adversarial controller that could observe the monitor's rule and statistic. The monitor tracks evidence of violations against a prespecified reference rate. The researchers also show why finite safety assessments cannot exclude attackers that preserve normal behavior until certification and intervene afterward. In simulated RoCo collaboration, that switching strategy produced commanded-separation violations in 34 of 36 post-certification episodes. The monitoring approach comes with an operational tradeoff: revocation also reduces the number of tasks executed.
Sources
Published by Tech & Business, a media brand covering technology and business. This story was sourced from cs.LG updates on arXiv.org and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Products AI
Products AI

Figma opens code layers beta and begins Specs and Payload rollouts

Figma said it is rolling out code layers in open beta on all plans, letting teams bring working code onto its design canvas. Specs, a Markdown editor that links shared decisions to designs, diagrams and code layers, is also beginn...

AI Products
AI Products

Bloomberg expands ASKB AI interface to all Terminal users

Bloomberg is making its conversational AI interface, ASKB, available to all Terminal users, The Wall Street Journal reports. Users can combine their own content with Bloomberg's existing financial data, giving the generative AI sy...

AI Science
AI Science

Preprint reports simpler AI support workflow system with slower responses

Researchers report in a preprint that a portable set of instructions and tools generated customer-support resolution workflows with 99.2% procedural equivalence to human-approved answers and 83.3% evidence sufficiency. Their deplo...