Skip to main content
Science AI

arXiv paper proposes statistically grounded SAE steering for LLM activation control

An arXiv preprint on artificial intelligence presents a transparent sparse autoencoder feature steering pipeline for activation-space control of large language models, framed as a lightweight alternative to fine-tuning. The method first applies a six-condition reliability filter, then ranks sparse features through an unweighted Borda consensus over three statistics: an F-test, KSG mutual information, and Cohen's d. The steering direction is built as a Cohen's-d-weighted combination of SAE decoder rows, described as an optimization-free construction motivated by Fisher-LDA under approximate feature decorrelation. Across three Gemma-family models, four behavioral domains, and 356 layer-strength configurations, the approach produced measurable domain-specific shifts while showing a substantial gap between raw attribute movement and quality-preserving generation. In the strongest configuration reported, logical-correctness steering reached a primary-score delta of +1.16 in Gemma 2 9B. The authors find that usable steering is highly localized by model, domain, layer, and strength, and argue that activation-steering evaluations should report quality-conditioned success alongside raw behavioral shift. Code and data are stated to be available with the paper.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from arXiv and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
AI Infrastructure
AI Infrastructure

Anthropic lines up at least 14.8 GW of compute agreements

Anthropic has entered agreements for at least 14.8 GW of compute capacity since October, according to an analysis by The Information summarized by Techmeme. The analysis says the company has made cloud-computing deals with SpaceX,...

AI Infrastructure
AI Infrastructure

Google deploys WeatherNext 3 across consumer and cloud products

Google and DeepMind have released WeatherNext 3, an AI weather model that uses live geostationary satellite data rather than traditional physics simulations, according to the report. Google says it generates hourly forecasts at up...

AI
AI

Spotify describes Portal routing plugin for AI coding tasks

Spotify engineers described shunt, a Claude Code plugin that routes large-file reading and predictable code generation through Portal's AiKA modes, using Gemini 2.5 Flash in the examples. The author reported mean bulk-read token s...

AI Policy
AI Policy

Report says Inspur uses subsidiaries to obtain advanced AI chips

The New York Times reports that Inspur, a China-owned company blacklisted by Washington over work with the Chinese military, has bypassed US restrictions on advanced AI chips through new subsidiaries and partners. The report says ...

AI Products
AI Products

AI reduces Kenya's overseas essay-writing gig work, report says

The New York Times reports that AI has sharply reduced work in Kenya's essay-writing industry, which at its peak paid more than 40,000 people in Nairobi to complete assignments for overseas students. The report describes fewer rou...