Skip to main content

Share story

Science AI

arXiv paper proposes statistically grounded SAE steering for LLM activation control

An arXiv preprint on artificial intelligence presents a transparent sparse autoencoder feature steering pipeline for activation-space control of large language models, framed as a lightweight alternative to fine-tuning. The method first applies a six-condition reliability filter, then ranks sparse features through an unweighted Borda consensus over three statistics: an F-test, KSG mutual information, and Cohen's d. The steering direction is built as a Cohen's-d-weighted combination of SAE decoder rows, described as an optimization-free construction motivated by Fisher-LDA under approximate feature decorrelation. Across three Gemma-family models, four behavioral domains, and 356 layer-strength configurations, the approach produced measurable domain-specific shifts while showing a substantial gap between raw attribute movement and quality-preserving generation. In the strongest configuration reported, logical-correctness steering reached a primary-score delta of +1.16 in Gemma 2 9B. The authors find that usable steering is highly localized by model, domain, layer, and strength, and argue that activation-steering evaluations should report quality-conditioned success alongside raw behavioral shift. Code and data are stated to be available with the paper.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from arXiv and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
AI Science
AI Science

Researchers reproduce AI agent society gains on four gaming GPUs

A research team working with Apex Fusion says it reproduced the central result of MIT's SwarmWorld experiment on four RTX 3090 gaming GPUs using a 4-bit version of the open-weight Qwen3.8-27B model. The experiment tests whether ag...

AI Infrastructure
AI Infrastructure

Google open-sources TorchTPU for native PyTorch workloads on TPUs

Google released TorchTPU as open source on GitHub, saying the stack lets developers train and serve existing PyTorch models on its TPU accelerators with minimal code changes. Co-developed with Meta's PyTorch team, it supports fami...

AI
AI

Google opens preview of Gemini agents for government workflows

Google Cloud has made Gemini for government services available in preview, offering agencies agents for tasks including public-records discovery, document redaction, bid evaluation and grant expense audits. Google says connectors...

AI Infrastructure
AI Infrastructure

llm-d 1.0 adds traffic priorities and upgrade controls for model serving

Google announced the release of llm-d 1.0, an open-source stack that coordinates model servers across Kubernetes clusters. The release adds stable v1 interfaces, router high availability and controls that let interactive requests ...

AI Infrastructure
AI Infrastructure

Google previews managed Gemini search for air-gapped data centers

Google announced a preview of managed enterprise search with Gemini on Google Distributed Cloud air-gapped, allowing regulated organizations to query files without connecting to the public internet or Google's global infrastructur...