Skip to main content

Share story

Science AI

Preprint reports lower compute use when AI models manage their own context

A preprint introduces Context Language Models, which manage the information they retain by editing a context file themselves. The researchers report that applying this approach to existing models produced 11.4% higher accuracy with 21.5% fewer FLOPs, a measure of computation, on BrowseComp-Plus. On 12-hour EdgeBench tasks, they report 5% higher scores with 59% fewer FLOPs. The work also introduces Suffix Cache Reuse for serving these models, reporting 35% less server-side computation than standard SGLang at matched performance. These are preprint results on the tested tasks and serving comparisons.
Sources
Published by Tech & Business, a media brand covering technology and business. This story was sourced from arxiv.org and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
AI Capital
AI Capital

SoftBank and Nvidia complete $30B OpenAI funding pledges

SoftBank and Nvidia have each made a final $10 billion investment to complete their respective $30 billion pledges to OpenAI's last funding round, The Information reported. The payments complete the two investors' commitments to t...

AI Products
AI Products

SpaceXAI releases Grok iOS app for Intune-managed organizations

SpaceXAI has released Grok for Intune on the App Store, giving organizations a dedicated iOS version of its AI assistant that supports Microsoft's application management system. The company says the app honors workplace restrictio...

Capital Security
Capital Security

Armadin raises $255.5 million Series B for AI cybersecurity agents

Armadin said Thursday it raised $255.5 million in a Series B round led by a16z and Accel, Reuters reported. The AI cybersecurity company, started by Mandiant founder Kevin Mandia to build cybersecurity agents, said the financing v...

Capital Security
Capital Security

Osavul raises €8.5M to expand threat intelligence business

Osavul has raised €8.5M in Series A financing led by European cybersecurity fund 33N Ventures, with participation from Balnord, G+D Ventures and 42CAP. The company will use the money to improve its AI, expand its sales team and en...