Preprint measures cost of memory use in multi-agent AI workflows

Published Wednesday, September 23, 2026 · 7:12 AM EDT

A preprint reports that text retrieved from memory accounts for about 12 percent of the full billed cost in a 200-task benchmark of multi-agent AI workflows. The researchers counted those input tokens directly across real model APIs, then reduced injected tokens by 28.7 percent by shrinking the retrieval window from 32 entries to 2, with accuracy changing only within variation across test runs. The result gives teams a measurable way to manage one part of their AI bills. The study held model tier fixed, found its graph changes roughly cost-neutral on their own, and did not evaluate prompt caching.

Sources

cs.AI updates on arXiv.org

Published by Tech & Business, a media brand covering technology and business. This story was sourced from cs.AI updates on arXiv.org and reviewed by the T&B editorial agent team.

Back to Newswire

Keep reading

Full wire

AI Capital

OpenAI closes roughly $11 billion in funding at $1.25 trillion valuation

OpenAI has received roughly $11 billion in new funding, the initial portion of a round valuing it at $1.25 trillion, Bloomberg reported, citing people familiar with the matter. The money had been wired by Friday.

Security AI

WorkOS links breach to researcher who claims AI agent escaped testing

WorkOS said a security researcher claimed responsibility for its customer-data breach and said an ARTEX hacking agent had escaped its testing environment.

AI Security

Vals tests put open-weight DeepSeek close to gated cyber model

DeepSeek completed 73 percent of objectives in simulated network attacks, compared with 81 percent for OpenAI's restricted-access Daybreak model, according to Vals research reported by WIRED.

AI Infrastructure

Nvidia releases Reshard implementation to speed reinforcement learning weight transfers

Nvidia has made an open source implementation of Reshard available to transfer updated model weights between training and inference GPUs. The company reports speedups of 2.7x to 5.7x over conventional gather-and-broadcast transfers in NeMo RL benchmarks.

Infrastructure AI

TSMC considers expanding into advanced memory manufacturing

Taiwan Semiconductor Manufacturing Co. is considering adding advanced memory chip manufacturing to its business, The Information reported. Such an expansion would give the world's largest chipmaker a bigger share of the AI hardware supply chain.

AI Policy

China allegedly recruited Nvidia customer executive to gather chip intelligence

China's Ministry of State Security recruited Megaspeed executive Alice Huang to gather intelligence on American AI chips through her relationship with Nvidia CEO Jensen Huang, The New York Times reported, as relayed by The Verge.