Skip to main content

Share story

AI Science

Preprint proposes lazy memory retrieval for long LLM chats

A preprint describes Pull, a session router intended to reduce the context supplied to stateful LLM conversations. It maintains a local metadata directory and retrieves only turns needed for a query, while leaving collapsed turns available for later expansion. On the reported LoCoEval tests, Pull reduced per-query context tokens by 75.1% on single-hop tasks and 72.0% on multi-hop tasks with no reported quality loss. The results are from controlled benchmarks, not a production deployment.
Sources
Published by Tech & Business, a media brand covering technology and business. This story was sourced from cs.CL updates on arXiv.org and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
AI Science
AI Science

Insilico says AI-discovered Rentosertib has entered Phase III trials

Insilico Medicine says Rentosertib, its generative AI-discovered drug candidate also known as ISM001-055, has entered Phase III clinical trials for idiopathic pulmonary fibrosis. The company described the clinical advance in an announcement carried by News-Medical.Net.

AI Infrastructure
AI Infrastructure

Five technology giants commit more than $3T to future spending

Alphabet, Meta, Microsoft, Amazon and Oracle have committed more than $3T to future spending on data centres, leases, equipment and energy, The Next Web reported, citing Bloomberg. Alphabet accounts for more than $1T and Meta for more than $800B.

Products AI
Products AI

Salesforce's Rune acquisition agreement reportedly worth $375 million

Salesforce's agreement to acquire military logistics software developer Rune Technologies is worth $375 million in cash and stock, Resilience Media reported. Rune builds AI software that helps the US military predict supply needs and manage logistics in the field.

Infrastructure Science
Infrastructure Science

Quilty Space projects shortfall of about 150 launches through 2030

The world outside China faces a shortfall of about 150 rocket launches through 2030 against demand from satellite operators and civil space agencies, analytics firm Quilty Space estimates in a new report.