Skip to main content

Share story

AI Science

Preprint reports faster context transfer between different AI model families

Researchers propose HeteroFold, a method that lets different AI model families reuse previously processed context without having the receiving model process the text again. The preprint reports that transferring a 32K context from Llama-3.1-8B to Ministral-3-14B was 10.7 times faster than native context processing and 1.18-1.47 times faster than two existing transfer methods. HeteroFold aligns model structures, translates the sender's stored attention data into the receiver's representation, and calibrates it while keeping both models frozen. It matched text-based communication on a multi-agent benchmark. The reported speed comparison applies to the specified model pair and context length.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from cs.AI updates on arXiv.org and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Capital
Capital

Edelbyte emerges from stealth with $70 million in funding

Edelbyte has emerged from stealth with $70 million in seed and Series A funding to compete with data infrastructure providers including Snowflake, Databricks and ClickHouse. Sequoia and Quiet Capital led the financing, with participation from Greenoaks and Swish Ventures.

Capital
Capital

Nidus raises $30M across pre-seed and seed rounds

Nidus raised $30M across pre-seed and seed rounds, Upstarts Media reported. Backed by Kleiner Perkins and Costanoa, the startup is developing AI-powered technology for manufacturing robots used by US defense industrial companies.

Capital
Capital

TSMC plans $500 million fund for chip startups and suppliers

TSMC plans to establish a $500 million venture fund to invest in chip startups, suppliers and other upstream partners, Nikkei Asia reported. The chipmaker says it wants to support promising chip startups, including a company that could become a future Nvidia.

Infrastructure
Infrastructure

Vulcan launch failure destroys 40 Amazon Leo satellites

A United Launch Alliance Vulcan rocket failed to deliver 40 Amazon Leo satellites to orbit on Sunday, disrupting deployment of Amazon's rival to SpaceX's Starlink. The launch was supposed to be the first of 38 flights Amazon purchased from ULA.