Skip to main content

Share story

AI Science

Preprint reports faster context transfer between different AI model families

Researchers propose HeteroFold, a method that lets different AI model families reuse previously processed context without having the receiving model process the text again. The preprint reports that transferring a 32K context from Llama-3.1-8B to Ministral-3-14B was 10.7 times faster than native context processing and 1.18-1.47 times faster than two existing transfer methods. HeteroFold aligns model structures, translates the sender's stored attention data into the receiver's representation, and calibrates it while keeping both models frozen. It matched text-based communication on a multi-agent benchmark. The reported speed comparison applies to the specified model pair and context length.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from cs.AI updates on arXiv.org and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Capital Security
Capital Security

Armadin raises $255.5 million Series B for AI cybersecurity agents

Armadin said Thursday it raised $255.5 million in a Series B round led by a16z and Accel, Reuters reported. The AI cybersecurity company, started by Mandiant founder Kevin Mandia to build cybersecurity agents, said the financing v...

Capital Security
Capital Security

Osavul raises €8.5M to expand threat intelligence business

Osavul has raised €8.5M in Series A financing led by European cybersecurity fund 33N Ventures, with participation from Balnord, G+D Ventures and 42CAP. The company will use the money to improve its AI, expand its sales team and en...

Products
Products

Raspberry Pi raises 2GB Pi 4 and Pi 5 prices by $12.50

Raspberry Pi increased prices for its 2GB Raspberry Pi 4 and Raspberry Pi 5 by $12.50 effective today, bringing them to $67.50 and $77.50 respectively. The company said rising memory costs had made holding their prices unsustainab...

Infrastructure AI
Infrastructure AI

Dell, Jera and Rhaelm plan $15B AI data center near Tokyo

Dell, Jera and UK-based Rhaelm are partnering to build a $15B, 400MW off-grid AI data center and gas power plant near Tokyo, the Financial Times reports. The planned facility would be among Asia's largest data center projects outs...