Skip to main content

Share story

AI Science Infrastructure

Preprint finds shared model blocks cut GPU memory use by 18-48%

Researchers report that sharing parts of related language models cut GPU memory use by 18-48% in their tests. Their preprint describes LinkerLLM, a loader that lets variants derived from the same pretrained model share blocks of weights, the values that govern model behavior. The approach fit up to five 7B-parameter variants on one 24 GB consumer GPU. Post-training changed every tensor the researchers examined, so identical-file matching saved no memory. Five of eight tested configurations retained at least 94% of the quality of an unshared variant on the reported benchmarks; each of the other three fell below that threshold on one benchmark. Independently trained specializations showed substantially less shared structure.
Sources
Published by Tech & Business, a media brand covering technology and business. This story was sourced from cs.LG updates on arXiv.org and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Infrastructure AI
Infrastructure AI

TSMC considers expanding into advanced memory manufacturing

Taiwan Semiconductor Manufacturing Co. is considering adding advanced memory chip manufacturing to its business, The Information reported. Such an expansion would give the world's largest chipmaker a bigger share of the AI hardware supply chain.

AI Infrastructure
AI Infrastructure

Musk says government work will fall below 10% of SpaceX revenue

Elon Musk said government contracts will account for less than 10% of SpaceX revenue this quarter, down from 16.6% in the third quarter, The Next Web reports. Renting AI computing has become its largest revenue source.

AI Infrastructure
AI Infrastructure

Vercel adds DeepSeek search and page retrieval to AI Gateway

Vercel announced that DeepSeek Search and DeepSeek Fetch are available through AI Gateway for any model that supports tool calling. Developers can use one Gateway API key without creating a separate DeepSeek account and retain the tools when switching model providers.