Skip to main content

Share story

Infrastructure

vLLM 0.28 adds KV offloading and serving changes

v0.28.0
Highlights
This release features 584 commits from 270 contributors (76 new)!

Kimi-K3 performance push: a major optimization effort for Kimi-K3 across the stack — Decode Context Parallel (D... Image: Primary
vLLM released version 0.28.0, adding disk-based KV-cache offloading, E/P/D disaggregation in Model Runner V2, and a Rust frontend with gRPC multimodal image inference. The project also raised the default maximum batched tokens from 8,192 to 16,384 and enabled prefix caching by default for Mamba models. It lists release wheels for CUDA, CPU and other targets, while moving bitsandbytes support to an out-of-tree plugin and removing several deprecated options.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from GitHub and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Capital Security
Capital Security

Pluto Security announces $42 million in funding for AI workspace controls

Pluto Security has emerged from stealth and announced $42 million in total funding, including an approximately $34 million latest round led by Jump Capital. The company plans to spend the new capital on product development, resear...

Security
Security

Ghostscript exploit tests expose server risk from crafted PDF uploads

Wordfence researchers developed two exploits for a Ghostscript flaw that could let attackers execute code on servers processing crafted PDFs, BleepingComputer reported. The vulnerability, CVE-2026-39919, affects versions 9.21 thro...

Security Infrastructure
Security Infrastructure

Cyberattack reportedly halts Denmark-Germany tunnel construction

A cyberattack has halted construction of the road-and-rail tunnel under the Fehmarn Belt between Denmark and Germany, UA.News reported, citing RMF24 and Danish media. Workers' identification cards stopped functioning, while vessel...

AI
AI

Google opens Gemini 4 Argon API at introductory token prices

Google has made Gemini 4 Argon globally available to developers and enterprises through the API in AI Studio and Gemini platform. The model launches at an introductory price of $2 per million input tokens and $10 per million outpu...