AWS announces public SGLang support for Trainium chips

Image: Primary

Published Thursday, November 12, 2026 · 5:11 PM EST

Amazon announced public availability of SGLang-Neuron, a plugin that lets developers serve AI models and generate reinforcement learning training outputs on AWS Trainium chips through existing SGLang interfaces. RadixArk released it in collaboration with Annapurna Labs, with access through an AWS Deep Learning Container. The plugin runs model execution through native PyTorch while SGLang retains its API server and request scheduling. It also supports splitting prompt processing and token generation between servers, transferring cached prompt data over Elastic Fabric Adapter. AWS's walkthrough uses a Trainium3 EC2 instance; supported models, features and validated configurations are specified in the project documentation.

Sources

Artificial Intelligence

In this story

Amazon

Published by Tech & Business, a media brand covering technology and business. This story was sourced from Artificial Intelligence and reviewed by the T&B editorial agent team.

Back to Newswire

Keep reading

Full wire

Products

Microsoft 365 outage disrupts email, collaboration and AI connectors

Microsoft 365 connectivity problems disrupted multiple services Thursday, with Microsoft identifying elevated infrastructure load across multiple regions, CNET reported. Its service alert named Exchange Online, Teams, SharePoint Online, Copilot 365 and Microsoft Defender XDR.

Security

Researchers report 21 N-central servers compromised through new exploit

Attackers have compromised at least 21 production N-able N-central servers through a newly disclosed exploit chain, security company Huntback told BleepingComputer. Nineteen ran the latest Hotfix 2 release, issued November 10. The attacks installed XMRig cryptocurrency miners.

Capital AI

Orakl Oncology raises $34M to expand cancer drug prediction platform

Paris-based Orakl Oncology has raised a $34M Series A co-led by Norrsken VC and Singular, bringing total funding to $50M.

Capital

Nebuly raises $21 million to measure the economic value of AI agents

Nebuly raised $21 million in Series A financing to help enterprises measure the economic value of AI agents. Planven led the round for the startup, which is based in Turin and New York.

Capital Infrastructure

Gama raises €15M to move satellite solar arrays into volume production

French satellite equipment company Gama raised a €15M seed round from Transition, Planet A, Draper Associates, and Manta Ray to move its Wing solar arrays into volume production near Paris. The funding covers a production line, expanded testing, and around 60 engineering hires.

Capital AI

Axle raises $9M for investment bank meeting software and AI agents

Axle raised $9M in a round led by Eniac and Bonfire Ventures, with Teamworthy Ventures also participating, the startup announced Thursday. Its software helps investment banks arrange meetings between investors and company management, analysts and industry experts.