AWS adds AZ-placement controls for SageMaker inference components
Image: Primary
Image: Primary
AWS has launched Ray LLM Deep Learning Containers for serving language models across multiple GPU nodes, extending its preassembled inference stack beyond single-node deployments. The containers bundle the inference engine, servin...
AWS has replaced flat per-event pricing for Amazon Bedrock AgentCore short-term memory with charges based on data ingested, retrieved and stored. The service gives AI agents context within a session; AWS says developers recording ...
Microsoft detailed a Maia 300 design that doubles accelerator density to 96 chips in a 167-kW rack and connects up to 12,288 accelerators through one network. The company says the full rack delivers up to 7 times Maia 200's token ...
NVIDIA announced contributions of Vera Rubin rack and compute tray designs to the Open Compute Project, giving equipment builders shared specifications for AI data centers. Its updated MGX 1.2 architecture supports rack deployment...
Microsoft announced Maia 300, its third-generation in-house AI chip, with production deployment set to begin in 2027. The company plans to scale its Maia family to multi-gigawatt deployments starting that year and make it the prim...
Frore Systems introduced LiquidJet Diamond coldplates, claiming they can handle GPU hotspots reaching 770 W/cm² and reduce GPU temperatures by 16C-22C compared with conventional coldplates. The company claims token efficiency impr...