# Google expands Kubernetes tools for AI training and distributed inference

_Published Monday, November 9, 2026 at 8:02 PM EST · AI, Infrastructure · Latest · Tier 2 — Notable_

![Google expands Kubernetes tools for AI training and distributed inference — Primary](https://storage.googleapis.com/gweb-cloudblog-publish/images/kubena26-hero.max-2500x2500.jpg)

Google Cloud introduced and expanded an open-source stack for running AI workloads on Kubernetes, including OpenRL for reinforcement learning and llm-d 1.0 for distributed inference. Google says it created OpenRL and contributed it to the CNCF Sandbox.

OpenRL interleaves training and model-generated practice runs on the same accelerators and sends only changed model parameters to workers. The approach lets teams share hardware instead of maintaining separate pools for those tasks.

The llm-d software routes requests toward workers holding reusable model context. Google reports that production deployments increased cache hit rates from 35% to 70% and cut median time to first token by 70-85% on multi-turn agent workloads. Those performance figures apply to the cited deployments.

## Sources

- [Cloud Blog](https://cloud.google.com/blog/topics/developers-practitioners/the-open-ai-native-stack-on-kubernetes-from-open-models-to-distributed-inference-and-agents/)

---
Canonical: https://techandbusiness.org/newswire/8CZ5JESRPM9ivo2Q86p9DH
Published: 2026-11-10T01:02:12.344Z
Story chronology: 2026-11-10T00:00:00.000Z
Retrieved: 2026-11-10T03:08:14.706Z
Publisher: Tech & Business (techandbusiness.org)