# Buoyant releases Kinference to manage self-hosted AI inference

_Published Wednesday, November 4, 2026 at 9:18 AM EST · AI · Latest · Tier 2 — Notable_

Buoyant announced general availability of Kinference, open source software that routes and manages AI inference requests across models and GPUs running on Kubernetes. Available under the Apache 2.0 license, it builds on the vLLM inference engine.

Platform owners can set cost and compliance policies, assign usage costs to teams, and send requests to cloud providers under defined conditions. Routing considers cached model data and queue status to reduce GPU work. Buoyant reports latency improvements against standard Kubernetes load balancing, measured on one workload type.

## Sources

- [PRWeb](https://www.prweb.com/releases/buoyant-announces-kinference-an-open-source-inference-control-plane-for-kubernetes-302928404.html)

---
Canonical: https://techandbusiness.org/newswire/2T5TC3xkWcfkz3VEV2MX0V
Published: 2026-11-04T14:18:20.338Z
Story chronology: 2026-11-04T14:00:00.000Z
Retrieved: 2026-11-04T21:58:54.475Z
Publisher: Tech & Business (techandbusiness.org)