AI tools & infrainfo
Buoyant releases Kinference open-source inference control plane for Kubernetes and vLLM
Original title: Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM
AI summary · x-ai/grok-4.7Summaries by Vani AI
Buoyant has released Kinference, an open source inference control plane for Kubernetes and vLLM.
Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM.
Key facts
- Open source tool for inference on Kubernetes and vLLM
- Vendors
- Buoyant
- Products
- KinferenceKubernetesvLLM
From the original article
14 min read at marktechpost.comBuoyant has released Kinference, an Apache 2. 0 inference control plane for vLLM on Kubernetes. It adds declarative routing policies, KV-cache-aware load balancing and per-tenant metrics, and cut median TTFT 95% in Buoyant’s own benchmark.
By Michal Sutter · marktechpost.com
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.