Respan launches open-source Rust AI gateway built from plugins
Original title: Launch HN: Respan (YC W24) – Open-source Rust AI gateway built around plugins
The pre-alpha gateway, under MIT or Apache-2.0, lets teams add providers and features without changing a small core.
Andy of Respan (YC W24) announced an open-source Rust AI gateway whose core only dispatches events and treats providers, protocols, modalities, and features as plugins. The team says years of wrapping LiteLLM, including a wrapper past 100,000 lines and a January upgrade they rolled back, led them to redesign. The gateway is pre-alpha, can run locally, and the company sells a hosted platform with observability, evals, and unified billing.
Unconfirmed: The team says it still has not determined the cause of intermittent connection errors after a LiteLLM upgrade.
- Respan says its LiteLLM wrapper grew past 100,000 lines before a January upgrade was rolled back.
- Plugins cover providers, MCP and voice, images and video, fallbacks, routing, and PII redaction.
- The gateway is licensed MIT or Apache-2.0 and can run locally without the hosted platform.
- A Mistral provider implementation is described as a 22-line file.
- Vendors
- Respan
- Products
- Respan GatewayLiteLLM
- Organizations
- Y Combinator
From the original article
5 min read at news.ycombinator.com[](https://news. ycombinator. com/)Hacker Newsnew past comments ask show jobs submitlogin [](https://news.
By Andydy25 · news.ycombinator.com
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.