Ollaya – Ollama for open-source, Jev-style decision models
Ollaya is an open-source local runtime for fast Jev-style decision models, compatible with TypeSafe.
Ollaya is an open-source local runtime for Jev-style decision models, including Convai Innovations' Laya family, that returns calibrated answers in a single forward pass. It reports about 8-10 ms median latency for a five-question HTTP request on an RTX 4090 and serves TypeSafe-compatible /v1/systemone and /v1/models endpoints, so TypeSafe Python SDK 0.7.1 works unchanged. Desktop, CLI, and Docker builds cover macOS, Windows, and Linux under Apache-2.0, with NVIDIA GPU acceleration when CUDA 13 and driver R580 or newer are present.
- Decision models answer in one pass, about 10 ms on an RTX 4090.
- The server matches TypeSafe's API and works with Python SDK 0.7.1.
- Open weights include English, multilingual, and router Laya models.
- Apache-2.0 builds cover desktop, CLI, systemd, and Docker.
- Vendors
- NVIDIAConvai Innovations
- Organizations
- Convai InnovationsTypeSafe
- AI models
- Layalaya:enlaya:multilingualJev
From the original article
3 min read at ollaya.dev
Ask typed questions about any text or JSON and get calibrated answers in milliseconds. Private, open source, on your own hardware. ollaya run laya --preset triage \ "I was charged twice this month and want a refund."
By Ardakilic · ollaya.dev
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.