Skip to content
NewA calmer, faster ZeroHour

datasette-llm 0.1a11 adds OpenAI-compatible LLM endpoints

Original title: datasette-llm 0.1a11

Simon Willison ()1 · 1 read
AI summary · x-ai/grok-4.7Summaries by Vani AI

Users can point Datasette at LM Studio, Ollama, or llama.cpp servers that speak the OpenAI web protocol.

datasette-llm 0.1a11 is an alpha release of the Datasette plugin used to configure LLMs for other plugins. It adds support for OpenAI-compatible endpoints, so a model can be hosted anywhere that implements that protocol. The notes show an example that runs Datasette with uvx against a local model.

Key facts
  • The plugin configures LLMs for use by other Datasette plugins.
  • Named compatible hosts include LM Studio, Ollama, and llama.cpp.
  • The example sets plugins.datasette-llm.default_model with an api_base value.
Explain this AI news with Vani AIWhat was announced, what is new and why it matters, in a new chat

From the original article

Release: datasette-llm 0. 1a11 datasette-llm is the intermediate plugin for Datasette that supports configuring LLMs for use with other Datasette plugins. This release adds support for OpenAI-compatible endpoints, so you can configure Datasette to use an LLM hosted anywhere that talks the OpenAI pseudo-standard web protocol.

Simon Willison

simonwillison.net

Read the full article at Simon Willison

A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.