跳到正文
RadarAI· Simon Willison 博客·· 6 小时前AI 评分22

datasette-llm 0.1a11 发布:支持 OpenAI 兼容端点

AI 导读

Datasette 的中间插件 datasette-llm 发布 0.1a11,新增对 OpenAI 兼容端点的支持,可将 Datasette 配置为使用任何遵循该协议的 LLM 服务。用 LM Studio、Ollama 或刚发布 v1.0.0 的 llama.cpp 跑本地模型的用户,可通过 uvx 启动由本地模型驱动的 Datasette Agent 实例。

正文 · 原文

Simon Willison 博客·2026-11-15 07:59· 2 小时前AI 评分41

datasette-llm 0.1a11

AI 导读

Datasette 的中间插件 datasette-llm 发布 0.1a11,新增对 OpenAI 兼容端点的支持,可将 Datasette 配置为使用任何遵循该协议的 LLM 服务。这意味着用 LM Studio、Ollama 或刚发布 v1.0.0 的 llama.cpp 跑本地模型的用户,可通过 uvx 启动由本地模型驱动的 Datasette Agent 实例。

正文 · 原文

Release: datasette-llm 0.1a11

datasette-llm is the intermediate plugin for Datasette that supports configuring LLMs for use with other Datasette plugins.

This release adds support for OpenAI-compatible endpoints, so you can configure Datasette to use an LLM hosted anywhere that talks the OpenAI pseudo-standard web protocol.

This means that if you're running local models with LM Studio or Ollama or llama.cpp (which just hit v1.0.0) you can run Datasette via uvx like this:

wget https://datasette.io/content.db

uvx --with datasette-agent datasette \
  --root --secret 1 \
  -s plugins.datasette-llm.default_model '{
    "model": "lmstudio-qwen",
    "model_name": "qwen/qwen3.8-27b",
    "api_base": "http://localhost:1234/v1"
  }' content.db

And you'll get a local server running a Datasette Agent instance powered by your local model!

Screenshot of a chat interface. Header bar reads "home" on the left and "root" with a hamburger menu icon on the right. Below is a back arrow, the heading "Chat", a model label "lmstudio-qwen" and an "EXPORT" button. A blue user message bubble says "how many repos and how many releases are there?" Below it is a collapsed tool call "list_databases_and_tables" and an expanded tool call "sql_query". Its REQUEST section shows database "content", display "both" and the SQL: SELECT (SELECT COUNT(*) FROM repos) AS repo_count, (SELECT COUNT(*) FROM releases) AS release_count. Its RESPONSE section shows columns repo_count and release_count with a single row of 200 and 1889. Below that is a table with columns repo_count and release_count and one row: 200, 1889, followed by a "View SQL query" button. The assistant reply reads "There are 200 repos and 1,889 releases in the content database." At the bottom is a text input with placeholder "Type a message... (# to tag a table or query)" and a blue "Send" button.

Tags: uv, datasette-agent, llm, datasette, llms, ai, generative-ai

来源:Simon Willison 博客 · simonwillison.net

来源:RadarAI · aihot.news