llm-chat-completions-server 0.1a0
- ID
- 9291
- Status
- summarized
- Published
- 30 Jul 2026, 11:43 PM
- Fetched
- 31 Jul 2026, 8:44 AM
- Provider
- Simon Willison
- Category
- developer-ai
- Original URL
- https://simonwillison.net/2026/Jul/30/llm-chat-completions-server/
- Source URL
- https://simonwillison.net/atom/everything/
Summary
- Score
- 7.0
- Created
- 31 Jul 2026, 4:28 PM
- Tags
- Audience
- developersvibe_codersai_agent_users
What happened
Simon Willison released llm-chat-completions-server 0.1a0, an LLM plugin that starts a localhost server exposing all installed LLM models through an OpenAI Chat Completions-compatible endpoint. It leverages the content-addressable log design in LLM 0.32rc1 to de-duplicate conversation messages via hashes, so repeated conversation prefixes don't re-send identical content. The plugin was written entirely by GPT-5.6 Sol.
Why it matters
If you use the LLM CLI tool, you can now point any OpenAI-compatible client (agents, chat UIs, eval harnesses) at localhost:9001 and use your locally-installed models instead of paying for OpenAI API calls—useful for testing agent workflows locally before spending on hosted endpoints. The de-duplication via content-addressable hashes means long multi-turn conversations won't redundantly reprocess earlier messages.
Discussion angle
The fact that GPT-5.6 Sol wrote the entire plugin unprompted is worth discussing—does this signal that OpenAI API compatibility has become a de facto standard so well-known that code generation models can implement it flawlessly, and what does that mean for developers building API wrappers?