open-webui – Jacar

View options

View Cards

Mode Paginated

Per page Per batch 48

Filters

llama-server as an OpenAI-compatible API in Docker, tested with the official SDKs

llama-server, the llama.cpp server, exposes /v1/chat/completions, /v1/completions, /v1/embeddings and /v1/models in OpenAI's format, so the official SDK works by changing base_url. I tested v0.5.0 in Docker: tools, schema-constrained JSON and Open WebUI work, but the context is split across slots and a named tool_choice is ignored.

October 13, 2026 17 min 76

Tools

How to install Open WebUI with Docker and Ollama, slim image included

Open WebUI 0.11.4 installs from a two-service docker-compose.yml: Ollama runs the models and the slim Open WebUI image, which on arm64 downloads 176 MB against 1.49 GB for the full one, serves the interface. This guide creates the admin account, chats with a local model and turns on tool approval.

October 5, 2026 16 min 31