Since oMLX 0.7.1.dev1, one server on your Mac serves Qwen on /v1/chat/completions and the Clef decision models on /v1/systemone. On an M5 Max, Clef-flash decided each ticket in 111 ms and, with Qwen writing the reply, triage got 39 of 40 labels right against 34 with Qwen alone.
To install gsd-pi, the Open GSD terminal agent, run npx @opengsd/gsd-pi@latest with Node.js 22.18 or later. It works without an API key: with a models.json pointing at llama.cpp and a 64k context, a 4B Qwen3.5 finished a task with 12 passing tests and a commit. gsd-core, by contrast, installs inside Claude Code or OpenCode.
OpenCode uses a local model when you declare an @ai-sdk/openai-compatible provider in opencode.json with the llama-server or Ollama URL and the model's context limit. Version 1.18.31 sends 7,516 tokens on its first turn, so the 4k context Ollama assigns by default without a large GPU is not enough: reserve 32k.
Dify Agent, the Linux-sandbox agent Dify introduced in 1.16, works with a local model once you install the Ollama plugin and switch on tool calling. With Dify 1.17.1 and Qwen3.5-4B on a CPU, the published agent returned correct figures in three out of three runs; Build mode finished none of its three sessions.
20 min31
We use first- and third-party cookies to analyze site traffic. You can accept them, reject them, or configure your choice.
Learn more about cookies
Cookie preferences
NecessaryEssential for the site to work. Always on.
AnalyticsHelp us understand how the site is used (Google Analytics).