Tag
Ollama 0.34.1 through 0.34.4 reject with HTTP 400 any request to /api/chat or /api/generate that carries typical_p in options, even at 1.0. The fix is to drop the field in the client, go back to 0.34.0, use the /v1 endpoint, or move to 0.40.0, which only logs a warning.
oMLX listens on 127.0.0.1:8000 by default and exposes eight endpoints compatible with OpenAI and Anthropic. The API key travels in the Authorization header or in x-api-key, supports sub-keys that only call the API, and can be skipped for local connections. Everything is configurable through settings.json, environment variables or flags.
OpenRouter is a hosted gateway that gathers more than 500 AI models from over 80 providers behind a single OpenAI-compatible API. You change the base URL and use one key and one balance. You pay each model's rate with no markup, plus 5.5% when you buy credits, and gain automatic routing and failover.
Large language models have spent two years promising effortless documentation for code, APIs and architecture. After watching dozens of projects try it, clear patterns emerge for where it works and where it just becomes more debt.
Function calling converts the LLM into a component that returns structured data. How it works, real use cases, and common production pitfalls.
