Tag
oMLX manages each model's lifecycle with four pieces: a downloader that pulls weights from Hugging Face, aliases that rename the model in the API, a TTL that unloads it after idle time, and a tiered KV cache that spills blocks to SSD when RAM fills up.
oMLX MCP is a bridge that exposes your local oMLX server as Model Context Protocol tools. The mcp_omlx package connects Claude Desktop to the models running on your Mac and gives you seven tools to list models, load and unload them from memory, and run inference without leaving the client.
Tested May 2026 recipe: oMLX 0.3.8 on Mac M5 Max with 128 GB, TurboQuant at 3.5-bit, Qwen 3.6 35B-A3B model stack, Claude Code wiring and real benchmarks.
100 must-have apps for your M5 Mac organised into 20 categories: browser, notes, terminal, IDE, containers, AI and more. Each pick with purpose, key features, plugins, pricing in EUR and the official link.
NPUs stopped being an accessory and became the component that defines real performance in laptops, phones, and small servers. A practical look at the hardware that rules 2026, which workloads pay off, and where the traditional GPU still wins.
Neural processing units have stopped being a marketing label on Snapdragon, Apple Silicon and AMD Ryzen AI laptops. Here is what you can actually do from code today, which tools are mature, and when it pays off to target the NPU instead of the CPU or GPU.
I have spent six months using a MacBook Pro with M4 Pro as my main development machine. I lay out what has genuinely changed versus the previous M2 Pro, where the jump is noticeable, and where the investment is not justified if you already own a recent machine.
M3 and M4 solidified the Apple Silicon advantage: unified memory up to 128 GB shared across CPU, GPU, and Neural Engine; 12 to 16 hours of real battery life; and a 38-TOPS Neural Engine that runs large language models directly on the laptop. The practical difference for developers is measurable.
Ollama became the standard for running large language models locally in 2024. It wraps llama.cpp in a single binary with Docker-style CLI and an OpenAI-compatible API. Phi-3 Mini runs in 4 GB; Llama 3.1 8B Q4 needs 6 GB. For production traffic at scale, vLLM remains the correct choice.
Qualcomm Snapdragon X Elite is the first ARM chip to match Apple M3 performance in Windows laptops, with 22+ hours of battery life and a 45 TOPS NPU for on-device AI. Most software runs well via the Prism emulator, though it is not yet ready for anti-cheat gaming or specialized x86 workloads.
Installing Ollama on an Apple Silicon Mac is as simple as running one Homebrew command. Then pick a model based on available RAM (Phi-3 for 8 GB, Llama 3.1 8B for 16 GB) and expose the local, OpenAI-compatible HTTP API on port 11434 to plug it into your own applications.
LM Studio is a desktop app for Mac, Windows, and Linux that downloads and runs large language models on your own machine, with a polished chat interface and no terminal required. It includes an OpenAI-compatible API and RAG with your documents. For individual use it beats Ollama on user experience; for teams or production, OpenWebUI, vLLM, or TGI are the better fit.
