Categories

Mac

oMLX benchmarks: measurement method and the memory ceiling

An oMLX tokens-per-second figure is only useful if it states the prompt length, the route, the cache state and the Mac's. On an M5 Max, Qwen3.8-27B's first token went from 1.12 to 65.5 seconds between a 1k and a 32k prompt. The default memory ceiling leaves 8 % of RAM for macOS, between 3 and 8 GB.