Categories

Architecture

Agent OS in production: real cases without the marketing

An Agent OS is a runtime layer built to run AI agents rather than ordinary applications, and after six months of production deployments the trade-off is clear. A dedicated agent stack starts slower but stays stable; Kubernetes with orchestration bolted on top moves faster early, then hits observability and policy limits. It pays off from five active agents.

Architecture

LLM caches: saving tokens without dropping quality

A caching proxy in front of a language model can cut the token bill significantly, but it introduces subtle risks if the design is not careful. Which cache types work in production, where the usual traps sit, and how to add them without degrading the experience.