Category
AI without the hype: models, agents and use cases that work in production.
ThinkingBox is an MIT-licensed Microsoft sandbox that runs an agent against stateful MCP tools and judges it by the side effects it leaves in the system, not by what it claims to have done. Its companion benchmark covers 507 business tasks, each repeated twenty times.
Agentic search means the model plans its own queries against the repository using grep, file listings and a language server, instead of querying an embedding index built beforehand. Claude Code and Cline work this way by design, yet Cursor and Devin Desktop still index, and their own documentation says so.
Agent Lightning is the Microsoft Research framework that applies reinforcement learning to the model behind an agent you already wrote. The agent points its OpenAI client at the Agent Lightning proxy instead of the model, and the proxy records requests, responses and rewards while the agent keeps its tools and control flow.
The 2026-07-28 revision turns MCP into a stateless protocol. The initialize exchange and the Mcp-Session-Id header are gone, and the protocol version plus client capabilities now travel inside the _meta field of every request. In exchange, Roots, Sampling and Logging are deprecated with a twelve-month window.
Qwen3-VL 8B at Q4_K_M is 4.68 GiB of weights plus a 1.08 GiB vision tower, and its KV cache costs 144 KiB per token. At 8,192 tokens of context the total is around 7 GiB and fits comfortably in 16 GB; at the native 256K it would ask for 36 GiB of cache alone and fits on no consumer card.
The Apple Watch Ultra 3 does not run Siri AI on its own. The model runs on the paired Apple Intelligence iPhone and on Private Cloud Compute, and Apple is not shipping Siri AI in the European Union because of its Digital Markets Act dispute. In the EU the watch keeps Workout Buddy, on-device Siri and its health alerts.
Gemma 4 ships in five sizes under Apache 2.0. Quantised to 4 bits the weights run from 2.9 GB on the E2B to 17.5 GB on the 31B according to Google's own table, so your memory picks the size. And the 256K window adds another 10 GiB of cache on top.
August 2026 produced about a dozen models with genuinely downloadable weights, and several names that exist only as a hosted API. The ones that change what fits on your own machine are Muse Glimmer 30B and Qwen3.8-27B, both Apache 2.0, plus Ling-3.0-tiny for smaller hardware.
Muse Code is the terminal coding agent Meta Superintelligence Labs released in beta on 5 August 2026. It runs on Muse Spark 1.2, coordinates persistent background subagents, appends every model call and every edit to a local event log, and installs with a single command on macOS and Linux.
Between 1 June and 28 August 2026, Claude Code shipped 81 releases, from 2.1.160 to 2.1.251, carrying 149 additions. Four of them change how you actually work: Claude Opus 5 as the default, cross-session messaging, self-hosted environments, and credential masking in the sandbox.
oMLX is a local inference server for Apple Silicon Macs that wraps Apple's MLX framework in a web process and exposes it through the OpenAI and Anthropic APIs. It adds continuous batching, on-disk KV caching and several models in memory at once, all driven from the menu bar.
FreeToken is an open-source inference engine, released by UC Berkeley and UT Austin researchers in August 2026, that splits a MoE model's experts across GPU, CPU and system memory according to each machine's measured bandwidth. It serves models from 35B to 753B parameters on consumer hardware.
OpenRouter is a hosted gateway that gathers more than 400 AI models from over 70 providers behind a single OpenAI-compatible API. You change the base URL, use one key and one balance, and gain automatic routing, failover and pass-through token pricing. Unlike a self-hosted proxy such as LiteLLM, you run no infrastructure at all.
browser-use is an open-source Python library that lets an AI agent drive a web browser the way you do: it opens pages, reads the DOM, clicks and fills in forms. It was born on Playwright and in 2025 switched to speaking Chrome's CDP protocol directly for speed. This guide explains how it works and when to use it.
Firecrawl is an open-source API that turns any web page into clean Markdown, ready for a language model. With scrape and crawl endpoints plus schema-guided JSON extraction, it gives your AI agent reliable web data. This guide covers its formats, how to self-host it with Docker and when it beats a scraper of your own.
Composio connects your AI agent to more than a thousand applications (GitHub, Slack, Gmail, Notion) through pre-authenticated tools and managed OAuth authentication. Instead of writing each integration by hand, you request the tools by name and the agent acts on behalf of each user. This guide explains what it is, how it handles authentication and how to plug it into your agent framework.
Dify is an open-source platform for building AI applications and agents, with a visual workflow canvas, prompt management, a RAG knowledge base and LLMOps layers. You can self-host the whole thing with Docker Compose on top of Postgres, Redis and a vector database. This guide explains how to deploy it and when it beats Flowise and Langflow.
Flowise is an open-source tool that lets you build AI agents by dragging nodes onto a visual canvas, with barely any code. It is built on LangChain.js and you can self-host the whole thing with a single Docker container. This guide covers how to deploy it, the difference between chatflows and AgentFlow v2, and how it compares to Langflow and Dify.
Langflow is an open-source tool for building AI agents and workflows by dragging blocks onto a visual canvas, with barely any code. You can self-host it with Docker, wire up models, tools and vector databases, and publish every flow as an API or as an MCP server. This guide explains how to deploy it and build your first agent.
Your own MCP server exposes your data and functions to any AI assistant through the Model Context Protocol. With the official Python SDK and its FastMCP class you write a server in about twenty lines: you define tools, resources and prompts as type-annotated functions, and you connect it to Claude, Cline or Goose over stdio or HTTP.
Durable execution lets an AI agent survive crashes, restarts and API rate limits without losing its progress. Temporal applies this model: your logic lives in a workflow that resumes exactly where it stopped, and every model or tool call runs as an activity that Temporal retries for you automatically on failure.
Deploying an AI agent to production means turning your local script into a containerised service, with external state, observability and managed secrets. In this guide you package an agent inside a minimal Docker image, expose an HTTP endpoint with FastAPI and add health checks, retries and rate limits so it survives real traffic.
E2B is open-source infrastructure that runs your agent's generated code inside isolated Firecracker microVMs, each with its own Linux kernel. It boots in about 150 ms, exposes a stateful interpreter from its Python SDK and can be self-hosted with Terraform. This guide explains why an agent needs a sandbox and how to use E2B.
Prompt caching stores the stable prefix of your prompt (instructions, documents, tools) so it isn't reprocessed on every call. Anthropic and Gemini discount those tokens by up to 90%; OpenAI discounts by 50% on classic models and up to 90% on GPT-5.6. This guide covers each provider, how to structure the prompt, and how to cache on your own machine with vLLM.
promptfoo is an open-source tool to test and evaluate prompts, agents and RAG systems with declarative YAML configs. It compares models like GPT, Claude or Gemini in one matrix, scores answers with automatic assertions and adds red teaming with over fifty vulnerability types. It plugs into your CI, and OpenAI acquired it in March 2026.
DeepEval is the open-source framework for evaluating AI systems as if you were writing Pytest tests: you define cases, pick research-backed metrics (G-Eval, faithfulness, tool correctness) and get a score from 0 to 1 that passes or fails each response, both on your machine and in continuous integration.
Helicone is an open-source LLM observability platform you integrate by changing a single line: your client's base URL. It logs cost, latency and tokens for every call, adds caching and rate limiting, and you can self-host it with Docker. It is Apache-2.0 and has nearly 6,000 GitHub stars, though since March 2026 it sits in maintenance mode.
Langfuse is an open-source platform to observe, debug and evaluate AI applications and agents. You can self-host it with Docker Compose on Postgres, ClickHouse, Redis and S3 storage, and its Python SDK, built on OpenTelemetry, captures traces, spans and generations with their cost and latency. This guide explains how to deploy it and instrument an agent.
DSPy is a Python framework from Stanford that treats calls to an LLM as code: you define signatures with typed inputs and outputs, pick a module such as chain of thought, and let an optimizer write the prompts for you from examples and a metric. That way you compile programs instead of hand-tuning prompts.
Outlines is a Python library for constrained generation: it forces the model to produce output that conforms to a JSON schema, a regular expression or a grammar, with a guarantee by construction rather than statistics. It works with vLLM, Transformers, Ollama and llama.cpp, and its Rust engine adds barely any overhead per token.
Instructor is the most widely used Python library for getting reliable structured outputs from a language model: you define the result you expect as a Pydantic model, Instructor patches the client so the model honours it, and it retries on its own, with the validation error included, until it returns a valid, already-typed object.
Not every open model calls tools equally well: the Qwen3 family, Nous Hermes, Llama 3.1 and Mistral stand out because they were trained for it. To choose, check the Berkeley Function-Calling Leaderboard, make sure a parser exists for the model's template, and match it to your GPU's VRAM.
Function calling lets a model you run with Ollama on your own machine ask your code to call a function (check the weather, query a database) and use the result to answer. Ollama has supported tools since July 2024; in 2026 models such as qwen3 and llama3.3 do it with reasonable reliability.
Qwen-Agent is the Qwen team's official framework for giving their models tools: function calling, a sandboxed code interpreter, RAG and MCP. It is on version 0.0.34, released in February 2026, has around 16,800 GitHub stars and holds the canonical implementation of Qwen3 tool calling, both in the cloud and on your own machine.
Hermes 4 is the family of open-weight models Nous Research released in August 2025, in 14B, 70B and 405B parameter sizes. Its headline change is hybrid reasoning: one model answers directly or deliberates with think tags before replying, and it keeps the Hermes tool-calling format for agents.
Hermes 3 is Nous Research's family of open-weight models, fine-tuned on Llama 3.1 in 8B, 70B and 405B sizes. Its strength is tool use through JSON-formatted function calls. You can run it on your own machine with Ollama or vLLM and give it agentic capabilities without depending on a paid API.
Haystack is a Python framework by deepset, Apache 2.0 licensed, for building AI applications as pipelines of connected components: retrievers, generators and routers. Since the 2.0 rewrite it allows cycles, which lets you add an Agent component that calls tools in a loop. It serves both RAG and production agents.
Agno, the Python framework formerly known as Phidata, builds AI agents with one clear goal: performance. It creates each agent in about two microseconds and uses roughly 3.75 KiB of memory, so it scales to thousands of concurrent agents. It offers agents, teams and workflows, over twenty model providers and the AgentOS runtime.
Mastra is an open-source TypeScript framework for building AI agents and applications with a single package: agents, tools, workflows, memory, RAG and evals. It was built by the team behind Gatsby, hit version 1.0 in January 2026 and connects to over 40 model providers through one interface.
Semantic Kernel is Microsoft's open-source kit for integrating AI models into C#, Python and Java through a kernel that orchestrates plugins and functions. In 2026 its successor is Microsoft Agent Framework, which merges Semantic Kernel and AutoGen; Semantic Kernel itself keeps support for at least one more year.
LlamaIndex is a Python framework focused on connecting your data to a language model. Its AgentWorkflow module lets you build agents that reason and call tools: FunctionAgent for models with function calling, and ReActAgent for any model. This guide shows how to turn a RAG pipeline into an agent that acts over your own documents.
Google ADK (Agent Development Kit) is Google's open-source framework for building, evaluating and deploying AI agents. It is code-first, works with Gemini and other models via LiteLLM, and offers workflow agents, tools and memory. Version 2.5.0 landed in July 2026 and deploys straight to Vertex AI.
smolagents is Hugging Face's agent library: in under a thousand lines of code it lets you build an agent that reasons by writing Python instead of filling in JSON. Its CodeAgent runs those actions as code, takes around 30% fewer steps than classic tool calling and works with any model, local or API.
Pydantic AI is the agent framework from the Pydantic team: you build agents in Python where every model output is validated against a type you define. You declare the expected answer as a Pydantic model and the agent guarantees that structure, with dependency injection, tools and support for more than twenty model providers.
The OpenAI Agents SDK is a lightweight Python framework for building agents and multi-agent workflows with few primitives: agents, tools, handoffs, guardrails, sessions and built-in tracing. It is the production-ready evolution of Swarm, works with the OpenAI API and with over 100 other LLMs.
Continue is an open-source coding assistant for VS Code and JetBrains that brings chat, autocomplete, inline editing and an agent mode into a single panel. Under the Apache 2.0 licence it works with more than a hundred models, including ones you run locally with Ollama, so you pick the model and keep control of your code.
Windsurf is the agentic code editor created by Codeium: a VS Code fork whose agent reads your project, plans and edits several files with your approval. In July 2025 Cognition, the company behind Devin, bought it, and on 2 June 2026 it was renamed Devin Desktop; its agent Cascade reached end of life on 1 July 2026 and was replaced by Devin Local.
Gemini CLI is Google's coding agent for the terminal: open source, with a one-million-token context window and the Gemini 3 model. Since 18 June 2026 its free tier for individuals moved to Antigravity CLI, but the tool still works with an API key from AI Studio or an enterprise licence.
