Categories

AI Agents

How to use Shieldstral as a local guardrail for your agent

Shieldstral is the 3B safety classifier Mistral released in August 2026: it answers yes or no to a policy written in plain language. Converted to GGUF Q8_0 with llama.cpp and served on a CPU, it blocked no legitimate one among the 100 Spanish and English prompts I prepared, but let 8 of 17 injections through.

Tools

RabbitMQ 4.3 streams vs quorum queues, measured

A RabbitMQ quorum queue deletes each message once it is acknowledged and fsyncs before accepting it; a stream keeps it for rereading. On RabbitMQ 4.3.6, with 1 KB messages, the quorum queue moved 45,156 msg/s and the stream, over its own protocol, 281,330 msg/s, using 9 KB of memory per million messages against 20.5 MB.

AI Agents

How to use OpenCode with local models on llama.cpp and Ollama

OpenCode uses a local model when you declare an @ai-sdk/openai-compatible provider in opencode.json with the llama-server or Ollama URL and the model's context limit. Version 1.18.31 sends 7,516 tokens on its first turn, so the 4k context Ollama assigns by default without a large GPU is not enough: reserve 32k.

How to Install

How to install OpenBao with Docker and Raft storage

To install OpenBao with Docker, run the openbao/openbao:2.6.2 image with Raft storage on a volume, initialise it with bao operator init and unseal it with three of the five keys. OpenBao is the MPL 2.0 fork of HashiCorp Vault and keeps its API, so your applications read secrets the same way.

Tools

How to use init containers in Docker Compose with pre_start

Docker Compose 5.3.0, released on 2 July 2026, adds init containers through the pre_start key: steps that run in ephemeral containers, in order, before the service starts. Use them for migrations, volume permissions and generated configuration. Compose 2.40.3 rejects the whole file, and every step must be idempotent because it runs again.

AI Agents

How to migrate self-hosted Langfuse from v3 to v4

To migrate Langfuse v3 to v4 with Docker Compose, first upgrade ClickHouse to 26.4 while still on v3, back up PostgreSQL and ClickHouse, start v4 in dual write mode, backfill the history and cut over to events_only once every SDK is compatible. I tested it with 45,931 traces and three Python SDK versions.

Tools

File Browser alternatives now that the project is archived

File Browser was archived on 31 August 2026 and its v2.63.23 carries at least 8 published vulnerabilities that will never be patched. After testing the alternatives in Docker on the same folder, FileBrowser Quantum is the drop-in replacement, copyparty the lightweight pick for sharing large files, and Filestash the right one when your data lives in S3, SFTP or SMB.

Tools

How to enable CrowdSec 1.8 bot detection

CrowdSec 1.8 adds bot detection to its WAF, still in alpha, which serves every visitor a page with a proof of work and a browser fingerprint. You enable it with the appsec-bot-challenge collection and its configs in the AppSec acquisition, always behind a compatible bouncer such as OpenResty 1.2.3.

AI Agents

How to use DeepSeek Harness with a local model

DeepSeek Harness (dsh) is the open-source agent harness DeepSeek released in August 2026. It works with a local model if you declare an openai-completions provider in settings.yaml that points at llama-server, with a placeholder key and the real context size. With Qwen3.5-4B on CPU it left the tests green in 4 of 5 attempts, but slowly.

AI Agents

How to build an agent with Dify Agent and a local model

Dify Agent, the Linux-sandbox agent Dify introduced in 1.16, works with a local model once you install the Ollama plugin and switch on tool calling. With Dify 1.17.1 and Qwen3.5-4B on a CPU, the published agent returned correct figures in three out of three runs; Build mode finished none of its three sessions.

How to Install

How to enable Paperless-ngx 3 local AI with Ollama

Paperless-ngx 3 suggests title, tags, correspondent and dates with an LLM and answers questions about your documents, all locally with Ollama. You upgrade from 2.20.15 by changing the image tag. On CPU, Gemma 4 E4B took 25.8 s per suggestion and used about 7 GiB, provided you dodge a bug with reasoning models.

Tools

Why Docker Compose 5.5 recreates your containers

Docker Compose 5.5 changes the digest it uses to decide whether a container's image has changed. On the containerd image store, containers that Compose 2.40 or a pulling 5.4 up labelled with the index digest are recreated once on the first up, with no real change. up --dry-run lists them beforehand.

Tools

How to prepare your self-hosted n8n for n8n 3.0

n8n 3.0 is not out yet: n8n plans it for October 2026 and the stable release is 2.39.6. To prepare a Docker install, open Settings > Migration Report, replace the removed nodes, pin the defaults that change, move binaryData to storage and try the v3-nightly image on a copy.

How to Install

How to install OpenClaw with Docker and a local model

OpenClaw 2026.9.4 installs with Docker Compose from the official GHCR image, which ships for amd64 and arm64. To run it without a cloud API, connect it to a llama-server on the compose file's internal network. Publish port 18789 on 127.0.0.1 only, because the repository's compose file opens it on every interface.

Artificial Intelligence

How to import a Hugging Face model into Ollama 0.34

Since Ollama 0.34.1, ollama create no longer converts or quantizes safetensors weights. To import a Hugging Face model, download it with hf download, convert it to GGUF with llama.cpp's convert_hf_to_gguf.py, quantize it with llama-quantize and build it from a Modelfile. With MiniCPM5-2B on a CPU, the three stages took 35 s, 21 s and 2 s.

How to Install

How to upgrade Jellyfin 12 with Docker and keep a way back

Jellyfin 12.0 came out on 8 September 2026 and rewrites the database on startup, so there is no way back without a backup. In Docker, the safe path is to stop the container, copy /config, remove third-party plugins, change the tag to 12.0, migrate and run a full library scan.

How to Install

How to migrate from MinIO to Garage with Docker

MinIO images no longer pull from Docker Hub, and the quay.io copy is frozen in 2025. To migrate from MinIO to Garage with Docker, run Garage v2.4.1 next to MinIO, copy the buckets with rclone sync, verify them with rclone check, and switch endpoint, keys and region in your clients.

How to Install

How to install llama.cpp on Linux, macOS and Docker

There are four ways to install llama.cpp: the llama.app script, which drops a 15 MB llama binary into ~/.local/bin; Homebrew; the server-v0.4.1 Docker image; or CMake. I tested them on 14 September 2026 on Linux arm64 with Gemma 4 E2B, in the terminal with llama cli and as an OpenAI-compatible API.

How to Install

How to install Forgejo with Docker, Caddy and Forgejo Runner

To install Forgejo with Docker, use the codeberg.org/forgejo/forgejo:16.0 image, which since 10 September 2026 is 16.0.4 and fixes a critical remote code execution flaw. Put it behind Caddy with REVERSE_PROXY_TRUSTED_PROXIES set to the proxy's IP, and register Forgejo Runner 13 against the instance's public URL.

Tools

What the TrueNAS Proxmox plugin does and when it pays off

Open Storage for Proxmox is a GPL-3.0 storage plugin you install on every Proxmox VE node. It creates one zvol per disk on TrueNAS 25.10, publishes it over iSCSI or NVMe/TCP through the API, with no SSH, and adds ZFS snapshots and clones. The current release is 2.1.23~beta3.

AI Agents

Engram: persistent memory for coding agents

Engram is a Go binary backed by SQLite and FTS5 that gives coding agents persistent memory over MCP. It stores decisions and conventions between sessions, syncs through git and needs no Node, Python or Docker. Its search is lexical rather than semantic, and that shapes what you should save.

Tools

Activepieces and Windmill against n8n: which self-hosted automation to choose

n8n is not open source: its Sustainable Use License limits you to your own internal business purposes and forbids charging people to access a hosted instance. Activepieces publishes its core under MIT but keeps agents, projects and API access outside it. Windmill compiles to AGPLv3 from source, yet the distributed Community Edition is not open.

How to Install

How to install Jellyfin with Docker

Jellyfin is a GPL-2.0 media server that asks for no account and no subscription. You install it from the official compose file, which publishes port 8096 and mounts three separate volumes for configuration, cache and media. The stable release in August 2026 is 10.11.11, and hardware transcoding is included.

Tools

k3s vs k0s vs Talos Linux: which lightweight Kubernetes to choose

k3s and k0s are Kubernetes distributions you install on a conventional Linux host you keep administering; Talos Linux is an immutable operating system with no shell and no package manager, driven by an API, running upstream Kubernetes. They are not layers: you pick one, and node count decides which.

How to Install

How to install k3s in your homelab

k3s is a conformant Kubernetes distribution that fits in a 68 MiB binary and installs with one command. It ships containerd, Flannel, CoreDNS, Traefik, ServiceLB and local storage already wired, keeps its state in SQLite, and has a node serving in three seconds.

How to Install

How to install Karakeep, your bookmark manager with AI tagging

Karakeep is a self-hosted bookmark manager that stores links, notes, images and PDFs, archives the whole page with monolith and videos with yt-dlp, and tags everything with a language model. It installs from a three-container compose file, and tagging works with either a hosted model or a local Ollama.

Artificial Intelligence

What the new MCP specification breaks in your server

The 2026-07-28 revision turns MCP into a stateless protocol. The initialize exchange and the Mcp-Session-Id header are gone, and the protocol version plus client capabilities now travel inside the _meta field of every request. In exchange, Roots, Sampling and Logging are deprecated with a twelve-month window.

Tools

What Obscura is, the Rust headless browser for AI agents

Obscura is a headless browser engine written in Rust and released under Apache-2.0. It runs JavaScript on V8, speaks the Chrome DevTools Protocol and replaces headless Chrome inside Playwright or Puppeteer without touching your code. Its measured advantage is memory: around 38 MB per session against 532 MB for Chromium.

Artificial Intelligence

The Apple Watch Ultra 3 as an AI assistant in Europe

The Apple Watch Ultra 3 does not run Siri AI on its own. The model runs on the paired Apple Intelligence iPhone and on Private Cloud Compute, and Apple is not shipping Siri AI in the European Union because of its Digital Markets Act dispute. In the EU the watch keeps Workout Buddy, on-device Siri and its health alerts.

AI Agents

Herdr: a terminal multiplexer for coding agents

Herdr is a Rust terminal multiplexer that runs your coding agents inside a background server. It marks every pane as working, blocked or idle, and that status rolls up to the workspace, so you can see at a glance which agent is waiting on you.

Artificial Intelligence

Gemma 4 locally, which size fits your GPU

Gemma 4 ships in five sizes under Apache 2.0. Quantised to 4 bits the weights run from 2.9 GB on the E2B to 17.5 GB on the 31B according to Google's own table, so your memory picks the size. And the 256K window adds another 10 GiB of cache on top.

Artificial Intelligence

Muse Code: Meta’s terminal coding agent

Muse Code is the terminal coding agent Meta Superintelligence Labs released in beta on 5 August 2026. It runs on Muse Spark 1.2, coordinates persistent background subagents, appends every model call and every edit to a local event log, and installs with a single command on macOS and Linux.

Tools

Claude Code vs Codex CLI vs Muse Code in 2026

All three are terminal agents, but they bet on different things. On the official Terminal-Bench 4.0 board, published on 28 August 2026, Claude Code with Opus 5 solves 51.8% of trials at $18.09 each, and Codex with GPT-5.6 Sol solves 37.3% at $7.70. Muse Code appears on no board at all.

Mac

Benchmarks and the memory ceiling in oMLX

oMLX ships a benchmark tool in the panel that measures time to first token, time per output token, tokens per second and peak memory, with prompts from 1,024 to 200,000 tokens. The default memory ceiling is system RAM minus 8 GB, and that is what decides which context fits.

Mac

The oMLX admin dashboard and its command line

The oMLX panel lives at localhost:8000/admin and gathers monitoring, model loading and unloading, chat with history, a Hugging Face downloader, benchmarks and per-model settings. The command line covers the rest with four commands: serve, start, stop and launch, the last one for wiring up external clients.

Mac

The oMLX API key, port and endpoints

oMLX listens on 127.0.0.1:8000 by default and exposes eight endpoints compatible with OpenAI and Anthropic. The API key travels in the Authorization header or in x-api-key, supports sub-keys that only call the API, and can be skipped for local connections. Everything is configurable through settings.json, environment variables or flags.

Mac

Installing, updating and uninstalling oMLX with Homebrew

oMLX installs through Homebrew in two commands: first the tap for jundot's repository, then the formula. You end up with a launchd service that starts via omlx start, a log inside Homebrew's var directory and an upgrade path through brew upgrade. The current version is 0.6.4, released on 29 August 2026.