Category
AI without the hype: models, agents and use cases that work in production.
Claude 3.5 Sonnet (Anthropic, June 2024) matches Claude 3 Opus quality at Sonnet pricing, with a 200k-token context window and 92% on HumanEval. It stands out in coding and complex instruction-following, and introduced the Artifacts workspace feature on Claude.ai.
Mistral Large 2, released by French startup Mistral AI in July 2024, is a 123-billion-parameter model with a 128k-token context window that rivals GPT-4o and Claude 3.5 Sonnet on several benchmarks. Its EU data residency and its 3 EUR per million input tokens pricing make it the most serious European alternative to US providers.
The EU AI Act (Regulation 2024/1689) entered force on 1 August 2024. It classifies AI systems into four risk levels with graduated deadlines: prohibitions in February 2025, GPAI obligations in August 2025, and high-risk requirements in August 2026. It applies to any company operating or selling in the EU, with fines exceeding GDPR levels.
Installing Ollama on an Apple Silicon Mac is as simple as running one Homebrew command. Then pick a model based on available RAM (Phi-3 for 8 GB, Llama 3.1 8B for 16 GB) and expose the local, OpenAI-compatible HTTP API on port 11434 to plug it into your own applications.
Meta released Llama 3.1 405B on July 23, 2024: 405 billion parameters, 128k token context, and benchmarks matching GPT-4o and Claude 3.5 Sonnet. Self-hosting needs about 220 GB of VRAM in Q4; Together.ai, Fireworks, and Groq offer per-token access.
GPT-4 Turbo, released in November 2023, expanded GPT-4's context to 128,000 tokens and cut the input price threefold, down to 10 dollars per million tokens. GPT-4o now beats it on price, speed and answer quality, but Turbo still holds up in stable production apps, contracts pinned to a specific version, and deterministic tests that depend on its exact behaviour.
Evaluating a RAG system without metrics is pure guesswork. Ragas measures four core signals: faithfulness, answer relevancy, context precision and context recall, using an LLM as judge. TruLens, DeepEval and other frameworks cover similar ground. Wiring evaluation into CI from day one catches regressions in prompts, chunking or model choice before they reach production.
SGLang adds a Python DSL for controlling LLM generation with constrained decoding, parallel branching, and RadixAttention, the structure that indexes the KV cache as a radix trie to reuse shared prefixes across requests. When that pattern exists, speedups over vLLM reach up to 5 times; without it, the advantage shrinks.
GPT-4o is the OpenAI model presented on May 13, 2024, that fuses text, image, and audio into a single native model, without separate pipelines. It delivers roughly 320-millisecond conversational latency, better multimodal understanding, and a price 50% lower than GPT-4 Turbo.
Llama 3 is the open-model family Meta released on April 18, 2024, in 8-billion and 70-billion-parameter sizes, trained on 15 trillion tokens. The 70B beat Claude Sonnet, Mistral Medium, and GPT-3.5 in Meta's own human evaluation, and its licence allows free commercial use up to 700 million monthly active users.
nomic-embed-text-v1.5 from Nomic AI is an embedding model with weights, code and training data released under Apache 2.0: 137 million parameters, up to 8192 tokens of context, and an MTEB score of 62.4, almost matching the 62.3 of OpenAI's text-embedding-3-small, at 768 dimensions instead of 1536.
LangGraph modela agentes LLM como grafos de estados explícitos. Cuándo supera al bucle tradicional de LangChain y cómo estructurar flujos que no se desmoronan en producción.
Outlines, Guidance e Instructor obligan al modelo a emitir JSON válido en el propio paso de generación. Cuándo ganan frente a reintentos y function calling.
Anthropic launched the Claude 3 family on March 4, 2024 with three models: Haiku, Sonnet, and Opus, all with 200k-token context. Haiku costs $0.25 per million tokens; Opus matches GPT-4 Turbo on benchmarks. This comparison explains when to choose each tier and how to combine them in production to cut costs without sacrificing quality where it matters.
Mixtral 8x22B is Mistral AI's Mixture of Experts model released in April 2024: 141B total parameters but only 39B active per token, an unrestricted Apache 2.0 licence, and multilingual performance ahead of Llama 3 70B in Spanish, French, Italian, and German. Production serving needs datacenter-class GPUs.
LM Studio is a desktop app for Mac, Windows, and Linux that downloads and runs large language models on your own machine, with a polished chat interface and no terminal required. It includes an OpenAI-compatible API and RAG with your documents. For individual use it beats Ollama on user experience; for teams or production, OpenWebUI, vLLM, or TGI are the better fit.
A model trained in PyTorch or TensorFlow, running the same way on a server, a phone, a browser tab, or an ARM gateway on the factory floor: that is what ONNX Runtime solves. It turns the ONNX format into a genuinely portable artifact, exported once, at the cost of some peak performance versus a platform-native runtime.
Cuando una aplicación habla con dos o más proveedores de LLM, antes o después aparece un proxy entre medias. LiteLLM propone uno concreto, y esta es la lectura honesta de qué gana y qué cuesta.
Gemini 1.5 Pro launched in February 2024 with a verified one-million-token context window. It retrieves over 95% of data up to 530,000 tokens in recall tests, reshaping RAG system design, making full-document analysis viable, and enabling new architectural patterns through context caching.
OpenAI released text-embedding-3 on 25 January 2024 in two variants: small and large. It improves MTEB quality over ada-002, adds variable dimensions you can truncate without retraining, and lowers the price for small. Migration pays off for most serious RAG setups, but measure real recall on your own corpus before reindexing everything.
pgvector matured in 2023-2024 with the HNSW index type and parallel construction that arrived in version 0.6. For projects already running PostgreSQL, a dedicated vector database is not needed in most cases: this guide explains when PostgreSQL is enough, how to configure the index, and where it starts to fall short.
Cohere Embed v3 is an embedding model that distinguishes queries from documents via the input_type parameter and scores intrinsic text quality, with multilingual support for over 100 languages at 1024 dimensions. It costs $0.10 per million tokens versus OpenAI's $0.02, and delivers better recall in multilingual RAG.
Text Generation Inference (TGI) is the Hugging Face stack for serving open LLMs in production: continuous batching, 4-bit and 8-bit quantization, streaming, and an OpenAI-compatible API. After a brief restrictive-licence episode in 2023, it returned to Apache 2.0 in version 2.0.
Claude 2, launched by Anthropic in July 2023, offers a 100,000-token context window and safety grounded in Constitutional AI. Against GPT-4 it wins on long-document analysis and wide-context code; GPT-4 remains ahead on complex mathematical reasoning and its tooling ecosystem.
