Categories

Jacar categories — explore the topics A rocket whose eyes follow your cursor.
Artificial Intelligence

Mistral Large: European Contender Against GPT-4

Mistral Large 2, released by French startup Mistral AI in July 2024, is a 123-billion-parameter model with a 128k-token context window that rivals GPT-4o and Claude 3.5 Sonnet on several benchmarks. Its EU data residency and its 3 EUR per million input tokens pricing make it the most serious European alternative to US providers.

Artificial Intelligence

GPT-4 Turbo: Long Context and More Reasonable Costs

GPT-4 Turbo, released in November 2023, expanded GPT-4's context to 128,000 tokens and cut the input price threefold, down to 10 dollars per million tokens. GPT-4o now beats it on price, speed and answer quality, but Turbo still holds up in stable production apps, contracts pinned to a specific version, and deterministic tests that depend on its exact behaviour.

Artificial Intelligence

Retrieval Evaluation Frameworks: Ragas and Similar

Evaluating a RAG system without metrics is pure guesswork. Ragas measures four core signals: faithfulness, answer relevancy, context precision and context recall, using an LLM as judge. TruLens, DeepEval and other frameworks cover similar ground. Wiring evaluation into CI from day one catches regressions in prompts, chunking or model choice before they reach production.

Artificial Intelligence

Claude 3 Family: Haiku, Sonnet and Opus Compared

Anthropic launched the Claude 3 family on March 4, 2024 with three models: Haiku, Sonnet, and Opus, all with 200k-token context. Haiku costs $0.25 per million tokens; Opus matches GPT-4 Turbo on benchmarks. This comparison explains when to choose each tier and how to combine them in production to cut costs without sacrificing quality where it matters.

Artificial Intelligence

LM Studio: Exploring AI Models from Your Desktop

LM Studio is a desktop app for Mac, Windows, and Linux that downloads and runs large language models on your own machine, with a polished chat interface and no terminal required. It includes an OpenAI-compatible API and RAG with your documents. For individual use it beats Ollama on user experience; for teams or production, OpenWebUI, vLLM, or TGI are the better fit.

Artificial Intelligence

OpenAI text-embedding-3: What Changes vs the Previous One

OpenAI released text-embedding-3 on 25 January 2024 in two variants: small and large. It improves MTEB quality over ada-002, adds variable dimensions you can truncate without retraining, and lowers the price for small. Migration pays off for most serious RAG setups, but measure real recall on your own corpus before reindexing everything.