Categories

Jacar categories — explore the topics A rocket whose eyes follow your cursor.
Artificial Intelligence

LLM Observability: Traces, Costs, and Quality

LLM applications need three distinct observability planes: prompt and response traces for debugging hallucinations, per-token and per-feature cost tracking, and response quality evaluation. Mature tools like Langfuse, LangSmith, and Helicone cover all three planes with specific instrumentation.

Artificial Intelligence

Claude’s Computer Use: When the Agent Moves the Mouse

Computer Use is the Claude API feature, launched by Anthropic on 22 October 2024, that lets the model view screenshots and move the mouse, type, and click inside a loop your own system executes and controls. It works well on apps without an API and fails on CAPTCHAs, highly dynamic interfaces, and long tasks.

Artificial Intelligence

GitHub Copilot Workspace: GitHub’s Conversational IDE

GitHub Copilot Workspace, in technical preview since April 2024, proposes task-oriented development: describe the problem in a GitHub issue and the AI reads the codebase, generates an editable multi-file plan, and implements it. It competes with Cursor Composer, though with more latency; its edge is native integration with PRs, issues, and GitHub history.

Architecture

vLLM: Serving LLMs in Production with Very High Throughput

vLLM serves language models on GPU using PagedAttention and continuous batching, two techniques that multiply throughput compared with a naive server. It exposes an OpenAI-compatible API, so migrating an existing application only requires changing the base URL and deploying the right binary.

Artificial Intelligence

Choosing an Open LLM for Enterprise in 2024

Choosing an open LLM for enterprise in 2024 is no longer just Llama 2: Mistral, Mixtral, Qwen, Yi, DeepSeek, and Phi-2 all compete with different licences and sizes. The criteria that actually decide are commercial licence, available hardware, language support, and your own evaluation on real use cases, not just the trendy benchmark.

Architecture

pgvector: Semantic Search Without Leaving Postgres

pgvector turns PostgreSQL into a fully functional vector database without adding a separate service to the stack. It extends Postgres with the vector type, IVFFlat indexes for approximate nearest-neighbour search (ANN), and the ability to combine relational SQL filters with vector ranking in a single query. For most RAG projects and internal chatbots, those limits never become a problem.

Artificial Intelligence

Ensemble Learning in Machine Learning

An ensemble combines the predictions of several models, through bagging, boosting, or stacking, to reach a more accurate and stable result than any single model. Random Forest and XGBoost dominate tabular data because they exploit that idea: diversity between models reduces error, as long as their mistakes are not correlated with each other.

Artificial Intelligence

Pre-trained Models and Transfer Learning

Transfer learning lets you reuse a model already trained on a massive dataset, such as ImageNet or a large text corpus, to solve a new task with far less proprietary data and compute time. It works through fine-tuning, feature extraction, or prompting, and it performs best when the source and target domains are similar to each other.