Categories

Jacar categories — explore the topics A rocket whose eyes follow your cursor.
Artificial Intelligence

Claude’s Computer Use: When the Agent Moves the Mouse

Computer Use is the Claude API feature, launched by Anthropic on 22 October 2024, that lets the model view screenshots and move the mouse, type, and click inside a loop your own system executes and controls. It works well on apps without an API and fails on CAPTCHAs, highly dynamic interfaces, and long tasks.

Artificial Intelligence

GitHub Copilot Workspace: GitHub’s Conversational IDE

GitHub Copilot Workspace, in technical preview since April 2024, proposes task-oriented development: describe the problem in a GitHub issue and the AI reads the codebase, generates an editable multi-file plan, and implements it. It competes with Cursor Composer, though with more latency; its edge is native integration with PRs, issues, and GitHub history.

Architecture

vLLM: Serving LLMs in Production with Very High Throughput

vLLM serves language models on GPU using PagedAttention and continuous batching, two techniques that multiply throughput compared with a naive server. It exposes an OpenAI-compatible API, so migrating an existing application only requires changing the base URL and deploying the right binary.

Artificial Intelligence

How to Install Ollama on macOS with Apple Silicon

Installing Ollama on an Apple Silicon Mac is as simple as running one Homebrew command. Then pick a model based on available RAM (Phi-3 for 8 GB, Llama 3.1 8B for 16 GB) and expose the local, OpenAI-compatible HTTP API on port 11434 to plug it into your own applications.

Artificial Intelligence

SGLang: Fine Control Over LLM Execution

SGLang adds a Python DSL for controlling LLM generation with constrained decoding, parallel branching, and RadixAttention, the structure that indexes the KV cache as a radix trie to reuse shared prefixes across requests. When that pattern exists, speedups over vLLM reach up to 5 times; without it, the advantage shrinks.

Artificial Intelligence

Llama 3: Meta’s New Open Standard

Llama 3 is the open-model family Meta released on April 18, 2024, in 8-billion and 70-billion-parameter sizes, trained on 15 trillion tokens. The 70B beat Claude Sonnet, Mistral Medium, and GPT-3.5 in Meta's own human evaluation, and its licence allows free commercial use up to 700 million monthly active users.

Artificial Intelligence

nomic-embed-text: Competitive Open Embeddings

nomic-embed-text-v1.5 from Nomic AI is an embedding model with weights, code and training data released under Apache 2.0: 137 million parameters, up to 8192 tokens of context, and an MTEB score of 62.4, almost matching the 62.3 of OpenAI's text-embedding-3-small, at 768 dimensions instead of 1536.

Artificial Intelligence

Choosing an Open LLM for Enterprise in 2024

Choosing an open LLM for enterprise in 2024 is no longer just Llama 2: Mistral, Mixtral, Qwen, Yi, DeepSeek, and Phi-2 all compete with different licences and sizes. The criteria that actually decide are commercial licence, available hardware, language support, and your own evaluation on real use cases, not just the trendy benchmark.

Architecture

pgvector in 2024: HNSW Indexes and Real Scaling

pgvector matured in 2023-2024 with the HNSW index type and parallel construction that arrived in version 0.6. For projects already running PostgreSQL, a dedicated vector database is not needed in most cases: this guide explains when PostgreSQL is enough, how to configure the index, and where it starts to fall short.

Artificial Intelligence

Cohere Embed v3: Multilingual and Enterprise-Oriented

Cohere Embed v3 is an embedding model that distinguishes queries from documents via the input_type parameter and scores intrinsic text quality, with multilingual support for over 100 languages at 1024 dimensions. It costs $0.10 per million tokens versus OpenAI's $0.02, and delivers better recall in multilingual RAG.

Artificial Intelligence

Hugging Face TGI: Serving Open Models at Scale

Text Generation Inference (TGI) is the Hugging Face stack for serving open LLMs in production: continuous batching, 4-bit and 8-bit quantization, streaming, and an OpenAI-compatible API. After a brief restrictive-licence episode in 2023, it returned to Apache 2.0 in version 2.0.

Architecture

Vector Databases: Qdrant, Pinecone, and Weaviate

Vector databases have gone from an experimental curiosity to the central component of most LLM-based products. This comparison covers Qdrant, Pinecone, and Weaviate: architecture, strengths, limitations, and a decision tree for choosing the right option based on your operational priorities and budget.

Artificial Intelligence

LangChain: The Framework for Orchestrating LLM Applications

LangChain is a Python framework that unifies building LLM applications: prompt templates, retrievers over vector databases, function-calling agents, and conversational memory. It earns its keep in fast prototypes and multi-model systems, but for a single well-defined production use case, direct code usually stays more maintainable.

Architecture

Chroma: A Lightweight Vector Database for Embedding Prototypes

Chroma is the easiest vector database to get started with embeddings and semantic search: install it with pip install chromadb, no extra infrastructure required, and it exposes a minimal API (add, query, delete). It suits prototypes and mid-sized RAG systems well; past a few million vectors, Qdrant or Milvus scale better.

Artificial Intelligence

Midjourney v5: Photorealistic Quality at Prompt’s Reach

Midjourney v5, released in March 2023, delivers consistent photorealism in skin, light, and depth of field, something v4 could not manage. The --style raw parameter disables the default artistic look, ideal for product photography. It still lacks an official API and only runs through Discord, so Stable Diffusion XL and DALL-E 3 remain more practical for automating pipelines.

Artificial Intelligence

Generative AI and Regulation: First Legislative Steps

In 2023, three frameworks address generative AI regulation differently: the EU AI Act sets four risk tiers with fines up to 6% of global turnover; the US NIST framework is voluntary; the UK delegates to sector regulators. Product teams should inventory AI use cases and document risks now.

Artificial Intelligence

How to Install Ollama to Run LLMs on Your Computer

Ollama makes it trivial to run models like Llama 2 or Mistral on your own computer: one binary, one command, and quantised weights downloading to disk with no compilation required. Covers installation on macOS, Linux, and Windows with an honest look at what local inference can and cannot do compared to frontier models.

Artificial Intelligence

Predictive Maintenance with Classic Machine Learning

Industrial predictive maintenance rarely needs deep learning: classic models such as random forests, SVMs, or survival models solve 80% of cases. The key lies in feature engineering over vibration, temperature, and power-consumption signals, with pipelines that run on as little as 50 MB of RAM without a GPU.

Artificial Intelligence

Vector Database Comparison: Qdrant, Pinecone, and Weaviate

Qdrant is the pick when full control and performance in self-hosted setups matter most; Pinecone wins for fully managed SaaS with zero operations; Weaviate stands out when native embeddings and hybrid search built into one pipeline add real value. This comparison covers architecture, quantisation, filtering, and RAG use cases to help you decide based on budget and control needs.

Artificial Intelligence

The Hyperbolic Tangent: A Powerful Activation Function

The hyperbolic tangent (tanh) is an activation function that maps any real value to the interval (-1, 1) with zero-centred output, which makes it more stable than sigmoid in hidden layers. It is the standard in LSTM and GRU memory cells, though it shares with sigmoid the vanishing-gradient problem at extreme inputs.

Artificial Intelligence

The Sigmoid Function: A Key Tool in Neural Networks

The sigmoid function compresses any real value into the range (0, 1), making it the natural activation function for modelling probabilities in neural networks. It is differentiable everywhere, enabling training via backpropagation, though it suffers from saturation and vanishing gradients in deep layers, where ReLU and tanh have taken over.

Artificial Intelligence

Softmax Function: Activation for Classification

The Softmax function converts a vector of logits (arbitrary values) into a probability distribution where every value is positive and the values sum to exactly 1. It is the standard output-layer activation for multi-class classification, and the final operation language models use to predict the next token.

Artificial Intelligence

Linear Function: A Common Activation Function

The linear function, f(x) = ax + b, is the simplest activation a neural network can use: its output is directly proportional to the input, with no non-linear transformation. It is the standard choice for the output layer in regression problems, but in hidden layers it collapses the entire network into a single linear model, so it should never be used there.

Artificial Intelligence

Mathematical Formulation of Artificial Neural Network Input

In a neural network, the input is represented as a column vector x in R^n that the hidden layer transforms through a weight matrix W, a bias vector b, and a non-linear activation function such as ReLU, sigmoid, or tanh. Training adjusts W and b by minimising the loss function via gradient descent and backpropagation.

Artificial Intelligence

Multilayer Neural Networks: Advancing Artificial Intelligence

A multilayer neural network consists of an input layer, one or more hidden layers, and an output layer, where each neuron weights its inputs and applies a non-linear activation function before passing the result to the next layer. Through forward propagation and backpropagation, the network adjusts millions of weights to learn hierarchical representations capable of classifying images, translating text, or generating language.

Artificial Intelligence

DataFrames and Pipelines in Spark: Data Processing Optimisation

Spark DataFrames are distributed, schema-based tables that the Catalyst engine optimises automatically, while pipelines chain those transformations into a reproducible end-to-end flow. Together they let you process large data volumes efficiently across a cluster, scaling from a laptop to hundreds of nodes without rewriting code.

Artificial Intelligence

ChatGPT 4: Advances in Chatbot Technology

ChatGPT 4 combines advanced natural language processing with deep learning to deliver conversations that are more natural, coherent, and personalised than earlier chatbots. It understands intent and accumulated context, handles multiple intents in a single turn, and reduces escalations to human agents, though it still requires careful design and human oversight.

Artificial Intelligence

Pre-trained Models and Transfer Learning

Transfer learning lets you reuse a model already trained on a massive dataset, such as ImageNet or a large text corpus, to solve a new task with far less proprietary data and compute time. It works through fine-tuning, feature extraction, or prompting, and it performs best when the source and target domains are similar to each other.

Artificial Intelligence

Explaining AI Through XAI

Explainable AI (XAI) is the set of techniques that open the black box of AI models and answer why they made a given decision. Methods such as LIME, SHAP and Grad-CAM activation maps are the most widely used. Its adoption is mandatory in regulated environments: healthcare, justice, and financial services.