Skip to content

Monday, April 20, 2026

Latest Posts

Pair programming with AI in 2025: habits that stick
vLLM in 2025: the improvements that matter to LLM-serving teams
Microsoft's GraphRAG in enterprise: patterns that work
Alignment evaluation: RLHF, DPO, and recent alternatives
Gemma 2: Google's open model one year later

Passion for Technology

en
- es

Tag: throughput

vLLM: Serving LLMs in Production with Very High Throughput

October 5, 2024 javi

Tarjeta gráfica GPU con iluminación azul en entorno de servidor

vLLM has become the reference for serving LLMs on GPU. PagedAttention, continuous batching, OpenAI-compatible API. How to deploy it well and when it is worth it.

Arquitectura Inteligencia Artificial

Recent Posts

Pair programming with AI in 2025: habits that stick
vLLM in 2025: the improvements that matter to LLM-serving teams
Microsoft’s GraphRAG in enterprise: patterns that work
Alignment evaluation: RLHF, DPO, and recent alternatives
Gemma 2: Google’s open model one year later
o3 in public: the reasoning leap is confirmed
Gemini 2.0: integrated tools and agent mode
Home lab: self-hosted lab as a testing ground
Full-stack TypeScript in 2025: the good, the meh, the bad
WASI preview 3: threads and async in WebAssembly
AI-assisted code review: an honest adoption story
Llama 3.2 at the edge: Meta bets on small
Cloudflare Workers in 2025: from edge to enterprise
Generics in Go: three years later, what has survived
NPU in the PC: faster, cheaper local AI

Copyright © All rights reserved

Usamos cookies para asegurar que te damos la mejor experiencia en nuestra web. Si continúas usando este sitio, asumiremos que estás de acuerdo con ello. Pulsa en "Aceptar todo" si estás de acuerdo.

Ajustes de Cookies Aceptar Todo

Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.

Necessary

Always Enabled

Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.

Functional

Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.

Performance

Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.

Analytics

Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.

Advertisement

Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.

Others

Others

Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.

SAVE & ACCEPT