Llama 3.1 405B: When Open Catches Up With Closed Top-Tier

Meta released Llama 3.1 405B on July 23, 2024: 405 billion parameters, 128k token context, and benchmarks matching GPT-4o and Claude 3.5 Sonnet. Self-hosting needs about 220 GB of VRAM in Q4; Together.ai, Fireworks, and Groq offer per-token access.

July 25, 2024 5 min 281

Artificial Intelligence

Llama 3: Meta’s New Open Standard

Llama 3 is the open-model family Meta released on April 18, 2024, in 8-billion and 70-billion-parameter sizes, trained on 15 trillion tokens. The 70B beat Claude Sonnet, Mistral Medium, and GPT-3.5 in Meta's own human evaluation, and its licence allows free commercial use up to 700 million monthly active users.

May 20, 2024 2 min 217 4.5