Tag
Llama 3 is the open-model family Meta released on April 18, 2024, in 8-billion and 70-billion-parameter sizes, trained on 15 trillion tokens. The 70B beat Claude Sonnet, Mistral Medium, and GPT-3.5 in Meta's own human evaluation, and its licence allows free commercial use up to 700 million monthly active users.
Choosing an open LLM for enterprise in 2024 is no longer just Llama 2: Mistral, Mixtral, Qwen, Yi, DeepSeek, and Phi-2 all compete with different licences and sizes. The criteria that actually decide are commercial licence, available hardware, language support, and your own evaluation on real use cases, not just the trendy benchmark.
With quantization, model weights are stored with fewer bits (4, 5, or 8 instead of 16), so Llama 2 13B shrinks from 26 GB to about 7.5 GB. With llama.cpp it runs on an ordinary 16GB-RAM laptop with no dedicated GPU, and the quality loss is smaller than intuition suggests.
Ollama makes it trivial to run models like Llama 2 or Mistral on your own computer: one binary, one command, and quantised weights downloading to disk with no compilation required. Covers installation on macOS, Linux, and Windows with an honest look at what local inference can and cannot do compared to frontier models.
Meta released LLaMA 2 on July 18, 2023 with a royalty-free commercial licence, in three sizes (7B, 13B, 70B parameters). The 70B model matches or beats GPT-3.5 on standard benchmarks. For 99.9% of organisations the licence allows download, modification, and production use with full data privacy and no fine-tuning restrictions.
