How to Install Ollama to Run LLMs on Your Computer

Ollama makes it trivial to run models like Llama 2 or Mistral on your own computer: one binary, one command, and quantised weights downloading to disk with no compilation required. Covers installation on macOS, Linux, and Windows with an honest look at what local inference can and cannot do compared to frontier models.

August 21, 2023 5 min 312 4.3

Artificial Intelligence

Federated Learning and Privacy: Data Protection

Federated learning trains AI models collaboratively across many devices or organisations without moving the original data: each participant trains locally and sends only gradients to the central server. Formalised by Google in 2016, it does not guarantee privacy on its own: it needs differential privacy or secure aggregation to prevent leaks from those gradients.

March 18, 2023 5 min 176 4.5