Categories

Tag

onnx

View Cards
Mode Paginated
Per page Per batch 48
Artificial Intelligence

Phi-3 on the edge: Microsoft’s SLM in 2025

Phi-3 is Microsoft Research's family of small language models aimed at the edge, and it competes directly with Llama 3.2, Gemma 2 and Qwen 2.5. Phi-3-mini holds 3.8B parameters and, quantized to 4 bits, fits in about 2 GB, running on a CPU with a neural accelerator, an integrated GPU or an NPU.

5 min 293 4.6
Artificial Intelligence

ONNX Runtime at the Edge: Portable, Fast Inference

A model trained in PyTorch or TensorFlow, running the same way on a server, a phone, a browser tab, or an ARM gateway on the factory floor: that is what ONNX Runtime solves. It turns the ONNX format into a genuinely portable artifact, exported once, at the cost of some peak performance versus a platform-native runtime.

3 min 342