distance

Vector Norms (L1, L2) and Distance

A vector norm measures its length or magnitude. The L1 norm adds the absolute values of the components, while the L2 norm applies the Pythagorean theorem: the square root of the sum of squares. Both define different distances between points and underpin the regularisation that prevents overfitting in neural networks.