Categories

Tag

regression

View Cards
Mode Paginated
Per page Per batch 48
Technology

Mean Squared Error (MSE) as a Loss Function

Mean squared error (MSE) is the most common loss function in regression: it averages the square of the gap between each true value and its prediction. Squaring punishes big mistakes hard, keeps the function differentiable and gives gradient descent a clear, smooth target to minimise while training a model.

7 min 9
Artificial Intelligence

Linear Function: A Common Activation Function

The linear function f(x) = ax + b is the simplest activation a neural network can use: in its identity form, f(x) = x, it is the standard choice for the output layer in regression, because it does not bound the range of possible values. In hidden layers it fails, because composing several linear functions collapses the whole network into one equivalent linear layer.

6 min 216 4.4