Categories

Artificial Intelligence

Softmax Function: Activation for Classification

The Softmax function converts a vector of logits (arbitrary values) into a probability distribution where every value is positive and the values sum to exactly 1. It is the standard output-layer activation for multi-class classification, and the final operation language models use to predict the next token.