Definition

Backpropagation

Backpropagation is the 1986 algorithm that still trains every neural network today. After a forward pass produces a prediction, the error is measured against the expected output and pushed backward through the layers, computing how much each weight contributed. Every parameter is then nudged slightly in the direction that reduces the error. Repeat billions of times across trillions of tokens and the model learns.