Backpropagation

Backpropagation is how neural networks learn. Imagine adjusting the knobs on a mixing board, listening to the music, and tweaking the knobs to make it sound better. Backpropagation is the algorithm that figures out *which* knobs to tweak (the weights) and by how much to reduce error (the difference between the desired output and the actual output).