Cross-Entropy

A way to measure how different the AI's predictions are from the actual truth. It's like judging how well a weather forecast matches the real weather—lower cross-entropy means a better forecast. Models try to minimize cross-entropy during training, so think of it as the AI trying to get its story straight.