techniques
Gradient Clipping
Gradient clipping is a technique to prevent exploding gradients during neural network training. Think of it as putting a speed limit on how much the model's parameters can change in a single update step. This keeps training stable, especially when working with complex models or recurrent networks.
Want to learn more about AI?
Peter Saddington has trained 17,000+ people on agile and AI. Let’s talk.
Work with Peter