Deep Learning Fundamentals - Premium Edition

Learning Rates in Artificial Neural Networks Explained

In this lesson, we'll be discussing a configurable parameter called the learning rate, and we'll see how it's used when we train a neural network.

When we previously learned about the neural network training process, we briefly introduced the idea of a learning rate. There, we mentioned that the learning rate is a fractional value for which we multiply the gradients by before updating the weights with the resulting product.