Neural Network Learning Rate - Deep Learning Dictionary
video
lock
text
lock
Learning Rate - Deep Learning Dictionary
When training a neural network, we go through the following steps:
In between steps 4 and 5 of training, we multiply the gradients obtained in step 4 by a parameter called the learning rate before updating the weights.