Neural Network Optimization Algorithms - Deep Learning Dictionary
Optimization Algorithms - Deep Learning Dictionary
When we create a neural network, each weight between nodes is initialized with a random value. During training, these weights are iteratively updated and moved towards their optimal values that will lead to the network's lowest loss.
The weights (and other learnable parameters) are optimized using an optimization algorithm, also referred to as an optimizer.
Committed by on