Gradient descent

Gradient descent is the optimization algorithm that trains neural networks. It adjusts weights by following the slope of the loss function downhill.

• Gradient descent adjusts model weights.
• It follows the loss function slope to find minima.